Context-dependent Features Fusion with BERT for Evaluating Multi-Turn Customer-Helpdesk Dialogues

Siu Hin Ng, Yen Chun Huang, Sheng Jie Lin, Yung Chun Chang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

With the growth of online text data in recent years, the research on automated dialogue systems has made more progress than before. In this paper, we propose a new model DepBERT. This model uses BERT pre-training model and integrates Syntactic Dependency Feature to extract the key features of customer and helpdesk data in the dialogue content to enhance the prediction of evaluating multiple turns of dialogue. The contribution of this research is to optimize the method of automated evaluation dialogue system. The F1-score of DepBERT has a 4% increase in customer dataset and has a 10% increase in helpdesk dataset compared to BERT, indicating that it can effectively predict the task behavior in the dialogue between the customer and the helpdesk.

Original languageEnglish
Title of host publicationProceedings - 2021 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2021
PublisherAssociation for Computing Machinery (ACM)
Pages512-517
Number of pages6
ISBN (Electronic)9781450391153
DOIs
Publication statusPublished - Dec 14 2021
Event2021 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2021 - Virtual, Online, Australia
Duration: Dec 14 2021Dec 17 2021

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2021 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2021
Country/TerritoryAustralia
CityVirtual, Online
Period12/14/2112/17/21

Keywords

  • BERT
  • Context-dependency Parsing
  • Dialogue Evaluation
  • Multi-feature Fusion
  • Natural Language Processing

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint

Dive into the research topics of 'Context-dependent Features Fusion with BERT for Evaluating Multi-Turn Customer-Helpdesk Dialogues'. Together they form a unique fingerprint.

Cite this