The Eighth Dialog System Technology Challenge

• DOI: 10.48550/arxiv.1911.06394
• Publication Date: 2019-01-01
• Authors: Kim, Seokhwan; Galley, Michel; Gunasekara, Chulaka; Lee, Sungjin; Atkinson, Adam; Peng, Baolin; Schulz, Hannes; Gao, Jianfeng; Li, Jinchao; Adada, Mahmoud; Huang, Minlie; Lastras, Luis; Kummerfeld, Jonat...; Lasecki, Walter S.; Hori, Chiori; Cherian, Anoop; Marks, Tim K.; Rastogi, Abhinav; Zang, Xiaoxue; Sunkara, Srinivas; Gupta, Raghav
• Keywords: FOS: Computer and information sciences; Computer Science - Computation and Language; 0202 electrical engineering, electronic engineering, information engineering; 02 engineering and technology; Computation and Language (cs.CL)

This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.<br/>Submitted to NeurIPS 2019 3rd Conversational AI Workshop<br/>