Dialog System
Technology Challenges


July 24, 2017 The timeline has changed. Please check the updated schedule.

July 11, 2017 'Dialogue Breakdown Detection' track resources are available here.

June 2, 2017 'End-to-End Conversation Modeling' track resources are available here.

June 2, 2017 'End-to-End Goal Oriented Dialog Learning' track resources are available here.

May 22, 2017 Challenge registration has opened! Please fill out this form.

Background and Motivation

Starting as an initiative to provide a common testbed for the task of Dialog State Tracking, the first Dialog State Tracking Challenge (DSTC) was organized in 2013, followed by Dialog State Tracking Challenges 2 & 3 in 2014. More recently, Dialog State Tracking Challenge 4 and Dialog State Tracking Challenge 5 have been completed in 2015 and 2016. Since 2014, the challenge as evolved in several ways. First, from human-computer interactions, the challenges started to investigate human-human interactions. Then, the event started to offer pilot tasks on Spoken Language Understanding, Speech Act Prediction, Natural Language Generation and End-to-end System Evaluation which increased the reach of the challenge into the research community of dialog systems and AI.

Given the remarkable success of the first five editions of the DSTC, and understanding both, the complexity of the dialog phenomenon and the interest of the research community in a wider variety of dialog related problems, the DSTC rebrands itself as "Dialog System Technology Challenges" for its sixth edition. In this sixth edition of the DSTC, the call for task proposals has resulted into three tracks, (1) End-to-End Goal Oriented Dialog Learning, (2) End-to-End Conversation Modeling and (3) Dialogue Breakdown Detection. The objective of the tracks is to invite interested organizations conduct dialog related challenges in specific areas of research and under the umbrella of the DSTC.

Supporting Organizations

The 6th Dialog System Technology Challenge (DSTC6) is supported by Microsoft Research, Mitsubishi Electric Research Laboratories, Xerox Research Centre Europe, Facebook AI Research, Heriot-Watt University, Nara Institute of Science and Technology, Institute for Infocomm Research, and COLIPS.