Dialog System Technology Challenges
Long Beach, USA, December 10, 2017


Oct 24, 2017 A tentative workshop program is now online. It also includes an optional lab tour program to USC on December 11. Please consider staying one more night if you're interested in.

Oct 12, 2017 Workshop Registration and Paper Submission are now open.

Oct 8, 2017 Entry submission to Track 3 has opened.

Oct 6, 2017 Entry submission deadline for Track 1 and 2 has been extended to Oct 10.

Oct 5, 2017 We're inviting organizations to sponsor the DSTC6 workshop. More details

Sep 28, 2017 Entry submission to Track 1 and Track 2 has opened.

Sep 27, 2017 DSTC6 workshop will be held at Hyatt Regency in Long Beach on December 10, 2017.

Sep 21, 2017 Track 1 and 3 have new timelines.

Sep 5, 2017 Challenge registration deadline has been extended to Sep 8.

Jul 11, 2017 'Dialogue Breakdown Detection' track resources are available here.

Jun 2, 2017 'End-to-End Conversation Modeling' track resources are available here.

Jun 2, 2017 'End-to-End Goal Oriented Dialog Learning' track resources are available here.

May 22, 2017 Challenge registration has opened! Please fill out this form.

Background and Motivation

Starting as an initiative to provide a common testbed for the task of Dialog State Tracking, the first Dialog State Tracking Challenge (DSTC) was organized in 2013, followed by Dialog State Tracking Challenges 2 & 3 in 2014. More recently, Dialog State Tracking Challenge 4 and Dialog State Tracking Challenge 5 have been completed in 2015 and 2016. Since 2014, the challenge as evolved in several ways. First, from human-computer interactions, the challenges started to investigate human-human interactions. Then, the event started to offer pilot tasks on Spoken Language Understanding, Speech Act Prediction, Natural Language Generation and End-to-end System Evaluation which increased the reach of the challenge into the research community of dialog systems and AI.

Given the remarkable success of the first five editions of the DSTC, and understanding both, the complexity of the dialog phenomenon and the interest of the research community in a wider variety of dialog related problems, the DSTC rebrands itself as "Dialog System Technology Challenges" for its sixth edition. In this sixth edition of the DSTC, the call for task proposals has resulted into three tracks, (1) End-to-End Goal Oriented Dialog Learning, (2) End-to-End Conversation Modeling and (3) Dialogue Breakdown Detection. The objective of the tracks is to invite interested organizations conduct dialog related challenges in specific areas of research and under the umbrella of the DSTC.

Supporting Organizations

The DSTC6 workshop is sponsored by Adobe Research and endorsed by International Speech Communication Association (ISCA). The workshop proceedings will be available in the ISCA archive.

The DSTC6 Track 3 (Dialogue Breakdown Detection Challenge 3) is sponsored by Denso IT Laboratory, Inc., Honda Research Institute Japan Co., Ltd., Nextremer and NTT docomo.

The 6th Dialog System Technology Challenge (DSTC6) is supported by Microsoft Research, Mitsubishi Electric Research Laboratories, Naver Labs Europe, Facebook AI Research, Heriot-Watt University, Nara Institute of Science and Technology, Institute for Infocomm Research, and COLIPS.