Dialog System Technology Challenges
Honolulu, Hawaii, USA, January 27, 2019


April 1, 2019 Launched the DSTC8 website

February 1, 2019 Published escription of the proposed DSCT8 tracks

January 11, 2019 Deadline for DSCT8 tracks

January 8, 2019 Information about our keynote talk at AAAI is provided

December 19, 2018 Camera-ready papers deadline is Today

December 6, 2018 Temptative schedule for AAAI Workshop

November 22, 2018 Call for Track proposals DSTC8

November 21, 2018 Dialog System Technology Challenge 7 paper accepted for oral presentation at Conversational AI: Today's Practice and Tomorrow's Potential (NeurIPS 2018)

November 2, 2018 Paper deadline extended to November 16, 2018 at 23:59 Pacific Time.

October 19, 2018 Instructions about paper submissions to AAAI can be found at the Call for Workshop Papers section.

October 7, 2018 System submission closes tomorrow.

September 18, 2018 Modified deadline for system submission, and objective and subjective evaluations for all tracks Check new Dates.

September 10, 2018 The evaluation phase has started. It will finish in October 8.

August 22, 2018 Deadline and acceptance notification for paper submission have included in the Important Dates section.

August 10, 2018 DSTC7 workshop has been accepted at AAAI. See you in Hawaii in January 2019.

June 6, 2018 Decided potential venues for DSTC7 at NIPS, AAAI or IWSDS. Workshop proposals to NIPS and AAAI will be submitted soon.

June 1, 2018 Development phase has been started (Registration Form)

April 1, 2018 DSCT 7 website launched

Background and Motivation

Starting as an initiative to provide a common testbed for the task of Dialog State Tracking, the first Dialog State Tracking Challenge (DSTC) was organized in 2013, followed by Dialog State Tracking Challenges 2 & 3 in 2014. More recently, Dialog State Tracking Challenge 4 and Dialog State Tracking Challenge 5 and Dialog System Technology Challenge 6 have been completed in 2015, 2016, and 2017 respectively. Since DSTC4, the challenge has evolved in several ways. First, from human-computer interactions, the challenges started to investigate human-human interactions. Then, the event started to offer pilot tasks on Spoken Language Understanding, Speech Act Prediction, Natural Language Generation and End-to-end System Evaluation which increased the reach of the challenge into the research community of dialog systems and AI.

Given the remarkable success of the first five editions, and understanding both, the complexity of the dialog phenomenon and the interest of the research community in a wider variety of dialog related problems, the DSTC rebranded itself as "Dialog System Technology Challenges" for its sixth edition.

On the other hand, although DSTC4 and DSTC5 started using human annotations, since DSTC6 the goal has shifted towards End-to-End systems with the aim of minimizing the human annotation effort while exploring more complex tasks.

In this seventh edition, the call for task proposals has resulted into three different tracks, (1) Sentence Selection: using the Ubuntu corpus and Flex Data: Student – Advisor dialogues, (2) Sentence Generation and (3) Audio Visual Scene-aware dialog. The objective of these tracks is to invite interested organizations conduct dialog related challenges in specific areas of research and under the umbrella of the DSTC.

DSTC 7 Organizations

The 7th Dialog System Technology Challenge (DSTC7) is supported by Microsoft Research, Mitsubishi Electric Research Laboratories, Adobe Research, Naver Labs Europe, Heriot-Watt University, Nara Institute of Science and Technology, Institute for Infocomm Research, and COLIPS.

Workshop Sponsors