Skip to main content
    • Aa
    • Aa
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 10
  • Cited by
    This article has been cited by the following publications. This list is generated based on data provided by CrossRef.

    McTear, Michael Callejas, Zoraida and Griol, David 2016. The Conversational Interface.

    Lisetti, Christine Amini, Reza and Yasavur, Ugan 2015. Now All Together: Overview of Virtual Health Assistants Emulating Face-to-Face Health Interview Experience. KI - Künstliche Intelligenz, Vol. 29, Issue. 2, p. 161.

    Lison, Pierre 2015. A hybrid approach to dialogue management based on probabilistic rules. Computer Speech & Language, Vol. 34, Issue. 1, p. 232.

    Breen, Andrew Bui, Hung H. Crouch, Richard Farrell, Kevin Faubel, Friedrich Gemello, Roberto Ganong III, William F. Haulick, Tim Kaplan, Ronald M. Ortiz, Charles L. Patel-Schneider, Peter F. Quast, Holger Ratnaparkhi, Adwait Sejnoha, Vlad Shen, Jiaying Stubley, Peter and Mulbregt, Paul 2014. Interactive Displays.

    Grześ, Marek Hoey, Jesse Khan, Shehroz S. Mihailidis, Alex Czarnuch, Stephen Jackson, Dan and Monk, Andrew 2014. Relational approach to knowledge engineering for POMDP-based assistance systems as a translation of a psychological model. International Journal of Approximate Reasoning, Vol. 55, Issue. 1, p. 36.

    Wang, Lu Heck, Larry and Hakkani-Tur, Dilek 2014. 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). p. 4082.

    Yasavur, Ugan Lisetti, Christine and Rishe, Naphtali 2014. Let’s talk! speaking virtual counselor offers you a brief intervention. Journal on Multimodal User Interfaces, Vol. 8, Issue. 4, p. 381.

    Wang, Fangju and Swegles, Kyle 2013. Modeling user behavior online for disambiguating user input in a spoken dialogue system. Speech Communication, Vol. 55, Issue. 1, p. 84.

    Chinaei, Hamid R. and Chaib-Draa, Brahim 2012. 2012 11th International Conference on Machine Learning and Applications. p. 144.

    Rieser, Verena and Lemon, Oliver 2011. Learning and Evaluation of Dialogue Strategies for New Applications: Empirical Methods for Optimization from Small Data Sets. Computational Linguistics, Vol. 37, Issue. 1, p. 153.


Recent research advances in Reinforcement Learning in Spoken Dialogue Systems

  • Matthew Frampton (a1) and Oliver Lemon (a2)
  • DOI:
  • Published online: 01 December 2009

This paper will summarize and analyze the work of the different research groups who have recently made significant contributions in using Reinforcement Learning techniques to learn dialogue strategies for Spoken Dialogue Systems (SDSs). This use of stochastic planning and learning has become an important research area in the past 10 years, since it promises automatic data-driven optimization of the behavior of SDSs that were previously hand-coded by expert developers. We survey the most important developments in the field, compare and contrast the different approaches, and describe current open problems.

Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

A. Cheyer , D. Martin 2001. The open agent architecture. Journal of Autonomous Agents and Multi-Agent Systems 4(1/2), 143148.

M. English , P. Heeman 2005. Learning mixed-initiative dialog strategies by using reinforcement learning on both conversants. In Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, 10111018.

N. Fraser , G. Gilbert 1991. Simulating speech systems. Computer Speech and Language 5(1), 8199.

J. Henderson , O. Lemon , K. Georgila 2008. Hybrid reinforcement/supervised learning of dialogue policies from fixed datasets. Computational Linguistics 34(4), 487511.

O. Lemon , K. Georgila , J. Henderson 2006a. Evaluating effectiveness and portability of reinforcement learned strategies. In Proceedings of the IEEE/ACL Workshop on Spoken Language Technology, Palm Beach, Aruba, 178181.

E. Levin , R. Pieraccini , W. Eckert 2000. A stochastic model of computer-human interaction for learning dialogue strategies. IEEE Transactions On Speech and Audio Processing 8(1), 1123.

K. Scheffler , S. Young 2002. Automatic learning of dialogue strategy using dialogue simulation and reinforcement learning. In Proceedings of the Human Language Technology conference, Marcus, M. (ed.). San Diego, USA, 1219.

J. Tetreault , D. Litman 2006. Comparing the utility of state features in spoken dialogue using reinforcement learning. In Proceedings of the Human Language Technology Conference/North American chapter of the Association for Computational Linguistics annual meeting, Moore, R.C., Bilmes, J.A. & Chu-Carroll, J. (eds). New York, USA, 272279.

M. Walker , J. Fromer , S. Narayanan 1998. Learning optimal dialogue strategies: a case study of a spoken dialogue agent for email. In Proceedings of the 36th Annual Meeting of the Association of Computational Linguistics, 13451352.

M. Walker , C. Kamm , D. Litman 2000. Towards developing general models of usability with PARADISE. Natural Language Engineering 6(3), 363377.

M. Walker , D. Litman , C. Kamm , A. Abella 1997. PARADISE: a framework for evaluating spoken dialogue agents. In Proceedings of the 35th Annual Meeting of the Association of Computational Linguistics, 271280.

J. Williams , S Young . 2007. Partially Observable Markov Decision Processes for spoken dialog systems. Computer Speech and Language 21(2), 231422.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

The Knowledge Engineering Review
  • ISSN: 0269-8889
  • EISSN: 1469-8005
  • URL: /core/journals/knowledge-engineering-review
Please enter your name
Please enter a valid email address
Who would you like to send this to? *