کد مقاله | کد نشریه | سال انتشار | مقاله انگلیسی | نسخه تمام متن |
---|---|---|---|---|
558526 | 874946 | 2009 | 31 صفحه PDF | دانلود رایگان |
![عکس صفحه اول مقاله: Data-driven user simulation for automated evaluation of spoken dialog systems Data-driven user simulation for automated evaluation of spoken dialog systems](/preview/png/558526.png)
This paper proposes a novel integrated dialog simulation technique for evaluating spoken dialog systems. A data-driven user simulation technique for simulating user intention and utterance is introduced. A novel user intention modeling and generating method is proposed that uses a linear-chain conditional random field, and a two-phase data-driven domain-specific user utterance simulation method and a linguistic knowledge-based ASR channel simulation method are also presented. Evaluation metrics are introduced to measure the quality of user simulation at intention and utterance. Experiments using these techniques were carried out to evaluate the performance and behavior of dialog systems designed for car navigation dialogs and a building guide robot, and it turned out that our approach was easy to set up and showed similar tendencies to real human users.
Journal: Computer Speech & Language - Volume 23, Issue 4, October 2009, Pages 479–509