کد مقاله | کد نشریه | سال انتشار | مقاله انگلیسی | نسخه تمام متن |
---|---|---|---|---|
384000 | 660838 | 2014 | 10 صفحه PDF | دانلود رایگان |
• We show the relation between discourse units and paraphrasing.
• We propose a new method for computing text similarity based on elementary discourse units.
• We apply the method to the task of paraphrase identification.
• We achieved 93.4% accuracy in experiments conducted on the PAN corpus..
Previous work on paraphrase identification using sentence similarities has not exploited discourse structures, which have been shown as important information for paraphrase computation. In this paper, we propose a new method named EDU-based similarity, to compute the similarity between two sentences based on elementary discourse units. Unlike conventional methods, which directly compute similarities based on sentences, our method divides sentences into discourse units and employs them to compute similarities. We also show the relation between paraphrases and discourse units, which plays an important role in paraphrasing. We apply our method to the paraphrase identification task. Experimental results on the PAN corpus, a large corpus for detecting paraphrases, show the effectiveness of using discourse information for identifying paraphrases. We achieve 93.1% and 93.4% accuracy, respectively by using a single SVM classifier and by using a maximal voting model.
Journal: Expert Systems with Applications - Volume 41, Issue 6, May 2014, Pages 2832–2841