کد مقاله کد نشریه سال انتشار مقاله انگلیسی نسخه تمام متن
6864515 1439543 2018 6 صفحه PDF دانلود رایگان
عنوان انگلیسی مقاله ISI
Fine-grained attention mechanism for neural machine translation
ترجمه فارسی عنوان
مکانیزم توجه دقیق به ترجمه ماشین عصبی
کلمات کلیدی
ترجمه ماشین عصبی، مکانیسم توجه، توجه زیبا،
موضوعات مرتبط
مهندسی و علوم پایه مهندسی کامپیوتر هوش مصنوعی
چکیده انگلیسی
Neural machine translation (NMT) has been a new paradigm in machine translation, and the attention mechanism has become the dominant approach with the state-of-the-art records in many language pairs. While there are variants of the attention mechanism, all of them use only temporal attention where one scalar value is assigned to one context vector corresponding to a source word. In this paper, we propose a fine-grained (or 2D) attention mechanism where each dimension of a context vector will receive a separate attention score. In experiments with the task of En-De and En-Fi translation, the fine-grained attention method improves the translation quality in terms of BLEU score. In addition, our alignment analysis reveals how the fine-grained attention mechanism exploits the internal structure of context vectors.
ناشر
Database: Elsevier - ScienceDirect (ساینس دایرکت)
Journal: Neurocomputing - Volume 284, 5 April 2018, Pages 171-176
نویسندگان
, , ,