DecoMT: Decomposed Prompting for Machine Translation Between Related Languages using Large Language Models.
- ,
- Anoop Kunchukuttan,
- Raj Dabre,
- Ai Ti Aw,
- Nancy Chen
- Agency for Science, Technology and Research (A*Star),
- Microsoft India,
- National Institute Of Information And Communications Technology, Japan,
- The French National Centre for Scientific Research (Singapore)
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOpen access
Publication Information
Output type
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOriginal language
EnglishPages from-to (Number of pages)
Pages 4586-4602Publication milestones
- Published - 2023
Publication status
Published - 2023
Publisher
Association for Computational Linguistics, United StatesPublication IDs
- Scopus: 85183797174
Host publication title
Proceedings of the 2023 Conference on Empirical Methods in Natural Language ProcessingAbstract
This study investigates machine translation between related languages i.e., languages within the same family that share linguistic characteristics such as word order and lexical similarity. Machine translation through few-shot prompting leverages a small set of translation pair examples to generate translations for test sentences. This procedure requires the model to learn how to generate translations while simultaneously ensuring that token ordering is maintained to produce a fluent and accurate translation. We propose that for related languages, the task of machine translation can be simplified by leveraging the monotonic alignment characteristic of such languages. We introduce DecoMT, a novel approach of few-shot prompting that decomposes the translation process into a sequence of word chunk translations. Through automatic and human evaluation conducted on multiple related language pairs across various language families, we demonstrate that our proposed approach of decomposed prompting surpasses multiple established few-shot baseline approaches. For example, DecoMT outperforms the strong few-shot prompting BLOOM model with an average improvement of 8 chrF++ scores across the examined languages.
Publication metrics
PlumX, opens in new tab
Citations
13
Captures
19
Access to documents
Related Event
Title
Conference on Empirical Methods in Natural Language Processing
Event type
ConferenceDegree of recognition
International eventDate
06/12/2023 - 10/12/2023Location
Resorts World Convention CentreSingapore
