![](https://dblp1.uni-trier.de/img/logo.ua.320x120.png)
![](https://dblp1.uni-trier.de/img/dropdown.dark.16x16.png)
![](https://dblp1.uni-trier.de/img/peace.dark.16x16.png)
Остановите войну!
for scientists:
![search dblp search dblp](https://dblp1.uni-trier.de/img/search.dark.16x16.png)
![search dblp](https://dblp1.uni-trier.de/img/search.dark.16x16.png)
default search action
8th WMT 2023: Singapore
- Philipp Koehn, Barry Haddon, Tom Kocmi, Christof Monz:
Proceedings of the Eighth Conference on Machine Translation, WMT 2023, Singapore, December 6-7, 2023. Association for Computational Linguistics 2023, ISBN 979-8-89176-041-7 - Frontmatter.
- Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Philipp Koehn, Benjamin Marie, Christof Monz, Makoto Morishita, Kenton Murray, Makoto Nagata, Toshiaki Nakazawa, Martin Popel, Maja Popovic, Mariya Shmatova:
Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet. 1-42 - Mariana L. Neves, Antonio Jimeno-Yepes, Aurélie Névéol, Rachel Bawden, Giorgio Maria Di Nunzio, Roland Roller, Philippe Thomas, Federica Vezzani, Maika Vicente Navarro, Lana Yeganova, Dina Wiemann, Cristian Grozea:
Findings of the WMT 2023 Biomedical Translation Shared Task: Evaluation of ChatGPT 3.5 as a Comparison System. 43-54 - Longyue Wang, Zhaopeng Tu, Yan Gu, Siyou Liu, Dian Yu, Qingsong Ma, Chenyang Lyu, Liting Zhou, Chao-Hong Liu, Yufeng Ma, Weiyu Chen, Yvette Graham, Bonnie Webber, Philipp Koehn, Andy Way, Yulin Yuan, Shuming Shi:
Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMs. 55-67 - Mathias Müller, Malihe Alikhani, Eleftherios Avramidis, Richard Bowden, Annelies Braffort, Necati Cihan Camgöz, Sarah Ebling, Cristina España-Bonet, Anne Göhring, Roman Grundkiewicz, Mert Inan, Zifan Jiang, Oscar Koller, Amit Moryossef, Annette Rios, Dimitar Shterionov, Sandra Sidler-Miserez, Katja Tissi, Davy Van Landuyt:
Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23). 68-94 - Steve Sloto, Brian Thompson, Huda Khayrallah, Tobias Domhan, Thamme Gowda, Philipp Koehn:
Findings of the WMT 2023 Shared Task on Parallel Data Curation. 95-102 - Jan Christian Blaise Cruz:
Samsung R&D Institute Philippines at WMT 2023. 103-109 - Hiroyuki Deguchi
, Kenji Imamura, Yuto Nishida, Yusuke Sakai, Justin Vasselli, Taro Watanabe:
NAIST-NICT WMT'23 General MT Task Submission. 110-118 - Josef Jon, Martin Popel, Ondrej Bojar:
CUNI at WMT23 General Translation Task: MT and a Genetic Algorithm. 119-127 - Keito Kudo, Takumi Ito
, Makoto Morishita, Jun Suzuki:
SKIM at WMT 2023 General Translation Task. 128-136 - Ben Li, Yoko Matsuzaki, Shivam Kalkar:
KYB General Machine Translation Systems for WMT23. 137-142 - Luo Min, Yixin Tan
, Qiulin Chen:
Yishu: Yishu at WMT2023 Translation Task. 143-149 - Alexander Molchanov, Vladislav Kovalenko:
PROMT Systems for WMT23 Shared General Translation Task. 150-154 - Matiss Rikters, Makoto Miwa:
AIST AIRC Submissions to the WMT23 Shared Task. 155-161 - Pavel Rychlý, Yuliia Teslia:
MUNI-NLP Submission for Czech-Ukrainian Translation Task at WMT23. 162-165 - Yangjian Wu, Gang Hu:
Exploring Prompt Engineering with GPT Language Models for Document-Level Machine Translation: Insights and Findings. 166-169 - Zhanglin Wu, Daimeng Wei, Zongyao Li, Zhengzhe Yu, Shaojun Li, Xiaoyu Chen, Hengchao Shang, Jiaxin Guo, Yuhao Xie, Lizhi Lei, Hao Yang, Yanfei Jiang:
Treating General MT Shared Task as a Multi-Domain Adaptation Problem: HW-TSC's Submission to the WMT23 General MT Shared Task. 170-174 - Di Wu, Shaomu Tan, David Stap, Ali Araabi, Christof Monz:
UvA-MT's Participation in the WMT 2023 General Translation Shared Task. 175-180 - Hui Zeng:
Achieving State-of-the-Art Multilingual Translation Model with Minimal Data and Parameters. 181-186 - Wenbo Zhang:
IOL Research Machine Translation Systems for WMT23 General Machine Translation Shared Task. 187-191 - Hao Zong:
GTCOM and DLUT's Neural Machine Translation Systems for WMT23. 192-197 - Rachel Bawden, Benoît Sagot:
RoCS-MT: Robustness Challenge Set for Machine Translation. 198-216 - Xiaoyu Chen, Daimeng Wei, Zhanglin Wu, Ting Zhu, Hengchao Shang, Zongyao Li, Jiaxin Guo, Ning Xie, Lizhi Lei, Hao Yang, Yanfei Jiang:
Multifaceted Challenge Set for Evaluating Machine Translation Performance. 217-223 - Shushen Manakhimova, Eleftherios Avramidis, Vivien Macketanz, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov, Sebastian Möller:
Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? 224-245 - Ananya Mukherjee, Manish Shrivastava:
IIIT HYD's Submission for WMT23 Test-suite Task. 246-251 - Beatrice Savoldi, Marco Gaido, Matteo Negri, Luisa Bentivogli:
Test Suites Task: Evaluation of Gender Fairness in MT with MuST-SHE and INES. 252-262 - Sheema Firdous, Sadaf Abdul-Rauf:
Biomedical Parallel Sentence Retrieval Using Large Language Models. 263-270 - Zhanglin Wu, Daimeng Wei, Zongyao Li, Zhengzhe Yu, Shaojun Li, Xiaoyu Chen, Hengchao Shang, Jiaxin Guo, Yuhao Xie, Lizhi Lei, Hao Yang, Yanfei Jiang:
The Path to Continuous Domain Adaptation Improvements by HW-TSC for the WMT23 Biomedical Translation Shared Task. 271-274 - Lichao Zhu, Maria Zimina, Maud Bénard, Behnoosh Namdar, Nicolas Ballier, Guillaume Wisniewski, Jean-Baptiste Yunès:
Investigating Techniques for a Deeper Understanding of Neural Machine Translation (NMT) Systems through Data Filtering and Fine-tuning Strategies. 275-281 - Li An, Linghao Jin, Xuezhe Ma:
MAX-ISI System at WMT23 Discourse-Level Literary Translation Task. 282-286 - Fabien Lopez, Gabriela González Sáez, Damien Hansen, Mariam Nakhlé, Behnoosh Namdarzadeh, Nicolas Ballier, Marco Dinarelli, Emmanuelle Esperança-Rodier, Sui He, Sadaf Mohseni, Caroline Rossi, Didier Schwab, Jun Yang, Jean-Baptiste Yunès, Lichao Zhu:
The MAKE-NMTVIZ System Description for the WMT23 Literary Task. 287-295 - Anqi Zhao, Kaiyu Huang, Hao Yu, Degen Huang:
DUTNLP System for the WMT2023 Discourse-Level Literary Translation. 296-301 - Yuhao Xie, Zongyao Li, Zhanglin Wu, Daimeng Wei, Xiaoyu Chen, Zhiqiang Rao, Shaojun Li, Hengchao Shang, Jiaxin Guo, Lizhi Lei, Hao Yang, Yanfei Jiang:
HW-TSC's Submissions to the WMT23 Discourse-Level Literary Translation Shared Task. 302-306 - Shaolin Zhu, Deyi Xiong:
TJUNLP: System Description for the WMT23 Literary Task in Chinese to English Translation Direction. 307-311 - Moussa Doumbouya, Baba Mamadi Diané, Solo Farabado Cissé, Djibrila Diané, Abdoulaye Sow, Séré Moussa Doumbouya, Daouda Bangoura, Fodé Moriba Bayo, Ibrahima Sory 2. Condé, Kalo Mory Diané, Chris Piech, Christopher D. Manning:
Machine Translation for Nko: Tools, Corpora, and Baseline Results. 312-343 - Marcelo Sandoval-Castañeda, Yanhong Li, Bowen Shi, Diane Brentari, Karen Livescu, Gregory Shakhnarovich:
TTIC's Submission to WMT-SLT 23. 344-350 - Baixuan Xu, Haochen Shi, Tianshi Zheng, Qing Zong, Weiqi Wang, Zhaowei Wang, Yangqiu Song:
KnowComp Submission for WMT23 Sign Language Translation Task. 351-358 - Nguyen-Hoang Minh-Cong, Nguyen Van Vinh, Minh Le Nguyen:
A Fast Method to Filter Noisy Parallel Data WMT2023 Shared Task on Parallel Data Curation. 359-365 - Steinthor Steingrimsson
:
A Sentence Alignment Approach to Document Alignment and Multi-faceted Filtering for Curating Parallel Sentence Pairs from Web-crawled Data. 366-374 - Frithjof Petrick, Christian Herold, Pavel Petrushkov, Shahram Khadivi, Hermann Ney:
Document-Level Language Models for Machine Translation. 375-391 - Nathaniel R. Robinson, Perez Ogayo, David R. Mortensen, Graham Neubig:
ChatGPT MT: Competitive for High- (but Not Low-) Resource Languages. 392-418 - Marzena Karpinska, Mohit Iyyer:
Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist. 419-451 - Rachel Wicks, Matt Post:
Identifying Context-Dependent Translations for Evaluation Set Production. 452-467 - Xuan Zhang, Navid Rajabi, Kevin Duh, Philipp Koehn:
Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA. 468-481 - Vivek Iyer, Pinzhen Chen, Alexandra Birch:
Towards Effective Disambiguation for Machine Translation with Large Language Models. 482-495 - Jingyi Zhang, Gerard de Melo, Hongfei Xu, Kehai Chen:
A Closer Look at Transformer Attention for Multilingual Translation. 496-506 - Felix Schmidt, Mattia Di Gangi:
Bridging the Gap between Position-Based and Content-Based Self-Attention for Neural Machine Translation. 507-521 - Tosho Hirasawa, Emanuele Bugliarello
, Desmond Elliott
, Mamoru Komachi:
Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation. 522-535 - Benjamin Muller, Belen Alastruey, Prangthip Hansanti, Elahe Kalbassi, Christophe Ropers, Eric Michael Smith, Adina Williams, Luke Zettlemoyer, Pierre Andrews, Marta R. Costa-jussà:
The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages. 536-550 - Edison Marrese-Taylor, Pin Chen Wang, Yutaka Matsuo:
Towards Better Evaluation for Formality-Controlled English-Japanese Machine Translation. 551-560 - Jan-Thorsten Peter, David Vilar, Daniel Deutsch, Mara Finkelstein, Juraj Juraska, Markus Freitag:
There's No Data like Better Data: Using QE Metrics for MT Data Filtering. 561-577 - Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei
, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster:
Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. 578-628 - Frédéric Blain
, Chrysoula Zerva, Ricardo Ribeiro
, Nuno Miguel Guerreiro, Diptesh Kanojia, José G. C. de Souza
, Beatriz Silva, Tânia Vaz, Yan Jingxuan, Fatemeh Azadi, Constantin Orasan, André F. T. Martins:
Findings of the WMT 2023 Shared Task on Quality Estimation. 629-653 - Lemao Liu, Francisco Casacuberta, George Foster, Guoping Huang, Philipp Koehn, Geza Kovacs, Shuming Shi, Taro Watanabe, Chengqing Zong:
Findings of the Word-Level AutoCompletion Shared Task in WMT 2023. 654-662 - Kirill Semenov, Vilém Zouhar, Tom Kocmi, Dongdong Zhang, Wangchunshu Zhou, Yuchen Eleanor Jiang:
Findings of the WMT 2023 Shared Task on Machine Translation with Terminologies. 663-671 - Pushpak Bhattacharyya, Rajen Chatterjee, Markus Freitag, Diptesh Kanojia, Matteo Negri, Marco Turchi:
Findings of the WMT 2023 Shared Task on Automatic Post-Editing. 672-681 - Santanu Pal, Partha Pakray, Sahinur Rahman Laskar, Lenin Laitonjam, Vanlalmuansangi Khenglawt, Sunita Warjri, Pankaj Kundan Dadure, Sandeep Kumar Dash:
Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation. 682-694 - Chantal Amrhein, Nikita Moghe, Liane Guillou:
ACES: Translation Accuracy Challenge Sets at WMT 2023. 695-712 - Eleftherios Avramidis, Shushen Manakhimova, Vivien Macketanz, Sebastian Möller:
Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective. 713-729 - Sören Dreano, Derek Molloy, Noel Murphy:
Tokengram_F, a Fast and Accurate Token-based chrF++ Derivative. 730-737 - Sören Dreano, Derek Molloy, Noel Murphy:
Embed_Llama: Using LLM Embeddings for the Metrics Shared Task. 738-745 - Muhammad N. ElNokrashy, Tom Kocmi:
eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings. 746-750 - Thamme Gowda, Tom Kocmi, Marcin Junczys-Dowmunt:
Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics. 751-755 - Juraj Juraska, Mara Finkelstein, Daniel Deutsch, Aditya Siddhant, Mehdi Mirzazadeh, Markus Freitag:
MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task. 756-767 - Tom Kocmi, Christian Federmann:
GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4. 768-775 - Chi-kiu Lo, Samuel Larkin, Rebecca Knowles:
Metric Score Landscape Challenge (MSLC23): Understanding Metrics' Performance on a Wider Landscape of Translation Quality. 776-799 - Ananya Mukherjee, Manish Shrivastava:
MEE4 and XLsim : IIIT HYD's Submissions' for WMT23 Metrics Shared Task. 800-805 - Subhajit Naskar, Daniel Deutsch, Markus Freitag:
Quality Estimation Using Minimum Bayes Risk. 806-811 - Vikas Raunak, Tom Kocmi, Matt Post:
Evaluating Metrics for Document-context Evaluation in Machine Translation. 812-814 - Vasiliy Viskov, George Kokush, Daniil Larionov, Steffen Eger, Alexander Panchenko:
Semantically-Informed Regressive Encoder Score. 815-821 - Zhanglin Wu, Yilun Liu, Min Zhang, Xiaofeng Zhao, Junhao Zhu, Ming Zhu, Xiaosong Qiao, Jingfei Zhang, Miaomiao Ma, Yanqing Zhao, Song Peng, Shimin Tao, Hao Yang, Yanfei Jiang:
Empowering a Metric with LLM-assisted Named Entity Annotation: HW-TSC's Submission to the WMT23 Metrics Shared Task. 822-828 - Xiang Geng, Zhejian Lai, Yu Zhang, Shimin Tao, Hao Yang, Jiajun Chen, Shujian Huang:
Unify Word-level and Span-level Tasks: NJUNLP's Participation for the WMT2023 Quality Estimation Shared Task. 829-834 - Yuang Li, Chang Su, Ming Zhu, Mengyao Piao, Xinglin Lyu, Min Zhang, Hao Yang:
HW-TSC 2023 Submission for the Quality Estimation Shared Task. 835-840 - Ricardo Rei
, Nuno Miguel Guerreiro, José Pombal, Daan van Stigt, Marcos V. Treviso, Luísa Coheur
, José G. C. de Souza
, André F. T. Martins:
Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task. 841-848 - Archchana Sindhujan, Diptesh Kanojia, Constantin Orasan, Tharindu Ranasinghe:
SurreyAI 2023 Submission for the Quality Estimation Shared Task. 849-855 - Yulong Wu, Viktor Schlegel, Daniel Beck, Riza Batista-Navarro:
MMT's Submission for the WMT 2023 Quality Estimation Shared Task. 856-862 - Zeyu Yan:
IOL Research's Submission for WMT 2023 Quality Estimation Shared Task. 863-871 - Xingyu Chen, Rui Wang:
SJTU-MTLAB's Submission to the WMT23 Word-Level Auto Completion Task. 872-876 - Yi Wu, Haochen Shi, Weiqi Wang, Yangqiu Song:
KnowComp Submission for WMT23 Word-Level AutoCompletion Task. 882-889 - Nikolay Bogoychev, Pinzhen Chen:
Terminology-Aware Translation with Constrained Decoding and Large Language Model Prompting. 890-896 - Jingshu Liu, Mariam Nakhlé, Gaëtan Caillout, Raheel Qader:
Lingua Custodia's Participation at the WMT 2023 Terminology Shared Task. 897-901 - Yasmin Moslem, Gianfranco Romani, Mahdi Molaei, John D. Kelleher, Rejwanul Haque, Andy Way:
Domain Terminology Integration into Machine Translation: Leveraging Large Language Models. 902-911 - Tommi Nieminen:
OPUS-CAT Terminology Systems for the WMT23 Terminology Shared Task. 912-918 - Geon-Woo Park, Junghwa Lee, Meiying Ren, Allison Shindell, Yeonsoo Lee:
VARCO-MT: NCSOFT's WMT'23 Terminology Shared Task Submission. 919-925 - Jiawei Yu, Min Zhang, Yanqing Zhao, Xiaofeng Zhao, Yuang Li, Chang Su, Yinglu Li, Miaomiao Ma, Shimin Tao, Hao Yang:
HW-TSC's Participation in the WMT 2023 Automatic Post Editing Shared Task. 926-930 - Goutam Agrawal, Rituraj Das, Anupam Biswas, Dalton Meitei Thounaojam:
Neural Machine Translation for English - Manipuri and English - Assamese. 931-934 - Mazida A. Ahmed, Kuwali Talukdar, Parvez Aziz Boruah, Shikhar Kumar Sarma, Kishore Kashyap:
GUIT-NLP's Submission to Shared Task: Low Resource Indic Language Translation. 935-940 - Raj Dabre, Jay P. Gala, Pranjal A. Chitale:
NICT-AI4B's Submission to the Indic MT Shared Task in WMT 2023. 941-949 - Pranav Gaikwad, Meet Doshi, Sourabh Dattatray Deoghare, Pushpak Bhattacharyya:
Machine Translation Advancements for Low-Resource Indian Languages in WMT23: CFILT-IITB's Effort for Bridging the Gap. 950-953 - Ivana Kvapilíková, Ondrej Bojar:
Low-Resource Machine Translation Systems for Indic Languages. 954-958 - Edoardo Signoroni, Pavel Rychlý:
MUNI-NLP Systems for Low-resource Indic Machine Translation. 959-966 - Kshetrimayum Boynao Singh, Avichandra Singh Ningthoujam, Loitongbam Sanayai Meetei, Sivaji Bandyopadhyay, Thoudam Doren Singh:
NITS-CNLP Low-Resource Neural Machine Translation Systems of English-Manipuri Language Pair. 967-971 - Dhairya Suman, Atanu Mandal, Santanu Pal, Sudip Kumar Naskar:
IACS-LRILT: Machine Translation for Low-Resource Indic Languages. 972-977 - Wenbo Zhang:
IOL Research Machine Translation Systems for WMT23 Low-Resource Indic Language Translation Shared Task. 978-982 - Jannis Vamvas, Tobias Domhan, Sony Trenous, Rico Sennrich, Eva Hasler:
Trained MT Metrics Learn to Cope with Machine-translated References. 983-995 - Daniel Deutsch, Juraj Juraska, Mara Finkelstein, Markus Freitag:
Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level. 996-1013 - Javier Ferrando, Matthias Sperber, Hendra Setiawan, Dominic Telaar, Sasa Hasan:
Automating Behavioral Testing in Machine Translation. 1014-1030 - Telmo Pires, António Vilarinho Lopes, Yannick Assogba, Hendra Setiawan:
One Wide Feedforward Is All You Need. 1031-1044 - Noëmi Aepli, Chantal Amrhein, Florian Schottmann, Rico Sennrich:
A Benchmark for Evaluating Machine Translation Metrics on Dialects without Standard Orthography. 1045-1065 - Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, André Martins, Graham Neubig, Ankush Garg, Jonathan H. Clark, Markus Freitag, Orhan Firat:
The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation. 1066-1083
![](https://dblp1.uni-trier.de/img/cog.dark.24x24.png)
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.