Posteditar o traduir en el context jurídic: efectes sobre la qualitat i el temps de l’anglès a l’espanyol

Jeffrey Killman, Mónica Rodríguez-Castro

Resum


La recerca sobre l’ús de la traducció automàtica (TA) amb textos jurídics és escassa, tot i que els sistemes de TA més recents basats en dades han millorat la qualitat de les traduccions. En aquest estudi es presenten els resultats d’un experiment en què van participar 26 professionals de la traducció que van posteditar i traduir textos jurídics de l’anglès a l’espanyol. Els resultats mostren que la postedició va fer guanyar qualitat i temps. La millora de la qualitat era estadísticament significativa. La qualitat es va determinar mitjançant els criteris de puntuació estandarditzats d’una associació professional i el temps necessari per acabar les tasques es va registrar amb Translog-II. Les persones participants van contestar uns qüestionaris abans i després de l’experiment per recopilar dades sobre les variables demogràfiques, l’experiència prèvia, les opinions sobre la postedició de TA i les seves reflexions sobre l’experiment. Entre les respostes hi va haver un consens ampli sobre el fet que els resultats de la traducció automàtica eren positius, sobretot pel que fa a la terminologia i la fraseologia. Tanmateix, les variables dels participants relatives als anys d'experiència o les competències en traducció no van mostrar una incidència significativa ni en la qualitat ni en el temps.

Paraules clau


traducció automàtica; traducció automàtica neuronal; traducció automàtica estadística; traducció jurídica; postedició

Cites


Alcaraz Varó, Enrique, & Hughes, Brian. (2002). Legal translation explained. Routledge.

Angelelli, Claudia V. (2009). Using a rubric to assess translation ability: Defining the construct. In Claudia V. Angelelli & Holly E. Jacobson (Eds.), Testing and assessment in translation and interpreting studies: A call for dialogue between research and practice (pp. 13–47). John Benjamins. https://doi.org/10.1075/ata.xiv.03ang

Arnejšek, Mateja, & Unk, Alenka. (2020). Multidimensional assessment of the eTranslation output for English-Slovene. In André Martins, Helena Moniz, Sara Fumega, Bruno Martins, Fernando Batista, Luisa Coheur, Carla Parra, Isabel Trancoso, Marco Turchi, Arianna Bisazza, Joss Moorkens, Ana Guerberof, Mary Nurminen, Lena Marg, & Mikel L. Forcada (Eds.), Proceedings of the 22nd annual conference of the European Association for Machine Translation (pp. 383–392). European Association for Machine Translation. https://aclanthology.org/2020.eamt-1

Bentivogli, Luisa, Bisazza, Arianna, Cettolo, Mauro, & Federico, Marcello. (2016). Neural versus phrase-based machine translation quality: A case study [Conference Presentation]. Conference on Empirical Methods in Natural Language Processing (EMNLP), November 1-5, Austin, USA. CoRR, abs/1608.04631. https://doi.org/10.18653/v1/D16-1025

Biel, Łucja. (2017). Researching legal translation: A multi-perspective and mixed-method framework for legal translation. Revista de Llengua i Dret, Journal of Language and Law, 68, 76–188.

Bojar, Ondřej, Chatterjee, Rajen, Federmann, Christian, Graham, Yvette, Haddow, Barry, Huck, Matthias, Jimeno Yepes, Antonio, Koehn, Philipp, Logacheva, Varvara, Monz, Christof, Negri, Matteo, Névéol, Aurélie, Neves, Mariana, Popel, Martin, Post, Matt, & Rubino, Raphael. (2016). Findings of the 2016 Conference on Machine Translation (WMT16). In Proceedings of the First Conference on Machine Translation: Volume 2. Shared Task Papers (pp. 131–198). Association for Computational Linguistics. https://aclanthology.org/W16-2301

Cadwell, Patrick, Castilho, Sheila, O’Brien, Sharon, & Michell, Linda. (2016). Human factors in machine translation and post-editing among institutional translators. Translation Spaces, 5(2), 222–243. https://doi.org/10.1075/ts.5.2.04cad

Cao, Deborah. (2007). Translating Law. Multilingual Matters.

Carl, Michael. (2012). Translog-II: A program for recording user activity data for empirical translation process research [Poster session]. 13th International Conference on Intelligent Text Processing and Computational Linguistics. 2012, New Delhi, India. https://research.cbs.dk/en/publications/translogii-a-program-for-recording-user-activity-data-for-empiri

Castilho, Sheila, Moorkens, Joss, Gaspari, Federico, Calixto, Iacer, Tinsley, John, & Way, Andy. (2017a). Is neural machine translation the new state of the art? The Prague Bulletin of Mathematical Linguistics, 108(1), 109–120. https://doi.org/10.1515/pralin-2017-0013

Castilho, Sheila, Moorkens, Joss, Gaspari, Federico, Sennrich, Rico, Sosoni, Vilelmini, Georgakopoulou, Panayota, Lohar, Pintu, Way, Andy, Miceli Barone, Antonio V., & Gialama, Maria. (2017b). A comparative quality evaluation of PBSMT and NMT using professional translators. In Proceedings of MT Summit XVI. Volume 1: Research Track, Nagoya, Japan (pp. 116–131). https://aclanthology.org/2017.mtsummit-papers.10.pdf

Chromá, Marta. (2011). Synonymy and polysemy in legal terminology and their application to bilingual and bijural translation. Research in Language, 9(1), 31–50. https://doi.org/10.2478/v10015-011-0004-2

Crego, Josep, Kim, Jungi, Klein, Guillaume, Rebollo, Anabel, Yang, Kathy, Senellart, Jean, Akhanov, Egor, Brunelle, Patrice, Coquard, Aurélien, Deng, Yongchao, Enoue, Satoshi, Geiss, Chiyo, Johanson, Joshua, Khalsa, Ardas, Khiari, Raoum, Ko, Byeongil, Kobus, Catherine, Lorieux, Jean, Martins, Leidiana, Nguyen, Dang-Chuan, Priori, Alexandra, Riccardi, Thomas, Segal, Natalia, Servan, Christophe, Tiquet, Cyril, Wang, Bo, Yang, Jin, Zhang, Dakun, Zhou, Jing, & Zoldan, Peter. (2016). Systran’s pure neural machine translation systems. CoRR, abs/1610.05540. https://doi.org/10.48550/arXiv.1610.05540

Desmet, Luca. (2021). An exploratory study of professional post-edits by English-Dutch DGT Translators. [MA thesis]. Ghent University. [UGent Library repository]

Dik, Hugo. (2020). CTRL+V for Verdict: An analysis of Dutch to English legal machine translation. [MA thesis]. Leiden University. [Leiden University Student Repository]

Farzindar, Atefeh, & Lapalme, Guy. (2009). Machine translation of legal information and its evaluation. In Yong Gao & Nathalie Japkowicz (Eds.), Advances in Artificial Intelligence (pp. 64–73). Springer.

Forcada, Mikel L. (2017). Making sense of neural machine translation. Translation Spaces, 6(2), 291–309. https://doi.org/10.1075/ts.6.2.06for

Forcada, Mikel L. (2020). Building machine translation systems for minor languages: challenges and effects. Revista de Llengua i Dret, Journal of Language and Law, 73, 1–20. https://doi.org/10.2436/rld.i73.2020.3404

García, Ignacio. (2010). Is machine translation ready yet? Target, 22(1), 7–21. https://doi.org/10.1075/target.22.1.02gar

García, Ignacio. (2011). Translating by post-editing: Is it the way forward? Machine Translation, 25, 217–237. https://doi.org/10.1007/s10590-011-9115-8

Gotti, Fabrizio, Farzindar, Atefeh, Lapalme, Guy, & Macklovitch, Elliott. (2008). Automatic translation of court judgments. In Proceedings of The Eighth Conference of the Association for Machine Translation in the Americas, 21–25 October 2008, Waikiki, Hawaii, USA (pp. 370–379). https://aclanthology.org/2008.amta-govandcom.11.pdf

Heiss, Christine, & Soffritti, Marcello. (2018). DeepL Traduttore e didattica della traduzione dall’italiano in tedesco. inTRAlinea - Special Issue: Translation and Interpreting for Language Learners (TAIL). https://www.intralinea.org/specials/article/2294

Junczys-Dowmunt, Marcin, Dwojak, Tomasz, & Hoang, Hieu. (2016). Is Neural Machine Translation Ready for Deployment? A Case Study on 30 Translation Directions [Paper Presentation]. International Workshop on Spoken Language Translation, 8-9 December 2016, Seattle, WA, USA. https://doi.org/10.48550/arXiv.1610.01108

Kenny, Dorothy, & Doherty, Stephen. (2014). Statistical machine translation in the translation curriculum: Overcoming obstacles and empowering translators. The Interpreter and Translator Trainer, 8(2), 276–294.

Killman, Jeffrey. (2014). Vocabulary accuracy of statistical machine translation in the legal context. In Sharon O’Brien, Michel Simard, & Lucia Specia (Eds.), Proceedings of the Third Workshop on Post-Editing Technology and Practice (WPTP-3), The 11th Conference of the Association for Machine Translation in the Americas (AMTA), 22–26 October 2014, Vancouver, BC, Canada (pp. 85–98). AMTA. https://aclanthology.org/2014.amta-wptp.7.pdf

Kit, Chunyu, & Wong, Tak Ming. (2008). Comparative evaluation of online machine translation systems with legal texts. Law Library Journal, 100(2), 299–321.

Koby, Geoffrey S., & Melby, Alan K. (2013). Certification and job task analysis (JTA): Establishing validity of translator certification exams. Translation & Interpreting, 5(1), 174–210. https://doi.org/10.12807/ti.105201.2013.a10

Koby, Geoffrey S. (2015). The ATA Flowchart and Framework as a differentiated error-marking scale in translation teaching. In Ying Cui & Wei Zhao (Eds.), The handbook of research on teaching methods in language translation and interpretation (pp. 220–253). IGI Global. https://doi.org/10.4018/978-1-4666-6615-3.ch013

Koehn, Philipp. (2005). Europarl: A parallel corpus for statistical machine translation. In Proceedings of Machine Translation Summit X, 13–15 September 2005, Phuket, Thailand (pp. 79–86). https://aclanthology.org/2005.mtsummit-papers.11.pdf

Koehn, Philipp. (2010). Statistical machine translation. Cambridge University Press.

Koehn, Philipp, Och, Franz J., & Marcu, Daniel. (2003). Statistical phrase-based translation. In Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, 27 May–1 June, Edmonton, Canada (pp. 127–133). https://aclanthology.org/N03-1017.pdf

Koehn, Philipp, & Knowles, Rebecca. (2017). Six challenges for neural machine translation. In Proceedings of the First Workshop on Neural Machine Translation of the Association for Computational Linguistics, 4 August 2017 28–39, Vancouver, BC, Canada (pp. 28–39). https://aclanthology.org/W17-3204.pdf

Koponen, Maarit, & Salmi, Leena. (2017). Post-editing quality: Analysing the correctness and necessity of post-editor corrections. Linguistica Antverpiensia,16, 137–148. https://doi.org/10.52034/lanstts.v16i0.439

Lesznyák, Ágnes. (2019). Hungarian translators’ perceptions of neural machine translation in the European Commission. In Proceedings of MT Summit XVIII: Translator, Project and User Tracks, 19–23 August, Dublin (pp. 16–22). https://aclanthology.org/volumes/W19-67/

Lewis, Terence. (1997). When not to use MT and other translation tools. In John Hutchins (Ed.), EAMT Workshop: Language Technology in your Organization?, 21–22 May 1997, Copenhagen, Denmark (pp. 34–41). https://aclanthology.org/1997.eamt-1.5.pdf

Macken, Lieve, Prou, Daniel, & Tezcan, Arda. (2020). Quantifying the effect of machine translation in a high-quality human translation production process. Informatics – Special Issue: Feature Paper in Informatics, 7(12), 1–19. https://doi.org/10.3390/informatics7020012

Mellinger, Christopher D., & Hanson, Thomas A. (2017). Quantitative research methods in translation and interpreting studies. Routledge. https://doi.org/10.4324/9781315647845

Mellinger, Christopher D., & Shreve, Gregory M. (2016). Match evaluation and over-editing in a translation memory environment. In Ricardo Muñoz Martín (Ed.), Re-embedding Translation Process Research (pp. 131–148). John Benjamins. https://doi.org/10.1075/btl.128.07mel

Mileto, Fiorenza. (2019). Post-editing and legal translation. Digital Humanities Journal, 1(1). https://doi.org/10.21814/h2d.237

Moorkens, Joss. (2018). What to expect from neural machine translation: A practical in-class translation evaluation exercise. The Interpreter and Translator Trainer, 12(4), 375–387. https://doi.org/10.1080/1750399X.2018.1501639

Phelan, Mary. (2017). Analytical assessment of legal translation: A case study using the American Translators Association Framework. The Journal of Specialised Translation, 27, 189–210.

Roiss, Silvia. (2021). Y las máquinas rompieron a traducir… Consideraciones didácticas en relación con la traducción automática de referencias culturales en el ámbito jurídico. TRANS. Revista de Traductología, 25, 491–505. https://doi.org/10.24310/TRANS.2021.v1i25.11978

Rossi, Caroline, & Chevrot, Jean-Pierre. (2019). Uses and perceptions of machine translation at the European Commission. The Journal of Specialised Translation, 31, 177–200.

Şahin, Mehmet, & Dungan, Nilgün. (2014). Translation testing and evaluation: A study on methods and needs. Translation & Interpreting, 6(2), 67–90.

Šarčević, Susan. (1997). New approach to legal translation. Kluwer Law International.

Sennrich, Rico, Haddow, Barry, & Birch, Alexandra. (2016). Edinburgh neural machine translation systems for WMT 16. In Proceedings of the First Conference on Machine Translation (WMT16), 11–12 August, Berlin, Germany (pp. 371–376). Association for Computational Linguistics. https://doi.org/10.18653/v1/W16-2323

Stasimioti, Maria, Sosoni, Vilelmini, Mouratidis, Despoina, & Kermanidis, Katia. (2020). Machine translation quality: A comparative evaluation of SMT, NMT and tailored-NMT Outputs. In Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, Lisboa, Portugal (pp. 441–450). European Association for Machine translation. https://aclanthology.org/2020.eamt-1.47

Stefaniak, Karolina. (2020). Evaluating the usefulness of neural machine translation for the Polish translators in the European Commission. In André Martins, Helena Moniz, Sara Fumega, Bruno Martins, Fernando Batista, Luisa Coheur, Carla Parra, Isabel Trancoso, Marco Turchi, Arianna Bisazza, Joss Moorkens, Ana Guerberof, Mary Nurminen, Lena Marg, Mikel L. Forcada (Eds.), Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, 3–5 November, Lisbon (pp. 263–269). European Association for Machine Translation. https://aclanthology.org/2020.eamt-1.28

Toral, Antonio, & Sánchez-Cartagena, Víctor M. (2017). A multifaceted evaluation of neural versus phrasebased machine translation for 9 language directions. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers (pp. 1063–1073). Association for Computational Linguistics. https://aclanthology.org/E17-1100

Van Brussel, Laura, Tezcan, Arda, & Macken, Lieve. (2018). A fine-grained error analysis of NMT, SMT and RBMT output for English-to-Dutch. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC), Miyazaki, Japan (pp. 3799–3804). European Language Resources Association (ELRA). https://aclanthology.org/L18-1600

Vardaro, Jennifer, Schaeffer, Moritz, & Hansen-Schirra, Silvia. (2019). Translation quality and error recognition in professional neural machine translation post-editing. Informatics – Special Issue: Advances in Computer-Aided Translation Technology, 6(41), 1–29. https://doi.org/10.3390/informatics6030041

Wiesmann, Eva. (2019). Machine translation in the field of law: A study of the translation of Italian legal texts into German. Comparative Legilinguistics, 37, 117–153. https://doi.org/10.14746/cl.2019.37.4

Wu, Yonghui, Schuster, Mike, Chen, Zhifeng, Le, Quoc V., Norouzi, Mohammad, Macherey, Wolfgang, Krikun, Maxim , Cao, Yuan, Gao, Qin, Macherey, Klaus, Klingner, Jeff, Shah, Apurva, Johnson, Melvin, Liu, Xiaobing, Kaiser, Łukasz, Gouws, Stephan, Kato, Yoshikiyo, Kudo, Taku, Kazawa, Hideto, Stevens, Keith, Kurian, George, Patil, Nishant, Wang, Wei, Young, Cliff, Smith, Jason, Riesa, Jason, Rudnick, Alex, Vinyals, Oriol, Corrado, Greg, Hughes, Macduff, & Dean, Jeffrey. (2016). Google’s Neural Machine Translation System: Bridging the gap between human and machine translation. CoRR, https://doi.org/10.48550/arXiv.1609.08144

Yates, Sarah. (2006). Scaling the tower of babel fish: An analysis of the machine translation of legal information. Law Library Journal, 98(3), 481–500.




DOI: http://dx.doi.org/10.2436/rld.i78.2022.3831



 

Reconeixement - NoComercial - SenseObraDerivada (by-nc-nd): No es permet un ús comercial de l'obra original ni la generació d'obres derivades.