Interactive translation prediction versus conventional post-editing in practice: a study with the CasMaCat workbench

dc.contributor.affiliationCentro de Investigación Pattern Recognition and Human Language Technology
dc.contributor.authorSanchis Trilles, Germánes_ES
dc.contributor.authorAlabau, Vicentes_ES
dc.contributor.authorBuck, Christianes_ES
dc.contributor.authorCarl, Michaeles_ES
dc.contributor.authorCasacuberta Nolla, Francisco
dc.contributor.authorGarcia Martinez, Maria Mercedeses_ES
dc.contributor.authorGermann, Ulriches_ES
dc.contributor.authorGonzález Rubio, Jesúses_ES
dc.contributor.authorHill, Robin L.es_ES
dc.contributor.authorKohen, Philippes_ES
dc.contributor.authorLeiva Torres, Luis Albertoes_ES
dc.contributor.authorMesa Lao, Bartolomées_ES
dc.contributor.authorOrtiz Martínez, Danieles_ES
dc.contributor.authorSaint-Amand, Herve
dc.contributor.authorTsoukala, Chara
dc.contributor.authorVidal, Enrique
dc.contributor.funderEuropean Commission
dc.date.accessioned2015-04-29T10:42:16Z
dc.date.available2015-04-29T10:42:16Z
dc.date.issued2014-12
dc.description.abstract[EN] We conducted a field trial in computer-assisted professional translation to compare interactive translation prediction (ITP) against conventional post-editing (PE) of machine translation (MT) output. In contrast to the conventional PE set-up, where an MT system first produces a static translation hypothesis that is then edited by a professional (hence "post-editing"), ITP constantly updates the translation hypothesis in real time in response to user edits. Our study involved nine professional translators and four reviewers working with the web-based CasMaCat workbench. Various new interactive features aiming to assist the post-editor/translator were also tested in this trial. Our results show that even with little training, ITP can be as productive as conventional PE in terms of the total time required to produce the final translation. Moreover, translation editors working with ITP require fewer key strokes to arrive at the final version of their translation.en_EN
dc.description.accrualMethodSes_ES
dc.description.bibliographicCitationSanchis Trilles, G.; Alabau, V.; Buck, C.; Carl, M.; Casacuberta Nolla, F.; Garcia Martinez, MM.; Germann, U.... (2014). Interactive translation prediction versus conventional post-editing in practice: a study with the CasMaCat workbench. Machine Translation. 28(3-4):217-235. https://doi.org/10.1007/s10590-014-9157-9es_ES
dc.description.issue3-4es_ES
dc.description.referencesAlabau V, Leiva LA, Ortiz-Martínez D, Casacuberta F (2012) User evaluation of interactive machine translation systems. In: Proceedings of the 16th Annual Conference of the European Association for Machine Translation, pp 20–23es_ES
dc.description.referencesAlabau V, Buck C, Carl M, Casacuberta F, García-Martínez M, Germann U, González-Rubio J, Hill R, Koehn P, Leiva L, Mesa-Lao B, Ortiz-Martínez D, Saint-Amand H, Sanchis-Trilles G, Tsoukala C (2014) Casmacat: A computer-assisted translation workbench. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp 25–28es_ES
dc.description.referencesAlves F, Vale D (2009) Probing the unit of translation in time: aspects of the design and development of a web application for storing, annotating, and querying translation process data. Across Lang Cultures 10(2):251–273es_ES
dc.description.referencesBach N, Huang F, Al-Onaizan Y (2011) Goodness: A method for measuring machine translation confidence. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics, pp 211–219es_ES
dc.description.referencesBarrachina S, Bender O, Casacuberta F, Civera J, Cubel E, Khadivi S, Lagarda AL, Ney H, Tomás J, Vidal E, Vilar JM (2009) Statistical approaches to computer-assisted translation. Comput Linguist 35(1):3–28es_ES
dc.description.referencesBrown PF, Della Pietra SA, Della Pietra VJ (1993) The mathematics of statistical machine translation: parameter estimation. Comput Linguist 19(2):263–311es_ES
dc.description.referencesCallison-Burch C, Koehn P, Monz C, Post M, Soricut R, Specia L (2012) Findings of the 2012 workshop on statistical machine translation. In: Proceedings of the Seventh Workshop on Statistical Machine Translation, pp 10–51es_ES
dc.description.referencesCarl M (2012a) The CRITT TPR-DB 1.0: A database for empirical human translation process research. In: Proceedings of the AMTA 2012 Workshop on Post-Editing Technology and Practice, pp 1–10es_ES
dc.description.referencesCarl M (2012b) Translog-II: a program for recording user activity data for empirical reading and writing research. In: Proceedings of the Eighth International Conference on Language Resources and Evaluation, pp 4108–4112es_ES
dc.description.referencesCarl M (2014) Produkt- und Prozesseinheiten in der CRITT Translation Process Research Database. In: Ahrens B (ed) Translationswissenschaftliches Kolloquium III: Beiträge zur Übersetzungs- und Dolmetschwissenschaft (Köln/Germersheim). Peter Lang, Frankfurt am Main, pp 247–266es_ES
dc.description.referencesCarl M, Kay M (2011) Gazing and typing activities during translation : a comparative study of translation units of professional and student translators. Meta 56(4):952–975es_ES
dc.description.referencesDoherty S, O’Brien S, Carl M (2010) Eye tracking as an MT evaluation technique. Mach Transl 24(1):1–13es_ES
dc.description.referencesElming J, Carl M, Balling LW (2014) Investigating user behaviour in post-editing and translation using the Casmacat workbench. In: O’Brien S, Winther Balling L, Carl M, Simard M, Specia L (eds) Post-editing of machine translation: processes and applications. Cambridge Scholar Publishing, Newcastle upon Tyne, pp 147–169es_ES
dc.description.referencesFederico M, Cattelan A, Trombetti M (2012) Measuring user productivity in machine translation enhanced computer assisted translation. In: Proceedings of the Tenth Biennial Conference of the Association for Machine Translation in the Americases_ES
dc.description.referencesFlournoy R, Duran C (2009) Machine translation and document localization at adobe: From pilot to production. In: Proceedings of MT Summit XIIes_ES
dc.description.referencesGreen S, Heer J, Manning CD (2013) The efficacy of human post-editing for language translation. In: Proceedings of SIGCHI Conference on Human Factors in Computing Systems, pp 439–448es_ES
dc.description.referencesGuerberof A (2009) Productivity and quality in mt post-editing. In: Proceedings of MT Summit XII-Workshop: Beyond Translation Memories: New Tools for Translators MTes_ES
dc.description.referencesGuerberof A (2012) Productivity and quality in the post-editing of outputs from translation memories and machine translation. Ph.D. Thesises_ES
dc.description.referencesJust MA, Carpenter PA (1980) A theory of reading: from eye fixations to comprehension. Psychol Rev 87(4):329es_ES
dc.description.referencesKoehn P (2009a) A process study of computer-aided translation. Mach Transl 23(4):241–263es_ES
dc.description.referencesKoehn P (2009b) A web-based interactive computer aided translation tool. In: Proceedings of ACL-IJCNLP 2009 Software Demonstrations, pp 17–20es_ES
dc.description.referencesKrings HP (2001) Repairing texts: empirical investigations of machine translation post-editing processes, vol 5. Kent State University Press, Kentes_ES
dc.description.referencesLacruz I, Shreve GM, Angelone E (2012) Average pause ratio as an indicator of cognitive effort in post-editing: a case study. In: Proceedings of the AMTA 2012 Workshop on Post-Editing Technology and Practice, pp 21–30es_ES
dc.description.referencesLanglais P, Foster G, Lapalme G (2000) Transtype: A computer-aided translation typing system. In: Proceedings of the 2000 NAACL-ANLP Workshop on Embedded Machine Translation Systems, pp 46–51es_ES
dc.description.referencesLeiva LA, Alabau V, Vidal E (2013) Error-proof, high-performance, and context-aware gestures for interactive text edition. In: Proceedings of the 2013 annual conference extended abstracts on Human factors in computing systems, pp 1227–1232es_ES
dc.description.referencesMontgomery D (2004) Introduction to statistical quality control. Wiley, Hobokenes_ES
dc.description.referencesO’Brien S (2009) Eye tracking in translation process research: methodological challenges and solutions, Copenhagen Studies in Language, vol 38. Samfundslitteratur, Copenhagen, pp 251–266es_ES
dc.description.referencesOrtiz-Martínez D, Casacuberta F (2014) The new Thot toolkit for fully automatic and interactive statistical machine translation. In: Proceedings of the 14th Annual Meeting of the European Association for Computational Linguistics: System Demonstrations, pp 45–48es_ES
dc.description.referencesPlitt M, Masselot F (2010) A productivity test of statistical machine translation post-editing in a typical localisation context. Prague Bulletin Math Linguist 93(1):7–16es_ES
dc.description.referencesSanchis-Trilles G, Ortiz-Martínez D, Civera J, Casacuberta F, Vidal E, Hoang H (2008) Improving interactive machine translation via mouse actions. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp 485–494es_ES
dc.description.referencesSimard M, Foster G (2013) Pepr: Post-edit propagation using phrase-based statistical machine translation. In: Proceedings of MT Summit XIV, pp 191–198es_ES
dc.description.referencesSkadiņš R, Puriņš M, Skadiņa I, Vasiļjevs A (2011) Evaluation of SMT in localization to under-resourced inflected language. In: Proceedings of the 15th International Conference of the European Association for Machine Translation, pp 35–40es_ES
dc.description.sponsorshipThis work was supported by the European Union’s 7th Framework Programme (FP7/2007–2013) under grant agreement No 287576 (CasMaCat ).
dc.description.upvformatpfin235es_ES
dc.description.upvformatpinicio217es_ES
dc.description.volume28es_ES
dc.identifier.doi10.1007/s10590-014-9157-9
dc.identifier.issn0922-6567
dc.identifier.urihttps://riunet.upv.es/handle/10251/49455
dc.languageIngléses_ES
dc.publisherSpringer Verlag (Germany)es_ES
dc.relation.ispartofMachine Translationes_ES
dc.relation.projectIDinfo:eu-repo/grantAgreement/EC/FP7/287576/EU/Cognitive Analysis and Statistical Methods for Advanced Computer Aided Translation/es_ES
dc.relation.publisherversionhttp://link.springer.com/article/10.1007/s10590-014-9157-9es_ES
dc.relation.references10.3115/v1/E14-2007es_ES
dc.relation.references10.1556/Acr.10.2009.2.5es_ES
dc.relation.references10.1162/coli.2008.07-055-R2-06-29es_ES
dc.relation.references10.7202/1011262ares_ES
dc.relation.references10.1007/s10590-010-9070-9es_ES
dc.relation.references10.1145/2470654.2470718es_ES
dc.relation.references10.1037/0033-295X.87.4.329es_ES
dc.relation.references10.1007/s10590-010-9076-3es_ES
dc.relation.references10.3115/1667872.1667877es_ES
dc.relation.references10.1145/2468356.2468576es_ES
dc.relation.references10.3115/v1/E14-2012es_ES
dc.relation.references10.2478/v10108-010-0010-xes_ES
dc.relation.references10.3115/1613715.1613776es_ES
dc.relation.senia277068
dc.rightsReserva de todos los derechoses_ES
dc.rights.accessRightsAbiertoes_ES
dc.subjectCATes_ES
dc.subjectSMTes_ES
dc.subjectInteractive Translation Predictiones_ES
dc.subjectPost-editinges_ES
dc.subjectField triales_ES
dc.subjectUser studieses_ES
dc.subject.classificationESTADISTICA E INVESTIGACION OPERATIVAes_ES
dc.subject.classificationLENGUAJES Y SISTEMAS INFORMATICOSes_ES
dc.titleInteractive translation prediction versus conventional post-editing in practice: a study with the CasMaCat workbenches_ES
dc.typeArtículoes_ES
dc.type.versioninfo:eu-repo/semantics/publishedVersiones_ES
dspace.entity.typePublication
person.identifier425
person.identifier.orcid0000-0002-8497-5598
relation.isAuthorOfPublicationf2173382-e788-4b13-9559-0e3310f743ec
relation.isAuthorOfPublication.latestForDiscoveryf2173382-e788-4b13-9559-0e3310f743ec
relation.isOrgUnitOfPublication67c70cf8-06ea-418a-a880-ac518c952be9
relation.isOrgUnitOfPublication.latestForDiscovery67c70cf8-06ea-418a-a880-ac518c952be9
upv.uuid89dabf2c-9a2c-48a2-89d8-2031e9f61c8fes_ES

Archivos

Bloque original

Mostrando 1 - 2 de 2
Cargando...
Miniatura
Nombre:
MTJ-2014-Sanchis+-VersioAutor.pdf
Tamaño:
638.74 KB
Formato:
Adobe Portable Document Format
Descripción:
Versión del Autor.
Cargando...
Miniatura
Nombre:
MTJ-2014-Sanchis+.pdf
Tamaño:
574.5 KB
Formato:
Adobe Portable Document Format
Descripción:
Versión editorial