Abstracts
Abstract
The increasing availability of automatic live captioning (ALC) technology offers new possibilities for its application in simultaneous interpreting (SI). However, its effectiveness in SI contexts requires further investigation, particularly compared to conventional SI modes. This study addresses this gap by conducting a comparative analysis of four interpreting modes: SI without text, SI with text, sight translation and SI with ALC. We evaluated the performance of 27 interpreter trainees from three perspectives: human raters’ assessment of interpreting quality, interpreters’ self-perceived performance and local interpreting quality in relation to specific problem triggers and automatic speech recognition (ASR) errors. Results indicate that interpreters in SI with ALC perform at an intermediate quality level, surpassing SI without text, but not matching the quality achieved in SI with text or sight translation. Our analysis of problem triggers and ASR errors reveals a nuanced relationship between technological assistance and interpreter performance, highlighting both the benefits and challenges of SI with ALC. This research contributes to the growing body of knowledge on SI with ALC by examining the specific role and impact of ALC in SI, offering insights for computer-assisted interpreting development and suggesting potential applications in interpreter training programs.
Keywords:
- computer assisted interpreting,
- simultaneous interpreting,
- automatic speech recognition,
- sight translation,
- simultaneous interpreting with text
Résumé
La disponibilité croissante de la technologie de sous-titrage automatique en direct (Automatic Live Captioning, ou ALC) offre de nouvelles possibilités pour son application dans l’interprétation simultanée (IS). Cependant, son efficacité dans les contextes d’IS nécessite une enquête approfondie, notamment en comparaison avec les modes d’IS conventionnels. Cette étude comble cette lacune en menant une analyse comparative de quatre modes d’interprétation : l’IS sans texte, l’IS avec texte, la traduction à vue et l’IS avec ALC. Nous avons évalué la performance de 27 interprètes en formation sous trois angles : l’évaluation de la qualité par des juges, l’auto-évaluation des interprètes et la qualité d’interprétation face aux déclencheurs de problèmes et erreurs de reconnaissance vocale (Automatic Speech Recognition, ou ASR). Les résultats indiquent que les interprètes en IS avec ALC obtiennent un niveau de qualité intermédiaire, surpassant l’IS sans texte mais n’atteignant pas la qualité de l’IS avec texte ou de la traduction à vue. Notre analyse des déclencheurs de problèmes et des erreurs ASR révèle une relation nuancée entre l’assistance technologique et la performance, soulignant les avantages et défis de l’IS avec ALC. Cette recherche contribue aux connaissances sur l’IS avec ALC en examinant son rôle spécifique, offrant des perspectives pour le développement de l’interprétation assistée par ordinateur, et suggérant des applications dans la formation des interprètes.
Mots-clés :
- interprétation assistée par ordinateur,
- interprétation simultanée,
- reconnaissance automatique de la parole,
- traduction à vue,
- interprétation simultanée avec texte
Resumen
La creciente disponibilidad de la tecnología de subtitulado automático en tiempo real (Automatic Live Captioning, o ALC) ofrece nuevas posibilidades para la interpretación simultánea (IS). Sin embargo, su eficacia requiere una investigación más profunda, particularmente en comparación con los modos convencionales. Este estudio aborda esta brecha analizando cuatro modos de interpretación: IS sin texto, IS con texto, traducción a la vista e IS con ALC. Evaluamos el desempeño de 27 intérpretes en formación mediante evaluación por jueces, autoevaluación de los intérpretes y calidad de interpretación en relación con desencadenantes de problemas y errores de reconocimiento automático del habla (Automatic Speech Recognition, o ASR). Los resultados indican que la IS con ALC alcanza un nivel de calidad intermedio, superior a la IS sin texto pero sin lograr la calidad de la IS con texto o traducción a la vista. Nuestro análisis revela una relación matizada entre la asistencia tecnológica y el desempeño, destacando tanto beneficios como desafíos de la IS con ALC. Esta investigación contribuye al conocimiento sobre IS con ALC al examinar su rol específico, ofreciendo perspectivas para el desarrollo de la interpretación asistida por computadora y sugiriendo aplicaciones en formación de intérpretes.
Palabras clave:
- interpretación asistida por ordenador,
- interpretación simultánea,
- reconocimiento automático de voz,
- traducción a la vista,
- interpretación simultánea con texto
Appendices
Bibliography
- Agrifoglio, Marjorie (2004): Sight Translation And Interpreting: A Comparative Analysis of Constraints and Failures. Interpreting, 6(1): 43-67.
- Čeňková, Ivana (2015): Sight Interpreting/Translation. In: Franz Pöchhacker, ed. Routledge Encyclopedia of Interpreting Studies. London: Routledge, 374-375.
- Cheung, Andrew K. F. and Li, Tianyun (2022): Machine Aided Interpreting: An Experiment of Automatic Speech Recognition in Simultaneous Interpreting. Translation Quarterly, (104): 1-20.
- Chmiel, Agnieszka, Janikowski, Przemysław and Lijewska, Agnieszka (2020): Multimodal Processing in Simultaneous Interpreting with Text. Target, 32(1): 37-58.
- Defrancq, Bart and Fantinuoli, Claudio (2021): Automatic Speech Recognition in The Booth: Assessment of System Performance, Interpreters’ Performances and Interactions in the Context of Numbers. Target, 33(1): 71-102.
- Desmet, Bart, Vandierendonck, Mieke and Defrancq, Bart (2018): Simultaneous Interpretation of Numbers and the Impact of Technological Support. In: Claudio Fantinuoli, ed. Interpreting and technology. Berlin: Language Science Press, 13-27.
- Diriker, Ebru (2015): Simultaneous Interpreting. In: Franz Pöchhacker, ed. Routledge Encyclopedia of Interpreting Studies. London: Routledge, 382-385.
- Frittella, Francesca Maria (2023): Usability research for interpreter-centred technology: The case study of SmarTerp. Berlin: Language Science Press. https://langsci-press.org/catalog/book/366.
- Gile, Daniel (2009): Basic Concepts and Models for Interpreter and Translator Training. Amsterdam/Philadelphia: John Benjamins.
- Guo, Meng, Han, Lili and Anacleto, Marta Teixeira (2023): Computer-Assisted Interpreting Tools: Status Quo and Future Trends. Theory and Practice in Language Studies, 13(1): 89-99.
- Guo, Meng, Xie, Yuxing, Han, Lili, Lei, Victoria Lai Cheng and Li, Defeng (in press): From sight to insight: Unravelling student interpreters’ usage and perceptions of live captioning in Chinese-English simultaneous interpreting. Linguistica Antverpiensia, New Series: Themes in Translation Studies, 24.
- Korpal, Paweł and Stachowiak-Szymczak, Katarzyna (2018): The Whole Picture: Processing of Numbers and Their Context in Simultaneous Interpreting. Poznan Studies in Contemporary Linguistics, 54(3): 335-354.
- Korpal, Paweł and Stachowiak-Szymczak, Katarzyna (2020): Combined Problem Triggers in Simultaneous Interpreting: Exploring the Effect of Delivery Rate on Processing and Rendering Numbers. Perspectives, 28(1): 126-143.
- Lambert, Sylvie (2004): Shared Attention During Sight Translation, Sight Interpretation and Simultaneous Interpretation. Meta, 49(2): 294-306.
- Li, Changshuan (2010): Coping Strategies for Fast Delivery In Simultaneous Interpretation. The Journal of Specialised Translation, (13): 19-25.
- Li, Tianyun and Chmiel, Agnieszka (2024): Automatic Subtitles Increase Accuracy and Decrease Cognitive Load in Simultaneous Interpreting. Interpreting, 26(2): 253-281.
- Lu, Xiaolei and Han, Chao (2023): Automatic assessment of spoken-language interpreting based on machine-translation evaluation metrics: A multi-scenario exploratory study. Interpreting. John Benjamins. 25(1): 109-143. https://doi.org/10.1075/intp.00076.lu
- Ma, Xingcheng and Cheung, Andrew K. F. (2020): Language Interference in English-Chinese Simultaneous Interpreting With and Without Text. Babel, 66(3): 434-456.
- Nllb Team, Costa-jussà, Marta R., Cross, James et al. (2022): No language left behind: scaling human-centered machine translation (2207.04672v3) [Preprint]. https://arxiv.org/abs/2207.04672
- Pisani, Elisabetta and Fantinuoli, Claudio (2021): Measuring the Impact of Automatic Speech Recognition on Number Rendition in Simultaneous Interpreting. In: Caiwen Wang and Binhan Zheng, eds. Empirical studies of translation and interpreting. London: Routledge, 181-197.
- Pöchhacker, Franz (2022): Interpreters and Interpreting: Shifting the Balance? The Translator, 28(2): 148-161.
- Prandi, Bianca (2023): Computer-Assisted Simultaneous Interpreting: A Cognitive-Experimental Study on Terminology. Berlin: Language Science Press.
- Radford, Alec, Narasimhan, Karthik, Salimans, Tim and Sutskever, Ilya (2018): Improving language understanding by Generative Pre-Training [technical report]. OpenAI. Consulted on 22 April 2023, https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
- Seeber, Kilian G. (2007): Thinking outside the cube: Modeling language processing tasks in a multiple resource paradigm. In: Proceedings of Interspeech 2007, 1382-1385. https://archive-ouverte.unige.ch/unige:97484
- Seeber, Kilian G. (2011): Cognitive Load in Simultaneous Interpreting: Existing Theories—New Models. Interpreting, 13(2): 176-204.
- Seeber, Kilian G. (2017): Multimodal Processing in Simultaneous Interpreting. In: John W. Schwieter and Aline Ferreira, eds. The Handbook of Translation and Cognition, 1st ed. Hoboken: John Wiley & Sons, 461-475.
- Seeber, Kilian G. and Delgado Luchner, Carmen (2020): Simulating Simultaneous Interpreting with Text: From Training Model to Training Module. In: María Dolores Rodríguez Melchor, Ildikó Horváth and Kate Ferguson, eds. The role of technology in conference interpreter training. Lausanne: Peter Lang, 129-151.
- Setton, Robin (2015): Simultaneous with Text. In: Franz Pöchhacker, ed. Routledge Encyclopedia of Interpreting Studies. London: Routledge, 385-386.
- Shreve, Gregory M., Lacruz, Isabel and Angelone, Erik (2010): Cognitive Effort, Syntactic Disruption, and Visual Interference in a Sight Translation Task. In: Gregory M. Shreve and Erik Angelone, eds. Translation and Cognition. Amsterdam/Philadelphia: John Benjamins, 63-84.
- Wang, Xiaoman, Wang, Binhua and Yuan, Lu (2025): The Function Of ASR-Generated Live Transcription in Simultaneous Interpreting: Trainee Interpreters’ Perceptions from Post-Task Interviews. Humanities and Social Sciences Communications, 12(1): 1-12.
- Yang, Shanshan, Li, Defeng and Lei, Victoria Lai Cheng (2020): The Impact of Source Text Presence on Simultaneous Interpreting Performance in Fast Speeches: Will It Help Trainees or Not? Babel, 66(4-5): 588-603.
- Yuan, Lu and Wang, Binhua (2023): Cognitive Processing of the Extra Visual Layer of Live Captioning in Simultaneous Interpreting. Triangulation Of Eye-Tracking and Performance Data. Ampersand, 11.
- Yuan, Lu and Wang, Binhua (2024): Eye-Tracking the Processing of Visual Input of Live Transcripts in Remote Simultaneous Interpreting: Preliminary Findings. FORUM, 22(1): 119-145.
10.7202/009352ar