Assessing AI-Powered Literary Translation Quality: Austen's “Sense and Sensibility” As a Corpus

تقييم جودة الترجمة المدعومة بالذكاء الاصطناعي: رواية "العقل والعاطفة" لجاين أوستن أنموذجا

Authors

  • Hajir Waheedah University Yahia Fares of Medea, Algeria
  • Mohammad Babchikh University Yahia Fares of Medea, Algeria

DOI:

https://doi.org/10.33705/1111-017-001-032

Keywords:

Literary translation, AI-powered Machine Translation, Human translation, Quality assessment.

Abstract

: This research explores the disparities between the quality of human and AI-powered translations of literary texts. It compares the output of ChatGPT3.5 into Arabic of passages from Austen’s “Pride and Prejudice”- translated without any pre-editing or postediting- to the reference translation by Amin Al-Sharif. It departs from a comprehensive analysis of the translations' linguistic, stylistic, semantic, and structural aspects. The subsequent BLEU Score measurement shows that the Human translation was better in style and conveying meaning. Moreover, although the AI- translation conserves the structure of the Source Text, it fails to produce a text that preserves the stylistic and semantic features of literary prose

References

1- Austen, J. (n.d)). al-ʻAql wālʻāṭfh. (A. Al-Sharīf, (Trans). Maṭbaʻat al-Maʻrifah. (Arabic version)

2- Austen, J. (2006). Sense and Sensibility. (E. Copeland, Ed.) Cambridge University Press.

3- Chomsky, N. (2006). Language and Mind. Third Edition. Cambridge University Press. Philosophy for Linguist.

4- Ghazvininejad, M., Shi, X., Choi, Y., & Knight, K. (2016). Generating topical poetry. EMNLP 2016-Conference on Empirical Methods in Natural Language Processing, Proceedings, 1183–1191. https://doi.org/10.18653/V1/D16-1126

5- Newmark, P. (1980). The Translation of Metaphor. Babel. Revue Internationale de La Traduction / International Journal of Translation, 26(2), 93–100. https://doi.org/10.1075/BABEL.26.2.05NEW/CITE/REFWORKS

6- House, J. (1989). A Model for Translation Quality. In Blum-Kulka, S., House, J., & Kasper, G. (Eds.), Cross-Cultural Pragmatics: Requests and Apologies (pp. 281-291). Ablex Publishing Corporation.

7- Kolb, W., Dressler, W. U., & Mattiello, E. (2023). Human and machine translation of occasionalisms in literary texts: Johann Nestroy’s Der Talisman and its English translations. Target.‏

8- Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (n.d.). BLEU: A Method for Automatic Evaluation of Machine Translation.

9- Shi, X., Padhi, I., & Knight, K. (2016). Does String-Based Neural MT Learn Source Syntax? EMNLP 2016-Conference on Empirical Methods in Natural Language Processing, Proceedings, 1526–1534. https://doi.org/10.18653/V1/D16-1159

10- Toral, A., & Way, A. (2018). What Level of Quality can Neural Machine Translation Attain on Literary Text? arXiv:1801.04962v1, https://arxiv.org/abs/1801.04962

11- What is a BLEU score?-Custom Translator-Azure AI services | Microsoft Learn. (n.d.). Retrieved November 17, 2023, from https://learn.microsoft.com/en-us/azure/ai-services/translator/custom-translator/concepts/bleu-score

12- Yirmibeşoğlu, Z., Dursun, O., Dallı, H., Şahin, M., Hodzik, E., Gürses, S., & Güngör, T. (2023). Incorporating Human Translator Style into English-Turkish Literary Machine Translation. https://arxiv.org/abs/2307.11457v1

معالم العدد 21

Downloads

Published

2024-06-27

How to Cite

Waheedah, H., & Babchikh, M. (2024). Assessing AI-Powered Literary Translation Quality: Austen’s “Sense and Sensibility” As a Corpus: تقييم جودة الترجمة المدعومة بالذكاء الاصطناعي: رواية "العقل والعاطفة" لجاين أوستن أنموذجا. Maalim , 17(01), 24–1. https://doi.org/10.33705/1111-017-001-032

Issue

Section

المقالات

Deprecated: json_decode(): Passing null to parameter #1 ($json) of type string is deprecated in /var/www/vhosts/hcla.dz/maalim.hcla.dz/plugins/generic/citations/CitationsPlugin.inc.php on line 49