Detecting Erroneously Recognized Handwritten Byzantine Text

• DOI: 10.18653/v1/2023.findings-emnlp.524
• Publication Date: 2023-12-10T21:58:19Z
• Authors: John Pavlopoulos; Vasiliki Kougia; Paraskevi Platanou; Holger Essler
• Keywords: 102019 Machine Learning; 102001 Artificial intelligence; 102001 Artificial Intelligence; 605007 Digital Humanities; 605007 Digital humanities; 102019 Machine learning

Handwritten text recognition (HTR) yields textual output that comprises errors, which are considerably more compared to that of recognised printed (OCRed) text. Post-correcting methods can eliminate such errors but may also introduce errors. In this study, we investigate the issues arising from this reality in Byzantine Greek. We investigate the properties of the texts that lead post-correction systems to this adversarial behaviour and we experiment with text classification systems that learn to detect incorrect recognition output. A large masked language model, pre-trained in modern and fine-tuned in Byzantine Greek, achieves an Average Precision score of 95%. The score improves to 97% when using a model that is pre-trained in modern and then in ancient Greek, the two language forms Byzantine Greek combines elements from. A century-based analysis shows that the advantage of the classifier that is further-pre-trained in ancient Greek concerns texts of older centuries. The application of this classifier before a neural post-corrector on HTRed text reduced significantly the post-correction mistakes.