Automatic Language Identification in Texts: A Survey

• DOI: 10.1613/jair.1.11675
• Publication Date: 2019-08-29T00:47:57Z
• Authors: Tommi Jauhiainen; Marco Lui; Marcos Zampieri; Timothy Baldwin; Krister Lindén
• Keywords: Identification; Language identification; Open research


 Language identification (“LI”) is the problem of determining natural language that a document or part thereof written in. Automatic LI has been extensively researched for over fifty years. Today, key many text processing pipelines, as techniques generally assume input known. Research in this area recently especially active. This article provides brief history research, and an extensive survey features methods used literature. We describe using unified notation, to make relationships between clearer. discuss evaluation methods, applications LI, well off-the-shelfLI systems do not require training by end user. Finally, we identify open issues, work date on each issue, propose future directions research LI.