SemEval-2017 Task 2: Multilingual and Cross-lingual Semantic Word Similarity

• DOI: 10.18653/v1/s17-2002
• Publication Date: 2018-01-30T04:09:28Z
• Authors: Jose Camacho-Coll...; Mohammad Taher Pi...; Nigel Collier; Roberto Navigli
• Keywords: Similarity (geometry); SemEval

This paper introduces a new task on Multilingual and Cross-lingual SemanticThis Semantic Word Similarity which measures the semantic similarity of word pairs within across five languages: English, Farsi, German, Italian Spanish. High quality datasets were manually curated for languages with high inter-annotator agreements (consistently in 0.9 ballpark). These used semi-automatic construction ten cross-lingual datasets. 17 teams participated task, submitting 24 systems subtask 1 14 2. Results show that combine statistical knowledge from text corpora, form embeddings, external lexical resources are best performers both subtasks. More information can be found website: http://alt.qcri.org/semeval2017/task2/