GERBIL

• DOI: 10.1145/2736277.2741626
• Publication Date: 2016-02-05T15:37:12Z
• Authors: Ricardo Usbeck; Michael Röder; Axel-Cyrille Ngon...; Ciro Baron; Andreas Both; Martin Brümmer; Diego Ceccarelli; Marco Cornolti; Didier Cherix; Bernd Eickmann; Paolo Ferragina; Christiane Lemke; Andrea Moro; Roberto Navigli; Francesco Piccinno; Giuseppe Rizzo; Harald Sack; René Speck; Raphaël Troncy; Jörg Waitelonis; Lars Wesemann
• Keywords: Gerbil; Strengths and weaknesses

We present GERBIL, an evaluation framework for semantic entity annotation. The rationale behind our is to provide developers, end users and researchers with easy-to-use interfaces that allow the agile, fine-grained uniform of annotation tools on multiple datasets. By these means, we aim ensure both tool developers can derive meaningful insights pertaining extension, integration use applications. In particular, GERBIL provides comparable results so as them easily discover strengths weaknesses their implementations respect state art. With permanent experiment URIs provided by framework, reproducibility archiving results. Moreover, generates data in machine-processable format, allowing efficient querying post-processing Finally, diagnostics allows deriving areas which should be further refined, thus create informed agenda extensions detect right purposes. aims become a focal point art, driving research community presenting objective