The OWL Reasoner Evaluation (ORE) 2015 Competition Report

• DOI: 10.1007/s10817-017-9406-8
• Publication Date: 2017-02-21T09:41:50Z
• Authors: Bijan Parsia; Nicolas Matentzoglu; Rafael S. Gonçalves; Birte Glimm; Andreas Steigmiller
• Keywords: Semantic reasoner; Benchmarking; Realisation

The OWL Reasoner Evaluation competition is an annual (with associated workshop) that pits 2 compliant reasoners against each other on various standard reasoning tasks over naturally occurring problems. 2015 was the third of its sort and had 14 competing in six tracks comprising three (consistency, classification, realisation) two profiles (OWL DL EL). In this paper, we discuss design, execution results with particular attention to lessons learned for benchmarking, comparative experiments, future competitions.