Responsible Research Assessment (Parts I and II): Responses to the Commentaries

• DOI: 10.31234/osf.io/6akmr_v2
• Publication Date: 2025-02-06T07:24:06Z
• Authors: Daniel Leising; Anne Gärtner; Felix D. Schönbrodt
• Keywords: Meta-science; Social and Behavioral Sciences

We give a brief overview of our deliberations in responding to the commentaries on two target papers presenting RESQUE (Research Quality Evaluation) framework. While we were able incorporate many suggestions for improvement directly, acknowledge that other areas (e.g., quality theorizing) will require further elaboration. In this paper, specifically touch following issues: (a) eligible types publication, (b) measurability, (c) criteria software and datasets, (d) theoretical rigor, (e) quantity, (f) authorship, (g) potential bias (against certain methodologies, research contributions, or subdisciplines), (h) overall rigor score, (i) weighting individual indicators, (j) data, (k) impact, (l) interdisciplinary value, (m) teaching, (n) expertise, (o) gaming new metrics, (p) representativeness. The framework has met with largely positive reception so far, but continues evolve thrive best when community involvement stays strong.