Rethinking Impact Factors: New Pathways in Journal Metrics

• DOI: 10.7490/f1000research.1116751.1
• Publication Date: 2019-05-16
• Authors: Cassidy R. Sugimoto; Liz Allen; Jeroen Bosman; Tindaro Cicero; Stephen Curry; Sarah de Rijcke; Annette Flanagin; Michele S. Garfinkel; Michael Hill; Vincent Larivière; Jennifer Lin; Marco Malgarini; Ben R. Martin; Marie McVeigh; Alexis-Michel Mug...; Dakota Murray; Renato H. L. Pedrosa; Andrew Plume; James Pringle; Bernd Pulverer; Martijn Roelandse; Fei Shu; James T. Walker; Ludo Waltman; Paul Wouters
• Keywords: Impact factor; Scrutiny; Citation index; Audience measurement; Publication; Citation impact; Collection development

Journals have long served as the dominant mechanism by which scholars made priority claims and disseminated their work to each other public. Over course of last few decades, these communication vehicles been increasingly metricized, one aspect a general effort measure, rank, rate quality research. When Journal Citation Reports was first published an addendum 1975 Science Index, it suggested using aggregated citation metrics – indicators journal use inform librarians in collection management decisions, while detailed network data could aid at intersection fields find publication venues. time single indicator from JCR, Impact Factor (JIF) moved out library context, has applied not only assess journals, but also predict performance documents associated authors within journals. This extensive misapplication JIF spurred increased scrutiny construction metrics, evidenced growing number declarations manifestos asking either for be used responsibly, or them eliminated processes research assessment. To contribute conversation around indicators, we convened diverse group stakeholders—metric providers, funders, evaluation agencies, administrators, publishers, editors, librarians, scientometricians, researchers, readers/users scholarly publications—for one-week workshop hosted jointly Lorentz Center, Centre Technology Studies Leiden University (CWTS), Clarivate Analytics. The workshop, entitled “Rethinking Factors: New Pathways Metrics” focused on It restricted citation-based examined broad array current potential level. Our discussion began with enumeration functions provides foundation build typology grounded functions, turn is based belief that should serve strengthen reinforce primary journal. At present, are most widely promoted indicators; contend broadening scope match multi-dimensional roles journals lead more responsible framework, values such diversity, transparency, reliability considered integral part impact. Further, provide principles indicators. These essential ensure proliferation does distort system, leads granular transparent assessments. We sought relate ideals fairness openness practical realities those who generate them. end set recommendations further actions.