Journal Article Evaluation practices and effects of indicator use—a literature review Get access Sarah de Rijcke, Rijcke * 1 Centre for Science Technology Studies (CWTS), Faculty Social Sciences, Leiden University, 2300 AX, The Netherlands, *Corresponding author. Email: s.de.rijcke@cwts.leidenuniv.nl Search other works by this author on: Oxford Academic Google Scholar Paul F. Wouters, Wouters Alex D. Rushforth, Rushforth Thomas P. Franssen, Franssen Björn Hammarfelt 2 Swedish School Library...

Journal Article Accountability in context: effects of research evaluation systems on publication practices, disciplinary norms, and individual working routines the faculty Arts at Uppsala University Get access Björn Hammarfelt, Hammarfelt * 1Department ALM, University, 751 05 Uppsala, Sweden 2CWTS, Leiden 2333 AL Leiden, The Netherlands *Corresponding author. Email: bjorn.hammarfelt@abm.uu.se Search for other works by this author on: Oxford Academic Google Scholar Sarah de Rijcke Research...

A researcher's number of publications has been a fundamental merit in the competition for academic positions since late 18th century. Today, simple counting supplemented with whole range bibliometric indicators, which supposedly not only measures volume research but also its impact. In this study, we investigate how bibliometrics are used evaluating impact and quality two specific settings: biomedicine economics. Our study exposes various metrics external evaluations candidates at Swedish...

The use of bibliometric indicators on individual and national levels has gathered considerable interest in recent years, but the application models for allocating resources at institutional level so far less attention. This article studies implementation measures Swedish universities. Several based publications, citations, research grants are identified. design performance-based resource allocation across major universities is then analysed using a framework from field evaluation studies....

While bibliometric indicators, such as the journal impact factor, have long played an important role in many STEM disciplines it has been repeatedly shown that established methods limited use humanities. Using a questionnaire on metrics and publication practices Australia Sweden, we tested assumption indicators play minor among humanities scholars. Our findings show our respondents to considerable degree, with range of rankings being employed. The scholars part institutional policy, CVs...

Using the Arts & Humanities Citation Index (A&HCI) 2008, we apply mapping techniques previously developed for journal structures in Science and Social Sciences Indices. relations among 110,718 records were aggregated at level of 1,157 journals specific to A&HCI, are questioned on whether a cognitive structure can be reconstructed visualized. Both cosine-normalization (bottom up) factor analysis (top down) suggest division into approximately 12 subsets. The these subsets explored using...

Global university rankings have become increasingly important 'calculative devices' for assessing the 'quality' of higher education and research. Their ability to make characteristics universities 'calculable' is here exemplified by first proper ranking ever, produced as early 1910 American psychologist James McKeen Cattell. Our paper links epistemological rationales behind construction this sociopolitical context in which Cattell operated: an era psychology became institutionalized against...

Purpose The publication oeuvre of a researcher carries great value when academic careers are assessed, and being recognised as successful candidate is usually equated with productive author. Yet, how publications valued in the context evaluating so far an understudied topic. paper aims to discuss these issues. Design/methodology/approach Through content analysis assessment reports three disciplines – biomedicine, economics history this analyses externalities used evaluate oeuvres....

The use of indicators and metrics for research evaluation purposes is well‐documented; however, less known about their by individual scholars. With a focus on the social sciences, this article contributes to existing literature in fields with diverse publication practices. Scholars Australia Sweden were asked reasons using metrics. A total 581 completed surveys analyzed generate descriptive statistics, textual analysis performed comments provided open questions. While just under half...

Abstract Recent years have seen a rise in awareness around “responsible metrics” and calls for research assessment reforms internationally. Yet within the field of quantitative science studies policy contexts, concerns about limitations evaluative bibliometrics are almost as old tools themselves. Given that many articulated recent reform movements go back decades, why has momentum change grown only past 10 years? In this paper, we draw on analytical insights from sociology social collective...

This paper builds on emerging concerns with how temporality and spatiality unfold in, order, academic evaluation practices. We unpack the notion of ‘trajectory’ – a simultaneously prospective retrospective narrative device permeating contemporary discourses is mobilized within particular site. Materials for our study are drawn from reports commissioned by Swedish universities when hiring new professors. These texts authored external referees who rank compare candidates, in this case...

Purpose In this article, the ideas and methods behind “patent-paper citation” are scrutinised by following intellectual technical development of approaches in early work on patentometrics. The aim is to study how references from patents papers came play a crucial role establishing link between science technology. Design/methodology/approach comprises conceptual history “patent paper its emergence as an important indicator technology interaction. By tracing key field, it analyses overarching...

Abstract In this paper we study the diversity of users open access articles on Finnish Journal.fi platform. This platform hosts around hundred journals from Finland publishing in different fields and mainly English languages. The is based an online survey, conducted 48 during Spring 2020, which visitors were asked to indicate their background allow location download behaviour be tracked. Among 668 survey participants, two largest groups students (40%) researchers (36%), followed by private...

Purpose The aim of this article is to study a locally‐oriented and book‐based research field using two Swedish language sources. Knowledge about citation patterns outside journal‐based, English databases scarce; thus substantial part in the humanities social sciences neglected bibliometric studies. Design/methodology/approach Citation characteristics (publication type, language, gender age) journal Tidskrift för Litteraturvetenskap (2000‐2009) grant applications (2006‐2009) are studied....

Recent years have seen a rise in awareness around “responsible metrics” and calls for research assessment reforms internationally. Yet within the field of quantitative science studies policy contexts, concerns about limitations evaluative bibliometrics are almost as old tools themselves. Given that many articulated recent reform movements go back decades, why has momentum change grown only past ten years? In this paper, we draw on analytical insights from sociology social collective action...

One can go even further and remember that interruption is one of the fundamental devices all structuring. It goes far beyond sphere art. To give only example, it basis quotation. quote a text involves its context.11 Walter Benjamin, "What Epic Theater" in Illuminations (1968/2007, p. 151). Benjamin This article employs citation analysis on micro level—the level cited document; this case, Benjamin's (1968/2007). The study shows how frequently publication—more than 4,000 citations Web...

EDITOR'S SUMMARY Bibliometric evaluation for research in the field of sciences can be a good way to assess quality and factual basis claims lead more funding authors work. However, due diverse fields covered, this type is less effective world humanities. Many professionals researchers humanities believe that bibliometric meant only STEM can't properly any findings made Four common about bibliometrics are do not adequately cover non‐uniform nature humanities; greater coverage will solve all...

In this article, we problematize the notion that continuously growing use of bibliometric evaluation can be effectively explained by ‘neoliberal’ ideology. A prerequisite for our analysis is an understanding neoliberalism as both denoting a more limited set concrete principles organization society (the narrow interpretation) or hegemonic ideology broad interpretation). This conceptual framework, well brief history evaluative bibliometrics, provides analytical framing approach, in which four...