Responsible Research Assessment and Open Science in Practice: Evidence from a Spanish Research Funding Call
Daniela De Filippo, Borja González-Albo, Fernanda Morillo, María BordonsAbstract
Purpose
This article assumes that embracing the values of open science is central to the ongoing reform of research assessment. Two main objectives are pursued: (1) to analyze whether responsible research assessment (RRA) and open science principles are being implemented in the Severo Ochoa (SO) call for proposals for centers of excellence in Spain; (2) to study the engagement of a selection of centers holding the excellence seal with open science practices.
Methodology
First, a longitudinal study of the content of the SO calls from 2011 to 2025 is conducted to identify changes reflecting adoption of the RRA and open science principles. Second, the open science practices of the selected centers are analyzed across two operational dimensions: i) open scientific knowledge and infrastructure and ii) openness to non-academic actors.
Findings
The call has evolved over the years, adapting its evaluation criteria to the principles of RRA: drastic decrease of the role of publication-based indicators, wider range of contributions considered and use of narrative CVs. Open science practices are increasingly promoted, particularly in centers’ strategic plans. Centers with the seal of excellence show higher levels of open publications and societal impact than the average in their fields. These centers show quite a strong commitment to the values of open science, although there is still room for improvement.
Research limitations
The analysis is limited by the lack of solid, reliable sources and indicators for some open science practices. Enhanced standardization and interoperability of information sources are needed to generate reliable indicators for monitoring these practices.
Practical implications
The RRA principles are being integrated into the SO call, but some open science practices still require greater promotion. This is relevant, because centers of excellence can set the benchmarks for the country’s entire scientific community.
Originality/value
Studying how RRA and open science principles are implemented by funding agencies is crucial, as funders have a clear influence on researchers’ behavior.