Evaluating ICMR (Indian Council of Medical Research)-intramural research programme efficiency: A five-year retrospective analysis
Anand Bodade, Vikas Dhiman, Sidhartha Giri, Pramit Ghosh,Background and objectives
A systematic performance assessment of biomedical research institutes is crucial for optimising resource allocation and maximising scientific output. This study was conceptualised to evaluate the efficiency of the intramural research programme of the Indian Council of Medical Research (ICMR) and to measure real-world impact of research activities undertaken in ICMR ecosystem, using the ICMR-impact of research and innovation scale (ICMR-IRIS), based on a novel unit of measurement called publication equivalent (PE).
Methods
A retrospective analysis of data from ICMR institutes was conducted over five financial years. The financial and human resources available at the institute during five years (cumulative 2016-17 to 2020-21) constituted the input, and research outcomes during the subsequent five-year period (cumulative 2020-21 to 2024-25) were designated as the output. ICMR has a nationwide network of 28-intramural institutes; each one focuses on a specific research mandate. For this study, information was collected from 23 institutes along with verifiable documents. Institutional inputs and outcomes were collated, validated, and quantified using PE. The primary outcome measures consisted of ( a ) PE earned per crore of budget in rupees (INR) utilised in the input years (PE/one crore INR), and ( b ) PE earned for each year a scientist worked for that institute (PE/one scientist-year).
Results
ICMR institutes produced a total output of 10770 PEs in 5 y, against input of Rs. 2575.3 x 10 7 or 2575.3 crores INR (∼ $268 million USD) and 2529 scientist-years. Considerable variation was noted between financial input (INR 22.4 Cr to INR 440.5 Cr) and also between scientist-years (14.0-290.0 y) of the 23 institutes. Earned PE ranged between 70 to 1779 across different institutes. An estimated 4.18 PE was earned per crore of INR spent and 4.26 PE per scientist-year of service. The output from the intramural research programme was contributed mostly (79%) by publications and their impact on clinical guidelines or health programmes. Innovations or technology-related research output constituted 21% of the total PE. There was substantial variation between outcomes and derived metrics of different ICMR institutes. ICMR-NIV, Pune achieved the highest overall PE (1779), and ICMR-NCDIR Bengaluru generated the highest research output in terms of both financial utilisation (12.04 PE/crore INR) and human resource (8.08 PE/scientist years).
Interpretation and conclusions
Research output from ICMR institutions is heavily weighted toward publications and guidelines, while a smaller but vital portion focused on biomedical innovations and technologies. The analysis will help in shaping strategic directions for the intramural research programme of ICMR in the near future.