Reporting transparency in veterinary pathology deep learning: A systematic review of reproducibility-critical details
Sweta Banerjee, Christof A. Bertram, Viktoria Weiss, Jonas Ammeling, Thomas Conrad, Nils Porsche, Robert Klopfleisch, Christoph Stroblberger, Christopher Kaltenecker, Katharina Breininger, Marc AubrevilleWhereas reproducibility of studies is a prerequisite for trustworthy deep learning (DL) in veterinary histopathology and microscopy, the actual degree of methodological transparency that exists in the literature remains uncertain. We performed a Preferred Reporting Items for Systematic Reviews and Meta-Analyses-guided systematic review to quantify the degree to which supervised DL and supervised machine learning studies report reproducibility-critical details. Using a veterinary-journal-restricted Boolean search executed in PubMed and Scopus, we screened 180 unique records and included 50 primary research articles for full-text analysis. Based on a recently published guideline for the development of DL models in veterinary pathology, we extracted information for each study across 5 dimensions: (1) study and task characterization, (2) data transparency, (3) experimental design and data-leakage control, (4) model and training details, and (5) performance evaluation and reporting. Among the included studies, private data sets predominated, with 90% of studies relying on private data. Sharing of code was uncommon (3%). Key training details such as augmentation and hyperparameters were often incompletely reported; augmentation was not reported in 56% of studies, and key hyperparameters were absent in 40% of studies. It was often not clear whether patient-level stratification (necessary to avoid data leakage) was performed. In summary, these results highlight major deficits in the reporting of details and experimental design necessary for reproducing DL results in veterinary histopathology. This review provides a practical baseline and reporting roadmap to support more transparent and reproducible research in veterinary computational pathology.