HECLIP: Histology-Enhanced Contrastive Learning for Imputation of Transcriptomics Profiles
Qing Wang, Wen-jie Chen, Jing Su, Guangyu Wang, Qianqian SongAbstract
Motivation
Histopathology, particularly hematoxylin and eosin (H&E) staining, is pivotal for diagnosing and characterizing pathological conditions by visualizing tissue morphology. However, H&E-stained images inherently lack molecular resolution, necessitating costly and labor-intensive technologies like spatial transcriptomics to uncover spatial gene expression patterns. There is a critical need for scalable computational methods that can bridge this imaging-transcriptomics gap.
Results
We present HECLIP (Histology-Enhanced Contrastive Learning for Imputation of Profiles), an innovative deep learning framework designed to infer spatial gene expression profiles directly from H&E-stained histology images. HECLIP employs an image-centric contrastive learning strategy to capture morphological features relevant to molecular expression. By minimizing dependence on spatial transcriptomics data, HECLIP enables accurate and biologically meaningful predictions of gene expression. Extensive benchmarking on publicly available datasets demonstrates that HECLIP outperforms existing methods. Ablation studies confirm the contribution of each model component to its overall performance.
Availability and Implementation
The source code for HECLIP is freely available at: https://github.com/QSong-github/HECLIP.
Supplementary Information
Supplementary data and detailed implementation are available at the Supplementary Materials.