DOI: 10.1097/js9.0000000000000648 ISSN:

A novel staging system derived from natural language processing of pathology reports to predict prognostic outcomes of pancreatic cancer: a retrospective cohort study

Bo Li, Beilei Wang, Pengjie Zhuang, Hongwei Cao, Shengyong Wu, Zhendong Tan, Suizhi Gao, Penghao Li, Wei Jin, Zhuo Shao, Kailian Zheng, Lele Wu, Bai Gao, Yang Wang, Hui Jiang, Shiwei Guo, Liang He, Yan Yang, Gang Jin
  • General Medicine
  • Surgery

Objective:

To construct a novel Tumor-Node-Morphology (TNMor) staging system derived from natural language processing (NLP) of pathology reports to predict outcomes of pancreatic ductal adenocarcinoma (PDAC).

Method:

This retrospective study with 1,657 participants was based on a large referral center and The Cancer Genome Atlas Program (TCGA) dataset. In the training cohort, NLP was used to extract and screen prognostic predictors from pathology reports to develop the TNMor system, which was further evaluated with the tumor-node-metastasis (TNM) system in the internal and external validation cohort, respectively. Main outcomes were evaluated by the log-rank test of Kaplan-Meier curves, concordance index (C-index) and area under receiver operating curve (AUC).

Results:

The precision, recall, and F1 scores of the NLP model were 88.83%, 89.89%, and 89.21%, respectively. In Kaplan-Meier analysis, survival differences between stages in the TNMor system were more significant than that in the TNM system. In addition, our system provided an improved C-index (Internal validation, 0.58 vs. 0.54, P< 0.001; External validation, 0.64 vs. 0.63, P< 0.001), and higher AUCs for 1, 2, and 3-year survival (Internal validation: 0.62 vs. 0.54, P< 0.001; 0.64 vs. 0.60, P=0.017; 0.69 vs. 0.62, P=0.001; External validation: 0.69 vs. 0.65, P=0.098; 0.68 vs. 0.64, P=0.154; 0.64 vs. 0.55, P=0.032, respectively). Finally, our system was particularly beneficial for precise stratification of patients receiving adjuvant therapy, with an improved C-index (0.61 vs. 0.57, P< 0.001), and higher AUCs for 1, 2, and 3-year survival (0.64 vs. 0.57, P< 0.001; 0.64 vs. 0.58, P< 0.001; 0.67 vs. 0.61, P< 0.001; respectively) compared with the TNM system.

Conclusion:

These findings suggest that the TNMor system performed better than the TNM system in predicting PDAC prognosis. It is a promising system to screen risk-adjusted strategies for precision medicine.

More from our Archive