DOI: 10.47582/jompac.1987747 ISSN: 2717-7505

Evaluation of Demirjian-based dental age estimation: a comparison of multimodal large language models with specialist dentists

Banu Çiçek Tez Yaşar, Elif Gökçe Erkan Acar
Show PDF Cite
Aims: This study evaluated the performance of three multimodal large language models (LLMs) ChatGPT, Gemini, and Claude in Demirjian-based dental age (DA) estimation from panoramic radiographs compared with specialist dentists. Methods: This retrospective cross-sectional study included 135 panoramic radiographs of children aged 6–13 years. Two specialist dentists confirmed inter-examiner reliability (ICC=0.90) on a pilot subset; the pediatric dentist then assessed all radiographs using the Demirjian method. The radiographs were analyzed once per model using standardized prompts in ChatGPT-5.5 Instant, Gemini 3.5 Flash, and Claude Sonnet 4.6; thus, the reported metrics reflect single-session model performance. Demirjian stages were converted into gender-specific maturity scores and DAs. Performance was assessed using bias, mean absolute error (MAE), and intraclass correlation coefficient (ICC). Statistical analyses included paired-samples t-tests, Wilcoxon, Friedman, Mann–Whitney U, and independent-samples t-tests (p0.05). Conclusion: ChatGPT yielded the lowest MAE relative to CA; Gemini showed the highest specialist agreement, which should not be equated with accuracy. Current multimodal LLMs remain insufficiently accurate and consistent to replace specialist dentists and should be considered adjunctive decision-support tools.

More from our Archive