Generative AI, foundation models and large language models in radiation therapy physics: Clinical applications, challenges, and future directions

Abstract

Generative AI (Gen AI), Foundation Models (FMs), and Large Language Models (LLMs) are powerful emerging technologies that demonstrate exceptional capabilities in processing vast amounts of unstructured and structured data, including text, voice, images, video and other formats, and adapting to a wide range of specific tasks. Their immense potential to drive meaningful improvements in treatment outcomes is increasingly evident. The advent of these technologies has marked a transformative era in healthcare, including the fields of radiation oncology and medical physics. Specifically, these powerful technologies offer unprecedented opportunities to analyze domain‐specific data, process and synthesize medical images, automate routine tasks, support clinical decision‐making, optimize and streamline clinical workflows, and enhance the quality of clinical trials. While these emerging technologies present new opportunities to revolutionize radiation therapy practice, their implementation also raises important educational, ethical, and regulatory considerations. This scoping review highlights benefits, promises, risks, and challenges, such as interpretability, data privacy, regulatory compliance, reproducibility, hallucination, and integration into existing clinical workflow. Finally, emerging opportunities are outlined to guide future research directions. This review paper provides a timely overview of Gen AI, FMs and LLMs, aiming to inform medical physicists, clinicians, and researchers of the evolving role of these disruptive technologies in shaping the future of radiation therapy.