AI-POWERED CHATBOTS IN PSYCHIATRY: A CRITICAL EVALUATION OF CHATGPT'S SLEEP AID GUIDANCE

Background

ChatGPT is an artificial intelligence (AI)-powered chatbot that has gained immense popularity on social media, attracting millions of users who turn to it for medical inquiries. There is a heightened expectation that individuals will seek advice on managing common psychiatric symptoms through this platform. Among these symptoms, insomnia, known for its substantial health and economic implications, is a frequently encountered concern. Many individuals who previously sought assistance from clinicians in the form of advice on sleep aids may now turn to ChatGPT for similar guidance.

Aims & Objectives

The evolving role of AI in medical diagnosis and advisory services has garnered significant attention. While AI holds promise for educating and offering guidance on sleep-related issues, it is also associated with safety concerns, particularly when it comes to advice concerning the use of sleep aids. Thus, our primary objective was to conduct an evaluation of the advice on sleep aids provided by ChatGPT.

Method

To evaluate ChatGPT's sleep advice, we provided the chatbot with a set of commonly asked questions pertaining to sleep and sleep aids. Subsequently, we assessed the accuracy and suitability of the advice provided by comparing it with recommendations found in established psychiatric clinical guidelines. The responses were scrutinized from the perspective of experienced psychiatrists.

Results

ChatGPT effectively responded to all questions provided, delivering concise and easily understandable guidance. ChatGPT offered a comprehensive list of potential causes of insomnia and detailed recommendations for sleep hygiene. It also provided suggestions for both over-the-counter sleep aids and prescription sleep medications, emphasizing their short-term use under healthcare provider guidance and highlighting potential side effects. Furthermore, ChatGPT emphasized the importance of prioritizing non-pharmacological approaches to improve sleep.

However, it is essential to acknowledge that the advice provided was generic and not tailored to the individual's specific medical or psychiatric history. Novel agents for insomnia were not included in the recommendations, and alternative formulations, such as prolonged-release medications, were not discussed. Other psychotropic agents, such as antipsychotics, were also not mentioned as possible sleep aids that a psychiatrist might consider.

These findings suggest that while ChatGPT offers valuable information and guidance on insomnia management, there is room for improvement in terms of tailoring advice to individual circumstances and considering emerging treatments and formulations for insomnia.

Discussion & Conclusion

AI chatbots like ChatGPT provide accessible and comprehensive insomnia advice, complementing traditional consultations for addressing time-constrained queries and the growing demand for healthcare information outside traditional settings. However, they lack the specificity required for personalized guidance, which often demands nuanced human understanding. Human providers remain crucial for tailored advice. In conclusion, AI chatbots show promise in modern healthcare, offering accessible, comprehensive information for insomnia management. They complement traditional consultations, empowering individuals with timely information, fostering a more informed approach to their health.

References

Sateia MJ, Buysse DJ, Krystal AD, Neubauer DN, Heald JL. (2017) Clinical practice guideline for the pharmacologic treatment of chronic insomnia in adults: an American Academy of Sleep Medicine clinical practice guideline. J Clin Sleep Med. 13(2):307–349.

Riemann D et al; (2017) European guideline for the diagnosis and treatment of insomnia. J Sleep Res. 26(6):675-700.

Campbell DJ, et al (2023). Evaluating ChatGPT responses on obstructive sleep apnea for patient education. J Clin Sleep Med. July 2023 (online)