Journal Article Review Epublish 4 citations
PubMed: 41662115 DOI: 10.1371/journal.pmen.0000488
Generative multimodal large language models in mental health care: Applications, opportunities, and challenges.
PLOS Ment Health 2(11):e0000488
Authors: Ariel Soares Teles, Jaya Chaturvedi, Tao Wang, Marcia Scazufca, Yamiko Msosa, Daniel Stahl, Angus Roberts
Affiliations
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom. Campus Araioses, Federal Institute of Maranhão, Araioses, Maranhão, Brazil.
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom.
- Hospital das ClÃnicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, São Paulo, Brazil.
Abstract
Generative Large Language Models (LLMs) are transforming mental health care by enabling the generation and understanding of human-like text with increasing nuance and contextual awareness. However, mental health is a complex, multidimensional domain that often requires richer sources of information beyond text. This narrative review explores the emerging role of Multimodal LLMs (MLLMs), which are models that integrate diverse input modalities such as speech, images, video, and physiological signals, to incorporate the multifaceted nature of mental states and human interactions. We first outline the foundational principles of MLLMs and their distinction from traditional text-only LLMs. We then synthesize recent empirical studies and experimental applications of MLLMs in mental health research and clinical settings, highlighting their potential to improve diagnostic accuracy, enable real-time monitoring, and support context-aware, personalized interventions. Finally, we outline opportunities for future research and innovation, and discuss key implementation challenges in MLLM-based mental health care.
MeSH
Language, Research, Mental Health