System Maintenance Notice

Please note that maintenance work is scheduled between 4 AM and 5 AM - CET. During this time, you may experience reduced performance. Thanks for your patience.

Publications

Journal Article Epublish

PubMed: 40665965 DOI: 10.1017/cts.2025.10064

Integrating large language models in biostatistical workflows for clinical and translational research.

J Clin Transl Sci 9(1):e131

Authors: Steven C Grambow, Manisha Desai, Kevin P Weinfurt, Christopher J Lindsell, Michael J Pencina, Lacey Rende, Gina-Maria Pomann

Affiliations

  • Department of Biostatistics and Bioinformatics, Duke University School of Medicine, Durham, NC, USA.
  • Department of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
  • Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA.

Abstract

Introduction

Biostatisticians increasingly use large language models (LLMs) to enhance efficiency, yet practical guidance on responsible integration is limited. This study explores current LLM usage, challenges, and training needs to support biostatisticians.

Methods

A cross-sectional survey was conducted across three biostatistics units at two academic medical centers. The survey assessed LLM usage across three key professional activities: communication and leadership, clinical and domain knowledge, and quantitative expertise. Responses were analyzed using descriptive statistics, while free-text responses underwent thematic analysis.

Results

Of 208 eligible biostatisticians (162 staff and 46 faculty), 69 (33.2%) responded. Among them, 44 (63.8%) reported using LLMs; of the 43 who answered the frequency question, 20 (46.5%) used them daily and 16 (37.2%) weekly. LLMs improved productivity in coding, writing, and literature review; however, 29 of 41 respondents (70.7%) reported significant errors, including incorrect code, statistical misinterpretations, and hallucinated functions. Key verification strategies included expertise, external validation, debugging, and manual inspection. Among 58 respondents providing training feedback, 44 (75.9%) requested case studies, 40 (69.0%) sought interactive tutorials, and 37 (63.8%) desired structured training.

Conclusions

LLM usage is notable among respondents at two academic medical centers, though response patterns likely reflect early adopters. While LLMs enhance productivity, challenges like errors and reliability concerns highlight the need for verification strategies and systematic validation. The strong interest in training underscores the need for structured guidance. As an initial step, we propose eight core principles for responsible LLM integration, offering a preliminary framework for structured usage, validation, and ethical considerations.

MeSH

Language, Biomedical Research, Translational Research, Biomedical, Workflow, Academic Medical Centers, Research, Artificial Intelligence