Capacity for large language model chatbots to aid in orthopedic management, research, and patient queries.

TitleCapacity for large language model chatbots to aid in orthopedic management, research, and patient queries.
Publication TypeJournal Article
Year of Publication2024
AuthorsSosa BR, Cung M, Suhardi VJ, Morse K, Thomson A, Yang HS, Iyer S, Greenblatt MB
JournalJ Orthop Res
Date Published2024 Jan 21
ISSN1554-527X
Abstract

Large language model (LLM) chatbots possess a remarkable capacity to synthesize complex information into concise, digestible summaries across a wide range of orthopedic subject matter. As LLM chatbots become widely available they will serve as a powerful, accessible resource that patients, clinicians, and researchers may reference to obtain information about orthopedic science and clinical management. Here, we examined the performance of three well-known and easily accessible chatbots-ChatGPT, Bard, and Bing AI-in responding to inquiries relating to clinical management and orthopedic concepts. Although all three chatbots were found to be capable of generating relevant responses, ChatGPT outperformed Bard and BingAI in each category due to its ability to provide accurate and complete responses to orthopedic queries. Despite their promising applications in clinical management, shortcomings observed included incomplete responses, lack of context, and outdated information. Nonetheless, the ability for these LLM chatbots to address these inquires has largely yet to be evaluated and will be critical for understanding the risks and opportunities of LLM chatbots in orthopedics.

DOI10.1002/jor.25782
Alternate JournalJ Orthop Res
PubMed ID38245845
Related Faculty: 
Matthew B. Greenblatt, M.D., Ph.D. He Sarina Yang, M.D., Ph.D.

Pathology & Laboratory Medicine 1300 York Avenue New York, NY 10065 Phone: (212) 746-6464
Surgical Pathology: (212) 746-2700