AI and Neurological Rare & Neuroimmune Diseases ── Multiple sclerosis ── 2026-11-13
Multiple sclerosis: treatment, trials and AI
- Abstract
BACKGROUND: Early diagnosis and intervention are crucial in multiple sclerosis (MS), yet diagnostic delays are common. Large language models (LLMs) such as generative pre-trained transformers (GPTs) may streamline diagnostic workflows by extracting MS diagnostic signals from clinical notes. OBJECTIVE: To derive MS diagnosis status from the first neurology note using a computable algorithm based on the 2017 McDonald criteria and applying GPT-4 for node-level reasoning within a structured decision framework. METHODS: We analyzed the first neurology notes from 125 randomly selected patients (people with MS, related disorders, and controls) enrolled in a clinic-based cohort between 2017 and 2023. We included the clinical history and diagnostic testing sections but redacted the assessment and plan. We converted the 2017 McDonald criteria into a decision tree and provided expert-curated clinical knowledge to guide GPT-4 reasoning at each decision node. GPT-4 generated binary decisions at each node to traverse the tree and assign MS diagnoses at terminal nodes. We evaluated performance against neurologist-assessed diagnoses and characterized hallucination types (non-factual, incongruent, irrelevant, over-reliant, and logical reasoning errors). RESULTS: In this study cohort (mean age 40±12 years; 81% women) representative of the clinic population, GPT-4 performed well in predicting MS diagnosis (84% accuracy, 79% precision, 74% recall, 91% specificity) using first neurology notes. Hallucinations occurred in 32 cases (26%), most commonly incoherence (75%) and overreliance (47%). CONCLUSION: A structured, LLM-guided decision framework can identify MS diagnoses from early clinical documentation. Large-scale studies are needed to mitigate hallucinations, validate this approach, and test implementation in clinical settings.
Journal IF-equivalent: 2.6 (OpenAlex 2-year mean citedness, value as of 2026-11-12, retrieved 2026-11-13; not the official Clarivate IF)Reference: Venkatesh S, DelSignore M, Wu X, Morris M, Kerr WT, Visweswaran S, et al. Large language model–enhanced decision tree framework for identifying multiple sclerosis diagnoses from clinical documentation. Mult Scler Relat Disord. 2027 Jan;117:108024. doi:10.1016/j.msard.2026.108024. PMID: 43014132.Checked: Abstract only