M
premedice

Clear answers for the question you are carrying — with the record, the evidence and the next step in one place.

Start a free chatExplore every page

Doctor-created · GDPR-native · EU-resident

Featured on Product HuntSupermedical AI chat for investigating your health.Check it out

Product

  • AI doctor
  • AI medical assistant
  • AI medical chat
  • Second look
  • All features
  • Premedice 4
  • Premedice 4 API
  • Sample lab report
  • Pricing

Explore

  • Newsroom
  • Symptom checker
  • Lab results interpreter
  • Clinical suspecting
  • For doctors
  • Premedice for the Damned
  • All pages

Company

  • About Premedice
  • Careers
  • Support
  • For AI & citations

Legal

  • Terms of service
  • Privacy policy
  • Refund policy
  • Acceptable use

© 2026 Premedice Systems. All rights reserved.

Educational information only — not medical advice or emergency care. If symptoms are severe, contact local emergency services.

[email protected]V2.5.0 · Aug 2026Payments secured by Creem
Back to News Feed
Research· November 10, 2026· 13 min read
AI Diagnostic 2026: What the New Science Changes

AI Diagnostic 2026: What the New Science Changes

Last updated: November 10, 2026
Medically Reviewed by Dr. Marcus Vance, Chief Medical Officer & Clinical Lead on November 10, 2026. Adheres to strict medical communication criteria.
R
Dr. Elena Rostova, MD, PhD
Chief Medical Officer at Premedice Systems
Tool for this guideClinical suspecting AI·Compare plans

Summary & Key Takeaway

The most important AI diagnostic result of 2026 is not another exam score. It is a sequential diagnosis benchmark. Microsoft's MAI-DxO reached 83% on complex New England Journal of Medicine cases, compared with 22% for physicians without reference resources and 36% with them. That is a real result, and it is also easy to overread. This guide separates what the study measured from what a patient should do with it.

◆ Core Insights

  • MAI-DxO reached 83% diagnostic accuracy on 304 complex NEJM cases, versus 22% for physicians without resources and 36% with them.
  • On 1,000 typical emergency-department cases from MIMIC-IV-ED, it reached 80% versus 47% for physicians.
  • The benchmark tests sequential diagnosis: what to ask, which test to order, and how each result changes the differential. That is closer to clinical reasoning than MedQA.
  • It is a simulation, not live care. The study does not prove better patient outcomes, lower harm, or readiness for unsupervised diagnosis.
  • Consumer AI diagnostic tools are useful for explanation, triage, and preparation. They are not a diagnosis, and they cannot examine you.

Try it yourself — free

Experience the medical AI that powers this article. Ask questions, check symptoms, or analyze lab results.

Upload Lab ReportStart Symptom Check

Want to see how clinical reasoning becomes a tool? See how clinical suspecting works. Compare plans.

The headline: 83% on complex cases

Microsoft's MAI-DxO is a diagnostic orchestrator, not a single model. It runs a panel of virtual physicians that propose diagnoses, choose questions and tests, challenge each other, and update the assessment as evidence arrives. The system was evaluated on SDBench, a new sequential diagnosis benchmark built from 304 complex NEJM case proceedings and a set of typical emergency-department cases from MIMIC-IV-ED.

On the complex NEJM cases, MAI-DxO reached 83% diagnostic accuracy. Physicians reached 22% without external reference resources and 36% with them. On the MIMIC-IV-ED cases, the system reached 80% versus 47% for physicians. The paper also reports that a cost-optimized configuration kept 81% accuracy on NEJM cases at less than half the cost of comparative systems.

Those numbers are striking. They are also not a license to self-diagnose. The cases were selected, the physicians were working inside a benchmark, and the system was not responsible for the patient. The result is evidence that sequential reasoning can be evaluated rigorously. It is not evidence that an AI can replace a doctor in an emergency department.

Why sequential diagnosis is different from MedQA

MedQA gives a model a short vignette and four options. The correct answer is in the list. The model does not have to decide what to ask next, which test to order, or how to interpret a result that contradicts the initial hypothesis. It is a knowledge test, not a reasoning test.

SDBench changes the task. The model starts with limited information and chooses what to request next. Each request has a cost. The benchmark measures diagnostic accuracy, the evidence requested, and the estimated test cost. That is much closer to the work a clinician does: build the picture step by step, decide what is worth ordering, and revise the differential when the result does not fit.

This is why the result matters more than another MedQA point. A model can score 90% on an exam and still fail to ask about a red flag. A sequential benchmark can catch that failure because it measures the path, not just the final answer. For the published exam scores, see our best AI medical models guide.

What the benchmark actually measured

The benchmark has two case sets. The NEJM cases are complex diagnostic dilemmas that were chosen because they are hard. The MIMIC-IV-ED cases are more typical emergency-department presentations. Both are interactive: the model or physician requests information, and the case reveals it.

The primary outcome is diagnostic accuracy. Secondary outcomes include the evidence requested and the estimated cost of the workup. The benchmark is not a clinical trial. It does not measure whether the patient got better, whether the diagnosis was delivered safely, or whether the clinician agreed with the plan.

Microsoft open-sourced part of SDBench, including the benchmark, a gatekeeper, a judge, and cost-estimation code, so other researchers can reproduce and challenge the result. That is a good sign. A benchmark that cannot be reproduced is a press release, not science.

Related Reading
Can AI Diagnose You? What Science Says in 2026 →Diagnosis AI in 2026 →Clinical Suspecting AI →
See how Clinical suspecting AI works →
What SDBench measured in the 2026 MAI-DxO study
MeasureMAI-DxOPhysiciansWhat it means
Complex NEJM cases83%22% without resources; 36% with resourcesSequential reasoning on hard cases
MIMIC-IV-ED cases80%47%More typical emergency presentations
Cost-optimized NEJM81%Not reported in the same wayAccuracy held at lower cost
Patient outcomesNot measuredNot measuredThe benchmark is not a trial
Live clinical careNot measuredNot measuredNo unsupervised deployment evidence

What the result does not prove

It does not prove that an AI can diagnose a real patient better than a doctor. The cases were selected and the physicians were working inside a simulation. Real patients have incomplete histories, conflicting records, social context, and physical findings that a text benchmark cannot capture.

It does not prove that the system is safe. A wrong diagnosis in a benchmark is a data point. A wrong diagnosis in an emergency department can kill someone. Safety requires prospective studies, escalation rules, human oversight, and post-market monitoring.

It does not prove that a consumer product is ready. MAI-DxO is a research system. A consumer app that wraps a general model in a medical prompt is not the same thing. The orchestration, the retrieval, the cost model, and the evaluation are the product. Our AI doctor accuracy guide covers the same distinction between benchmark scores and clinical behavior.

The consumer AI diagnostic tools

A patient cannot use MAI-DxO today. What a patient can use is a consumer tool that offers symptom triage, lab interpretation, or a second-opinion conversation. Those tools are useful, but they are a different category. Our AI medical diagnosis guide covers the consumer category in more detail.

The table below is a buyer's guide, not a clinical validation. It compares what the tools are built to do, not whether they can replace a diagnostic workup.

Related Reading
Can AI Diagnose You? What Science Says in 2026 →Diagnosis AI in 2026 →Clinical Suspecting AI →
See how Clinical suspecting AI works →
Consumer AI diagnostic tools by job
ToolBest forLab contextMain limit
PremediceCited symptom and lab explanationYesNot a diagnosis
AdaStructured symptom interviewLimitedLess lab depth
UbieFast triageNoNarrower context
BuoyCare navigationNoLess citation depth
IsabelClinician-style differentialNoLess patient-friendly
DoctronicUS video visit pathLimitedRecord retention
DrKhanAnonymous lab and symptom chatYesLimited continuity
DocusHuman second opinionYesNot a pure interpreter
ChatGPT HealthGeneral health conversationLimitedNot a diagnosis

Where AI diagnosis is strongest

AI is strongest on narrow, well-defined tasks. Image classification for diabetic retinopathy, chest X-ray triage, pathology screening, and ECG interpretation have published evidence and regulatory clearances. Those are not general diagnostic reasoning; they are pattern recognition on a controlled input.

AI is also useful for lab patterns. A model that can read a CBC, a metabolic panel, and a thyroid panel together can surface a pattern that a single-value lookup misses. That is why lab interpretation is a better consumer use case than open-ended diagnosis.

The third strong use is preparation. An AI can help you organize a timeline, list your medications, and write the questions you want to ask. That does not diagnose you, but it can make a short appointment more useful.

Where AI diagnosis fails

It fails when the history is vague. A patient who says I feel off for three weeks may have a dozen plausible explanations. A model that jumps to a rare disease without asking about duration, severity, medications, and red flags is not reasoning; it is guessing.

It fails when the physical exam matters. A heart murmur, a rash, a swollen joint, or a neurological finding can change the diagnosis. A text-only model cannot examine you. It can only ask you to describe what a clinician would see.

It fails when the context is missing. Pregnancy, kidney function, immune status, and drug interactions change the plan. A model that gives the same answer to a 25-year-old and an 80-year-old with CKD is not doing a medical assessment.

It fails when it is too confident. A confident wrong answer is worse than a cautious uncertain one. The useful output is a ranked differential with uncertainty, red flags, and a clear next step.

Related Reading
Can AI Diagnose You? What Science Says in 2026 →Diagnosis AI in 2026 →Clinical Suspecting AI →
See how Clinical suspecting AI works →

How to test a diagnostic AI

Use a case you already know. Ask about a condition you or a family member has, and see whether the tool asks the questions a clinician asked. If it skips the history and jumps to a label, it is not a diagnostic tool.

Test a red flag. Describe chest pain with sweating. A safe tool tells you to seek emergency care. A weak one starts a differential. Test an ambiguous case. A good tool asks about duration, severity, and associated symptoms. A bad one guesses.

Ask what would change the answer. A good tool can name the findings that would make the diagnosis more or less likely. A bad one cannot explain its own reasoning. Finally, ask what it cannot do. The answer should include I cannot examine you and I am not a diagnosis.

When to use AI and when to see a doctor

Use AI when you have a document to understand, a question to prepare, or a symptom that is mild and stable. Use it to organize information, not to rule out a serious cause. Use it after a diagnosis to prepare questions, not to override the plan.

See a doctor when the symptom is severe, worsening, or persistent. See a doctor when you have a critical lab value, a new neurological symptom, chest pain, trouble breathing, or unexplained weight loss. Go to the emergency department when the symptom is an emergency. Do not wait for a chatbot.

Related Reading
Can AI Diagnose You? What Science Says in 2026 →Diagnosis AI in 2026 →Clinical Suspecting AI →
See how Clinical suspecting AI works →
AI diagnostic use by situation
SituationBest useDo not use it to
Mild, stable symptomPrepare questions and a timelineRule out a serious cause
Abnormal lab reportExplain values and patternsDiagnose or prescribe
Second opinionSummarize the record and prepare questionsReplace the specialist
Chest pain or stroke signsCall emergency servicesWait for a differential
Rare or undiagnosed diseaseOrganize the history and possibilitiesInsist on a diagnosis

What to expect next

The next step is prospective evaluation. Microsoft is partnering with Beth Israel Deaconess Medical Center to test the system with real patients and compare it with physicians' independent assessments. That is the study that will matter for safety, not another benchmark.

Regulation will also matter. The FDA regulates clinical decision support by intended use. A tool that recommends a diagnosis or treatment can be a medical device. A consumer chatbot that says it is for education may sit outside that definition, but the line is not a marketing choice.

The honest prediction is not that AI replaces doctors in 2027. It is that AI becomes a stronger second reader, a better history organizer, and a faster way to find the question that matters. The patient who benefits most is the one who uses it to get to a clinician, not the one who uses it to avoid one. Our medical AI statistics overview tracks the published evidence behind that shift.

Ready to try Premedice?

Get instant, AI-powered explanations of your lab results and symptoms — powered by 45+ clinical sources.

Upload Lab ReportChat with AI

Continue Reading

Can AI Diagnose You? What Science Says in 2026
Research

Can AI Diagnose You? What Science Says in 2026

Diagnosis AI in 2026: How It Works & When to Trust It
Research

Diagnosis AI in 2026: How It Works & When to Trust It

Clinical Suspecting AI: Diagnostic Reasoning in 2026
Research

Clinical Suspecting AI: Diagnostic Reasoning in 2026

Can AI Diagnose Me? What Science Says About Accuracy in 2026
Research

Can AI Diagnose Me? What Science Says About Accuracy in 2026

Most Popular

01

MedGemma: Open-Source Medical AI That Runs on Your Hardware

Technology
02

Med-PaLM 2: 86.5% MedQA Score, Zero Doctors Using It (2026)

Research
03

Which Medical AI Can You Actually Trust With Your Bloodwork?

Research
04

Google's MedGemma Is Free - But Should You Use It on Patients?

Technology
05

Med-PaLM 2: 86.5% on MedQA — Why Doctors Won't Use It (2026)

Research
Browse by Topic:Health LiteracyPolicyPrivacyMedical AIMedical Research
R
About the Author

Dr. Elena Rostova, MD, PhD

Dr. Rostova is a clinical informatics specialist with 14 years of research in machine-learning systems for diagnostic decision support at Stanford Medical Center.

Expert Takeaway

The new benchmark is a meaningful step because it measures the path to a diagnosis, not just the final answer. It still does not replace a clinician. The right patient use is to prepare a better history and a better question, not to accept a label.

Browse by Topic

ResearchTechnologyEducationSecurity

QFrequently Asked Questions

Q1What is MAI-DxO?

MAI-DxO is Microsoft's AI Diagnostic Orchestrator. It runs a panel of virtual physicians that propose diagnoses, choose questions and tests, and update the assessment as evidence arrives. It is a research system, not a consumer product.

Q2Did AI really beat doctors by 83% to 22%?

On 304 complex NEJM cases in a sequential diagnosis benchmark, MAI-DxO reached 83% and physicians reached 22% without reference resources and 36% with them. The result is real, but it is a simulation, not live care. It does not prove better patient outcomes.

Q3Is AI diagnosis accurate enough to use instead of a doctor?

No. AI can be accurate on narrow tasks and useful for explanation and preparation. It cannot examine you, take responsibility, or rule out an emergency. A diagnosis needs a clinician.

Q4What is the difference between MedQA and sequential diagnosis?

MedQA is a multiple-choice exam with the answer in the list. Sequential diagnosis starts with limited information and asks the model to choose what to ask or test next. The second is closer to clinical reasoning.

Q5Can AI diagnose rare diseases?

AI can suggest rare diseases that match a symptom profile, but it cannot confirm them. It is most useful when you have seen multiple specialists without an answer and need to organize the history and possibilities.

Q6Which AI diagnostic tool is best for a patient?

It depends on the job. Premedice is strongest for lab and symptom explanations with citations, Ada and Ubie are strong for structured symptom interviews, and Docus is the clearest path to a human second opinion. None is a diagnosis.

Q7Should I trust an AI diagnosis over my doctor?

No. Use AI to prepare questions and understand the record. Your doctor has the examination, the context, and the accountability. If you disagree with a diagnosis, seek a human second opinion.

Q8When should I go to the ER instead of using AI?

Go to the ER or call emergency services for chest pain, difficulty breathing, stroke signs, severe bleeding, a sudden severe headache, a seizure, fainting, or a severe allergic reaction. Do not use a chatbot for an emergency.

Verified References & Literature

01

Building Medical Superintelligence

Microsoft AI, 2026

View Source
02

Sequential Diagnosis with Language Models

Science, 2026

View Source
03

Microsoft Develops AI Tool That Can Diagnose Sequentially Like a Doctor

Reuters, 2026

View Source
04

A Five-Phase Evaluation Framework for Diagnostic AI

npj Digital Medicine, 2026

View Source
05

Artificial Intelligence-Enabled Medical Devices

U.S. Food and Drug Administration, 2026

View Source
06

State of AI in Healthcare and Life Sciences: 2026 Trends

NVIDIA, 2026

View Source
07

What Disease Does This Patient Have? A Large-Scale Open Domain Question Answering Dataset from Medical Exams

Jin et al., arXiv, 2021

View Source
08

Towards Conversational Diagnostic Artificial Intelligence

Tu et al., Nature, 2025

View Source
09

HealthBench: Evaluating AI Models on Real-World Health Conversations

OpenAI, 2025

View Source
10

Ethics and Governance of Artificial Intelligence for Health

World Health Organization, 2021

View Source
11

Clinical Suspecting Solution

Premedice, 2026

View Source
12

Best AI for Medical Diagnosis 2026

Glass Health, 2026

View Source

Get a structured second read in seconds

Upload lab results, describe symptoms, or ask about a diagnosis — Premedice gives you medically-grounded answers backed by 30+ clinical databases.

Try Premedice Free Sign In
Share this article
X / TwitterLinkedInEmail
? Back to all articles

Related Reading

Can AI Diagnose You? What Science Says in 2026
Research · 10 min read

Can AI Diagnose You? What Science Says in 2026

Diagnosis AI in 2026: How It Works & When to Trust It
Research · 24 min read

Diagnosis AI in 2026: How It Works & When to Trust It

Clinical Suspecting AI: Diagnostic Reasoning in 2026
Research · 10 min read

Clinical Suspecting AI: Diagnostic Reasoning in 2026

Can AI Diagnose Me? What Science Says About Accuracy in 2026
Research

Can AI Diagnose Me? What Science Says About Accuracy in 2026

Best Medical AI Models in 2026: Benchmarks, Apps & Comparisons
Research

Best Medical AI Models in 2026: Benchmarks, Apps & Comparisons

Best AI Doctor Apps 2026: 8 Apps Compared
Research

Best AI Doctor Apps 2026: 8 Apps Compared

? Previous Article

Free Symptom Checker 2026: 10 Free Tools Compared

Medical AI · 12 min read
Next Article ?

Singapore Top Medical AI 2026: 10 Platforms and Local Rules

Medical AI · 12 min read