Clinical case: “A 68-year-old male presents with fatigue, shortness of breath, and ankle swelling. His history includes hypertension and coronary artery disease. Lab results show elevated BNP and low ejection fraction.”

• Deep Vein Thrombosis (DVT) • Congestive Heart Failure (CHF)

• Chronic obstructive pulmonary disease (COPD) • Hepathic Cirrhosis

What a physician diagnoses

Symptoms
Suggestive of heart failure

History and risk factors
CAD, hypertension

Lab results (BNP↑, EF↓)
Confirm heart failure

✅ Final diagnosis
Congestive Heart Failure (CHF)

What an LLM generates

“The patient may be experiencing chronic obstructive pulmonary disease (COPD), given symptoms of shortness of breath and fatigue”

Potential pitfalls
• Domain knowledge
• Multi-step and causal reasoning
• Probabilistic reasoning
• ...