A study benchmarks eight open-source small language models for emergency department decision support, addressing privacy concerns by keeping patient data local. Researchers evaluated zero-shot prompting, prefix tuning, LoRA, and full fine-tuning across triage prediction, referral recommendations, and diagnosis tasks using MIMIC-IV-ED data. The results show that LoRA fine-tuned open-source models surpass commercial baselines like Claude Haiku and Sonnet in triage level prediction accuracy.
- LoRA fine-tuning of open-source SLMs beats commercial LLMs on ED triage tasks
- Local deployment solves privacy risks associated with transmitting patient data externally
- Study uses MIMIC-IV-ED dataset with 2,083 cases for robust evaluation
- LoRA offers a practical balance of performance and efficiency for clinical SLMs