ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understanding

ClinFusion is a new vision-centric multimodal medical LLM for understanding both 2D and native 3D medical images.

It introduces a cascaded vision encoder with a fusion operator, plus new evaluation methods for instruction following and report generation.

The model reportedly beats leading open-source and some proprietary medical systems on many benchmarks, including MedIF-Bench.

Radiologists also gave its generated reports strong blinded quality ratings, suggesting more clinically useful outputs.