Multimodal Deep Learning Model for Multi-task Diagnosis and Triage Suggestions of Ophthalmic Diseases

Multimodal Vision-language Model for Multi-task Diagnosis and Triage Suggestions of Ophthalmic Diseases Patients presenting with complaints of anterior segment diseases first complete a slit-lamp examination or take a mobile phone eye photograph. A multimodal vision-language model uses patient-related images (such as selfies and eye exam photos) to make an intelligent diagnosis. The diagnosis is kept private. The patient then seeks medical attention and undergoes a clinical examination by an experienced clinician. A second experienced clinician then reviews the clinical diagnosis. If the diagnosis agrees, it is considered the gold standard. If there is a discrepancy in the diagnosis, the consensus between the two clinicians is used as the gold standard.