Dermacen Analytica: A Novel Methodology Integrating Multi-Modal Large Language Models with Machine Learning in Tele-Dermatology
March 2024
in “
arXiv (Cornell University)
”
TLDR The new AI system improves remote skin condition diagnosis and access to care.
The paper presents a novel AI-empowered system that integrates large language models and machine learning to assist in diagnosing skin conditions in dermatology. This methodology combines transformer-based vision models and machine learning tools to simulate a dermatologist's workflow, achieving a nuanced interpretation of dermatological conditions. The system's performance was validated using publicly available medical case studies and images, achieving scores of 0.87 for both contextual understanding and diagnostic accuracy. This approach is expected to enhance tele-dermatology applications, improving remote consultation capabilities and access to care, particularly in underserved areas.