Dermacen Analytica: A Novel Methodology Integrating Multi-Modal Large Language Models with Machine Learning in Tele-Dermatology

    March 2024 in “ arXiv (Cornell University)
    Dimitrios P. Panagoulias, Evridiki Tsoureli‐Nikita, Maria Virvou, George A. Tsihrintzis
    TLDR The new AI system improves remote skin condition diagnosis and access to care.
    The paper presents a novel AI-empowered system that integrates large language models and machine learning to assist in diagnosing skin conditions in dermatology. This methodology combines transformer-based vision models and machine learning tools to simulate a dermatologist's workflow, achieving a nuanced interpretation of dermatological conditions. The system's performance was validated using publicly available medical case studies and images, achieving scores of 0.87 for both contextual understanding and diagnostic accuracy. This approach is expected to enhance tele-dermatology applications, improving remote consultation capabilities and access to care, particularly in underserved areas.
    Discuss this study in the Community →