Comparison of Large Language Models in Generating Patient Handouts for the Dermatology Clinic: A Blinded Study

    February 2024 in “ JAAD International ”
    Crystal Chang, Iesha L Ticknor, Jacob-Anthony Spinelli, Bhavnit K. Bhatia, Sangeeta Marwaha, Paradi Mirmirani, Anne M. Seidler, Jeremy R Man, Patrick E. McCleskey
    TLDR ChatGPT is preferred for creating dermatology patient handouts, but all models can be useful with oversight.
    This study evaluated the effectiveness of large language models (LLMs) like ChatGPT, Bard, and BingAI in generating patient handouts for dermatology topics, including dermatitis, alopecia, and dyspigmentation. ChatGPT was most preferred by dermatologists, ranking first in 46.3% of cases, particularly for dermatitis and alopecia, while BingAI was slightly favored for dyspigmentation. ChatGPT and BingAI outperformed Bard in understandability based on the Patient Education Materials Assessment Tool (PEMAT). BingAI achieved the closest approximation to a sixth-grade reading level using the Simple Measure of Gobbledygook (SMOG). Despite some limitations, such as a small number of reviewers, the study suggests that LLMs can produce understandable and accurate handouts with oversight, highlighting the potential for these models in clinical settings.
    Discuss this study in the Community →

    Related Community Posts Join

    6 / 1000+ results

      community 7 Month Hair Progress (0.5 mg dut only, diffuse thinning)

      in Progress Pictures  710 upvotes 2 years ago
      An 18-year-old male switched from topical finasteride and minoxidil to oral dutasteride for diffuse hair loss and saw improvement without side effects, despite experiencing scalp itch and shedding. Commenters noted significant hair regrowth and were surprised by his young age and appearance.

      community [28M] 10 months on fin/min, 3 months using nizoral regularly

      in Progress Pictures  125 upvotes 2 years ago
      The user "DaysonDadum" shared their progress pictures after using finasteride and minoxidil for 10 months, along with regularly using Nizoral. They experienced positive results with no noticeable shedding and no side effects. Other users in the conversation asked about dosages and brands of the treatments.

      community Request for advice, feedback...

      in Chat  2 upvotes 9 months ago
      The conversation discusses hair loss treatments for a woman experiencing androgenetic alopecia and seborrheic dermatitis, with suggestions including low-dose oral minoxidil, dutasteride, and hormone replacement therapy. The user is seeking advice due to intolerance to spironolactone and topical minoxidil, and concerns about low testosterone and DHT levels.

      community Only 1.5 months into treatment - is this normal or too fast?

      in Progress Pictures  16 upvotes 2 months ago
      A 21-year-old started treatment for androgenetic alopecia and seborrheic dermatitis with oral finasteride, topical minoxidil, anti-dandruff shampoo, and a corticosteroid solution. After 1.5 months, they noticed increased hair density and are considering switching to oral minoxidil due to scalp issues.

    Similar Research

    5 / 1000+ results