Comprehensive Summary
This cross-sectional study by Wongvibulsin et al. examines the accuracy and reliability of current dermatology-focused mobile applications. Using data from November to December 2023, 41 apps from both Apple and Android app stores were selected by three separate investigators. Criteria applied included the app’s purpose, audience, claims, data availability, and inclusion of AI algorithms. Results indicated that only 14.6% of current Dermatology Applications included data availability, and, out of the 24.4% that claimed diagnostic capability, no app had scientific evidence to support its accuracy. Furthermore, less than 13% of the apps were supported by peer-reviewed journal publications. Additionally, only two out of the fourteen U.S.-based apps included information regarding its lack of US Food and Drug administration approval; similarly, only two of the fourteen European based apps achieved the “CE Mark” status. In regards to the apps’ data storage, about 50% of the apps did not provide any information about the usage of the user-submitted data. Overall, the findings showcase an absence of transparency and a lack of accuracy among AI-based dermatology applications.
Outcomes and Implications
With the current upsurge in consumer-dependency on AI mobile applications to conduct skin examinations, reliability levels are of high importance. Due to the lack of approval from the US Food and Drug Administration and ambiguity amongst certain criteria, there is a need to standardize the qualifications for such mobile applications to be of us by and for the general public. The study specifically examines the discrepancy among the 4 apps regarding the AI algorithm included, the presence of supporting publications, the management of user-submitted images, and datasets used. There is an extreme desire to take advantage of AI dermatology-focused mobile applications to positively contribute to patients’ lives, this cannot be achieved while the aforementioned concerns remain high. To meet this growing need and public desire, standardization of app content and a rigorous approval process are necessary.