Differences in the annotation between facial images and videos for training an artificial intelligence for skin type determination

  • Background The Grand-AID research project, consisting of GRANDEL-The Beautyness Company, the dermatology department of Augsburg University Hospital and the Chair of IT Infrastructure for Translational Medical Research at Augsburg University, is currently researching the development of a digital skin consultation tool that uses artificial intelligence (AI) to analyze the user's skin and ultimately perform a personalized skin analysis and a customized skin care routine. Training the AI requires annotation of various skin features on facial images. The central question is whether videos are better suited than static images for assessing dynamic parameters such as wrinkles and elasticity. For this purpose, a pilot study was carried out in which the annotations on images and videos were compared. Materials and Methods Standardized image sequences as well as a video with facial expressions were taken from 25 healthy volunteers. Four raters with dermatological expertise annotated eightBackground The Grand-AID research project, consisting of GRANDEL-The Beautyness Company, the dermatology department of Augsburg University Hospital and the Chair of IT Infrastructure for Translational Medical Research at Augsburg University, is currently researching the development of a digital skin consultation tool that uses artificial intelligence (AI) to analyze the user's skin and ultimately perform a personalized skin analysis and a customized skin care routine. Training the AI requires annotation of various skin features on facial images. The central question is whether videos are better suited than static images for assessing dynamic parameters such as wrinkles and elasticity. For this purpose, a pilot study was carried out in which the annotations on images and videos were compared. Materials and Methods Standardized image sequences as well as a video with facial expressions were taken from 25 healthy volunteers. Four raters with dermatological expertise annotated eight features (wrinkles, redness, shine, pores, pigmentation spots, dark circles, skin sagging, and blemished skin) with a semi-quantitative and a linear scale in a cross-over design to evaluate differences between the image modalities and between the raters. Results In the videos, most parameters tended to be assessed with higher scores than in the images, and in some cases significantly. Furthermore, there were significant differences between the raters. Conclusion The present study shows significant differences between the two evaluation methods using image or video analysis. In addition, the evaluation of the skin analysis depends on subjective criteria. Therefore, when training the AI, we recommend regular training of the annotating individuals and cross-validation of the annotation.show moreshow less

Download full text files

Export metadata

Statistics

Number of document requests

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Gabriele Maria Lehner, Laura Gockeln, Bettina Marie Naber, Janis Raphael Thamm, Sandra Schuh, Gabriel Duttler, Anna Rottenkolber, Dennis Hartmann, Frank KramerORCiDGND, Julia WelzelORCiDGND
URN:urn:nbn:de:bvb:384-opus4-1122819
Frontdoor URLhttps://opus.bibliothek.uni-augsburg.de/opus4/112281
ISSN:0909-752XOPAC
ISSN:1600-0846OPAC
Parent Title (English):Skin Research and Technology
Publisher:Wiley
Type:Article
Language:English
Year of first Publication:2024
Publishing Institution:Universität Augsburg
Release Date:2024/04/05
Tag:Dermatology
Volume:30
Issue:3
First Page:e13632
DOI:https://doi.org/10.1111/srt.13632
Institutes:Fakultät für Angewandte Informatik
Fakultät für Angewandte Informatik / Institut für Informatik
Medizinische Fakultät
Fakultät für Angewandte Informatik / Institut für Informatik / Lehrstuhl für IT-Infrastrukturen für die Translationale Medizinische Forschung
Medizinische Fakultät / Universitätsklinikum
Medizinische Fakultät / Lehrstuhl für Dermatologie
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
6 Technik, Medizin, angewandte Wissenschaften / 61 Medizin und Gesundheit / 610 Medizin und Gesundheit
Licence (German):CC-BY-NC-ND 4.0: Creative Commons: Namensnennung - Nicht kommerziell - Keine Bearbeitung (mit Print on Demand)