Assessing Facial Symmetry and Attractiveness using Augmented Reality

• DOI: 10.1007/s10044-021-00975-z
• Publication Date: 2021-03-28T10:02:21Z
• Authors: Wei Wei; Edmond S. L. Ho; Kevin D. McCay; Robertas Damaševi...; Rytis Maskeliūnas; Anna Esposito
• Keywords: 0906 Electrical and Electronic Engineering; G400; 0801 Artificial Intelligence and Image Processing; 0202 electrical engineering, electronic engineering, information engineering; Artificial Intelligence & Image Processing; Augmented reality; Facial analysis; Facial symmetry; Mobile app; 02 engineering and technology; G600; 0802 Computation Theory and Mathematics

AbstractFacial symmetry is a key component in quantifying the perception of beauty. In this paper, we propose a set of facial features computed from facial landmarks which can be extracted at a low computational cost. We quantitatively evaluated the proposed features for predicting perceived attractiveness from human portraits on four benchmark datasets (SCUT-FBP, SCUT-FBP5500, FACES and Chicago Face Database). Experimental results showed that the performance of the proposed features is comparable to those extracted from a set with much denser facial landmarks. The computation of facial features was also implemented as an augmented reality (AR) app developed on Android OS. The app overlays four types of measurements and guidelines over a live video stream, while the facial measurements are computed from the tracked facial landmarks at run time. The developed app can be used to assist plastic surgeons in assessing facial symmetry when planning reconstructive facial surgeries.