AI-based face transformation in patient seizure videos for privacy protection

authors

• Hou Jen-Cheng
• Li Chin-Jou
• Chou Chien-Chen
• Shih Yen-Cheng
• Fong Si-Lei
• Dufau Stephane
• Lin Po-Tso
• Tsao Yu
• Mcgonigal Aileen
• Yu Hsiang-Yu

keywords

• Epilepsy
• Video

document type

abstract

Objective: To investigate feasibility and accuracy of artificial intelligence (AI) methods of facial deidentification in hospital-recorded epileptic seizure videos, for improved patient privacy protection while preserving clinically important features of seizure semiology. Patients and Methods: Videos of epileptic seizures displaying seizure-related involuntary facial changes were selected from recordings at Taipei Veterans General Hospital Epilepsy Unit (between 1 Aug 2020 and 28 Feb 2023), and a single representative video frame prepared per seizure. We tested 3 AI transformation models: (1) morphing the original facial image with a different male face, (2) substitution with a female face and (3) cartoonization. Facial deidentification and preservation of clinically relevant facial detail were calculated based on (1) scoring by 5 independent expert clinicians and (2) objective computation. Results: According to clinician scoring of 26 facial frames in 16 patients, the best compromise between deidentification and preservation of facial semiology was the “cartoonization” model. A male facial morphing model was superior to the cartoonization model for deidentification, but clinical detail was sacrificed. Objective similarity testing of video data showed deidentification scores in agreement with clinicians’ scores; however, preservation of semiology gave mixed results likely due to inadequate existing comparative databases. Conclusion: AI-based face transformation of medical seizure videos is feasible and may be useful for patient privacy protection. In our study the cartoonization approach provided the best compromise between deidentification and preservation of seizure semiology.

more information