Facial Paresis Analysis
Team
Tim Büchner, Oliver Mothes, Sven SickertIntroduction
The human face is a complex and diverse part of the human body. All facial motions for individual mimics and emotional expressions are possible using 43 different muscles controlled respectively by one facial nerve on both halves of the face. However, this nerve can be injured by external or internal factors, which in turn can cause a facial palsy. A unilateral facial palsy essentially leads to a one-sided motor dysfunction of the facial muscles, a movement disorder. The resulting defective eye closure leads to the drying out of the eye, eye inflammation and visual impairment. The paralysis of the perioral musculature hinders regular dient and speech. Medical experts evaluate facial palsy in a subjective manner. But ideally, these functional deficits should be measured objectively by exploiting machine learning methods. The following projects tackle this task.
Project: Bridging the Gap – Mimics and Muscles
Time frame: 2019 – 2023The aim of the project is the synthesis of the facial surface model with a model of the facial muscles. High-resolution 3D video sequences, which are recorded synchronously together with electromyography sequences, are intended to facilitate understanding of the facial muscles. The resulting model should be used for an automatic objective evaluation of facial palsy.
Project: Irritationsfreies und emotionssensitives Trainingssystem (IRESTRA)
Time frame: 2016 – 2019The interaction between humans and machines is an ongoing research field in many scientific disciplines. To develop an optimal strategy for machines to interact with humans the interactions between humans can be used to detect signals for the mood of the interaction partner and react in an adequate way. Especially elderly people can benefit from an easy and intuitive handling of technical devices. The aim of the project is to develop an irritation free and non invasive emotion sensitive training device for elderly people and Facial Paresis patients. Older persons can use this system for memory training (e.g. person recognition), whereas paresis patients can do their daily facial training sessions with a direct feedback from the machine and motivation if necessary. Within this project these tasks are tackled by combining medical, psychological and neurological knowledge with machine learning and computer vision techniques both in 2D and 3D in coorperation with the Fraunhofer Institute for Applied Optics and Precision Engineering IOF, the Jena University Hospital (namely the Institute of Psychosocial Medicine and Psychological Therapy, the Department of Neurology and the Department of Otolaryngology) and the Department for General Psychology from the Friedrich Schiller University Jena.
Publications
Tim Büchner and Sven Sickert and Gerd F. Volk and Orlando Guntinas-Lichius and Joachim Denzler.
Challenges of Trustable AI and Added-Value on Health. Pages 179-183. 2022.
[bibtex] [web] [code] [abstract]
Anish Raj and Oliver Mothes and Sven Sickert and Gerd F. Volk and Orlando Guntinas-Lichius and Joachim Denzler.
Annual Conference on Medical Image Understanding and Analysis (MIUA). Pages 253-266. 2020.
[bibtex] [web] [abstract]
Gerd F. Volk and Maren Geitner and Katharina Geißler and Jovanna Thielker and Ashraf Raslan and Oliver Mothes and Christian Dobel and Orlando Guntinas-Lichius.
Frontiers Surgery - Otorhinolaryngology - Head and Neck Surgery. 2020.
[bibtex] [abstract]
Gerd F. Volk and Martin Thümmel and Oliver Mothes and Dirk Arnold and Jovanna Thielker and Joachim Denzler and Valeria Mastryukova and Winfried Mayr and Orlando Guntinas-Lichius.
Vienna Workshop on Functional Electrical Stimulation (FESWS). 2019.
[bibtex] [pdf] [abstract]
Oliver Mothes and Luise Modersohn and Gerd F. Volk and Carsten Klingner and Otto W. Witte and Peter Schlattmann and Joachim Denzler and Orlando Guntinas-Lichius.
European Archives of Oto-Rhino-Laryngology. 2019.
[bibtex] [pdf]
Gerd F. Volk and Anika Steinerstauch and Annegret Lorenz and Luise Modersohn and Oliver Mothes and Joachim Denzler and Carsten M. Klingner and Farsin Hamzei and Orlando Guntinas-Lichius.
Journal of Neurology. 2018.
[bibtex]
Rebecca Anna Schaede and Gerd F. Volk and Luise Modersohn and Jodie M. Barth and Joachim Denzler and Orlando Guntinas-Lichius.
Laryngo-Rhino-Otologie. 2017.
[bibtex] [web] [abstract]
Luise Modersohn and Joachim Denzler.
International Conference on Computer Vision Theory and Applications (VISAPP). Pages 271-278. 2016.
[bibtex] [pdf] [abstract]