392258 Projekt: Assessing Heart Rate in a Web Application (Pj) (WiSe 2024/2025)

Remote photoplethysmography (rPPG) is the contactless monitoring of the
blood volume pulse, and consequently the heart rate, using a regular camera. Classical
rPPG methods make use of signal processing techniques, while recent methods utilize largedeep learning models. [1]
We developed the Simulated Interaction Task (SIT) [2], a digital application designed to
measure qualitative and quantitative differences in social behaviour. The SIT is currently in
use in multiple clinical studies, for example to detect Autism Spectrum Disorder (ASD) in
adults or assess social anxiety in children. Participants perform the test on a laptop while
their faces are recorded via a web cam.
You will implement rPPG Methods in the existing SIT web application, providing users with
immediate feedback of their heart rate during the test. You will integrate a pretrained rPPG
model within the existing code and infrastructure (JavaScript, JATOS backend).

Bibliography

[1] Norden, M., Mayer, A., Molkenthin, D., Stubenvoll, C. & Drimalla, H. Validation of a Digital Stress Test (DST) for the induction of
acute stress responses. (2022) doi:10.17605/OSF.IO/XWU9A.
[2] Drimalla, Hanna, et al. "Towards the automatic detection of social biomarkers in autism spectrum disorder: Introducing the simulated
interaction task (SIT)." NPJ digital medicine 3.1 (2020): 25.