The lecture is dedicated to the multimodal analysis of human behavior. The focus is on the interpretation of affective signals, due to their high relevance for human-computer interactions. Different modalities of affective expression will be presented (e.g., movements, facial expressions, voice, physiological responses) and discussed with respect to their meaning and interpretation. In the context of different methods of sound and video analysis, different approaches are presented to computationally evaluate and interpret these signals. Besides the processing of multimodal signals, one topic will be the fusion of multimodal signals. Based on different use cases of social signal analysis, the potential but also the limits and risks of social signal processing will be explained.
We offer a corresponding tutorial with the lecture, in which you will implement some of the methods presented in the lecture. It is highly recommended taking lecture and tutorial during the same semester.
Frequency | Weekday | Time | Format / Place | Period |
---|
Module | Course | Requirements | |
---|---|---|---|
39-M-Inf-MBP Multimodal Behavior Processing | Multimodal Behavior Processing | Ungraded examination
Graded examination |
Student information |
The binding module descriptions contain further information, including specifications on the "types of assignments" students need to complete. In cases where a module description mentions more than one kind of assignment, the respective member of the teaching staff will decide which task(s) they assign the students.
A corresponding course offer for this course already exists in the e-learning system. Teaching staff can store materials relating to teaching courses there: