Every semester
5 Credit points
For information on the duration of the modul, refer to the courses of study in which the module is used.
Non-official translation of the module descriptions. Only the German version is legally binding.
The students know the relevant modalities of human behavior. Based on physiological and psychological principles, the students understand possible interpretations of various behavioral signals. Students are able to describe, explain and use diverse computational approaches for behavior analysis. Students will be able to apply various methods of sound, image and video processing as well as machine learning to specific cases of behavior analysis. Students understand the benefits of multimodal fusion and integration and are able to explain different fusion schemes. They are able to transfer the methods they have learned to concrete use cases, explain potentials and name possible limitations and risks.
The lecture and seminar are dedicated to the multimodal analysis of human behavior. The focus is on interpretation of social behavior and emotion expression, due to their high relevance for human-computer interactions.
In the first part of the course, different modalities of behavioral and affective expression will be presented (e.g., movements, facial expressions, voice, physiological responses) and discussed with respect to their meaning and interpretation. In the context of different methods of sound and video analysis, different approaches are presented to computationally evaluate and interpret these signals.
The second part of the course will focus on aspects of multimodality of behavioral signals. Besides the processing of multimodal signals, one important topic will be the fusion of multimodal signals. On the basis of different use cases of multimodal behavior analysis, the potential but also the limits and risks of multimodal behavior analysis will be explained.
Knowledge as in module 39-Inf-NN, module 39-Inf-13, or in module 39-Inf-ML.
—
The (partial) examination of the module can be performed as "ungraded" in some study programs at the students choice. Before the examination a respective determination must be carried out, a later modification (graded - ungraded) is impossible. If the "ungraded" option is chosen, it is not possible to include this module in a study program where this module is deemed to enter the calculation of the overall grade.
Module structure: 0-1 bPr, 0-1 uPr 1
Portfolio of homework assignments accompanying the lecture, usually given weekly, and final written exam (60 min) or oral exam (15 min). The assignments complement and deepen the content of the lecture. Proof of a sufficient amount of correctly solved assignments (usually 50% of the maximum total score in the semester). The final exam covers the content of the lecture and the assignments.
See explanations of ungraded examinations
The module can be recognised in the following compulsory optional subject areas (WP):
- WP "Vertiefung Informatik" in the Master's programme Informatics for the Natural Sciences
- WP "Vertiefung Intelligente Systeme" in the Master's programme Intelligent Systems
| Degree programme | Profile | Recommended start 3 | Duration | Mandatory option 4 |
|---|---|---|---|---|
| Data Science / Master of Science [FsB vom 06.04.2018 mit Änderungen vom 01.07.2019, 02.03.2020, 21.03.2023 und 10.12.2024] | Variante 1 | 2. | one semester | Compulsory optional subject |
| Data Science / Master of Science [FsB vom 06.04.2018 mit Änderungen vom 01.07.2019, 02.03.2020, 21.03.2023 und 10.12.2024] | Variante 2 | 2. | one semester | Compulsory optional subject |
| Courses offered for the Individual Subsidiary Subjects / Individueller Ergänzungsbereich im Bachelor | Technische Fakultät | 2. | one semester | Compulsory optional subject |
| Intelligent Systems / Master of Science [FsB vom 27.07.2018 mit Änderung vom 04.06.2020] | 2. | one semester | Compulsory optional subject | |
| Informatics for the Natural Sciences / Master of Science [FsB vom 30.09.2016 mit Berichtigung vom 10.01.2017 und Änderungen vom 15.09.2017, 02.05.2018, 04.06.2020 und 31.03.2023] | 2. | one semester | Compulsory optional subject | |
| Faculty of Technology - Courses offered for the Individual Subsidiary Subjects / Individueller Ergänzungsbereich im Bachelor | 2. | one semester | Compulsory optional subject |
The system can perform an automatic check for completeness for this module.