392256 ISY Project: Multi-Modal Smart Home Control (Pj) (SoSe 2019)

Verbalizing simple commands (e.g., "on", "brighter", "more blue") and simultaneously pointing to a specific lamp. Speech Interaction currently is a big thing and can be easily utilized in intelligent smart home environments (e.g., our intelligent apartment http://aiweb.techfak.uni-bielefeld.de/content/CSRA), but current smart home interfaces often are not using additional multi-modal information. The goal of this project is to combine speech recognition results with pointing gestures or other information. The resulting interface should be flexible to enable easy deployment of new interaction models and functionalities.

Please note that the teams will be selected by the supervisors on the basis of short applications that students are expected to send to them. Registering to the project in the ekVV will only be regarded as expression of interest; it will not secure a team membership. Please get in touch with the supervisors for information on the application procedure.

Teilnahmevoraussetzungen, notwendige Vorkenntnisse

Required skils (e.g. mandatory courses, if required)

• The programming can be done in C++, Python or Java.
• Willingness to familiarize oneself with the existing smart home automation and middleware RSB ("Robotics Service Bus").