392275 ISY Project: Development of Sonification Models for Auditory Data Science (Pj) (SoSe 2018)

- Short Description
Sonification, the non-speech auditory display of data, can enhance our understanding of patterns in high-dimensional data. This project aims at developing/extending a python-based sonification package with Model-based Sonifications, i.e. sonification algorithms that turn data into a dynamic (acoustic) system that users can interact with, e.g. to pluck, hit, shake the models to excite them to make sound. In the project we will:
- first familiarize with sonification and numerical integration of acoustic systems
- develop algorithms (starting from existing sonification models) to render sound in real-time
- create interactive data visualizations to which excitatory interactions are then coupled
- integrate the models into PySon, a sonification package which is currently in development
The focus and amount of activity will be scaled according to the team size - areas of activity will be selected according to the students' interests and skills.

You will learn:
- real-time computing in python
- sound synthesis techniques
- excitatory mechanisms for interacting with sound models
- development of reusable modular software components, to be used together with current data science tools such as matplotlib, pandas, scikit.

Please note that the teams will be selected by the supervisors on the basis of short applications that students are expected to send to them. Registering to the project in the ekVV will only be regarded as expression of interest; it will not secure a team membership.
Please get in touch with the supervisors for information on the application procedure.

Requirements for participation, required level

Required skills:
- sound synthesis and digital signal processing basics
- programming in python and basic knowledge in c/c++