Sök Kontakt
bild
Skolan för
datavetenskap
och kommunikation
KTH / CSC / Kurser / DT2140

DT2140 Multimodal interfaces

Laboratory exercises

The course includes four three-hour laboratory exercises. Lab 2 is held in the computer rooms at the Department for Speech, Music and Hearing.
Labs 1 and 3 are held at Osquars backe 3, computer room Magenta and Vit.
Lab 4 is held at Osquars backe 3, computer room Vit.

Lab 1: Visual interfaces
Task: To create a basic interactive environment that utilizes fiducial tracking as input.

Lab 2: Gestures and sounding objects
Task: The purpose of this lab session is to get a basic introduction in how to sonify body gesture. Sonification is therefore used for providing feedback about gestures. This will be achieved by using both simple sound generators and complex sound models.

Refer to the Lab 2 folder in Bilda for instructions and program components.

PD patch »
Processing application »
SendUDP application »

Lab 3: Multimodal speech interfaces
Task: To build a simple speech-driven dialogue system with a talking head.

Lab 4: Haptic interfaces
Task: To build a simple haptic and auditive virtual environment for data exploration.

Requirements:
In order to pass, the student should:
Attend and solve all four laboratory exercises, and actively discuss the solutions with the exercise assistant.


Course responsible: Olov Engwall, engwall@kth.se, 790 75 65