Course info

Authors: Daniel Thalmann.

Level: Advanced.

Prerequisites: Computer graphics.

Description:

The goal of this course is to present the concepts and the methods to carry out multi-media virtual environments. We thus explain how to build complex virtual worlds being able to be distributed on the networks. We introduce advanced concepts for real-time animation, 3d interaction, gesture recognition, audiospace, haptic rendering, collision detection and response, facial communication, voice recognition and synthesis. It is shown how to create avatars or clones 3d, how to create autonomous populations in the virtual worlds. We insist on concrete applications like 3d teleconferences, virtual surgery or interactive TV.

Topics:

• INTRODUCTION: Basic concepts of virtual environments, hardware, software, applications.
• MULTIMODAL INTERACTION: motion capture, gesture recognition, speech recognition and synthesis, spatial sound, haptics.
• AUGMENTED REALITY: Mixed reality, tracking, camera calibration.
• VIRTUAL ENVIRONNEMENTS IN THE MULTIMEDIA COMMUNICATION: Distributed Virtual Environments, avatars, facial communication, autonomous characters.

Format: Slides in pdf-format.

Course material

1. Intro
2. Fundamentals
3. Hardware
4. Interaction
5. Gesture recognition
6. Speech recognition
7. Speech synthesis
8. <">Audiospace
9. <">Haptics
10. Augmented reality