Explaining rehearsals of a symphony orchestra in virtual reality
Abstract
The project Symotiv’s (http://symotiv.de) goal is to describe the complex function of a symphony through an interactive experience of the orchestra’s digital twin. We are capturing the musicians, their instruments and their sounds with machine learning based 3D human pose estimation and visualize them in Virtual Reality in a three-dimensional, virtual concert hall. Our audience steps into the role of the conductor and experience the scene and the sound from a perspective within the orchestra. This opens the possibility of experiencing and understanding what is happening from new spatial, but above all sonic perspectives.
Mehr zum Titel
| Titel | Explaining rehearsals of a symphony orchestra in virtual reality |
|---|---|
| Medien | 25th International Conference on Human-Computer Interaction - Workshop on Interactive Technologies for Music Analysis and Visualization |
| Verlag | Springer |
| Heft | --- |
| Band | --- |
| ISBN | --- |
| Verfasser/Herausgeber | Prof. Michael Zöllner, Moritz Krause, Jan Gemeinhardt, Markus Bosl, Dirk Widmann |
| Seiten | --- |
| Veröffentlichungsdatum | 2023-07-23 |
| Projekttitel | --- |
| Zitation | Zöllner, Michael; Krause, Moritz; Gemeinhardt, Jan; Bosl, Markus; Widmann, Dirk (2023): Explaining rehearsals of a symphony orchestra in virtual reality. 25th International Conference on Human-Computer Interaction - Workshop on Interactive Technologies for Music Analysis and Visualization. |