Outcome summary
We built spatial AR and real-time video for theatre and showcase stages, and a VR viewing system for a museum.
Starting situation
Live performances wanted projected video that reacts to the performers in real time, instead of pre-recorded backgrounds; a museum wanted visitors to tour its rooms in virtual reality.
The system
- Spatial augmented reality (SAR): real-time video effects projected onto the stage and the set, for live-drawing performances and a theatre opera (2020).
- Real-time tracking and motion capture with 3D projection mapping (2020), later rebuilt on deep learning: motion-capture and real-time projection-mapping software (2023–2024).
- Stage scenography video and interactive stage video for theatre productions (2023–2024), and real-time interactive video for an art-and-technology showcase.
- VR: a virtual-reality tour for a museum in Italy, and a VR city tour for an Italian town (2020).