Case studies / Spatial AR, VR and real-time stage video

Spatial AR, VR and real-time stage video

Culture and public artSouth Korea

Stage
AR and real-time video
Museum
VR viewing system
Period
2020–2024

Outcome summary

We built spatial AR and real-time video for theatre and showcase stages, and a VR viewing system for a museum.

Starting situation

Live performances wanted projected video that reacts to the performers in real time, instead of pre-recorded backgrounds; a museum wanted visitors to tour its rooms in virtual reality.

The system

  • Spatial augmented reality (SAR): real-time video effects projected onto the stage and the set, for live-drawing performances and a theatre opera (2020).
  • Real-time tracking and motion capture with 3D projection mapping (2020), later rebuilt on deep learning: motion-capture and real-time projection-mapping software (2023–2024).
  • Stage scenography video and interactive stage video for theatre productions (2023–2024), and real-time interactive video for an art-and-technology showcase.
  • VR: a virtual-reality tour for a museum in Italy, and a VR city tour for an Italian town (2020).

Working on a similar challenge? Let’s find the right solution.

Connect with our experts for a free consultation. Your first pilot can start within 2 weeks of signing.

Discuss your project

Contact us

Tell us what you need. We read every message and reply in English, 한국어, Italiano, 日本語, Русский.

What can we help with?
Consents

How we handle your data: privacy policy