Dibbuk - Augmented Reality

May '24

Client: Kula Compagnie - Transnational Theatre

Research, 3D modelling and software development for the production of an augmented reality element for the piece Dibbuk - Between (two) Worlds by the Kula Compagnie. Opening night was on May 17th, 2024 at Ruhrfestspiele Recklinghausen.

After an exploration of the pros and cons of various technical approaches, the concept was realized based on an iPhone 12 Pro (Lidar Sensor) and a custom app. The app makes use of RealityKit and SwiftUI and can be controlled remotely by OSC via Ethernet. WiFi or BT were not reliable enough in a room with 500+ smartphones. The 3D models that were built beforehand, were rebuilt in code to achieve controllable, animated textures, which weren't possible in the usual USDZ format. On stage the iPhone's video signal is displayed on a 50x50cm led tile. The iPhone is mounted on the back of the tile, which is carried by an actor across the stage.

More images in preparation.

"The new Ring Parable" - The mixture of live performance and technology […] lends the production […] an impressive symbolic character, which at the same time goes far beyond anything symbolic. […]"
nachtkritik.de Sascha Westphal 18.5.2024

Stage Design: Sascha Gross
Stage Technician: Simon Vorgrimmler

Related Projects:

• Kula Compagnie (Aug '21)
• Sascha Gross (Jul '24)