Skeleton Conductor
A Multi-sensory interactive XR Art Experience.
Creating audio-visual art through movement.
together with the artist
Hanna Pajala-Assefa
2020
Skeleton Conductor is a user centred, single user XR art experience where the user is in a key position in the creative exploration it provides. The 6DoF VR enables a particular embodied situation where the real-time mapped gestures and movements of the user are the key ignitors and conductors of the audiovisual art. The progression of the interactivity score offers complex sonic properties and visual sculpting to induce attentive physical engagement and the dramaturgical journey lets one reflect on their aesthetic sensibilities. Skeleton Conductor emphasises the users felt experience and multi sensorial awareness and the sense of presence – it stimulates self-reflectivity through an open ended, improvisatory creative act.
Skeleton Conductor XR Art has been shown at several international art and VR festivals and it received People's Choice Award 2020 on it’s premiere at Altered-festival (USA).
Interactive Art | Unity | VFX | Music | Movement | VR
My role
Lead Developer
Unity / C#
Collaborated with a dance choreographer to craft an experience that encourages users to feel confident, curious, and comfortable moving within VR spaces
Designed and built all real-time visual effects using Unity’s VFX Graph
Configured full-body tracking with Vive trackers (hands, feet, head) and linked movement to reactive sound triggers
Integrated FMOD audio middleware with custom parameters and trigger zones for dynamic audio control
Collaborated closely with the sound designer to shape a responsive soundscape that reacts to user movement
Developed scene flow and experience structure - including opening, two distinct visual environments, and closing credits - all within a 15-minute arc
Led user testing sessions and refined the pacing and interaction design based on feedback, making the experience intuitive, immersive, and empowering
More about
Skeleton Conductor
https://helsinkixrcenter.com/news/introducing-skeleton-conductor/