Spatial UI and Full-Bosy Gesture Onboarding - Kluge｜Case Studies

Kluge Interactive: Immersive training for full body gameplay. 2D icons and menu cards – how Kluge is using mocopi Professional mode to make the most of spatial content tutorials.

Group 7813

Challenge

Kluge Interactive, the creators behind Synth Riders VR — the hit VR rhythm game powered by full-body gesture input and music — have built a reputation for designing intuitive, movement-based experiences in XR. But as spatial displays and advanced body tracking become the norm, even seasoned studios are expanding how they teach players user controlls and body gestures for immersive game play in order to move naturally in immersive environments.

For their growing catalog of gesture-driven (dance) content, Kluge’s UI/UX team needed a fast, reliable way to create clear, believable full-body gesture tutorials — a workflow traditionally handled by dedicated animation or mocap specialists, not interface designers.

Solution

Using mocopi Pro, Kluge’s designers now capture realistic, full-body motion data and animate their poses into immersive tutorials, giving users a holistic view of the full-body controls used in the experience, such as punching and ducking.

The mocopi Pro integrated seamlessly into their XR pipeline, giving the same UI/UX team the freedom to record, refine, and implement gesture tutorials — without relying on external motion capture resources or complex studio setups.

The UX creator behind spatial content is going to be coming into the production pipeline for immersive interactions. Due to a new creator audience in the market with minimal unity or game engine background, mocopi Professional mode was a perfect fit due to the ease of product use. When editing and managing the recorded content, the designer used XYN Motion Studio to trim their animations

Group 7809 — Production sites using mocopi

Outcome

With mocopi Professional mode, Kluge’s team is now able to create a tutorial for full body immersive tutorials with avatars rather than 2D images. As more content becomes spatially aware and developers utilize the full body tracking capabilities, tutorials will be the be quick and intuitive – utilizing the immersive aspect of the display. Say goodbye to icons and decoding UI for controlls, now watch the actual UI developer teach you, step by step.

In this way, mocopi Professional mode helps creative teams and users using spatial devices to stay ready for this shift, supporting the next generation of intuitive, spatial content.

“It was quick! Because it already supported all the platforms I use, I was able to create what I needed and move on to the next task. Before, this would have taken days longer — and even a small delay slows everyone down.”
— Umez Lilauwala, Lead UI/UX Designer, Kluge Studios

About Kluge

Kluge Interactive is an award-winning XR studio known for creating intuitive, gesture-based VR experiences like the fan-favorite rhythm game Synth Riders.
Full Body VR Experience – FINAL FURY: FINAL FURY | A True Arcade VR Fighting Game for Meta Quest & Steam