This article introduces an application called AirTouch, developed by Neural Lab.AirTouch allows users to integrate gesture control into Unity, Unreal, TouchDesigner, or other game engine projects using only standard tools. It simplifies adding gesture-based interactions without the need for specialized hardware or complex SDKs.
For more details, please refer to the Neural Lab page.
Key Features for Developers
- Webcam-Based Gesture Recognition: Leverage an existing webcam—no additional devices needed.
- Compatibility with Standard Inputs: AirTouch gestures emulate mouse, keyboard, and touch inputs, allowing you to layer gesture control into your application without modifying a single line of code.
- Quick Setup: Install AirTouch and start implementing gestures in minutes, with no need for extensive development.
- Engine-Agnostic: Easily integrate with Unity, Unreal, TouchDesigner, or any game engine you’re working with.
How It Works
AirTouch processes webcam input to detect hand gestures, translating them into actionable inputs for your application. This allows you to create experiences without disrupting your current development pipeline.
Hardware
If your PC doesn’t have a webcam, you will need a separate webcam to run AirTouch. It’s works best if the webcam is placed right next to the camera sensor on the Spatial Reality Display.
Install and run AirTouch
- In your PC settings, set the Spatial Reality Display as the main display.
- Run AirTouch_Setup_xxx.exe to install Air Touch.
- Activate license for AirTouch.
- Run the AirTouch application on your PC.
- Refer to AirTouch’s documentation for best practices in using hand gestures.
To connect AirTouch to a Unity project on the Spatial Reality Display
- Install Unity
- Download the Spatial Reality Display Unity SDK from the website. Follow instructions on the Developer’s site to install the SDK.
- In the Windows display settings, make sure the Spatial Reality Display screen is on the left side and the laptop screen is on the right. Also, check that the Spatial Reality Display screen is the primary display.
Best Practices
- To ensure gestures are locked onto the correct person, AirTouch uses eye tracking. By default, you need to face the camera to engage. You can disable eye tracking by navigating to File -> Advanced Settings and checking the box labeled “Ignore Eye Gaze.”
© Unity Technologies Japan/UCL
Was this article helpful?
