Holo Hands Tracking

Use custom skeletal mesh to represent hands in HoloLens 2 mixed reality

Category:
Tags: , , , ,

Description

This plugin provides representation of hand on devices supporting hand tracking via OpenXR. Hand tracking data is used to update pose of skeletal mesh. Each finger bone of model is scaled accurately to fit tracked data.

Note 1: Currently, it works only with HoloLens 2, because Quest 2 doesn’t stream hand tracking data via OpenXR interface.

Note 2: The plugin is intended to use with full-fledged hand tracking, and not hand pose prediction by sensors of VR motion controller.

Demo Video

Technical Details

Code Modules:

Number of Blueprints: 0

Number of C++ Classes: 1 (HoloHandSkeletalMeshComponent)

Network Replicated: Yes

Supported Development Platforms: Windows x64

Supported Target Build Platforms: Windows x64, HoloLens 2 (Windows Holographic)

Documentation: [DOC]

Example Project: [5.1]

Supported Engine Versions

5.1 – 5.3