Hand Tracking
Hand Tracking refers to the capability of detecting and tracking a user’s hand movements in a 3D space within an augmented/mixed reality or virtual reality environment. This feature allows to create more immersive and interactive experiences by enabling users to control or interact with virtual objects using their hands. Hand tracking can be implemented using different sensors and hardware, such as cameras, depth sensors, and specialized devices.
In Babylon.js, hand support is enabled per default, if supported, when using the default experience helper. This will enable basic hand support - 25 hidden spheres will be created for each hand, and each hand will have the default hand mesh loaded and enabled.
This list of joints defines the following skeleton joints and their order:
| SKELETON JOINT | SKELETON JOINT NAME | INDEX |
|---|---|---|
| Wrist | wrist | 0 |
| Thumb | thumb-metacarpal | 1 |
| thumb-phalanx-proximal | 2 | |
| thumb-phalanx-distal | 3 | |
| thumb-tip | 4 | |
| Index finger | index-finger-metacarpal | 5 |
| index-finger-phalanx-proximal | 6 | |
| index-finger-phalanx-intermediate | 7 | |
| index-finger-phalanx-distal | 8 | |
| index-finger-tip | 9 | |
| Middle finger | middle-finger-metacarpal | 10 |
| middle-finger-phalanx-proximal | 11 | |
| middle-finger-phalanx-intermediate | 12 | |
| middle-finger-phalanx-distal | 13 | |
| middle-finger-tip | 14 | |
| Ring finger | ring-finger-metacarpal | 15 |
| ring-finger-phalanx-proximal | 16 | |
| ring-finger-phalanx-intermediate | 17 | |
| ring-finger-phalanx-distal | 18 | |
| ring-finger-tip | 19 | |
| Little finger | pinky-finger-metacarpal | 20 |
| pinky-finger-phalanx-proximal | 21 | |
| pinky-finger-phalanx-intermediate | 22 | |
| pinky-finger-phalanx-distal | 23 | |
| pinky-finger-tip | 24 |
Learn More
For advanced hand tracking features, please refer to Babylon.js documentation: https://doc.babylonjs.com/features/featuresDeepDive/webXR/WebXRSelectedFeatures/WebXRHandTracking/.
