1.0Geckode!https://www.youbiquo.eu/geckodeAida Garfamihttps://www.youbiquo.eu/geckode/author/aida-garfami/rich600338<blockquote class="wp-embedded-content" data-secret="liC35CUVj1"><a href="https://www.youbiquo.eu/geckode/en/interaction-package-guides/">Interaction Package Guides</a></blockquote><iframe sandbox="allow-scripts" security="restricted" src="https://www.youbiquo.eu/geckode/en/interaction-package-guides/embed/#?secret=liC35CUVj1" width="600" height="338" title="“Interaction Package Guides” — Geckode!" data-secret="liC35CUVj1" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" class="wp-embedded-content"></iframe><script> /*! This file is auto-generated */ !function(d,l){"use strict";l.querySelector&&d.addEventListener&&"undefined"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!/[^a-zA-Z0-9]/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret="'+t.secret+'"]'),o=l.querySelectorAll('blockquote[data-secret="'+t.secret+'"]'),c=new RegExp("^https?:$","i"),i=0;i<o.length;i++)o[i].style.display="none";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute("style"),"height"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):"link"===t.message&&(r=new URL(s.getAttribute("src")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener("message",d.wp.receiveEmbedMessage,!1),l.addEventListener("DOMContentLoaded",function(){for(var e,t,s=l.querySelectorAll("iframe.wp-embedded-content"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute("data-secret"))||(t=Math.random().toString(36).substring(2,12),e.src+="#?secret="+t,e.setAttribute("data-secret",t)),e.contentWindow.postMessage({message:"ready",secret:t},"*")},!1)))}(window,document); //# sourceURL=https://www.youbiquo.eu/geckode/wp-includes/js/wp-embed.min.js </script> Interaction Package Guide Interaction Package Guide — LeonardoXR SDK Interaction Package Guides Version 1.0.2 Device: Youbiquo Leonardo XR Base SDK: Snapdragon Spaces 1.0.4 This guide describes how to configure the interaction layer for LeonardoXR applications using standard Unity packages: XR Interaction Toolkit (XRIT) 3.3.0 — high-level interaction system for controllers, ray interactors and direct interactors. XR Hands 1.7.2 — access to hand joint data and gesture recognition. Dependencies and Versions Package Version Source XR Interaction Toolkit 3.3.0 Unity Registry XR Hands 1.7.2 Unity Registry AR Foundation 6.2.1 Unity Registry Snapdragon Spaces SDK 1.0.4 Tarball (Qualcomm) LeonardoXR SDK 1.0.2 Tarball (Youbiquo) UniTask 2.5.10 Unity Registry NOTE All dependencies must be installed as described in the Getting Started guide before proceeding with interaction configuration. 1. XR Interaction Toolkit Configuration Installation Install via Window > Package Manager > Unity Registry > XR Interaction Toolkit > Install (version 3.3.0). If prompted “Enable the new input system?”, click Yes. If prompted “XR Interaction Layer Mask Update Required”, click I Made a Backup, Go Ahead! (for new projects) or No Thanks if no previous XRIT version was present. Import Starter Assets Open Window > Package Manager, select In Project then XR Interaction Toolkit. Under Samples, click Import on Starter Assets. Also click Import on Hand Interaction Demo (required for hand tracking samples). The Starter Assets include: Pre-configured Input Action Asset for XR controllers and hands. Reference prefabs for XR Origin with Ray Interactor and Direct Interactor. Base materials and shaders for interaction visual feedback. Configure Input Actions After import, an XRI Default Input Actions asset is added to Assets/Samples/XR Interaction Toolkit/[version]/Starter Assets/. This asset is pre-configured for standard controller profiles (including the Companion Controller via Microsoft MMRC Profile) and for hands. To associate the asset with the system: go to Edit > Project Settings > XR Plug-in Management > Input System and ensure Active Input Handling is set to Both or Input System Package (New). 2. Scene Configuration — XR Origin Base Scene Hierarchy AR Session XR Origin (Action-based) └── Camera Offset ├── Main Camera (tagged "MainCamera") ├── LeftHand Controller │ ├── XR Ray Interactor (left) │ └── XR Direct Interactor (left) └── RightHand Controller ├── XR Ray Interactor (right) └── XR Direct Interactor (right) Create the base structure by selecting GameObject > XR > XR Origin (Action-based). NOTE Disable AR Camera Background — not supported on LeonardoXR and automatically disabled at runtime. Also disable AR Camera Manager if not retrieving RGB frames from the camera. Input Action Manager Add the Input Action Manager component to the XR Origin (or a persistent GameObject). In the Action Assets field, assign: XR Input Actions (from Samples/LeonardoXR SDK/[version]/Core Samples/Shared Assets). 3. XR Hands Configuration Installation Install via Window > Package Manager > Unity Registry > XR Hands > Install (version 1.7.2). Import Hand Samples Open Window > Package Manager > In Project > XR Hands > Samples and import: Gestures — gesture recognition system. Hand Visualizer — hand mesh visualisation. Enable Hand Tracking Subsystem Go to Edit > Project Settings > XR Plug-in Management > OpenXR (Android tab). Under All Features, enable Hand Tracking Subsystem. Also enable Hand Tracking in the Snapdragon Spaces feature group. NOTE The Hand Tracking Subsystem must be enabled in All Features — not just in the Snapdragon Spaces section — to work correctly on LeonardoXR. Hand Data Access via XR Hands API using UnityEngine.XR.Hands; XRHandSubsystem handSubsystem = XRHandSubsystemUtility.GetSubsystem(); if (handSubsystem != null) { XRHand leftHand = handSubsystem.leftHand; if (leftHand.isTracked) { if (leftHand.GetJoint(XRHandJointID.IndexTip).TryGetPose(out Pose indexTipPose)) { // indexTipPose.position = position of left index fingertip } } } Gesture Recognition [SerializeField] XRHandGestures gestures; void OnEnable() { gestures.gesturePerformed += OnGesturePerformed; } void OnGesturePerformed(XRHandGesture gesture, Handedness handedness) { Debug.Log($"Gesture: {gesture.gestureName} performed with {handedness}"); } 4. Configuring Interactables Adding an Interactable to an Object Add a Collider to the object (e.g. Box Collider). Add XR Grab Interactable for grabbable objects, or XR Simple Interactable for objects that receive events without being moved. public class MyButton : MonoBehaviour { [SerializeField] XRSimpleInteractable interactable; void OnEnable() { interactable.selectEntered.AddListener(OnSelected); } void OnSelected(SelectEnterEventArgs args) { Debug.Log("Selected by: " + args.interactorObject); } } Interaction Layer Mask XRIT 3.x uses Interaction Layer Masks to filter which interactors can interact with which interactables: interactable.interactionLayers = InteractionLayerMask.GetMask("Default", "UI"); 5. UI Canvas and Interaction World Space Canvas Create a Canvas and set Render Mode to World Space. Add the Tracked Device Graphic Raycaster component to the Canvas (replaces the standard Graphic Raycaster). Add XR UI Input Module to the EventSystem GameObject in the scene (replaces the default Input System UI Input Module). Recommended Canvas Settings Parameter Recommended Value Render Mode World Space Dynamic Pixels Per Unit 1 Reference Pixels Per Unit 100 Scale 0.001 (for a ~1m canvas = 1000 pixel units) 6. Combining Controller and Hand Tracking On LeonardoXR it is not possible to simultaneously use headset Controllers and full Hand Tracking (with raycast from both hands) due to conflicts between OpenXR profiles. Option A — Controller Only (Companion Controller) Add Microsoft MMRC Profile to enabled profiles. Do not add Hand Interaction Profile. The Companion Controller handles pointing; hands can be used as colliders but not as raycast interactors. Option B — Hands Only (Dual Hand Mode) Add Hand Interaction Profile to enabled profiles. Do not add Microsoft MMRC Profile. Remove the Device Pointer Prefab from the Controller. Both hands tracked as full interactors; no phone input. Option C — Controller + One Hand Add Microsoft MMRC Profile to enabled profiles. Keep only the Right Hand Controller active in the XR Origin. The left hand can still function as a collider and poke interaction trigger, but not as a ray interactor. 7. UniTask — Asynchronous Operations UniTask 2.5.10 is included as a dependency for high-performance async operations (asset loading, waiting for subsystems, etc.) without GC allocations. using Cysharp.Threading.Tasks; public class HandSubsystemWaiter : MonoBehaviour { async UniTaskVoid Start() { // Wait until the XR Hands subsystem is ready await UniTask.WaitUntil(() => XRHandSubsystemUtility.GetSubsystem()?.running ?? false); Debug.Log("XR Hands subsystem ready."); } } UniTask is used internally by the LeonardoXR SDK for asynchronous operations. It is recommended to use it in application code as well for consistency with the SDK lifecycle. OpenXR Interaction Profile Reference Profile Use Microsoft Mixed Reality Motion Controller Profile Physical controllers interaction profile Hand Interaction Profile Hand tracking with poke/pinch interactor LeonardoXR Hand Interaction Profile Hand tracking with poke/pinch interactor