unity-xr-mr-ui-director
Skill1 starsChanged 31 days agoMITView on GitHub
Designs, implements, and reviews Unity 3D spatial UI for Meta Quest 3 mixed-reality projects. Use for MR menus, world-space canvases, hand or controller interaction, room-aware placement, Figma-to-Unity UI work, accessibility, and Quest 3 on-device UI validation.
In this repository83 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- game-gdd-authorSkill
- game-playtestSkill
- prototype-fastSkill
- quest3-verify-firstSkill
- review-game-trailerSkill
- scenario-blender-expertSkill
- scenario-blender-retopologySkill
- scenario-blender-uv-bakingSkill
- scenario-unity-expertSkill
- scenario-unity-mobileSkill
- scenario-unity-performanceSkill
- scenario-unity-pipeline-automationSkill
- scenario-unity-shadersSkill
- submit-game-versionSkill
- test-designing-guideSkill
- unity-multiplayerSkill
- unity-xrSkill
- xr-perceptual-constraints-displays-and-trackingSkill
- xr-platforms-audio-and-comfortSkill
- xr-referenceSkill
- xr-rendering-input-and-spatial-understandingSkill
- xr-ux-design-and-performance-budgetingSkill
- horizon-launch-roadmapSkill
- horizon-store-listing-assetsSkill
- horizon-store-publish-unitySkill
- horizon-vrc-checklistSkill
- meta-vr-glasses-unitySkill
- meta-xr-operator-unitySkill
- quest-asset-sourcingSkill
- quest-dev-workflowSkill
- quest-level-blockoutSkill
- quest-unity-project-settingsSkill
- unity-quest-android-buildSkill
- unity-quest-dev-setupSkill
- unity-test-runner-cliSkill
- hz-api-upgradeSkill
- hz-immersive-designerSkill
- hz-new-project-creationSkill
- hz-perfetto-debugSkill
- hz-quest-verify-firstSkill
- hz-simpleperf-debugSkill
- hz-store-submitSkill
- hz-unity-code-reviewSkill
- hz-unity-device-readinessSkill
- hz-unity-face-trackingSkill
- hz-unity-fbx-importSkill
- hz-unity-meta-core-sdkSkill
- hz-unity-meta-interaction-sdkSkill
- hz-unity-meta-mixed-reality-utility-kitSkill
- hz-unity-meta-movement-sdk-retargetingSkill
- hz-unity-meta-quest-uiSkill
- hz-unity-passthrough-camera-accessSkill
- hz-unity-placementSkill
- hz-unity-platform-sdkSkill
- hz-unity-project-analyzerSkill
- hz-unity-sdk-upgradeSkill
- hz-unity-tmp-resourcesSkill
- hz-vr-debugSkill
- The first 60 shown.
The file
Show its rules and text
We split this skill into the rules it gives an agent
20 rules. About 0 are common, 17 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈17
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 16
Use supporting skills when their trigger applies:
- Very specific: line 18
Use the bundled quest3-verify-first before current Quest package, API, entitlement, device, or policy claims.
- Distinctive: line 19
Use the bundled references in this skill for comfort, accessibility, Canvas, and MRUK work.
- Distinctive: line 20
Use a separately audited device bridge for logs, screenshots, and traces when one is installed.
- Distinctive: line 22
Use Figma design/library skills for tokens and flat component composition when a Figma deliverable is requested.
- Distinctive: line 28
Run the read-only audit:
- Distinctive: line 35
Never silently upgrade Unity or package versions.
- Distinctive: line 37
Read Unity implementation before changing packages, scenes, prefabs, or Canvas interaction components.
- Distinctive: line 71
Use Meta Interaction SDK only for a feature that XRI cannot provide adequately or when the existing project already uses it.
- Distinctive: line 73
Start with uGUI World Space Canvas for the first working Quest build.
- Distinctive: line 88
Read Quest 3 spatial UI standards for starting values.
- Distinctive: line 96
Use the configured local Unity Editor MCP for scene, prefab, asset, console, test, and screenshot operations.
- Very specific: line 98
Keep generated editor C# scoped, reviewable, and idempotent.
- Distinctive: line 99
If a separately audited and explicitly configured Quest device bridge exists, use it only for an action authorized by the current request.
- Distinctive: line 103
use World Space rendering.
- Very specific: line 105
keep child RectTransform.localScale at one.
- Distinctive: line 114
Use MRUK room data only after scene permission and room loading succeed.
- Distinctive: line 122
Do not assume a detected surface is usable.
- Distinctive: line 136
Read QA checklist before calling the UI complete.
- Distinctive: line 151
Never claim headset readability, comfort, or reachability without a Quest 3 test.
≈ “Common” is an estimate: at least 1 in 5 of the 364,980 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Unity XR/MR UI Director
Build spatial interfaces as physical objects with measurable size, distance, interaction states, and frame cost. Target Meta Quest 3. Keep the core interaction layer OpenXR/XRI-compatible unless the project already commits to Meta Interaction SDK.
Route supporting skills
Use supporting skills when their trigger applies:
- Use the bundled
quest3-verify-firstbefore current Quest package, API, entitlement, device, or policy claims. - Use the bundled references in this skill for comfort, accessibility, Canvas, and MRUK work. Do not require an unpinned device plugin.
- Use a separately audited device bridge for logs, screenshots, and traces when one is installed.
Use Figma design/library skills for tokens and flat component composition when a Figma deliverable is requested. Do not use a flat-screen mockup as evidence that an MR interface is readable or reachable.
1. Resolve the real project
- Locate
ProjectSettings/ProjectVersion.txtandPackages/manifest.json. - Match the required editor version against the Unity editors actually installed.
- Run the read-only audit:
python3 <skill-dir>/scripts/audit_unity_xr_ui.py "/absolute/path/to/unity-project"- Report missing packages, version mismatch, and input-module conflicts before scene edits.
- Never silently upgrade Unity or package versions. Package changes can reserialize scenes and prefabs.
Read Unity implementation before changing packages, scenes, prefabs, or Canvas interaction components.
2. Write the spatial UI brief
Define these fields before implementation:
- user task and success condition;
- standing, seated, or both;
- controller, hand ray, direct poke, gaze, voice, and fallback inputs;
- world-, room-, object-, body-, or head-relative placement;
- expected viewing distance and physical panel size in metres;
- bright, dark, cluttered, and moving-background conditions;
- persistence across room relocalization;
- destructive actions and recovery path;
- tracking-loss, permission-denial, loading, empty, and error states.
Reject a brief that specifies only pixels. Spatial UI needs metres and angular readability.
3. Choose one interaction stack
Default foundation:
URP
+ Input System
+ XR Plug-in Management
+ OpenXR
+ XR Interaction Toolkit
+ XR Hands when hand tracking is required
+ uGUI World Space Canvas
+ TextMesh Pro
+ MRUK for Quest room understandingUse Meta Interaction SDK only for a feature that XRI cannot provide adequately or when the existing project already uses it. Do not leave two active EventSystems, two UI input modules, or duplicate ray/poke interactors in one scene.
Start with uGUI World Space Canvas for the first working Quest build. Evaluate world-space UI Toolkit later if its interaction and focus path is proven on the project’s exact Unity/XRI versions.
4. Design the visual system
Create or document:
- semantic colour tokens, including passthrough-safe surfaces;
- type scale expressed in visual angle and tested physical distance;
- spacing and target-size tokens expressed in millimetres;
- depth/elevation tokens with a small number of layers;
- focus, aim, hover, pressed, activated, disabled, busy, error, and tracking-lost states;
- icon plus label treatment for unfamiliar or destructive actions;
- audio/haptic cues for critical confirmations;
- reduced-motion, seated, one-handed, subtitle, contrast, and text-size options.
Read Quest 3 spatial UI standards for starting values. Treat those values as testable baselines, not universal constants.
5. Implement through the available Unity bridge
Inspect the currently exposed Unity MCP tools before invoking anything. Meta's metavr MCP controls Quest devices; it does not, by itself, prove that Unity Editor scene-editing tools exist.
Preferred order:
- Use the configured local Unity Editor MCP for scene, prefab, asset, console, test, and screenshot operations.
- Map Meta examples that mention
Unity_RunCommandto the bridge's actual C# execution tool. Never invent the command name. - Keep generated editor C# scoped, reviewable, and idempotent. Name temporary commands under
Assets/Editor/Codex/and remove them only after confirming they are not user-owned. - If a separately audited and explicitly configured Quest device bridge exists, use it only for an action authorized by the current request. Before APK installation, launch, capture, or diagnostics, list connected devices and select an explicit serial when more than one exists.
For every Canvas:
- use World Space rendering;
- record its world size in metres and intended viewing distance;
- keep child
RectTransform.localScaleat one; - size children with anchors and
sizeDelta; - disable raycast targets on decorative graphics and labels;
- separate static and frequently changing content when rebuild cost matters;
- attach only the input-module and raycaster family selected for the project;
- build explicit tracking-loss and unavailable states.
6. Place UI in mixed reality
Use MRUK room data only after scene permission and room loading succeed. Choose a policy for missing room data.
- Room-locked panels: bind to semantic wall, table, floor, or room anchors.
- Object UI: place relative to stable bounds, not an arbitrary transform origin.
- Body-follow panels: use delayed follow, dead zones, and an explicit recenter action.
- Head-locked content: reserve for brief safety or system-critical cues; minimize duration and visual area.
- Real surfaces: test normals, clearance, occlusion, reachability, and user height.
Do not assume a detected surface is usable. Doorways, reflective surfaces, clutter, and narrow wall fragments need rejection rules.
7. Validate in increasing-cost order
- Static audit of packages, scenes, prefabs, and input modules.
- Unity compilation and console check.
- Edit-mode and play-mode tests where available.
- Editor/XR Simulator interaction smoke test.
- Quest 3 build and launch.
- Controller-ray, hand-ray, and poke tests as applicable.
- Bright, dark, cluttered, transparent, and low-contrast passthrough backgrounds.
- Permission denial, room-data absence, relocalization, anchor drift, and tracking interruption.
- Device frame timing and trace review. Do not approve performance from Game View alone.
Read QA checklist before calling the UI complete.
Output contract
Return:
- resolved Unity project and editor version;
- chosen interaction stack and why;
- spatial UI brief with physical measurements;
- changed assets/scripts/scenes;
- audit results and remaining warnings;
- device model, runtime conditions, and tests actually run;
- screenshots or trace paths when generated;
- a clear list of items still requiring human headset judgment.
Never claim headset readability, comfort, or reachability without a Quest 3 test.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

