What is the Mixed Reality Toolkit

MRTK is a Microsoft driven open source project.

MRTK-Unity provides a set of foundational components and features to accelerate MR app development in Unity. The latest Release of MRTK (V2) supports HoloLens/HoloLens 2, Windows Mixed Reality, and OpenVR platforms.

MRTK-Unity goals

• Provide basic features as an easy to use SDK and reduce barriers to get started.
• Enable rapid prototyping by providing the basic building blocks for MR app development.
• Showcase best practices in MR with UI controls and interactions that matches the WMR and HoloLens shell.
• Support a wide audience, allowing solutions to be built that will run on multiple VR / AR / XR platforms such as Windows Mixed Reality, Steam and Open VR.
• Ensure an extensive framework for advanced integrators, with the ability to swap out core components with their own should they wish to, or simply extend the framework to add new capabilities.

Required software

Windows 10 FCU	Unity 3D	Visual Studio 2017	Simulator (optional)
To develop apps for Windows Mixed Reality headsets, you need the Windows 10 Fall Creators Update	The Unity 3D engine provides support for building mixed reality projects in Windows 10	Visual Studio is used for code editing, deploying and building UWP app packages	The Emulators allow you test your app without the device in a simulated environment

Supported platforms

The Mixed Reality Toolkit V2 will includes many APIs to accelerate the development of MR / XR / VR / AR projects for a range of supported devices, starting with

• Microsoft HoloLens
• Microsoft HoloLens 2
• Microsoft Windows Mixed Reality immersive headsets (WMR)
• OpenVR (HTC Vive / Oculus Rift)

Feature areas

• Input System

• Articulated Hands + Gestures (HoloLens 2)

• Eye Tracking (HoloLens 2)

• Voice Commanding

• Gaze + Select (HoloLens)

• Controller Visualization

• Teleportation

• UI Controls

• Solver and Interactions

• Spatial Understanding

• Diagnostic Tool

Getting started with MRTK

The Mixed Reality team have prepared a few guides for getting up to speed on using the new Mixed Reality Toolkit, which can be found here:

• Downloading the Mixed Reality Toolkit
• Getting Started with the Mixed Reality Toolkit
• Mixed Reality Toolkit configuration guide

Find this document, other documentation articles and the MRTK API reference on our MRTK Dev Portal on github.io.

Engage with the community

Join the conversation around MRTK on Slack.

Ask questions about using MRTK on Stack Overflow.

Search for solutions or file new issues in GitHub.

Deep dive into future plans and learn how you can contribute to MRTK in our wiki.

Join our weekly community shiproom to hear directly from the feature team. (link coming soon)

For issues related to Windows Mixed Reality that aren't directly related to the MRTK, check out the Windows Mixed Reality Developer Forum.

Examples and QuickStart scenes

One radical change to the Mixed Reality Toolkit vNext, will be the standards and approaches to real world example scenes.

New examples will follow strict guidelines, such as:

• Each example must have utility and demonstrate a real world test case (no tests).
• Each example will use a standardized template, so all examples have the same look and feel.
• Each sample will be fully documented, detailing both the use case it is demonstrating and how to implement the features demonstrated.

Check the "Work In Progress" section of the Windows Mixed Reality - vNext SDK for a peek at the first new example.

The External\How To docs folder contains guides on migrating between versions and process troubleshooting. Please feel free to grow all these sections. We can't wait to see your additions!

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Useful resources on Microsoft Windows Dev Center

Academy	Design	Development	Community
See code examples. Do a coding tutorial. Watch guest lectures.	Get design guides. Build user interface. Learn interactions and input.	Get development guides. Learn the technology. Understand the science.	Join open source projects. Ask questions on forums. Attend events and meetups.

Build Status

Branch	Status
mrtk_development

For details on the different branches used in the Mixed Reality Toolkit repositories, check the Branch Guide.