Inside-out tracking
Also known as: inside-out positional tracking
Inside-out tracking is a method of tracking a headset's position and movement using cameras and sensors built into the headset itself, looking out at the room.
It replaced earlier systems that needed external sensors or base stations mounted around the room. While inside-out tracking made VR and mixed reality much easier to set up, it can lose track of controllers held out of the cameras' view, such as behind your back.
Inside-out tracking, explained at three levels
At home
Think about how you find your way in a familiar room with your eyes: you notice the lamp and the doorway shifting as you walk, and you know where you are. Inside-out tracking gives a headset that ability. Cameras on the headset watch the room, and as furniture and corners move in the image, it calculates where you are and which way you're facing.
At work
Inside-out tracking determines a headset's position and orientation using cameras and sensors built into the headset, rather than external sensors mounted around the room. It makes VR and mixed reality portable: no installation, no calibration, and devices that can move between rooms or sites. For businesses, that considerably lowers deployment costs for training, education, and field work.
At home
The headset's cameras pick out distinctive features in your room, such as the corner of a picture frame or the edge of a shelf, and follow how they shift as you move. Combined with motion sensors, that tells the headset its position. Controllers carry rings of infrared lights, invisible to you, that the cameras track. The same cameras can follow your fingers for hand tracking without controllers.
At work
Inside-out tracking relies on visual-inertial SLAM, simultaneous localization and mapping. Cameras extract feature points from the room and build a map, while an IMU fills the gaps between camera frames at high rates. The headset continuously estimates its pose relative to that map and saves it so play boundaries persist. Performance depends on lighting, textured surfaces, and camera field of view. Hand tracking reuses the cameras with machine learning models.
At home
SLAM needs things to track. Plain white walls, glossy floors, dim lighting, and mirrors give the cameras few reliable features, so the headset's position estimate drifts or jumps. Controllers held behind your back or close to your face leave the camera view, and the headset falls back on motion sensors, which drift within moments. In my view, a few posters on a blank wall can be a surprisingly effective VR upgrade.
At work
Inside-out tracking is typically accurate to within a few millimetres, but it trails outside-in systems, such as SteamVR base stations or optical motion capture, for precision work. Occlusion of controllers limits some motions. Headsets also store detailed spatial maps of the rooms they scan, which matters in sensitive facilities, so policies should cover map storage, sharing, and deletion. Test tracking in each real environment before deployment.
Real-world examples
At home
Aisha took her standalone headset to her cousin's place in Regina. Without setting up any sensors, she drew a play area on the floor and was playing within minutes.
At work
Fatima is an IT manager at a Quebec school board. Inside-out tracking headsets let teachers run VR science lessons in any classroom without installing base stations.
How it compares
| feature | Inside-out tracking | Outside-in tracking |
|---|---|---|
| Sensors | On the headset | Mounted around the room |
| Setup | Quick, portable | Installation and calibration |
| Accuracy | Good for most uses | Very high |
| Blind spots | Outside camera view | When sensors are blocked |
Inside-out trades a little precision for far easier setup.
For analysts
For training programs across many sites, inside-out tracking removes installation costs. I'd test tracking in each real environment, though, since lighting and room features affect reliability.
History & origin
Early consumer VR headsets in 2016 used 'outside-in' tracking: the Oculus Rift used external cameras, and HTC Vive used laser base stations. Microsoft's Windows Mixed Reality headsets, launched in 2017, brought inside-out tracking to PC VR. The Oculus Quest in 2019 used inside-out tracking for both the headset and controllers in a standalone device, making VR far more portable. Microsoft later deprecated Windows Mixed Reality, removing it from Windows 11 in 2024. Today, most consumer headsets use inside-out tracking, while outside-in remains popular for precise uses such as motion capture. In my opinion, inside-out tracking did more for VR's mainstream appeal than any increase in display resolution.