Meta’s Quest SDKs: Instant Placement, Keyboard Tracking & Bluetooth Colocation Discovery Unveiled

Meta has introduced new features in its Quest SDKs to enhance mixed reality experiences. These updates include Instant Placement, Keyboard Cutout, and Bluetooth Colocation Discovery.

Instant Placement

This feature allows users to place virtual objects on real surfaces without needing to scan the environment first. Traditionally, users had to conduct a scene scan, which could take a minute. Instant Placement uses the Depth API to enable quick placement of simple, stationary objects by sending a raycast to detect surfaces. However, for complex interactions or moving objects, scene scanning is still required.

Keyboard Cutout

With this update, any keyboard can be tracked and displayed as a passthrough cutout instead of needing a digital model. This is useful for productivity applications, allowing users to see their keyboard while using VR. Virtual Desktop already implemented this manually, but now developers can use this new capability in their apps with the Mixed Reality Utility Kit (MRUK).

Bluetooth Colocation Discovery

This feature simplifies local multiplayer experiences. Previously, users needed to go through menus to invite others to join. With the new Colocation Discovery API, headsets can communicate via Bluetooth. This makes it easier for a headset to host a session and for nearby headsets to automatically join.

These updates aim to make mixed reality more accessible, engaging, and user-friendly for developers and users alike.