The Apple Vision Pro may offer different levels of ‘immersion’

Apple has been granted a patent (number US 11709541 B2) for “techniques for switching between immersion levels” on the upcoming Vision Pro with a special controller.

The US$3,499 (and up) “spatial computer” was previewed at last month’s Worldwide Developer Conference. However, it won’t be available until early 2024 — and then, apparently, in limited quantities.

About the patent

The patent generally relates to systems, methods, and devices for selectively transitioning between levels of simulated reality (SR) immersion presented by an electronic device, and in particular, to selectively transitioning between levels of SR immersion using an input device of the device.

The Vision Pro will be able to present a user with virtual objects that either complement or replace a surrounding physical setting that is perceivable in a view presented by its display. Through that view, the user is provided with an experience in which they may be fully immersed in a surrounding physical setting, fully immersed in a virtual reality (VR) setting of virtual objects, or anywhere in between.

Obviously while the user is fully or partially immersed in a VR setting of virtual objects, physical objects in the surrounding physical setting continue to exist. For example, the user may be fully immersed in VR corresponding to a pre-historic world populated with dinosaurs. While that virtual pre-historic world may be deficient in living room furniture, the living room in which the user is located continues to include a coffee table. What’s more, even though the user’s dog may be absent from that virtual pre-historic world, the dog may continue to roam about the living room.

According to Apple’s patent, an existing technique to avoid any undesirable interactions with physical objects in the surrounding physical setting that are unencumbered by the virtual reality setting involves a user abruptly removing the electronic device providing the experience upon sensing such undesirable interactions. However, the company says that as experiences become increasingly immersive, the user may be unable to sense such undesirable interactions fast enough to avoid them. 

What’s more, abruptly removing the Vision Pro during an experience detracts from that experience. Apple say there’s a need to address the concerns related to these undesirable interactions while also minimizing any negative impacts on the experience.

The company says there solution is devices, systems, and methods for selectively transitioning between levels of simulated reality (SR) immersion. In one implementation, a non-transitory computer-readable storage medium stores program instructions computer-executable on a computer to perform operations. 

The operations include presenting first content representing a virtual reality (VR) setting on the Vision Pro Display. Using an input device of the electronic device, input is received representing a request to present a view corresponding to a physical setting in which the electronic device is located. The first content is simultaneously presented on the display with second content representing the view corresponding to the physical setting obtained using an image sensor of the electronic device.

Summary of the patent

Here’s Apple’s abstract of the patent: “In one implementation, a non-transitory computer-readable storage medium stores program instructions computer-executable on a computer to perform operations. The operations include presenting first content representing a virtual reality setting on a display of an electronic device. 

Using an input controller for the Vision Pro, input is received representing a request to present a view corresponding to a physical setting in which the electronic device is located. In accordance with receiving the input, the first content is simultaneously presented on the display with second content representing the view corresponding to the physical setting obtained using an image sensor of the electronic device.”