Apple is rumored to be working on a mixed reality headset or glasses that combines the features of Virtual Reality (VR) and Augmented Reality (AR). This combination results in Mixed Reality, where the boundaries between the real world and the virtual world become blurred. You still see the physical objects around you, but there are also digital objects with which you can interact.
- Apple and Mixed Reality
- Examples of Mixed Reality glasses
- Applications of Mixed Reality
Apple and Mixed Reality
Virtual Reality headsets are still a niche product, but in combination with Augmented Reality, Apple could reach the masses with it. According to rumors, Apple is (or has been) working on several products in this area. Analyst Ming-Chi Kuo distinguished three phases:
- Headset in 2023
- Glasses in 2025
- Contact lenses in 2030-2040
Whether all these products will actually be available is highly questionable. Apple is said to be internally divided and making lightweight glasses turned out to be more difficult than expected. As a result, Apple had to make more and more compromises, ultimately resulting in a ski goggle-like headset.
All these products work with Mixed Reality. According to Kuo, the glasses have their own computing power and storage, making them a mobile product that you can also wear outdoors.
Examples of Mixed Reality glasses
The two best-known examples of Mixed Reality products are the Microsoft Hololens and the Magic Leap. In addition, there are less well-known names, such as Nreal Light. This is sold in Germany by the largest provider, Telekom. Because these glasses are aimed at consumers, we pay some extra attention to this. There is already a lot of information available on the internet about the Hololens and Magic Leap, which are mainly aimed at business applications.
Nreal Light is available for €800 and only works in combination with a smartphone from the OPPO brand, which in turn also costs €1150. The glasses themselves weigh around 100 grams and have a resolution of 1080p per eye. It contains two microphones and two speakers with spatial sound. You must connect the glasses to the smartphone with a USB-C cable to use them. You also use this in the beginning to control the glasses with a kind of virtual laser pointer from the smartphone. Later you can also use finger movements.
What is Mixed Reality?
As indicated above, the boundary between the physical world and the virtual world becomes blurred with Mixed Reality (MR). The glasses map the environment and then give you the option to project digital objects into it. These digital objects are interactive with the environment and with each other. With MR glasses you have your hands free for interaction. Apple already offers many applications of Augmented Reality (AR), but you often still have an iPhone or iPad in your hand. Mixed Reality is rather a mix of VR and AR.
Microsoft was one of the pioneers of Mixed Reality and has published a detailed explanation. You will also find a lot of information at Intel.
The special thing is that objects and data are fixed in the real world. For example, you can show a product or service where it will be used. This is already possible with Augmented Reality, for example by placing virtual furniture in your living room, but Mixed Reality goes a lot further.
Applications of Mixed Reality
Mixed Reality has mainly been embraced by Microsoft and this has led to mainly business applications, for example for machine maintenance, optimization of processes (in industry), training and sales demonstrations. Mixed Reality can bridge the gap between the machines and devices a company uses and a virtual environment. You no longer need thick manuals, but can explain actions by pointing to them. For example, you can have an expert watch during a repair to see if everything is going well. But the expert could also demonstrate the repair so that others can learn from it.
You can also imagine something like this in a homely environment. Assembling a piece of IKEA furniture suddenly becomes a lot easier when the correct screw and the place where you need to screw it in are marked through your glasses. In the same way, you can make a LEGO building set or a jigsaw puzzle much faster, but that takes away the fun a bit. In business, for example, Mixed Reality can be used to optimally design a workspace or work process.
You will also find many applications in healthcare. With Mixed Reality, doctors can better explain to patients how certain treatments and operations are performed. Complex diseases are also easier to explain if the patient clearly understands what is going on. Better understanding ensures more peace and a faster recovery. In addition, Mixed Reality can be used to train patients in rehabilitation.
When training doctors, Mixed Reality can be used to explain anatomical procedures. An MRI scan produces a 3D image of a patient, but instead of individual ‘slices’ it is much better converted into a 3D projection, which doctors can walk around to get a better picture of the situation .
Mixed Reality therefore has a large overlap with AR and VR, which you will find more explanation about below:
- Everything about ARKit, Apple’s own augmented reality platform
- These are the best augmented reality apps with ARKit [round-up]
- Augmented reality: what is it? Difference with virtual reality and more
- These Virtual Reality glasses are suitable for the Mac
