Home » The full saga of Apple’s troubled mixed reality headset has been revealed

The full saga of Apple’s troubled mixed reality headset has been revealed

by admin
expansion / / Jony Ive will be speaking at the 2017 New Yorker Tech Fest stage in New York City.

series Report With information It details the progress, politics, and issues facing Apple’s plans to develop virtual, extended, or mixed reality headsets since the initiative gained momentum in 2015.

Citing some people who are familiar with the product, including those who worked directly on the product, the report explains the willingness dispute over the direction of the device. The stand-off was between Apple’s mixed reality product team (called the “Technology Development Group”) and renowned Apple designer Johnny Ive and his industrial design team. This report sheds light on Apple’s direction for devices recently announced by Bloomberg. report It’s about to be released.

They also say that Apple CEO Tim Cook is relatively let go of this product compared to other products like the iPhone, and the location of the Technology Development Group in an office separate from Apple’s headquarters is causing problems and frustration. Claims to be.

According to sources, Apple’s approach to mixed reality almost happened when the company purchased a German AR startup called Metaio to use some of its technology in its self-driving car project, Project Titan. It is said that it has started. Another important moment was when Apple hired Mike Rockwell, the leader of the AR / VR project team, away from Dolby Laboratories. Since 2015, Rockwell has built a team that includes Metaio co-founder Peter Meier and Apple Watch manager Fletcher Rothkopf.

In 2016, several AR demos were shown to members of Apple’s board of directors. First, a small triceratops has grown to life in front of board members. Another room has been transformed into an immersive lush environment. But the board wasn’t Rockwell, nor was it the company’s most important barrier. According to The Information, it was Ive who oversaw both Apple’s industrial design team and human interface team.

Ive and his crew believed that VR kept users away from the people around them and the world, and they opposed VR headsets because they didn’t look fashionable. However, the Technology Development Group gained the support of the industrial design team by showing the wearer’s facial expressions and eye images to the people around them on the outward screen on the front of the headset. The wearer was able to see the people around him through an external camera feed.

Rockwell and his colleagues developed and released ARKit In 2017, an application development suite that allows developers to create AR apps for iPhone and iPad using technologies and techniques that can later be adapted to headsets.

Initially, Rockwell and other mixed reality teams wanted to connect the headset to a base station to provide the most striking graphics and performance. Some of the team envisioned headsets primarily as a tool for professionals and creatives to use at their desks. .. But I didn’t like either of these ideas and wanted to make it a mass market lifestyle product that consumers could use on the go. Apple’s highest leadership supports Ive’s plans, and although Ive is currently working with Apple as a consultant, it still plays an active role in headset development.

The decision to make the headset a standalone device has been reported to have caused serious headaches. For example, some thought that the best way to get it to work on its own would be to have more features on a single chip. However, since the work on silicon has already been done, we needed to find a way to combat the delay inherent in the communication of multiple chips in the device with each other. They also wrote the software in anticipation of base station planning going on.

Nevertheless, the device is in the final stages of development.Bloomberg claimed last week that an advanced version of the product was recently released. To Apple’s board, And that Apple has “strengthened” the development of headset software. This is a derivative of iOS called rOS. (R stands for “reality”.)

The information report reveals many details about future headsets. In contrast to most consumer VR headsets today, the team believed that it was the minimum resolution that users wouldn’t perceive as pixelated images, at least 4K for each eye. It has the resolution of. Its built-in processor is closely tied to the M2 processor, which is expected to reach Macs and iPads in the coming months.

The headset has 14 cameras, some facing outwards and some facing inward. This allows the user to see the outside world and nearby people to see the video representation of the user’s eyes. A 3D avatar (probably similar to Memoji on the iPhone) that can be used for remote meetings and social gatherings with other headset wearers in the distance by tracking the wearer’s face and body movements live. Map.

Avatar is cartoonish because headsets without a tethered base station have limited processing power on the M2 chip (the canceled base station is said to have an ultra-high performance M1 Ultra). Sources said that when the base station was part of the plan, a more photo-realistic avatar was attempted, but the uncanny valley was the problem.

Apple originally planned to launch the headset in 2019, but now it could be announced later this year or in 2023. In addition, Apple plans to introduce AR glasses with a more natural look as a follow-up product, but the device may still take years to ship.

You may also like

Leave a Comment