Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

Former Apple employees reveal Vision Pro development details: it predicts your behavior like "mind reading"

2025-01-21 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > IT Information >

Share

Shulou(Shulou.com)11/24 Report--

CTOnews.com June 7, Apple launched a new headshow Vision Pro on WWDC2023 yesterday, and Sterling Crispin, a former Apple employee who was in charge of developing Vision Pro, tweeted yesterday that Vision Pro uses a lot of neuroscience to develop some of its key functions.

"when I was a neurotechnology prototype researcher in Apple's technology development team, I spent 10 percent of my life contributing to the development of VisionPro," Crispin said. "this is the longest single project I have ever worked on. I am proud and relieved that it has finally been unveiled. I have been working on AR and VR for a decade, and in many ways it is a crystallization of the entire industry."

Due to the limitations of the confidentiality agreement, Crispin can not disclose many details, but some of the content has been disclosed through patents. He said that his work at Apple mainly involves judging the mental state of users in immersive mode based on their body and brain data. " In other words, when the user is in a mixed reality or virtual reality experience, the artificial intelligence model will try to predict whether you are curious, distracted, scared, focused, recall past experiences, or other cognitive states. These states may be measured by eye tracking, brain electrical activity, heartbeat and rhythm, muscle activity, brain blood density, blood pressure, skin conductivity and so on. " He explained.

In order to achieve these specific predictions, they used a number of techniques, which are described in several patents that mentioned him. For example, one of the coolest results, he says, is to predict before the user clicks on something. "your pupils react before you click, in part because you expect what will happen after you click." So you can create more of this predictable pupil response by monitoring the user's eye behavior and adjusting the user interface in real time, creating a rough brain-computer interface through the eye. It's cool. I'd rather do it this way than have invasive brain surgery. " He also compared the technology to "mind reading".

In addition, in order to determine the user's cognitive state, the system will quickly show users some visual or sound signals that they cannot perceive. " Another patent details how to use machine learning and body and brain signals to predict how focused, relaxed or effective you are. Then update the virtual environment based on these states. So imagine an adaptive immersive environment that helps you study, work, or relax based on the background changes you see and hear. " Sterling Crispin said.

CTOnews.com noted that Apple said it had created 5000 new patents in the process of developing the headset. The main goal of Apple's Vision Pro is not to completely immerse users in virtual reality, but to expand the possibilities of users by combining the real world with the digital world.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

IT Information

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report