Apple Trains Humanoid Robots Using Human And Apple Vision Pro

JAKARTA - Apple has just released a new research paper that reveals a new training method for humanoid robots with the help of human instructors and modified Apple Vision Pro devices.

In a paper entitled Humanoid Policy ~ Human Policy, Apple describes the shortcomings of traditional robot training methods that are considered inefficient and expensive. To overcome this, Apple introduced a new approach called PH2D (Physical Human-Humanoid Data), which is a combination of demonstrations from robots and human training.

The research comes a week after Apple introduced their latest AI models, Matrix3D and StreamBridge.

Apple uses its modified consumer products as a means of training, including the Apple Vision Pro which only uses lower left cameras for visual observation, as well as sickles to track 3D head and hand movements.

In addition, Apple is also leveraging a modified Meta Quest headset with a ZED mini stereo camera, creating cheaper but more effective training alternatives.

Human organizations wear the headset and sit upright while carrying out various hand actions such as picking up, lifting objects, and pouring liquid. All these movements were recorded with sound guides and slowed down in the post-production process so that they could be used as humanoid robot training materials.

Apple developed a data processing model called HAT (Human-humanoid Action Transformer) which is able to analyze data from humans and robots simultaneously. This creates a common policy framework (generalizable policy framework) that allows robots to learn better than the two sources.

According to the paper, this combined approach yields better generalization and resilience capabilities than training that only uses data from real robots. One example of its success is on tasks such as holding objects vertically.

Although Apple has only shown off its prototype robotic lights so far, reports say the company is developing mobile robots for consumers that can carry out household chores and other simple work. PH2D is believed to be the basis of Apple's future robotic consumer technology.