Tesla Optimus can’t do that. The Figure AI robot received voice, hearing and vision thanks to OpenAI technologies

Tesla Optimus can't do that.  The Figure AI robot received voice, hearing and vision thanks to OpenAI technologies

The Technology section is powered by Favbet Tech

It seems that Musk has another reason to hate OpenAI.

The startup Figure AI, which announced its cooperation with OpenAI two weeks ago, has already demonstrated its first results. In the new video, the Figure 01 robot fully interacts with a person – it perceives requests visually and aurally, and also provides complete answers.

“I see an apple on a plate in the center of the table, a dryer with cups and a plate, and you are standing next to it with your hand on the table,” – this is how Figure 01 describes what he is shown.

Next, the person asks the robot for something to eat and Figure 01 holds out an apple. Yes, at the moment there are some delays designed to process the instructions, but mostly the robot executes the commands perfectly.

“I gave you an apple because it’s the only, um, edible item I could give you off the table,” says Figure 01, and it’s human “um” adds even more realism to the conversation.

For the final trick, Figure 01 asks what to do with the dishes. The robot replies that it needs to be moved to the dryer, and when asked to do so, it turns the glass over and puts it in the right place. Figure 01 reproduces the same thing with the plate, very clearly setting it on the ledge in the dryer.

Vision and speech are provided by GPT-4Vision and ChatGPT technologies respectively, while hearing is provided by WhisperJAX development. Figure AI created the framework of the robot and the models that make it move.

It seems that this kind of progress has long been expected from Tesla with its Optimus. The company rolled out prototypes pretty quickly — and to date, we’ve seen one assembled model that barely moved, and another that stood on a stand and waved at the audience. At the same time, during the promo that followed the presentation, the robots walked more confidently and interacted with the environment.

However, the latest demonstration that Elon Musk put on X “lit up” the engineer who controlled the robot’s movements.

Figure 01 doesn’t use any gimmicks on video, says the startup’s co-founder Brett Adcock.

“The video demonstrates end-to-end neural networks. No teleoperations,” Adcock, who wrote on X. “Also, it was shot at 1.0x speed and continuously.”

  • Figure AI is a Sunnyvale, California-based 50-employee company that develops autonomous, general-purpose AI-controlled humanoid robots. According to the company, its “creations” are designed to solve labor shortages, perform unwanted or dangerous jobs and support supply chains on a global scale.
  • Figure AI recently raised $675 million in another round of funding — including from Amazon founder Jeff Bezos, Nvidia, OpenAI, and Microsoft. The company is now valued at $2.6 billion.
  • In August, the startup announced a commercial deal that would see its first humanoid robot, the Figure 01, work at BMW’s only U.S. plant.

The Technology section is powered by Favbet Tech

Favbet Tech is an IT company with 100% Ukrainian DNA, which creates perfect services for iGaming and Betting using advanced technologies and provides access to them. Favbet Tech develops innovative software through a complex multi-component platform capable of withstanding huge loads and creating a unique experience for players. The IT company is part of the FAVBET group of companies.

The competition of ITS authors is ongoing. Write an article about game development, gaming and gaming devices and win a professional Logitech G923 Racing Wheel or one of the low-profile Logitech G815 LIGHTSYNC RGB Mechanical Gaming Keyboard!

Related Posts

UK to regulate cryptocurrency memes: illegal advertising

Britain’s financial services regulator has issued guidance to financial services companies and social media influencers who create memes about cryptocurrencies and other investments to regulate them amid…

unofficial renders of the Google Pixel 9 and information about the Pixel 9 Pro XL

The whistleblower @OnLeaks and the site 91mobiles presented the renders of the Google Pixel 9 phone. Four images and a 360° video show a black smartphone with…

Embracer to sell Gearbox (Borderlands) to Take-Two (Rockstar and 2K) for $460 million

Embracer continues to sell off assets – the Swedish gaming holding has just confirmed the sale of The Gearbox Entertainment studio to Take-Two Interactive. The sum is…

photo of the new Xbox X console

The eXputer site managed to get a photo of a new modification of the Microsoft Xbox game console. The source reports that it is a white Xbox…

Israel Deploys Massive Facial Recognition Program in Gaza, – The New York Times

The Technology section is powered by Favbet Tech The images are matched against a database of Palestinians with ties to Hamas. According to The New York Times,…

Twitch has banned chest and buttock broadcasts of gameplay

Twitch has updated its community rules and banned the focus of streams on breasts and buttocks. According to the update, starting March 29, “content that focuses on…

Leave a Reply

Your email address will not be published. Required fields are marked *