The Technology section is powered by Favbet Tech
After OpenAI’s Sora, which generates digital virtual worlds in the style of Minecraft, Google’s DeepMind generative model has shown its own talent for creating games.
According to MIT Technology Review, Genie can take a short text description, a hand-drawn sketch or a picture and turn it all into a video game in the style of classic 2D platformers like Super Mario Bros. You can’t expect a fast pace from the creation of AI yet – they work at a speed of one frame per second, compared to the typical 30-60 frames per second in most modern games.
Genie was trained on 30,000 hours of internet gameplay videos from hundreds of 2D platformers. Other models use a similar approach – this is how Nvidia trained GameGAN, which excelled in creating a Pac-Man clone.
All of the previous examples taught input action patterns (such as pressing buttons on a controller) as well as combining them with video (a video of Mario jumping is combined with a Jump action) — but adding these tags requires a lot of work. Instead, Genie learns only from videos and analyzes which of the possible actions will make the character change his position.
Genie generates each new game frame on the fly based on the player’s action: press “jump” and it will update the current image to show the game character jumping; press “left” and the image will change to show the character moved to the left
As for speed limits, it’s only a matter of time, says Tim Rockteschel, a Google DeepMind researcher:
“There are no fundamental limitations that would prevent us from achieving 30 frames per second. Genie uses many of the same technologies as today’s large language models, where significant progress has been made to improve output speed.”
Genie also learned some of the typical visual features of platformers – such as parallax, where the foreground moves sideways faster than the background – and often adds this effect to games.
Currently, the model is in the status of an internal research project and is not available to the public.
At the same time, games are not the only field of interest of Genie creators. The team is working on bots controlled by AI, which will be able to be in a virtual environment and solve various tasks by trial and error. In 2021, another DeepMind team developed a virtual playground called XLand, where such bots worked. All things considered, such an environment may well be created by Genie in the future.
The Technology section is powered by Favbet Tech
Favbet Tech is an IT company with 100% Ukrainian DNA, which creates perfect services for iGaming and Betting using advanced technologies and provides access to them. Favbet Tech develops innovative software through a complex multi-component platform capable of withstanding huge loads and creating a unique experience for players. The IT company is part of the FAVBET group of companies.
The competition of ITS authors is ongoing. Write an article about game development, gaming and gaming devices and win a professional Logitech G923 Racing Wheel or one of the low-profile Logitech G815 LIGHTSYNC RGB Mechanical Gaming Keyboard!