A neural network in a smartphone. Qualcomm optimized Stable Diffusion for fast performance on Snapdragon 8 Gen 2

Bringing large language models like Stable Diffusion to smartphones is the next step in bringing generative tools to a wider audience.

Typically, such generative neural networks require a lot of computing power to run, and most applications that offer such services on mobile devices perform processing in the cloud. However, Qualcomm has proven that its version of Stable Diffusion can easily do this on a smartphone.

Qualcomm showed off Stable Diffusion version 1.5, which generated a 512 x 512 pixel image in 15 seconds. By comparison, generating images on a decent laptop would take a few minutes, so the phone’s result is impressive.

It’s not known which smartphone was used for the demonstration – but it is equipped with the flagship Snapdragon 8 Gen 2 chipset (released last November and the AI-focused Hexagon processor). The company’s engineers have also performed various software optimizations to ensure optimal operation of the program.

In fact, other experimenters have already tried to run Stable Diffusion on Android. Developer Ivon Huang blogged about running a generative neural network on a Sony Xperia 5 II with a Qualcomm Snapdragon 865 processor and 8GB of RAM. Although, as Huang noted, it took an hour to create a 512 x 512 image with this setting.

Back in December, Apple released the optimizations needed to run Stable Diffusion locally on its own Core ML machine learning platform. Journalists at The Verge tried running Stable Diffusion 1.5 on iPhone 13 through Core ML-accelerated Draw Things. With this setting, it took about a minute to create a 512 x 512 image.A neural network in a smartphone.  Qualcomm optimized Stable Diffusion for fast performance on Snapdragon 8 Gen 2

Therefore, in both cases, Qualcomm wins in speed, but has certain limitations – the latest hardware and an optimization package that is not publicly available.

Running large AI models on mobile devices offers many advantages over cloud computing: convenience (no mobile connection required), cost (developers won’t charge users when the server bill is due), and privacy (you don’t sending data to someone else’s computer).

Source: The Verge

Related Posts

Nokia updated its logo for the first time in 60 years

The once-legendary Finnish smartphone maker Nokia Corporation has unveiled a new logo — its first logo change in nearly 60 years. The brand’s new identity, which causes…

“Not many people know what Nike is.” Ukrainian trailer of the film “AIR” / Air about the success story of a sports brand with Ben Affleck and Matt Damon

Warner Bros. Ukraine has published a dubbed Ukrainian trailer for the new film directed by Ben Affleck called Air, about the success story of the world-famous sportswear…

Review of the film “Myrnyi-21”.

Russia’s military invasion of Ukraine in 2014 forever changed the lives of all Ukrainians. This was reflected in all spheres of practical life in the country. Cinematography…

We have a ghost

On February 24, Netflix released the comedy film “We’ve Got a Ghost!”, starring David Harbor and Anthony Mackie. Its plot is based on the short story “Ernest”…

Microsoft is pushing users to install Windows 11 even on non-supported PCs with full-screen banners.

Microsoft Corporation is very active in luring Windows 10 users to the more modern Windows 11. This is far from news. But now the company’s efforts in…

The first four Leopard 2 are already in Ukraine – 10 more from Poland and 18 from Germany are on the way, instead of the 14 announced earlier

The first Leopard 2 A4 tanks are already in Ukraine – Prime Minister of Poland Tadeusz Morawiecki personally participated in their transfer. Another 10 tanks will arrive…

Leave a Reply

Your email address will not be published. Required fields are marked *