Qualcomm and Microsoft join hands to promote large-scale expansion of on-device AI at Microsoft Build developer conference
Main points
—
• Terminal-side generative AI solutions transfer query and reasoning to edge terminals such as PCs and mobile phones, allowing developers and cloud service providers to create more cost-effective, reliable and private generative AI.
Running Stable Diffusion on Windows laptops powered by Snapdragon computing platform
In order for generative AI to be truly accepted and used by more people, many reasoning tasks need to be processed on edge terminals. We have industry-leading AI hardware and software that empower developers to make full use of our powerful AI capabilities to create stunning new user experiences on laptops, mobile phones and other terminals equipped with Snapdragon platforms.
During Microsoft Build, Qualcomm Technologies will bring technology demos and bring tools to support the development of generative AI on next-generation Windows 11 PCs. Stable Diffusion is a generative AI model that generates text images with more than 1 billion parameters. It can now be fully run on the terminal side. Qualcomm Technologies said that in the next few months, models with up to 10 billion parameters, including large language models (LLM), are expected to run on the terminal side. In order to enhance the Qualcomm AI software stack and help developers create next-generation device-side AI experiences, Qualcomm AI Engine Direct SDK will be launched to the public for the first time on Microsoft Build. With the help of ONNX Runtime and Qualcomm AI software stack, users can now run AI workloads on the AI engine on the third-generation Snapdragon 8cx platform when using the 5G version of Surface Pro 9 and Lenovo ThinkPad x13s.
In order to expand AI across a wide range of devices and applications, both cloud and device-side processing are indispensable. By combining Microsoft's leadership in cloud AI and the capabilities of the Windows platform with Qualcomm Technologies' on-device AI expertise, we will accelerate the opportunities created by generative AI experiences.
For more information from Qualcomm Technologies at the Microsoft Build developer conference, please click [ Read the original text ].
*Qualcomm and Snapdragon are trademarks or registered trademarks of Qualcomm Incorporated.