New to Shacknews? Signup for a Free Account

Already have an account?

Video Game Release Dates 2024Palworld Strategy GuideShacknews Direct: Introducing Bubbletron!Destiny 2 Complete Strategy Guide
Video Game Release Dates 2024
Palworld Strategy Guide
Shacknews Direct: Introducing Bubbletron!
Destiny 2 Complete Strategy Guide

Qualcomm & Meta partner up on bringing open source Llama v2 LLM to mobile devices

Open source Llama v2 LLM is coming to smartphones thanks to a new partnership between Qualcomm and Meta.
Asif Khan
Asif Khan
Gizchina
3

Qualcomm and Meta announced a partnership today that will help everyone's favorite social media company's new large language model (LLM) Llama v2 run on mobile devices. While many LLMs require server farms powered by massively expensive NVIDIA GPUs, Llama 2 intends to run on Qualcomm chips for phones and PCs as soon as next year. Meta claims that Llama 2 can be packaged in smaller applications that can run on phones while doing much of the same stuff as market-leading chatbot ChatGPT.

Screenshot of Meta's Llama v2 website showing a header image that reads 'Introducing Llama 2 The next generation of our open source large language model Llama 2 is available for free for research and commercial use.'

Source: Meta

It's important to note that Llama v2 is an open-source effort from Meta. The company published its "weights," the data set that helps govern how an AI model works. This is a drastically different strategy when compared to other notable LLMs like Google Bard and OpenAI's GPT-4. 

Qualcomm chips feature a tensor processor unit (TPU) that the company believes will be fit for running calculations required by AI models. Between Meta's more streamlined Llama v2 offerings and Qualcomm's desire to get more involved in the extemely hot AI sector, it's possible that NVIDIA may actually face some competition if and when Llama v2 ships on mobile devices next year. This could also open the door for a lot of companies that have been on the sidelines waiting for more affordable ways to implement LLMs at a corporate or consumer level.

Meta and Qualcomm are no strangers to working together, with the Quest VR HMDs all running on variants of the Snapdragon line of chips. 

CEO/EIC/EIEIO
CEO/EIC/EIEIO

Asif Khan is the CEO, EIC, and majority shareholder of Shacknews. He began his career in video game journalism as a freelancer in 2001 for Tendobox.com. Asif is a CPA and was formerly an investment adviser representative. After much success in his own personal investments, he retired from his day job in financial services and is currently focused on new private investments. His favorite PC game of all time is Duke Nukem 3D, and he is an unapologetic fan of most things Nintendo. Asif first frequented the Shack when it was sCary's Shugashack to find all things Quake. When he is not immersed in investments or gaming he is a purveyor of fine electronic music. Asif also has an irrational love of Cleveland sports.

Filed Under
From The Chatty
Refresh Go To Thread
Hello, Meet Lola