Apple is working on AI models that can run on-device rather than on the cloud

Daniel Sims

Posts: 1,375   +43
Staff
Forward-looking: Apple has yet to reveal any significant GenAI project, unlike competitors, which have rushed out apps to varying degrees of success. The company has said it wants to avoid the technology's notorious flaws with a cautious approach. Part of this plan is to circumvent cloud-based AI in favor of locally-processed solutions.

The Financial Times reports that Apple's hiring records, previous statements, and comments from analysts suggest the company will unveil the results of its investments in generative AI this year. Apple's future products will likely run generative AI models using built-in hardware instead of cloud services.

While Apple has been cautious regarding generative AI chatbots or image generators like OpenAI, Microsoft, Google, and Adobe, it has made significant investments in the sector. A report from last September indicated that the company was spending millions per day on multiple AI projects utilizing text, voice, and images.

Apple CEO Tim Cook acknowledged the company's investments last May, saying he wants to avoid the pitfalls companies like Google and OpenAI have encountered as early pioneers. Amid the initial push, generative AI has become notorious for its lack of trustworthiness, copyright issues, and massive energy demands.

Wedbush Securities analyst Daniel Ives told FT he'd be surprised if Apple didn't complete a notable AI-related deal this year, referencing the 21 AI startups the Cupertino giant has acquired since 2017. Furthermore, Morgan Stanley reports that nearly half of Apple's AI job postings mention deep learning, indicating an aggressive push in the sector.

Morgan Stanley also expects Apple's iOS 18 unveiling at the Worldwide Developers Conference in June to focus on AI. The company's biggest foundational LLM, internally named "Ajax GPT," could become the engine behind an improved version of its virtual assistant, Siri.

Apple's AI models could leverage the neural engines of its latest chips like the M3 and A17 Pro. Similarly, Neural Processing Units lie at the heart of Intel's recent push toward AI PCs with its Meteor Lake notebook processors, which Microsoft might quickly follow and complement with a new AI-powered version of Windows.

However, the clearest indicator of Apple's goal to process LLMs on its devices is the company's research paper from earlier this month, which proposed utilizing flash memory for the task. Google and Samsung recently unveiled smartphones using onboard AI hardware for image editing, real-time text translation, search, and other tasks.

Permalink to story.

 
**Apple is also working on...

Yeah, not surprised. They've been a follower when it comes to these things for a while now.
 
That could be very interesting. High quality personalised private training could be very useful. I like the idea of data brokers, small companies/individuals that have highly specialised datasets for narrow topics. Like submarines, watercolours, ants, German literature of the 80s etc ...
 
**Apple is also working on...

Yeah, not surprised. They've been a follower when it comes to these things for a while now.

Adobe says hold my beer. They don't want you doing any generative AI on the desktop, how can they charge you even more money that way?

Local AI is very welcome
 
As long as you have the memory you can run AI models on-device today no problem. And you don't even need that much of it. 12 Gigs of VRAM will go a long ways, and the software has only gotten better.
 
AI is just a Marketing ploy, how can you say that a device can think for itself??? Sigh! All AI claims are mere fiction cause the best anyone has done to have AI product is cockroach and that was about ten years ago, the thing is AI is just well written programming that imitates a set human like instructions.
It will take a change in computer architecture past Quantum computers..
 
AI is just a Marketing ploy, how can you say that a device can think for itself??? Sigh! All AI claims are mere fiction cause the best anyone has done to have AI product is cockroach and that was about ten years ago, the thing is AI is just well written programming that imitates a set human like instructions.
It will take a change in computer architecture past Quantum computers..
So when I ask a chatbot to "show me an image of John Cena riding a Space X Rocket". It's not "creating" the image, it was just a "well written program" from the get go?
 
No thanks, Apple.
So when I ask a chatbot to "show me an image of John Cena riding a Space X Rocket". It's not "creating" the image, it was just a "well written program" from the get go?
AI can do cut and paste no better than any human can.
 
Far too much reliance on the cloud is going to bite us hard... I support on device functionality. First and foremost I'd like to see Siri become completely on-device, and actually work well and recognize my voice for authentication. Maybe I'm just dreaming of Star Trek like computer interactions, but that's what I want to see.
 
So when I ask a chatbot to "show me an image of John Cena riding a Space X Rocket". It's not "creating" the image, it was just a "well written program" from the get go?
DUH programs can do that without the AI label lololol sigh
 
Back