www.macrumors.com Open in urlscan Pro
2606:4700:10::ac43:1682  Public Scan

Form analysis
2 forms found in the DOM

https://www.macrumors.com/search/

<form class="searchForm--3JuDLM1D" action="https://www.macrumors.com/search/"><input type="text" id="searchform" name="s" size="20" placeholder="Search Site..." title="Search Site" aria-label="Search Site"><input type="submit"
    class="submitButton--3zqlGEoI" value="Submit"></form>

Name: mc-embedded-subscribe-form — POST https://macrumors.us5.list-manage.com/subscribe/post?u=7d0106b433773bd0aef5828e0&id=3989954cde

<form class="emailForm--1VJ6QPf6" action="https://macrumors.us5.list-manage.com/subscribe/post?u=7d0106b433773bd0aef5828e0&amp;id=3989954cde" method="post" id="mc-embedded-subscribe-form" name="mc-embedded-subscribe-form" target="_blank"
  novalidate="">
  <p><label for="mce-EMAIL">Get weekly top MacRumors stories in your inbox.</label></p><input type="email" value="" title="Email address" name="EMAIL" id="mce-EMAIL" placeholder="Email Address" size="30"><input type="text" class="honepot--3h1N3dfl"
    name="b_7d0106b433773bd0aef5828e0_3989954cde" value="" title="Leave blank" tabindex="-1"><input type="submit" value="Subscribe" name="subscribe" id="mc-embedded-subscribe">
</form>

Text Content

Skip to Content
Got a tip for us?Let us know
 * a. Send us an email
 * b. Anonymous form
 * close

PodcastInstagramFacebookTwitterMastodonYouTubeNotificationsRSSNewsletter
Open Menu

 * Front Page
 * Roundups Show Roundups
    * AirPods 3
    * AirPods Max
    * AirPods Pro
    * Apple Car
    * Apple Deals
    * Apple Pay
    * Apple Pro Display XDR
    * Apple Studio Display
    * Apple TV
    * Apple Vision Pro
    * Apple Watch SE
    * Apple Watch Series 9
    * Apple Watch Ultra 2
    * CarPlay
    * HomePod
    * HomePod mini
    * iMac
    * iOS 17
    * iOS 18
    * iPad
    * iPad Air
    * iPad mini
    * iPad Pro
    * iPadOS 17
    * iPhone 13
    * iPhone 14
    * iPhone 15
    * iPhone 15 Pro
    * iPhone 16
    * iPhone 16 Pro
    * iPhone SE
    * Mac mini
    * Mac Pro
    * Mac Studio
    * MacBook Air
    * MacBook Pro 14 & 16"
    * macOS Sonoma
    * visionOS
    * watchOS 10

 * Guides
 * How Tos
 * Reviews
 * Buyer's Guide
 * Forums

PodcastInstagramFacebookTwitterMastodonYouTubeNotificationsRSSNewsletter
Visit ForumsSearch

Close Search
Open Sidebar
 * Apple Vision Pro
 * iOS 17
 * iPhone 15
 * iPhone 15 Pro
 * iPhone 16
 * iPhone 16 Pro
 * macOS Sonoma
 * visionOS
 * watchOS 10
 * MacBook Pro 14 & 16"
 * HomePod
 * iPhone 14
 * Apple TV
 * iPad Pro
 * Apple Watch Ultra 2
 * iPad
 * AirPods 3
 * Apple Car
 * Apple Pro Display XDR
 * HomePod mini
 * Mac Pro
 * MacBook Air
 * iPhone 13
 * AirPods Max
 * AirPods Pro
 * Apple Deals
 * Apple Studio Display
 * Apple Watch SE
 * Mac Studio
 * iMac
 * iPad Air
 * iPad mini
 * iPhone SE
 * Mac mini
 * iOS 18
 * Apple Watch Series 9
 * CarPlay
 * iPadOS 17
 * Apple Pay

All >

 * Front Page
 * Roundups
 * Guides
 * How Tos
 * Reviews
 * Buyer's Guide
 * Upcoming Products
 * Forums
 * Archives
 * Tips / Contact Us
 * PodcastInstagramFacebookTwitterMastodonYouTubeNotificationsRSSNewsletter




APPLE DEVELOPS BREAKTHROUGH METHOD FOR RUNNING LLMS ON IPHONES

Thursday December 21, 2023 2:26 am PST by Tim Hardwick

Apple GPT in your pocket? It could be a reality sooner than you think. Apple AI
researchers say they have made a key breakthrough in deploying large language
models (LLMs) on iPhones and other Apple devices with limited memory by
inventing an innovative flash memory utilization technique.





LLMS AND MEMORY CONSTRAINTS

LLM-based chatbots like ChatGPT and Claude are incredibly data and
memory-intensive, typically requiring vast amounts of memory to function, which
is a challenge for devices like iPhones that have limited memory capacity. To
tackle this issue, Apple researchers have developed a novel technique that uses
flash memory – the same memory where your apps and photos live – to store the AI
model's data.




STORING AI ON FLASH MEMORY

In a new research paper titled "LLM in a flash: Efficient Large Language Model
Inference with Limited Memory," the authors note that flash storage is more
abundant in mobile devices than the RAM traditionally used for running LLMs.
Their method cleverly bypasses the limitation using two key techniques that
minimize data transfer and maximize flash memory throughput:

 1. Windowing: Think of this as a recycling method. Instead of loading new data
    every time, the AI model reuses some of the data it already processed. This
    reduces the need for constant memory fetching, making the process faster and
    smoother.
 2. Row-Column Bundling: This technique is like reading a book in larger chunks
    instead of one word at a time. By grouping data more efficiently, it can be
    read faster from the flash memory, speeding up the AI's ability to
    understand and generate language.

The combination of these methods allows AI models to run up to twice the size of
the iPhone's available memory, according to the paper. This translates to a 4-5
times increase in speed on standard processors (CPUs) and an impressive 20-25
times faster on graphics processors (GPUs). "This breakthrough is particularly
crucial for deploying advanced LLMs in resource-limited environments, thereby
expanding their applicability and accessibility," write the authors.


FASTER AI ON IPHONE

The breakthrough in AI efficiency opens new possibilities for future iPhones,
such as more advanced Siri capabilities, real-time language translation, and
sophisticated AI-driven features in photography and augmented reality. The
technology also sets the stage for iPhones to run complex AI assistants and
chatbots on-device, something Apple is already said to be working on.

Apple's work on generative AI could eventually be incorporated into its ‌Siri‌
voice assistant. Apple in February 2023 held an AI summit and briefed employees
on its large language model work. According to Bloomberg, Apple is aiming for a
smarter version of Siri that's deeply integrated with AI. Apple is planning to
update the way that ‌Siri‌ interacts with the Messages app, allowing users to
field complex questions and auto-complete sentences more effectively. Beyond
that, Apple is rumored to be planning to add AI to as many Apple apps as
possible.




APPLE GPT

Apple is reportedly developing its own generative AI model called "Ajax".
Designed to rival the likes of OpenAI's GPT-3 and GPT-4, Ajax operates on 200
billion parameters, suggesting a high level of complexity and capability in
language understanding and generation. Internally known as "Apple GPT," Ajax
aims to unify machine learning development across Apple, suggesting a broader
strategy to integrate AI more deeply into Apple's ecosystem.

As of the latest reports, Ajax is considered more capable than the earlier
generation ChatGPT 3.5. However, it's also suggested that OpenAI's newer models
may have advanced beyond Ajax's capabilities as of September 2023 .

Both The Information and analyst Jeff Pu claim that Apple will have some kind of
generative AI feature available on the ‌iPhone‌ and iPad around late 2024, which
is when iOS 18 will be coming out. Pu said in October that Apple is building a
few hundred AI servers in 2023, with more to come in 2024. Apple will reportedly
offer a combination of cloud-based AI and AI with on-device processing.

Tag: Apple GPT Guide
[ 145 comments ]


Get weekly top MacRumors stories in your inbox.


TOP RATED COMMENTS

grantishere
3 weeks ago
“Siri, when’s Apple GPT going to be released?”

“Here are the neatest pizza restaurants. Would you like directions?”
Score: 66 Votes (Like | Disagree)

Infodataset
3 weeks ago
Apple is so clever to avoid adding more ram ?
Score: 53 Votes (Like | Disagree)
Abazigal
3 weeks ago

> Does this mean Siri will finally be able to “call my wife on iPhone” again
> after losing that ability around 2-3 years ago?

At least it didn't respond with "which one?" ?
Score: 34 Votes (Like | Disagree)
wdfly
3 weeks ago
LOL innovative invention of swapping memory to storage…… maybe they can call it
something cool like “cache”.
Score: 22 Votes (Like | Disagree)
subjonas
3 weeks ago
Sounds like some significant headway. I’d definitely like as much AI done on
device as possible.

Apple will probably always be behind with their LLM as long as they prioritize
privacy, which I’m very ok with. But just like with big phones, they will bend
if there is enough market pressure, which I suspect may eventually be the case.
Score: 21 Votes (Like | Disagree)
contacos
3 weeks ago
I'll be impressed when Siri is finally multi-lingual. I cannot believe Siri was
released with iPhone 4S and it still cannot do it. It could be as simple as
being "aware" what language you usually type in with contact A and automatically
use Siri in language X to communicate with this person while using language Y
with contact Y. All they did was "this text is in another language, do you still
want me to read [the gibberish nonsense]" with iOS 16
Score: 18 Votes (Like | Disagree)

Read All Comments


POPULAR STORIES


APPLE PLANS TO EXPAND IPHONE DRIVER'S LICENSES TO THESE 8 U.S. STATES

Saturday January 6, 2024 9:34 am PST by MacRumors Staff 2
In 2021, Apple introduced a feature that lets residents of participating U.S.
states add their driver's license or ID to the Wallet app on the iPhone and
Apple Watch, providing a convenient and contactless way to display proof of
identity or age. Unfortunately, states have been slow to adopt the feature since
it was first announced in September 2021, with Wallet app IDs only supported
in...
Read Full Article


OLED IPAD PROS COULD START FROM $1,500, RISING TO AS MUCH AS $2,000

Monday January 8, 2024 4:09 am PST by Tim Hardwick
Apple's upcoming OLED iPad Pro will start at $1,500, rising to between $1,800
and $2,000 depending on size and configuration, representing a major increase in
prices compared to Apple's current equivalents. That's according to a new report
on the news aggregator account "yeux1122" on the Naver blog. This is the second
time a Korean source has claimed that Apple's new iPad Pros will be...
Read Full Article • 203 comments


APPLE ANNOUNCES FEBRUARY 2 LAUNCH DATE FOR VISION PRO HEADSET

Monday January 8, 2024 6:03 am PST by Hartley Charlton
Apple today announced that the Vision Pro headset will launch in the United
States on Friday, February 2. The headset will be available at all Apple Store
locations in the United States, as well as via the online Apple Store. Apple CEO
Tim Cook today said: The era of spatial computing has arrived. Apple Vision Pro
is the most advanced consumer electronics device ever created. Its...
Read Full Article • 257 comments



APPLE AGREES TO PAY CANADIAN CUSTOMERS FOLLOWING IPHONE THROTTLING CONTROVERSY

Sunday January 7, 2024 4:18 pm PST by Joe Rossignol
Canadians may soon be eligible to receive a payment from Apple following the
company's iPhone battery throttling controversy in 2017. Apple has agreed to pay
up to $14.4 million (CAD) to settle a class action lawsuit in Canada that
alleged the company secretly throttled the performance of some iPhone models,
and the British Columbia Supreme Court will decide whether to approve the
proposed...
Read Full Article • 24 comments


IOS 17.3 COMING SOON WITH THESE TWO NEW FEATURES FOR YOUR IPHONE

Wednesday January 10, 2024 6:44 am PST by MacRumors Staff 2
iOS 17.3 has been in beta testing since mid-December, and the upcoming software
update includes two new features for the iPhone so far. Apple seeded the third
beta of iOS 17.3 this week. The update should be coming soon, with a release
likely later this month. Below, we provide additional details about the new
features in iOS 17.3 so far. Stolen Device Protection Earlier this year, T...
Read Full Article


NEW MACBOOK AIR MODELS LAUNCHING THIS MARCH: 5 FEATURES TO EXPECT

Tuesday January 9, 2024 6:50 am PST by Tim Hardwick
The existing 15-inch MacBook Air arrived in June 2023, which is not that long
ago in terms of Mac update cycles. However, Apple released the current 13-inch
‌MacBook Air back in June 2022. It is now the oldest Mac in Apple's current
crop, having not been updated in over 550 days. But rumors suggest that is
unlikely to be the case for much longer. According to Bloomberg's Mark Gurman,
Apple...
Read Full Article



AMAZON'S NEW IPAD SALE HAS UP TO $170 OFF IPAD MINI, IPAD AIR, AND 9TH/10TH GEN
IPAD

Wednesday January 10, 2024 8:06 am PST by Mitchel Broussard
Today we're tracking a few iPad discounts on Amazon, including the 9th and 10th
generation iPad, iPad mini, and iPad Air. These deals include multiple all-time
low prices on Apple's tablets, matching the prices we tracked over the holiday
season. Note: MacRumors is an affiliate partner with Amazon. When you click a
link and make a purchase, we may receive a small payment, which helps us keep...
Read Full Article • 21 comments


APPLE VISION PRO: HERE'S EVERYTHING YOU GET IN THE BOX

Tuesday January 9, 2024 3:17 pm PST by Tim Hardwick
Apple has announced the launch date of Apple Vision Pro, its much-touted spatial
computing device. The mixed reality headset starts at $3,499 and will go on sale
in the U.S. on Friday, February 2, with availability in Canada and the United
Kingdom expected to follow later this year. Apple has not yet revealed all the
details about the device's configuration options ahead of pre-orders, which ...
Read Full Article • 157 comments


NEXT ARTICLE

Your Mac and Apple Vision Pro: What You Can Do (and What You Can't)



GUIDES

iOS 17 Features


Our comprehensive guide highlighting every major new addition in iOS 17, plus
how-tos that walk you through using the new features.

iOS 17.2 Features


Journal app, spatial video recording, Messages sticker reaction improvements,
Action button translate option, and more.

iPhone 15 and iPhone 15 Pro: How to Use All the New Features


Get the most out your iPhone 15 with our complete guide to all the new features.

50 New macOS Sonoma Features


A deep dive into new features in macOS Sonoma, big and small.

• macOS Sonoma Features to Check Out First
• iPhone 15 vs. iPhone 15 Pro
• 22 Hidden Features in watchOS 10
• Apple Watch Series 9 vs. Apple Watch Ultra 2
• 15 Time-Saving iPhone Tips
• 14 macOS Tips to Make Your Life Easier
• 14" MacBook Pro vs. 16" MacBook Pro
• Apple M2 Chip
• AirPods 3 vs. AirPods Pro 2
• One AirPod Not Working?
See more guides


UPCOMING

Apple Vision Pro
Early 2024

The Apple Vision Pro AR/VR headset is set to launch in early 2024. It features
dual 4K displays, gesture tracking, an M2 chip, and a $3,499 price tag.

MacBook Air
Early 2024

M3 models in 13.6" and 15.3" sizes.

iPad Air
Early 2024

Updated 10.9-inch model and new 12.9-inch model, M2 chip expected.

iPad Pro
Early 2024

Revamped models with OLED displays, M3 chip, and redesigned Magic Keyboard
accessory.

See full product calendar


OTHER STORIES

When is the Apple Vision Pro Coming Out?

18 hours ago by Juli Clover

Is 8GB of RAM Enough for a Mac in 2024?

22 hours ago by Tim Hardwick

iOS 17.3 Coming Soon With These Two New Features for Your iPhone

1 day ago by MacRumors Staff

New MacBook Air Models Launching This March: 5 Features to Expect

2 days ago by Tim Hardwick

Apple Announces Vision Pro Pre-Order Date

3 days ago by MacRumors Staff



 

MacRumors attracts a broad audience of both consumers and professionals
interested in the latest technologies and products. We also boast an active
community focused on purchasing decisions and technical aspects of the iPhone,
iPad, Mac, and other Apple platforms.



About MacRumors.com

Advertise on MacRumors





OUR STAFF

Arnold Kim
Editorial Director
Email • Twitter
Eric Slivka
Editor in Chief
Email • Twitter
Juli Clover
Managing Editor
Email • Twitter
Joe Rossignol
Senior Reporter
Email • Twitter
Mitchel Broussard
Deals Editor
Email • Twitter
Tim Hardwick
Senior Editor
Email • Twitter
Hartley Charlton
Senior Editor
Email • Twitter
Marianne Schultz
Project Manager
Email • Twitter
Dan Barbera
Video Content Producer
Email • Twitter
Ryan Barrieau
Graphic Designer
Email •Twitter
Steve Moser
Contributing Writer
Email • Twitter
Marko Zivkovic
Contributing Writer
Email • Twitter
Aaron Perris
Contributor
Email • Twitter


RELATED LINKS

Touch Arcade
Out Now: ‘Buriedbornes2’, ‘Alphadia I & II’, ‘Devil May Cry: Peak of Combat’,
‘Cardara!’, ‘Guts ‘n Grunts’, ‘Populus Run’, ‘NothingDoor’ and More
Virtual Pet/RPG Hybrid ‘Yolk Heroes: A Long Tamago’ Launching March 19th, New
Trailer Released
SwitchArcade Round-Up: ‘Cynthia: Hidden in the Moonshadow’, Plus Today’s Other
Releases and Sales
The Best Shoot ‘Em Ups On Switch To Play in 2024 – Cave, M2 STG, Taito, and More
Shmups
Marvel Snap’s New January 2024 Balance Update Tweaks Loki, Kingpin, and More
‘Devil May Cry: Peak of Combat’ Download Available and Launch Trailer Released
Ahead of Servers Going Live Tomorrow
SwitchArcade Round-Up: Reviews Featuring ‘My Next Life as a Villainess’, Plus
the Latest Releases and Sales
SpongeBob SquarePants ‘The Cosmic Shake’ and ‘The Battle for Bikini Bottom’ Are
Now Included in a Discounted Bundle From HandyGames on iOS
YouTube
CES 2024 Day 2: Interesting Tech from LG & Pepcom!
CES 2024 Day 1: Insane New Tech from Samsung!
Apple Vision Pro Available February 2nd! #visionpro #apple #shorts
Apple's New Products for 2024: Vision Pro, OLED iPad Pro, iPhone 16 & More!
Apple’s 2023 Year in Review | The MacRumors Show Ep. 82
Copyright © 2000-2024 MacRumors.com, LLC.

Privacy / DMCA contact / Affiliate and FTC Disclosure
Accessibility Statement
[ Featured On/Off ] [ Full Articles On/Off ] [ Fluid | Fluid HD ] [ Auto | Light
| Dark ]
Update Privacy Preferences