As reported by CNBC, Apple’s senior director of machine learning and artificial intelligence, Benoit Dupin, made a surprise appearance at Amazon’s AWS re:Invent conference in Las Vegas today.
Dupin used the opportunity to explain that Apple uses custom artificial intelligence chips from Amazon Web Services for many of its cloud services. Apple is also evaluating using Amazon’s newest AI chip to pre-train its Apple Intelligence models.
While speaking at the event, Dupin touted that Apple has used AWS chips, like the Graviton and Inferentia, for over a decade to help power Siri and search, the App Store, Apple Music, Apple Maps, and more. In doing this, Apple realized a 40% gain in efficiency compared to x86 chips from Intel and AMD.
“We have a strong relationship, and the infrastructure is both reliable, definite and able to serve our customers worldwide,” Dupin explained. Before joining Apple in 2014, Dupin served as the vice president of Amazon’s A9 Search Technology group.
“As we’ve grown our efforts around machine learning and AI, our use of AWS has grown with it. Apple leverages AWS services across many phases of our AI and ML lifecycle. From fine-tuning models to optimization and building the final adapters ready for deployment, AWS provides scalable, efficient, and high-performing accelerator technologies that Apple needs. This support has been crucial in helping Apple scale its training infrastructure to meet the demands of innovation.”
Dupin also confirmed that Apple is currently evaluating the latest AWS AI training chip, dubbed the Trainium2. During his appearance, Dupin said that Apple expects “up to 50% improvement in efficiency with pre-training” with the Trainium2 chip.
Apple’s use of the Trainium2 would be tied to pre-training for artificial intelligence models. The chips would not be used to actually run Apple Intelligence features for customers.
Apple Intelligence features are powered on-device or in the cloud using Apple’s Private Cloud Compute platform. Apple’s Private Cloud Compute infrastructure is built on its own Apple Silicon chips.
Earlier this year, Apple also confirmed in a research document that it used Google Tensor chips to train artificial intelligence models. At the time, we noted that it was notable for Apple to opt for Google’s Tensor chips instead of the Nvidia chips that other companies tend to rely on.
Follow Chance: Threads, Bluesky, Instagram, and Mastodon.
FTC: We use income earning auto affiliate links. More.
Comments