Skip to content
Apple, often perceived as lagging in the AI race, has surprised many with its recent unveiling of OpenELM, a cutting-edge generative AI model optimized for on-device use.
While Apple’s AI endeavors have been shrouded in secrecy, the introduction of OpenELM showcases the company’s long-standing commitment to AI innovation.
OpenELM is a family of open-source language models designed to run efficiently on Apple devices such as iPhones and Macs. Using a layer-wise scaling strategy, OpenELM allocates parameters within each layer of the transformer model to enhance accuracy.
With eight models available in four different parameter sizes, ranging from 270M to 3B, OpenELM has been trained on public datasets, setting it apart from its predecessors.
What sets OpenELM apart is its ability to handle AI-powered tasks without relying on cloud servers, making it ideal for on-device use.
Despite requiring half the amount of training data compared to similar models like OLMo, OpenELM has demonstrated superior performance. It has been trained on CoreNet, an open-source library, alongside other models to enable efficient inference and fine-tuning on Apple devices.
In a departure from traditional practices, Apple has released OpenELM comprehensively, providing model weights, inference code, and a complete framework for training and evaluation on publicly available datasets.
This move aims to empower the open research community and foster future endeavors in AI research.
The timing of OpenELM’s release, just weeks ahead of Apple’s WWDC event, hints at the potential AI features to be unveiled in iOS 18. This open-source initiative reflects a significant shift in Apple’s approach, moving away from its previously secretive nature to embrace transparency and collaboration within the research community.
With tech giants like Microsoft and now Apple investing in small-model technology, the release of OpenELM underscores the growing importance of on-device AI.
Apple’s adoption of on-device AI enhances user privacy and signifies a new era of innovation in the AI landscape.
