Introducing Apple’s On-Device and Server Foundation Models
Apple
|
Contributed by: Reid Stephan
Summary
At the 2024 Worldwide Developers Conference, Apple introduced Apple Intelligence, a personal intelligence system integrated into iOS 18, iPadOS 18, and macOS Sequoia. Apple Intelligence features generative models designed to enhance everyday tasks, like refining text, summarizing notifications, and creating playful images. Key components include a ~3 billion parameter on-device language model and a larger server-based model leveraging Private Cloud Compute. The development adheres to Responsible AI principles, emphasizing user empowerment, representation, careful design, and privacy protection. Training involves a combination of licensed and public data, with rigorous data quality and safety protocols. Apple’s models outperform many competitors in user preference for helpfulness and safety, facilitated by advanced fine-tuning and optimization techniques.
