Skip to main content

Apple's New Siri AI: Reads Your Screen, Remembers Your Life, Skips EU and China

Apple's New Siri AI: Reads Your Screen, Remembers Your Life, Skips EU and China

Apple today officially pulled back the curtain on its revamped Apple Intelligence, headlined by a completely rebuilt Siri AI. This isn't just a voice assistant with a fresh coat of paint—it's a context-aware companion that can dig through your messages, understand what's on your screen, and pick up conversations where you left off on another device.

The English beta is available now with the 2027 system update. Next month, French, Japanese, Korean, Portuguese, and Spanish join the party.

Siri Finally Gets What You're Talking About

The most striking upgrade is what Apple calls "personal context understanding." Ask Siri about an activity a family member suggested during a visit, and it'll comb through your chat history, find that they wanted to bake a family recipe together, grab the cooking steps from an old email, and add the ingredients to your shopping list. That's a mouthful, but it's the kind of seamless assist we've been waiting for.

System-level operations have also expanded. Siri can now write a letter from scratch or edit and share a photo set. In the third-party world, it can send WhatsApp messages, play audiobooks on Audible, and soon draft emails in Microsoft Outlook, search homework in Notability, and add restaurant recommendations in Tripsy.

Image

Your Screen Is an Open Book

Screen awareness is another headline feature. Browsing your favorite team's website? Ask Siri to find all home games and drop them into your calendar. Combined with broad world knowledge, it can check scores, plan vacations, or hunt down a coffee shop in a new city.

Waking up Siri is easier too. On iPhone, besides "Hey Siri," you can press the side button or swipe down from the Dynamic Island. On iPad and Mac, it's baked into Spotlight—hold Control and click to ask about images, files, or text on screen. On Vision Pro, a 3D interface floats anywhere in space; just look at it and speak. And the new dedicated Siri app syncs conversations via iCloud, so you can start on iPhone and finish on Mac, iPad, Apple Watch, or Vision Pro.

Image

Voice, Visuals, and Writing Get a Boost

The on-device AFM Core Advanced model brings a more expressive voice with customizable tone and speed. Speech recognition now handles capitalization, punctuation, and formatting on the fly. Visual intelligence spreads to iPad, Mac, and Vision Pro—iPad taps into screenshots, Mac gets keyboard shortcuts, Vision Pro lets you ask about physical objects, and iPhone adds a Siri mode in Camera. See a music festival poster? Ask about showtimes and add it to your calendar.

The writing tool works almost anywhere you can type, generating drafts or editing suggestions. It adapts punctuation and tone to each recipient, and system-wide proofreading covers most third-party apps. Photos gain spatial reconstruction, expansion, and stronger cleaning tools. Image Playground supports photorealistic styles via Private Cloud Compute, with SynthID identifying AI-generated images. Safari organizes tabs by theme, Notify Me watches for price drops, and custom extensions generate from descriptions. Calls get context awareness to fetch verification codes, Calendar entries are voice-controlled, Shortcuts build complex automations, and the Home app groups related notifications.

Audio, Health, and Privacy

Later this year, audio intelligence and health features arrive. Apple Watch Series 12 and Ultra 4, powered by the S11 chip, add sound recognition, real-time playback (double-tap the crown for the last 15 seconds of conversation text), Siri Review for auto-generated titles and highlights, and faster Shazam. Privacy stays front and center: Secure Exclave hardware isolation processes audio and deletes it immediately—no recordings stored. Real-time playback emits an audible prompt and shows a full-screen animation. iCloud syncs text fragments and summaries with end-to-end encryption. The Health app gets an "Insights" tab that turns sleep and VO2max data into personalized guidance.

The Architecture and the Catch

The new Apple Foundation Models were custom-built with Google and its Gemini models, running on-device and on Private Cloud Compute servers. Siri calls core capabilities like Spotlight index and App Toolbox through the system orchestrator, executed entirely on device. Apple Intelligence ships with iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27, covering iPhone 16 and newer, iPhone 15 Pro/Pro Max, iPad mini (A17 Pro), M1 and newer iPads, MacBook Neo, and M1 and newer Macs.

But there are clear limits. Siri AI won't be available on iOS, iPadOS, and watchOS in the EU initially, and dependent features will be missing. Apple says it's seeking a path that balances privacy and security. During regulatory talks, Siri AI and other new Apple Intelligence features also won't launch in China. Server-side model functions have daily quotas, with paid expansion options coming. And Siri AI isn't available to users under 13.

Key Points

  • Siri AI beta is out now in English, expanding to five more languages next month.
  • Personal context lets Siri dig through messages, emails, and photos to complete tasks.
  • Screen awareness turns any webpage or app into a queryable surface.
  • Cross-device continuity via iCloud keeps conversations flowing between iPhone, Mac, iPad, Watch, and Vision Pro.
  • Privacy first: on-device processing, Secure Exclave audio handling, and end-to-end encrypted sync.
  • Not in EU or China for now, and server-side features have daily quotas.