Apple watchOS 27.3 Developer Beta Launches Audio Intelligence Always-On Listening Feature
Apple has introduced the Audio Intelligence feature in the watchOS 27.3 developer beta, allowing Siri to access the Apple Watch microphone. The new Siri Recap generates conversation summaries through ambient listening, while Live Rewind generates a text transcript of the last 15 seconds of audio captured by the watch microphone. Apple also released a privacy statement, saying that raw audio is processed within dedicated hardware and is not saved as files, and that neither the operating system, apps, nor Apple can access it; summaries or transcript segments that users choose to save are synced across devices in the Siri app via end-to-end encryption. The iOS 27.3 developer beta also opened testing of a redesigned Health app, adding an Insights tab and personalized For You recommendations, and expanded language support to include Simplified Chinese, Traditional Chinese, French, Japanese, Korean, and others.
Why read this
AI score 55
The original text explains two uses of the always-on listening feature and Apple's privacy approach, allowing readers to judge how such features would be implemented.
Topics
Body
Starting today, Siri can tune into the Apple Watch’s mic with Audio Intelligence features that are available in the new watchOS 27.3 developer beta rolling out now. The two new additions are Siri Recap, which uses “ambient listening” to generate summaries of your conversation, and Live Rewind, which generates text transcripts of the last 15 seconds of audio your watch’s mic detected.
Apple is also releasing its redesigned Health app for testing today in the iOS 27.3 developer beta, and announced expanded language support in global English, Chinese (Simplified and Traditional), French, Japanese, Korean, Norwegian, Portuguese, Spanish, Turkish, and Vietnamese. It adds sections like a new Insights tab with summaries for heart, sleep, fitness, and other data that pop up during the day, a For You section with personalized recommendations, and health content like educational videos and articles.
When it comes to the implications of an ambient, always-listening AI, Apple has released this Audio Intelligence Privacy Overview (pdf) about how it plans to protect users’ privacy when their watch is listening around the clock. It goes into detail about Apple’s claims that users’ raw audio “is handled within dedicated hardware, is not saved as a file, and is not accessible to the operating system, apps, or Apple.” According to Apple, “If you use iCloud with two-factor authentication and have a device passcode, any Siri Recap summary or Live Rewind text snippet you choose to save syncs across your devices end-to-end encrypted in the Siri app.”