Apple Unveils AI-Powered Accessibility Features for iPhone, Mac, and Vision Pro

Apple’s New Accessibility Features Add AI Subtitles, Natural Voice Control, and Eye Tracking

Apple has announced a major set of accessibility updates coming later this year across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro, and this time, the company is using Apple Intelligence to make several core accessibility tools far more useful in real everyday situations.

The update focuses on features people already use daily, including VoiceOver, Magnifier, Voice Control, Accessibility Reader, and live subtitles, while also adding new eye-tracking controls for power wheelchair users on Vision Pro.

The biggest change here is how Apple is finally bringing natural language and contextual understanding into accessibility tools that previously depended on rigid commands or limited recognition systems. Instead of memorizing exact phrases or relying on basic image detection, users can now ask questions naturally, describe what they see, and interact with devices in a much more flexible way.

Apple also spent a large part of the announcement talking about privacy, especially because these new features rely heavily on AI processing.

ā€œApple’s approach to accessibility is unlike any other,ā€ said Tim Cook, Apple’s CEO. ā€œNow, with Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design.ā€

Sarah Herrlinger, Apple’s senior director of Global Accessibility Policy and Initiatives, also described the updates as ā€œnew, intuitive options for input, exploration, and personalizationā€ that still protect user privacy.

VoiceOver and Magnifier become far more interactive

Apple is expanding both VoiceOver and Magnifier with Apple Intelligence-powered image understanding and conversational interaction, which should make a noticeable difference for blind users and people with low vision.

VoiceOver’s new Image Explorer can now provide detailed descriptions of photos, scanned documents, bills, personal records, and other visual content systemwide. Users can also press the Action button on iPhone and ask follow-up questions about what appears inside the camera viewfinder.

That matters because older accessibility systems often stopped after giving one simple description, while this version allows users to continue the conversation naturally and request more context.

Magnifier receives similar upgrades and now supports spoken commands like:

  • ā€œZoom inā€
  • ā€œTurn on flashlightā€
  • ā€œRead this billā€
  • ā€œWhat does this sign say?ā€

Apple also redesigned the experience with a high-contrast interface aimed at users with low vision.

Voice Control finally supports natural language

Voice Control has existed for years, but many users struggled because they had to memorize exact labels or command structures before they could navigate apps properly.

Apple is changing that with a new flexible input system powered by Apple Intelligence.

Users can now say things like:

  • ā€œTap the purple folderā€
  • ā€œOpen the guide about best restaurantsā€
  • ā€œTap the map buttonā€

Instead of depending on exact interface labels, the system now understands descriptive language based on what appears onscreen. Apple says this also helps when apps fail to label buttons correctly for accessibility support.

This update looks especially useful for navigating visually dense apps like Maps, Files, and productivity apps where small interface elements usually create accessibility barriers.

Accessibility Reader now handles complex documents better

Accessibility Reader also receives one of its biggest upgrades yet, especially for users with dyslexia or low vision who struggle with dense layouts and academic material.

Apple says the feature now works better with:

  • Scientific articles
  • Multi-column documents
  • Pages with tables and images
  • Complex formatted layouts

The system can also generate summaries before users start reading, which helps people understand long articles faster before diving into full details.

Another important addition is built-in translation support that keeps the original formatting, colors, and font settings intact while translating text into the user’s native language.

Apple adds AI-generated subtitles across the ecosystem

One of the most practical additions announced today is automatic subtitle generation for videos that do not already include captions.

This feature works with:

  • Personal videos
  • Clips shared by family or friends
  • Online streamed content
  • Videos recorded on iPhone

Apple says subtitles generate directly on-device using speech recognition, which keeps everything private while automatically displaying spoken dialogue across iPhone, iPad, Mac, Apple TV, and Vision Pro.

For many users who are deaf or hard of hearing, this solves a frustrating issue where personal clips and social videos often arrive without subtitles even though professionally produced content usually includes them.

Vision Pro gets eye-based wheelchair controls

Apple also introduced a new accessibility feature for Apple Vision Pro that allows compatible power wheelchairs to use eye tracking as a control system.

The feature launches first with Tolt and LUCI alternative drive systems in the United States and supports both Bluetooth and wired connections.

ā€œThe option to control my power wheelchair on my own is gold to me,ā€ said Pat Dolan, founder of GeoALS and a member of Team Gleason’s patient advisory board, who has lived with ALS for 10 years.

Apple says Vision Pro’s eye tracking works across different lighting conditions and does not require frequent recalibration, which should make the system more reliable for long-term use.

Other accessibility updates coming later this year

Apple also announced several smaller accessibility improvements across its platforms:

  • Vehicle Motion Cues arrive on visionOS to reduce motion sickness in moving vehicles
  • Vision Pro gains face gesture controls and improved Dwell Control eye selection
  • Touch Accommodations gets more personalization options in iOS and iPadOS
  • Made for iPhone hearing aids gain improved pairing and device handoff
  • tvOS adds Larger Text support for easier reading
  • Name Recognition now supports more than 50 languages
  • FaceTime gains a new API for sign language interpretation apps
  • Sony Access controller support arrives for iPhone, iPad, and Mac gaming

Apple says all of these features will roll out later this year across supported devices.

One thought on “Apple Unveils AI-Powered Accessibility Features for iPhone, Mac, and Vision Pro

  • You’re getting somewhere. Now try fixing Passwords and Downloads. They stay in folders used by the browser. It’s extremely annoying to have to go through 6 or 12 folders before you can find THE PASSWORDS and THE DOWNLOADS. Browsers need to have some of that control taken away from them. Another thing, STOP FORCING us to use Google’s crap. I own an iPhone, not an Android.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.