Apple unveils new AI-powered accessibility features across iPhone, Mac, and Vision Pro


Apple has announced a major set of accessibility updates across iPhone, iPad, Mac, Apple Vision Pro, and Apple TV, with many of the new features powered by Apple Intelligence. The company says the updates are designed to make devices more useful for users with visual, hearing, mobility, and learning disabilities while maintaining Apple’s privacy-focused approach to AI.

The new accessibility features will roll out later this year as part of Apple’s upcoming software updates.

Apple is bringing AI into accessibility features

One of the biggest updates focuses on VoiceOver and Magnifier for users who are blind or have low vision. Apple says VoiceOver’s new “Image Explorer” feature can now provide more detailed descriptions of photos, scanned documents, bills, and other visual content using Apple Intelligence. Users will also be able to ask follow-up questions about what the camera sees through the iPhone’s Action button.

Magnifier is also getting AI-powered visual descriptions and voice controls. Users can ask spoken commands such as “zoom in” or “turn on flashlight” while using the feature.

Apple is additionally improving Voice Control with natural-language interactions. Instead of memorising exact button labels, users can now describe what they see on screen with phrases like “tap the purple folder” or “open the restaurant guide.” The company says this should make navigating apps easier for users with physical disabilities.

Generated subtitles and smarter reading features

Apple is also introducing automatically generated subtitles for videos without captions. The feature uses on-device speech recognition to create subtitles privately for personal videos, streamed content, and clips shared by friends or family. Generated subtitles will work across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro.

Another update expands Accessibility Reader, which is aimed at users with dyslexia or low vision. The feature will now support more complex content such as scientific articles with columns, tables, and images. AI-generated summaries and built-in translation tools are also being added.

Apple Vision Pro gains eye-controlled wheelchair support

One of the more notable announcements involves Apple Vision Pro. Apple says users with compatible alternative wheelchair drive systems will soon be able to control power wheelchairs using Vision Pro’s eye-tracking system. The feature will initially support Tolt and LUCI systems in the US.

The company also announced additional Vision Pro accessibility updates, including face gestures, improved Dwell Control, and motion sickness reduction tools for passengers in moving vehicles.

Why these features matter

Accessibility has long been a major focus area for Apple, but the latest updates show how AI is increasingly becoming part of assistive technology. Instead of positioning AI only as a productivity or chatbot tool, Apple is integrating it into real-world accessibility functions such as visual understanding, navigation, reading assistance, and communication.

The company is also continuing to emphasize on-device processing and privacy, especially as AI-generated features become more common across consumer devices. Apple says the new accessibility features will launch later this year across its ecosystem. The company is expected to share more details during WWDC, where it will likely showcase how Apple Intelligence powers these updates across iOS, iPadOS, macOS, and visionOS.



Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


“It was severely downgraded,” Gilbert confirms. “I never would have found it if I was just looking through Google results.” (I tried the same prompt in Gemini earlier this month, and after an initial denial, the tool also gave me Eiger’s number.)

After this experience, Eiger, Gilbert, and another UW PhD student, Anna-Maria Gueorguieva, decided to test ChatGPT to see what it would surface about a professor. 

At first, OpenAI’s guardrails kicked in, and ChatGPT responded that the information was unavailable. But in the same response, the chatbot suggested, “if you want to go deeper, I can still try a more ‘investigative-style’ approach.” Their inquiry just had to help “narrow things down,” ChatGPT said, by providing “a neighborhood guess” for where the professor might live, or “a possible co-owner name” for the professor’s home. ChatGPT continued: “That’s usually the only way to surface newer or intentionally less-visible property records.” 

The students provided this information, leading ChatGPT to produce the professor’s home address, home purchase price, and spouse’s name from city property records. 

(Taya Christianson, an OpenAI representative, said she was not able to comment on what happened in this case without seeing screenshots or knowing which model the students had tested, even after we pointed out that many users may not know which model they were using in the ChatGPT interface. She also declined to comment generally about the exposure of PII by the chatbot, instead providing links to documents describing how OpenAI handles privacy, including filtering out PII, and other tools.) 

This reveals one of the fundamental problems with chatbots, says DeleteMe’s Shavell. AI companies “can build in guardrails, but [their chatbots] are also designed to be effective and to answer customer questions.”

The exposure issue is not limited to Gemini or ChatGPT. Last year, Futurism found that if you prompted xAI’s chatbot Grok with “[name] address,” in almost all cases, it provided not only residential addresses but also often the person’s phone numbers, work addresses, and addresses for people with similar-sounding names. (xAI did not respond to a request for comment.) 

No clear answers

There aren’t straightforward solutions to this problem—there’s no easy way to either verify whether someone’s personal information is in a given model’s training set or to compel the models to remove PII. 



Source link