Prefer to listen? Here's the narrated briefing on this area.
Listen to Accessibility and assistive AI
Plus unlocks audio streaming. Pro adds downloadable audio, video, certificates, and more.
Evidence & Reach
Be My Eyes, partnered with OpenAI's GPT-4V, gives blind and low-vision users real-time AI-narrated descriptions of their surroundings, documents, and product labels. Apple's VoiceOver, Microsoft's Seeing AI, and Google's Lookout serve millions of vision-impaired users daily. AI-powered AAC (augmentative and alternative communication) devices from Tobii Dynavox and PRC-Saltillo give nonverbal people — including those with ALS, severe autism, and locked-in syndrome — fluent communication. Sign-language translation left the lab in August 2026, when Google DeepMind shipped **SL2T** on the Pixel 11: Deaf and hard-of-hearing users sign directly into Gboard and Live Transcribe instead of typing, starting with American Sign Language to English. It was trained on more than 100,000 hours across over 50 sign languages, and an on-device vision model sends only face, hand and body pose coordinates to the server, so no video leaves the phone. In 2026 Be My Eyes extended its AI assistant onto Ray-Ban and Oakley Meta smart glasses, putting real-time visual description into a hands-free wearable.
Sources:Be My Eyes — AI integrationMicrosoft Seeing AIWHO World Report on DisabilityBe My Eyes + Meta smart glasses (Be My Eyes, 2026)Meta Brain2Qwerty — non-invasive BCI (Meta AI, 2026)SL2T sign-language-to-text (Google DeepMind, 2026)
A Specific Story
A blind law student in São Paulo uses Be My Eyes' AI feature to read court filings unassisted — pointing her phone at a document and getting fluent English or Portuguese narration of legal language her screen reader struggles with. She's one of an estimated 285 million vision-impaired people globally for whom GPT-4-class multimodal AI is the first technology that meaningfully closes the print-access gap.
What's Next
Real-time AI captioning that handles overlapping speakers and dialect variation (a major step beyond current YouTube auto-captions), brain-computer interfaces for ALS patients moving from research to clinical trials (Neuralink, Synchron), and AI-powered prosthetics that learn the wearer's movement patterns rather than requiring conscious control. Non-invasive brain-computer interfaces are advancing fast too — Meta's Brain2Qwerty decodes typed sentences from brain activity with no surgery required.
Recent Top AI Stories showing progress in this area.
Google's sign language model ships inside Gboard and Live Transcribe on the Pixel 11
Google DeepMind moved a sign-language-to-text model called SL2T out of research and into two shipping products, Gboard and Live Transcribe, on the Pixel 11 at no additional cost. It was trained on more than 100,000 hours across over 50 sign languages and reaches a zero-shot score of 70 on the BLEURT translation metric on the FLEURS-ASL benchmark, well above any previously reported result. Pose tracking runs on the device, so only geometric coordinates leave the phone. American Sign Language to English ships first, guided by an advisory committee of Deaf organizations.
Meta's Brain2Qwerty types sentences from brain waves — no surgery required
Meta and Spain's Basque Center on Cognition, Brain and Language published Brain2Qwerty, a deep-learning system that decodes typed sentences from non-invasive brain scans — reaching 61 percent word accuracy, and 78 percent for its best participant, versus roughly 8 percent for earlier non-invasive methods. It still needs a room-sized brain scanner, so it is a research milestone rather than a product, but it points toward communication tools for people with brain injuries that skip surgical implants. Meta released the code and dataset.
Meta expands Be My Eyes integration on Ray-Ban and Oakley Meta glasses with voice-activated group calls and a customizable accessibility shortcut
For Global Accessibility Awareness Day on Thursday, Meta announced an expansion of its Be My Eyes partnership that lets blind and low-vision users start hands-free video calls with trusted friends, family, or trained support representatives by saying *"Hey Meta, Be My Eyes with [name]"* on Ray-Ban Meta and Oakley Meta Vanguard glasses. Connected support partners include Tesco, Sony, Amtrak, Hilton, Zain, and Clearblue — covering retail, telecom, consumer electronics, healthcare, travel, and hospitality. Meta also added a customizable one-touch action button for frequent accessibility features, voice-only call controls coming to WhatsApp and Messenger, and a new Wearables Device Access Toolkit for third-party assistive-tech apps. Be My Eyes now reports more than one million blind users and more than ten million sighted volunteers worldwide.