Smart Glasses Allow Deaf People to See Real-Time Conversation Captions

XRAI Glass has launched a pioneering pair of augmented reality smart glasses that allow deaf people to see conversations in real-time. The phone-tethered AR smart glasses, which the company say is the “first of its kind”, aims to enable the deaf community to engage in everyday conversations by instantly turning audio into captions that are displayed in front of the wearer’s eyes.

I;m thinking this could be a “game changer” if CC is current or up to speed with active speech. But if there is a speech/close caption delay or misprinted words on glass lens then the jury might be out on how far this technology goes. But its seems like a great product especially for those who are deaf or profoundly hard of hearing.

Not sure why dark glass lenses but that might be required to read CC display clearly. Also I see a black cord connected to a smart phone but no discussion on how the smart phone interacts with CC glasses. So for now maybe this is more “hype” then reality but its a start and might someday be perfect for those who can’t hear.

Link -

Sounds like a great idea. Especially when I’m driving

2 Likes

For @hass5744 : I need the laughing emoji!!!

I do like this idea, it would help me!! Wonder how it works in a group setting, though.

2 Likes

I thought the same thing. Also, what is the speed of the text displayed? Will one have time to read a fast talkers conversation? Will more than 1 person overwhelm the “screen”? And how does it effect my focus and vision? Seems like an interesting concept. I look forward to seeing how this plays out

1 Like

I’m Dan the CEO of XRAI Glass! To answer your questions, the lenses are indeed dark so you can better see the display. Without it, light would flood in and they wouldn’t work so well.

In group settings with lots of people talking over each other it does struggle a little, but we’re working on that.

Transcription speed is about 1/2 to 1.5 seconds delay. Accuracy is 90-95% (depending on whether you’re using normal language or very specialist terms).

Can’t wait for you all to experience it!

4 Likes

Has anyone seen this. It looks like such an exciting development for people that are absolutely struggling to hear:
Incredible development for seriously deaf people: absolutely innovative and revolutionary!

https://www.euronews.com/next/2022/07/29/new-ar-glasses-allow-deaf-people-to-see-conversations-by-turning-audio-into-subtitles

2 Likes

It’s the same story as the link above. We’re so excited for you to try it!

1 Like

I don’t need it for my hearing, unless chemo kills hearing. But if anyone can advise on how to transfer this to the conversation started yesterday, to avoid duplication that would be nice

1.5 second delay is a long delay. And since the lenses are dark I have visions going down a dark staircase while it’s printing up a conversation. Nice idea but God.

It’s up to 1.5 seconds. It’s typically much quicker, normally around the 1/2 second mark. The glasses look a lot darker than they actually are wearing them. We would definitely not advise walking up and down stairs with them on though!

Dan I was joking but thank you

You’ll want to keep the radio OFF. And of course don’t wear these for night-time driving.
:neutral_face:

1 Like

Hey dan3,
Thanks so much for joining us with your insights on the new XRAI Glass! I was gonna put a fairly sarcastic response down below, but, um, er, I’ll keep it positive for now! :blush:

First thing that came to my mind with the phone interface and captioned audio was “I sure hope it isn’t as LAME as Google Translate!” I use that almost daily with a Hispanic crew working on the pool at my house. We get a bowl-full of belly laughs over the so-called translations. I realize there are slang terms, nuances of use, etc., but speech is a challenge to translate perfectly.

So many people mumble, speak with accents etc., that you have really taken on a big challenge. Honestly, instead of wearing dark glasses (maybe good for daytime use) I’d rather we had spoken speech streamed to our aids but without using an accessory like a Roger pen, conversation disk, necklace doodad or other cumbersome thingamajig that could be dropped, misplaced or lost.

I applaud ANYONE out there helping us folks here - or rather HEAR - seamlessly, easily, naturally, just like folks who don’t have any need for a hearing device. Think “contact lenses” for hearing. Just pop 'em in, and hear all sound streamed direct to the aids.

Can that ever be done? We put a man on the moon in 1969, yet here we are 50-odd years later with really NOT a whole lot to take one’s breath away in the hearing instrument world. In fact, most audiologists don’t even use laser imaging to get the best shape of an ear canal for custom molds. Why? Cuz these tools are expensive, so us folks have to be fit with putty that’s far from perfect and results in painful aids.

Well… I drifted a bit off topic here, but main thing is: thanks for taking up a cause for us and I hope your invention will continue to evolve to make it like “contact lenses” for hearing.

I love the inspiration behind this invention - a 97-yr-old grandpa trying to engage with family for converstion! I guess that brings up a question: how good is the dexterity and ability to learn a new technology for these seniors?

I am prompted to ask cuz years ago, my mother-in-law (now passed, but in her late 80s at the time) absolutely COULD NOT change the program on her aids. Not only was she unable to press the button on the aids to change programs, but she was unable to use her iPhone to make calls or answer the phone. She used Apple Siri to MAKE a call, but if one came through, she was unable to swipe the icon to answer the phone.

My own mom - now 97 years young - runs circles around ME! No walker, cane, still drives her car, leads Sr Exercise class, etc., has a different issue: she is ADD! She simply can not read a manual or be taught a new technology. So how can folks like that be trained to use a wonderful new device? She wants to stream phone calls like I do (and she wears Phonak Paradise aids), but could never manage a new-fangled phone and figure out BT pairing/connecting.

Dexterity and learning skills should be taken into account for seniors if they use a device for communicating.

What initially sounds like it might have potential maybe doesn’t. I seem to recall it’s a pretty noisy world out there

It’s not a hearing aid;, the cellphone hears the sounds and projects captioned print on the glasses that the person reads. It’s small technology;, but I hear you; people can be remarkably hopeless with anything new; but reading is a basic skill. Let’s see…
Agreed, amazing development process……

If it’s printing evey conversation continuously, including car radios TV’s, etc then it appears that it would be an overwhelming nightmare. Nobody said it’s a hearing aid. But how does it decide what it should or shouldn’t caption in the lenses. Example is I’m walking in the city. There’s people walking along side of me talking. There’s people walking towards me talking. Some guy on the corner is yelling for a cab. Cars are honking their horns. A police siren screams going by. I hear a subway train passing below ground. A typical day in NYC. What gets captioned.

What about eye strain? Can’t imagine reading words that are a quarter inch from my pupil

And the list gets longer and longer. But has certainly peaked everyone’s curiosity