AI for Accessibility: Blind Gamer's Journey with ChatGPT

Published On Thu Jul 11 2024
AI for Accessibility: Blind Gamer's Journey with ChatGPT

AI accessibility? Blind gamer puts ChatGPT to the test | National ...

Japanese eSports gamer Mashiro is blind and often relies on a companion to get around Tokyo -- but he hopes that artificial intelligence, hailed as a promising tool for people with disabilities, can help him travel alone.

The 26-year-old "Street Fighter" player put the latest version of AI chatbot ChatGPT to the test on his way to a stadium for a recent Para eSports meet-up.

"I can't participate in an event like this without someone to rely on," he told AFP. "Also, sometimes I just want to get around by myself without speaking to other people. So if I can use technology like ChatGPT to design my own special needs support, that would be great."

This year, the US firm OpenAI released GPT-4o, which understands voice, text, and image commands in several languages. The generative gadget, along with others such as Google's Gemini, is part of a fast-growing field that experts say could make education, employment, and everyday services more accessible.

Unlocking the Potential of AI-Assisted Teaching with a Chatbot

Empowering Individuals with AI

AI can cater to specific needs better than "one-size-fits-all" assistive products and technologies, said Youngjun Cho, an associate professor in computer science at University College London (UCL).

"Its potential is enormous," said Cho, who also works at UCL's Global Disability Innovation Hub. "I envisage that this can empower many individuals and promote independence."

Software Testing & AI, Keys to the Future of Digital Accessibility

People with hearing loss can, for example, use AI speech-to-text transcription, while chatbots can help format a resume for someone with learning disabilities.

Some tools for visually impaired people, such as Seeing AI, Envision AI, and TapTapSee, describe phone camera images. Danish app Be My Eyes, where real-life volunteers help via live chat, is working with OpenAI to develop a "digital visual assistant."

Challenges and Future Development

Mashiro said ChatGPT's limited recognition of Japanese words and locations made his AI-assisted journey more challenging. Although the experiment was "a lot of fun," it would have been easier if ChatGPT was connected to a map tool, said the gamer, who traveled around Europe last year using Google Maps and help from those around him.

He has already decided on his next travel destination: Yakushima rainforest island in southern Japan. "I want to experience whatever happens when traveling somewhere like that," he said.

Assistive Technology for the Blind & Visually Impaired

AI is trained on "very mainstream datasets" which are "not representative of the full spectrum of people's perceptions and especially the margins," cautioned Marc Goblot of the Tech for Disability group.

Mashiro hopes that continued advancements in AI technology will further enhance accessibility for individuals with disabilities and open up new possibilities for independence and exploration.

Originally published on doc.afp.com, part of the BLOX Digital Content Exchange.