AI accessibility? Blind gamer puts ChatGPT to the test
Japanese eSports gamer Mashiro, who is blind, is exploring the potential of artificial intelligence to enhance his independence. Mashiro recently tested the latest version of the AI chatbot ChatGPT while making his way to a stadium for a Para eSports event.
At 26 years old, Mashiro, also known as Masahiro Fujimoto in his online persona, faces challenges navigating Tokyo alone due to his visual impairment. However, with the advancements in AI technology, he sees an opportunity to design his own support system tailored to his specific needs.
AI Technology for Accessibility
This year, OpenAI introduced GPT-4o, a sophisticated AI tool capable of interpreting voice, text, and image commands across multiple languages. Alongside other innovations like Google's Gemini, this technology is revolutionizing accessibility in education, employment, and daily life services.
Using his tactile stick adorned with a small monkey mascot, Mashiro followed the tactile paving on the streets while conversing with ChatGPT through an earpiece. Despite the challenges he faced, such as the increased time needed for navigation and the reliance on a friend in certain situations, Mashiro remained determined to explore the capabilities of AI.
Empowering Individuals through AI
Youngjun Cho, an associate professor in computer science at University College London, emphasizes the vast potential of AI in empowering individuals with disabilities. He envisions a future where AI technologies like speech-to-text transcription and personalized chatbots cater to specific needs, promoting independence and inclusivity.
While AI tools like Seeing AI, Envision AI, and TapTapSee cater to the visually impaired by describing images captured through phone cameras, initiatives like Be My Eyes connect volunteers to individuals in need of visual assistance.
Challenges and Opportunities
Despite the progress in AI accessibility tools, experts like Masahide Ishiki and Marc Goblot caution against the limitations and biases present in current AI datasets. Ishiki highlights the need for improved real-time visual recognition, while Goblot emphasizes the importance of diverse representation in AI training data.
For Mashiro, the limited recognition of Japanese words and locations by ChatGPT posed challenges during his AI-assisted journey. While he found the experience enjoyable, he believes integrating ChatGPT with map tools could enhance future travels, drawing from his past experiences navigating with Google Maps and external assistance.
