Skip to content →

Detailed Image Descriptions with Bing

For us visually impaired individuals, accessing image descriptions has long been a challenge. While object recognition apps provided some assistance, they were limited in their ability to describe images comprehensively. However, recent developments in artificial intelligence have brought about a groundbreaking solution, making detailed image descriptions accessible to the community Let’s look at the brief history:

From Your Eyes and the Excitement it Created

One recent innovation that significantly improved the visual recognition experience for the visually impaired is the “From Your Eyes” app. This app utilizes artificial intelligence model to assist users in perceiving and describing images. While this was a remarkable step forward, it was just the beginning of a revolution in image descriptions and accessibility.

The Arrival of GPT-4 and the Be My Eyes Collaboration

In the spring of this year, the developers of the “Be My Eyes” app made a groundbreaking announcement. They revealed their partnership with OpenAI to integrate the world-renowned GPT-4 artificial intelligence language model into their application. This announcement sent waves of excitement through the visually impaired community.

Beta testing of this remarkable development was initially made available to iOS users, offering them the opportunity to receive detailed photo descriptions powered by the GPT-4 AI model. However, we Android users had to exercise a bit of patience as we await for our turn.

Microsoft and OpenAI’s Collaboration with Bing

While visually impaired Android users waited for the integration of GPT-4 into Be My Eyes, another significant development took place. Microsoft, in collaboration with OpenAI, integrated GPT-4 into its Bing search engine. This move is a game-changer for the visually impaired community, as it meant that detailed photo descriptions are now just a few taps away.

How to access Detailed Image Descriptions with Bing

So, how can visually impaired individuals access detailed image descriptions using Bing? Here’s a step-by-step guide:

  1. Download the Bing app from the Google Play Store and sign in with your Microsoft account.
  2. Navigate to the “Chat” section at the bottom of the app.
  3. Focus on the “Ask Bing” text box.
  4. Tap the “Add an image to search” button with the right swipe gesture to open your camera. You can either take a picture or choose a photo from your gallery.
  5. If you want to select a photo from your gallery, swipe left to reach the “Open Gallery” button.
  6. After selecting or taking a photo, return to the “Ask Bing” text box.
  7. Ask a question like, “Can you describe this photo for me?”
  8. Wait for a minute or so as your photo is sent to the server and analyzed.

The Magic of Detailed Image Descriptions

The wait is worth it, as the description you receive will be as accurate, consistent, and realistic as if it were provided by a sighted friend. You can also ask further questions privately to explore more details.

A Real-Life Experience

To illustrate the incredible capabilities of Bing’s detailed photo descriptions, consider this experience I had: Sending a photo of a leisurely evening in a park, featuring two friends seated on folding chairs. The resulting description was astoundingly detailed, encompassing everything from the lush park grass to the ambient lighting, the design of the chairs, and even the colors and styles of clothing we were wearing.


The integration of GPT-4 into Bing represents a significant stride toward enhancing accessibility for the visually impaired. Now, obtaining detailed and accurate photo descriptions is easier than ever, empowering visually impaired individuals to engage with the visual world in a whole new way. As technology continues to advance, the future holds even more promising innovations for the visually impaired community.

Views: 419

About Author

Hasan Çimen

Published in Tips and Tricks


Leave a Reply

Your email address will not be published. Required fields are marked *

Subscribe to Blind Android Users mailing list

RSS Latest Updates

  • Untitled 5 December 2023
    New app added to the Accessible Apps directory by Amir: Premium. Accessible with a few unlabeled buttons. Download the number one dictionary app with English language learning tools and word games built for every level of learner. #Android #App
  • Untitled 4 December 2023
    Much expected announcement! New app added to the Accessible Apps directory by Editorial Staff: Seeing AI. Accessible. Seeing AI is a free app that narrates the world around you. Designed with and for the blind and low vision community. #Android #App #AI #SeeingAI
  • Untitled 4 December 2023
    156th episode of the Blind Android Users podcast has landed on your favorite podcatcher of choice. This episode features Samsung OneUI lockscreen settings, managing and clicking links in messaging apps, new image recognition feature of Jieshuo Screen Reader, and Android journey of Amir Soleimani @amir #Android #accessibility #podcast
  • Untitled 28 November 2023
    New games added to the Accessible Apps directory by Will Bilec: Conjury and Click Your Poison: INFECTED. Accessible. #Android #App #Game #a11y
  • Untitled 20 November 2023
    New app added to the Accessible Apps directory by Wesley Martin: Wordweb dictionary. Accessible. Wordweb dictionary is a free offline English dictionary and thesaurus with synonyms, related words and great search – and no adverts. Audio pronunciations are available with the separate Audio Edition app. #Android #App
  • Untitled 19 November 2023
    New app added to the Accessible Apps directory by Warren Carr: Radio G. Accessible with a few unlabeled buttons. Radio G is an online radio player that also includes a recorder #Android #App
  • Untitled 19 November 2023
    154th episode of the Blind Android Users podcast has landed on your favorite podcatcher of choice. This episode features Samsung OneUI display settings, Android 14 QPR Beta 2.1, interview with Dipti Prasad from Nobaflix a leading OTT for app mainly for Visually challenged individuals in India. #Android #accessibility #podcast