Facebook's Automatic Alternative Text Gives Photo Descriptions to Blind Users


Facebook just launched a program that reads keywords related to images on users’ newsfeeds. Automatic alternative text, or automatic alt text, uses object recognition technology to offer a “richer description” of the photo content.

On its Newsroom press page, Facebook stated that 2 billion photos are uploaded across its family of apps every day, and with “more than 39 million people who are blind, and over 246 million who have a severe visual impairment, many people may feel excluded from the conversation around photos on Facebook.”

“Each advancement in object recognition technology means that the Facebook Accessibility team will be able to make technology even more accessible for more people,” the social network added. “When people are connected, they can achieve extraordinary things as individuals and as a community — and when everyone is connected, we all benefit.”

Automatic Alternative Text from Facebook on Vimeo.

In the video above, one user with a visual impairment says:

That whole saying of pictures being worth a thousand words — I think it’s true, but unless you have somebody to describe it to you, even having three words, just helps flesh out all of the details that I can’t see. That makes me feel included and like I’m a part of it, too.

Prior to this advancement, people using screen readers only heard the name of the person who shared the image, followed by the word “photo.” Now, when they scroll through their newsfeeds, they might hear, “Image may contain three people, smiling, outdoors.”

Automatic alt text is first being launched on iOS screen readers set to English, but Facebook plans to add the program for other languages and platforms soon.

“Facebook’s mission is to make the world more open and connected,” the social network concluded in the video above. “And that goes for everyone.”

You can read more about the development of automatic alt text here, and learn more in Facebook’s Help Center and at facebook.com/accessibility.

Related to Blindness

When You Live in the Grey Area of Blindness

When people see me read within five inches from my face, they ask me, “Do you wear contacts?” or “Do you have glasses at home?” To which I say yes, and then they have a look of confusion on their faces. For most people, vision is something that can and must be fixed. They snap [...]

To the Man Who Wants to Marry Me

I once believed that no man would want to spend the rest of his life with me, let alone date me. I have been called many names based on my disability, and those words are hard to forget. “She does not matter. She is blind.” “You poor thing.” Having a disability can cause a battle [...]

How a Disabled Pregnant Woman Handles 6 Insensitive Questions

Being a young, 30-something, blind woman, I usually stand out in a crowd. People are often shocked to see someone my age wielding a white cane as I navigate through my local neighborhood. When my husband and I found out we were expecting just six months after I had been declared blind, the two of [...]

When a Doctor Said 'You Poor Thing' About My Blindness

I used to go to an eye doctor whose words showed that he looked down on me and my disability. He said, “You poor thing,” when I could not pass the eye exam. He was trained to be an expert on vision, but he was not an expert on my life. He looked at the [...]