Tech

Facebook and Instagram are adapting photo captions for the visually impaired

With AI, screen reading software can offer a description of images through greatly improved visual recognition

Updated 5 years ago · Published on 22 Jan 2021 4:00PM

Facebook and Instagram are adapting photo captions for the visually impaired
This new, more detailed description will first launch as a test on Facebook and Instagram. – ETX Studio pic, January 22, 2021

MAKE social networks more accessible to people with disabilities - this is what Facebook and Instagram aim to do through the use of artificial intelligence. From now on, photos published on these platforms will be equipped with a better description that will help blind and visually impaired people.

Facebook first launched this initiative back in 2016. Using automatic alternative text (AAT), the social network had set up a system to help blind and visually impaired people perceive photos published on the platform. Relying on artificial intelligence, screen reading software can offer a description of images through visual recognition. And the system is now greatly improved, Facebook announced on its blog. "The latest iteration of AAT represents multiple technological advances that improve the photo experience for our users." 

Descriptions are now more detailed and the system recognizes up to 10 times more photo content than when it was launched. The software can now describe the position of people in a photo and recognize actions and locations more accurately: "Detailed descriptions also include simple positional information - top/middle/bottom or left/center/right - and a comparison of the relative prominence of objects, described as "primary," "secondary," or "minor." These words were specifically chosen to minimize ambiguity. Feedback on this feature during development showed that using a word like "big" to describe an object could be confusing because it's unclear whether the reference is to its actual size or its size relative to other objects in an image. Even a Chihuahua looks large if it's photographed up close!," Facebook explains in its post. 

For users, photos of their loved ones will be more detailed while a shorter description will be adapted to other photos posted on the platform. According to Techcrunch, Facebook will offer simple descriptions so that they can be more easily translated into other languages for other countries when the system launches globally. – ETX Studio, January 22, 2021

Related News

Malaysia / 2d

Social media users defend UM student amid backlash over Najib fundraiser

Malaysia / 3d

Social media posts ‘emerge’- defending Ismail after Tuanku Muhriz’s public rebuke

Malaysia / 3d

Agong warns against using social media to spread hatred, insult others

Malaysia / 2w

Rejected love, pent-up emotions can push teenagers towards violence, says criminologist

Malaysia / 1mth

UMNO’s fundraiser for Najib draws sharp criticism on social media

Malaysia / 1mth

Another former senior minister expected to be called in for questioning?

Spotlight

Malaysia

Papagomo acquitted for second time in sedition case over government, Israel claims

Malaysia

ECRL fares start at RM60, with 50% discounts for children, seniors and OKU

Malaysia

DKU seeks court action against Ismail, 16 others over Negeri Sembilan royal dispute

By Alfian Z.M. Tahir

Malaysia

Kampung Manis: Dreams of 227 families to own replacement homes draw closer

Malaysia

Fadhlina takes legal action over video of 2023 Parliament speech

By Alfian Z.M. Tahir

Malaysia

Civil servants urged to turn Selangor Sultan’s anti-graft message into action

Malaysia

Animal welfare group urges probe into alleged sexual abuse of cat in viral video

Malaysia

Macron appeals for calm after France riots: 2,400 arrested, nearly 1,000 officers injured

Malaysia

Malaysia renews offer to help Indonesia fight fires

You may be interested

Our Planet

Countries off track on 22 of 23 global nature targets ahead of COP17

Events

Taobao revamps cross-border shopping as demand for Chinese brands grows

By Alfian Z.M. Tahir

Health

Singapore makes three potentially deadly viruses notifiable from Oct 31

People

Prevention and early detection vital to reduce NCD rates, says Penang Exco

By Ian McIntyre