New technology helps visually impaired Facebook users

Visually impaired Facebook users can now use embedded object recognition technology to provide them with spoken text descriptions of photos.

Users of iOS devices are able to hear lists of items that are on shown in the photographs. Automatic alt text recognises objects using machine learning, which helps to build artificial intelligence by using algorithms to make predictions. The iPhone’s VoiceOver feature to reads descriptions of the photos out loud to user.

While still in its early stages, the technology can reliably identify concepts in categories including transportation ('car,'boat,' 'airplane'), nature ('snow,' 'ocean,' 'sunset'), sports ('basketball court), and food ('sushi'). It can also describe people ('baby,' 'smiling, 'beard'), and identify selfies.