AI-powered backpack navigates blind pedestrians

Researchers at the University of Georgia created a special backpack in the US that can help the visually impaired overcome difficulties in their everyday life. The backpack is equipped with a Luxonis OAK-D 4K spatial camera that combines an Artificial intelligence processor with Intel Movidius image processing technology.

The system receives in-depth information and color images, detects obstacles on the ground and above the head of the user, and informs him via voice queries in order to find the right way. For instance, the system reads traffic signs (traffic lights, signs, etc.) and informs the user to stop if there isn’t a STOP sign for vehicles.

The system is managed with a Bluetooth headset and voice commands so that the user could request a description of the surrounding area or save his areas of interest with specific names (e.g. home park office). The total weight is quite small, therefore the transport isn’t tedious. The user should get used to wearing a backpack when he is outdoors.

The researchers intend to make that technology available to anyone who wants to improve it, as an open-source project, and in the future, it may be more practical to use. (e.g. a pair of smart glasses).