Real time object detection & recognition on mobile devices (an assistive tool for visually impaired)

Abstract

This project purely is designed for visually impaired people to help them in detecting objects, With the help of mobile phones user will be capable to perceive their desired objects in Realtime. User will be able to detect one object at one time in real-time. This is an Android[12] application in which the core functionalities are detecting objecting in real-time and speech recognition. To achieve object detection in real-time the detector which have used is SSD[1] along with mobilenetV2[2] for the classification. SSD[1] mobilenetv2[2] is a pretrained model trained on coco[3] dataset which consist of 80 classes that means this application can detect 80 different objects. Along with the detecting objects this application will be doing speech recognition, through the speech recognizer[13] user will be able to interact with the application. And system will be giving results and messages to the user using Android[12] text-to-speech. This application is going to play a full of force part in changing living’s of unsighted persons. Application is considered to be useful tool for visually impaired people to assist them to perceive multiple objects using mobile device camera. With the help of this tool user can easily locate and find objects within specific range with respect to the size of the objects.