Blind man navigation method and system based on computer vision

Abstract

Disclosed is a computer vision-based blind man navigation method; the system of the method mainly comprises two modules, wherein, ultrasonic wave is used to detect obstacles, and a video-awareness part is used for blind man navigation; an image acquisition device captures images through an ordinary video camera; a processor processes the captured video images through computer vision algorithm; the klt algorithm is used for feature tracking; and the corner features are taken as inputs. Firstly, the camera is artificially carried to travel along the pre-determined route so as to extract the feature points of partial image frames at equal time interval; then the extracted feature points are stored in a database. When a blind man walls along the trained route again, the feature points of each image frame are extracted and compared with the feature points stored in the database so as to finally determine the advancing direction of the blind man in the next step; and the steering result outputted through the video-processing algorithm is transmitted to the blind through feeling and sound sensation to form the three-dimensional feedback information and achieve blind man navigation.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a computer vision-based navigation method and device for blind people, which can help blind people to walk without hindrance in places they often go indoors and outdoors. Background technique [0002] As a special group in society, blind people need more care and care from society so that they can live better independently. How to walk safely is the biggest problem in the life of blind people. Blind people yearn for independence in life, but there are always aspects beyond their ability. In fact, many organizations have developed some tools to help blind people walk, such as: a navigation stick with a speaker, which has the advantage of emitting light at night to remind passers-by and drivers, but the disadvantage is that it is fragile and too sensitive; there are also tools for detecting obstacles ahead. Glasses for the blind have the advantage of being smaller in si...

AI Technical Summary

Problems solved by technology

In fact, many organizations have developed some tools to help blind people walk, such as: a navigation stick with a speaker, which has the advantage of emitting light at night to remind passers-by and drivers, but the disadvantage is that it is fragile and too sensitive; there are also tools for detecting obstacles ahead. Glasses for the blind have the advantage of small size and the disadvantage of small measurement range

In short, none of them can well meet the needs of actual use.

Images