Portable device and method for assisting blind person in taking bus

Abstract

The invention discloses a portable method for assisting a blind person in taking a bus. The method comprises the steps that multiple targets of pedestrians, buses and other vehicles are detected by constructing a deep neural network model; a position, size and reliability of a bus target in an image are obtained; bus target information detected continuously in multiple frames is fused and combinedwith distance detected by a ranging module to evaluate the traveling direction, moving speed and distance of the bus target; voice is played to prompt bus arriving information for a user. In addition, the blind person can input the route of a to-be-taken bus by using voice, the route is displayed on a display screen, so that a bus driver and other passengers conveniently provide assistance. The invention also discloses a portable device. The portable device comprises a controller, an image capturing module, a deep neural network inference module, the ranging module, a voice output module, a voice input module, a display module and the like. The portable device can prompt the blind person whether or not a bus arrives the station, and provides convenience for the blind person to get help ofother people.

Description

technical field [0001] The invention belongs to the research field of navigation for the blind, and in particular relates to a portable device and a method for assisting the blind to ride a car. Background technique [0002] When the blind person waits for the bus at the bus station, due to their visual defects, they cannot see the arrival of motor vehicles, nor can they judge whether the passing motor vehicles are buses, and travel is very inconvenient. At present, most of the field uses wireless communication. Establish electronic bus stop signs at bus stops, and add equipment to each bus. When the bus arrives, the two devices communicate with each other to remind blind people that the bus arrives; or each blind person carries a guiding device by himself, adding The sensing device, when the car is approaching, the two communicate with each other, and the guiding device prompts the blind person to get on the car. The downside of these types of installations is that they r...

AI Technical Summary

Problems solved by technology

The disadvantage of this type of installation is that it requires a large investment in retrofitting, such as modifying existing bus stops, or adding additional equipment to each bus, etc.

Images