Unlock instant, AI-driven research and patent intelligence for your innovation.

Blind person traffic intersection auxiliary method based on rapid deep neural network and mobile intelligent equipment

A deep neural network, mobile smart device technology, applied in the field of electronic information, can solve problems such as difficult to use, expensive and complex equipment

Active Publication Date: 2021-04-20
BEIJING UNIV OF TECH
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem of expensive and complicated equipment and difficult to use in the above-mentioned auxiliary method for blind persons at traffic intersections, the present invention proposes a method for assisting blind persons at traffic intersections based on fast deep neural network and mobile intelligent equipment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Blind person traffic intersection auxiliary method based on rapid deep neural network and mobile intelligent equipment
  • Blind person traffic intersection auxiliary method based on rapid deep neural network and mobile intelligent equipment
  • Blind person traffic intersection auxiliary method based on rapid deep neural network and mobile intelligent equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] The present invention uses Microsoft's COCO data set to pre-train the Q-DNN network. In addition, the present invention separately collects 2000 sets of traffic intersection scene training data, manually marks the obstacles, zebra crossings and traffic lights, and uses this data set to strengthen the pre-trained Q-DNN network. During the training, the training sample is divided into a training set and a verification set according to a ratio of 9:1; the batch size is set to 64 during training; CIOU_loss is used as the loss function of the Bounding box. CIOU_loss is based on DIOU, considering the scale information of the bounding box aspect ratio. The CIOU_loss calculation method is shown in formula (12):

[0066]

[0067] Among them, IOU is the intersection and union ratio of the prediction frame and the target frame, and Distance 2 Is the Euclidean distance between the predicted frame and the center point of the target frame, Distance c is the diagonal distance of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a blind person traffic intersection auxiliary method based on a rapid deep neural network and mobile intelligent equipment, and belongs to the field of electronic information. According to the method, a neural network Q-DNN suitable for the mobile intelligent equipment is designed by referring to other rapid deep neural networks, and an excellent network structure is introduced into the network, so that the feature extraction capability of the Q-DNN network is enhanced, and redundant network parameters are reduced. The network realizes accurate identification of important targets at a traffic intersection and meets the requirements of real-time operation on mobile intelligent equipment. In addition, the blind person is guided to go to the correct position of a zebra crossing in combination with GPS and detection results. By detecting the direction of the zebra crossing, the blind person is effectively assisted in adjusting the walking direction and smoothly passing through the zebra crossing. A traffic light signal classification method based on an HSI space is provided according to a traffic light detection result, and the traffic light signal identification problem is solved. Finally, the method is combined, a traffic intersection blind person assisting process based on the mobile intelligent equipment is designed, and the blind person is effectively assisted to safely and smoothly pass through the traffic intersection.

Description

technical field [0001] The invention belongs to the field of electronic information, and is an auxiliary method based on a fast deep neural network and capable of assisting blind people to identify traffic lights and zebra crossings. Background technique [0002] According to statistics, there are about 17.3 million blind people in China, and the safe travel of blind people has attracted much attention. At present, the auxiliary tools used by the blind to travel mainly include guide sticks and guide dogs. Among them, the function of the blind guide stick is single, the detection range is not wide, and the information obtained can only rely on the blind person's own feelings. It is difficult to provide effective information such as zebra crossings and traffic lights in complex scenes such as traffic intersections. Guide dogs can guide the blind to avoid obstacles. However, it needs to go through a series of long training, and has problems such as high price and scarce quanti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): A61H3/06A61F9/08G06K9/00G06K9/46G06N3/08
Inventor 何坚刘新远魏鑫王钦
Owner BEIJING UNIV OF TECH