Unlock instant, AI-driven research and patent intelligence for your innovation.

Blind Traffic Intersection Assistance Method Based on Fast Deep Neural Network and Mobile Smart Devices

A deep neural network, mobile smart device technology, applied in the field of electronic information, can solve problems such as difficult to use, expensive and complex equipment

Active Publication Date: 2022-04-22
BEIJING UNIV OF TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem of expensive and complicated equipment and difficult to use in the above-mentioned auxiliary method for blind persons at traffic intersections, the present invention proposes a method for assisting blind persons at traffic intersections based on fast deep neural network and mobile intelligent equipment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Blind Traffic Intersection Assistance Method Based on Fast Deep Neural Network and Mobile Smart Devices
  • Blind Traffic Intersection Assistance Method Based on Fast Deep Neural Network and Mobile Smart Devices
  • Blind Traffic Intersection Assistance Method Based on Fast Deep Neural Network and Mobile Smart Devices

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] The present invention uses Microsoft's COCO data set to pre-train the Q-DNN network. In addition, the present invention separately collects 2000 sets of traffic intersection scene training data, manually marks the obstacles, zebra crossings and traffic lights, and uses this data set to strengthen the pre-trained Q-DNN network. During the training, the training sample is divided into a training set and a verification set according to a ratio of 9:1; the batch size is set to 64 during training; CIOU_loss is used as the loss function of the Bounding box. CIOU_loss is based on DIOU, considering the scale information of the bounding box aspect ratio. The CIOU_loss calculation method is shown in formula (12):

[0066]

[0067] Among them, IOU is the intersection and union ratio of the prediction frame and the target frame, and Distance 2 Is the Euclidean distance between the predicted frame and the center point of the target frame, Distance c is the diagonal distance of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A blind traffic intersection assistance method based on a fast deep neural network and a mobile smart device belongs to the field of electronic information. This method designs a neural network Q‑DNN suitable for mobile smart devices with reference to other fast deep neural networks. By introducing an excellent network structure into the network, the feature extraction capability of the Q‑DNN network is enhanced and redundant network parameters are reduced. . The network realizes the accurate identification of important targets at traffic intersections and the requirement of real-time operation on mobile smart devices. Secondly, combined with GPS and detection results, guide the blind to the correct location of the zebra crossing. By detecting the direction of the zebra crossing, it can effectively assist the blind to adjust the walking direction and pass the zebra crossing smoothly. According to the traffic light detection results, a traffic light signal classification method based on HSI space is proposed to solve the problem of traffic light signal recognition. Finally, the present invention combines the above methods to design a mobile smart device-based auxiliary process for the blind at traffic intersections, effectively assisting the blind to pass safely and smoothly at traffic intersections.

Description

technical field [0001] The invention belongs to the field of electronic information, and is an auxiliary method based on a fast deep neural network and capable of assisting blind people to identify traffic lights and zebra crossings. Background technique [0002] According to statistics, there are about 17.3 million blind people in China, and the safe travel of blind people has attracted much attention. At present, the auxiliary tools used by the blind to travel mainly include guide sticks and guide dogs. Among them, the function of the blind guide stick is single, the detection range is not wide, and the information obtained can only rely on the blind person's own feelings. It is difficult to provide effective information such as zebra crossings and traffic lights in complex scenes such as traffic intersections. Guide dogs can guide the blind to avoid obstacles. However, it needs to go through a series of long training, and has problems such as high price and scarce quanti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): A61H3/06A61F9/08G06V10/44G06V10/56G06V10/82G06V20/54G06N3/08
Inventor 何坚刘新远魏鑫王钦
Owner BEIJING UNIV OF TECH