Wearable intelligent sensing blind guiding system

Abstract

A wearable intelligent sensing blind guiding system disclosed by the present invention comprises an MCU main control unit, a binocular camera, a voice broadcast module, a GPS positioning module, a local memory, a 4G/5G communication interface and an antenna, the binocular camera is connected with the MCU main control unit through a USB interface, the GPS positioning module is connected with the MCU main control unit through a UART interface. The local memory is connected with the MCU main control unit through a bus interface, the 4G/5G communication interface is connected with the MCU main control unit through a DTU interface, the 4G/5G communication interface is connected with an antenna, and the voice broadcast module is connected with the MCU main control unit through a UART interface; the binocular camera collects environment information, and the MCU uses a CNN deep learning neural network model to detect various obstacles on a walking channel of the visually impaired person, determine distances and orientations of the obstacles, reasonably plan a walking route, identify zebra crossings and traffic lights at a traffic intersection, and prompt the visually impaired person to walk through voice.

Description

technical field [0001] The invention relates to the field of blind guidance, in particular to a wearable intelligent perception blind guidance system. Background technique [0002] China is the country with the largest number of blind people in the world, about 12 million, accounting for 18% of the world's blind population. As a special group of social groups, they live in boundless darkness all their lives, so they often encounter various problems. The current market Most of the guide products on the Internet are simple in structure and single in function (it can only simply remind you that there are obstacles in front of you). Although some products are easy to use, the auxiliary effect is not obvious. Moreover, visually impaired friends will encounter many problems when using them. For example, the road conditions are bad, potholes are uneven, there are obstacles hanging ahead, etc. Ordinary blind guide products cannot accurately detect them. The obstacle detection funct...

AI Technical Summary

Problems solved by technology

[0002] China is the country with the largest number of blind people in the world, about 12 million, accounting for 18% of the world's blind population. As a special group of social groups, they live in boundless darkness all their lives, so they often encounter various problems. The current market Most of the guide products on the Internet are simple in structure and single in function (it can only simply remind you that there are obstacles in front of you). Although some products are easy to use, the auxiliary effect is not obvious. Moreover, visually impaired friends will encounter many problems when using them. For example, the road conditions are bad, potholes are uneven, there are obstacles hanging in front, etc. Ordinary guide products cannot accurately detect

The obstacle detection function of the existing blind guide products is only limited to the detection of the distance of the obstacle, and cannot accurately locate the position of the obstacle, and can only detect a single obstacle, such as the detection of multi-moving obstacles. Among them, only the obstacle closest to the user can be detected, so the practicability of the product's blind-guiding function is greatly reduced

[0003] There are international and domestic teams and companies who have conducted research on smart blind-guiding equipment such as guide glasses, but due to unsatisfactory performance and user experience, etc. In the stage of performance testing and small batch trial production, no large-scale market has been formed so far

Especially in China, the research and development of auxiliary blind-guiding equipment for the visually impaired is still in its infancy, and there is still a long way to go before large-scale productization and commercialization. Space is far from reaching the stage of development and popularization, so it is particularly important to solve this kind of problems

Images