Visual content blind guiding auxiliary system and method based on coding and decoding technology

Abstract

The invention discloses a visual content blind guiding auxiliary system and method based on coding and decoding technology, and relates to the field of computer vision, the system comprises a central processor module, a depth camera module, a voice broadcast device module, a voice understanding device module and a power supply module; wherein the central processing unit is used for controlling the system, visual data processing and signal transmission, control software with a blind guiding system is deployed on the central processing unit, and the control software comprises a visual content interpretation unit, a voice recognition unit and a road planning unit; the depth camera is used for carrying out image acquisition on a current scene and generating an RGB image and a depth map; the voice broadcast device is used for understanding the voice information output by the central processing unit and playing object searching or road planning conditions; the voice understanding device is used for collecting voice information of a user and transmitting the voice information to the central processing unit; the power supply is used for supplying power to the central processor. The blind person can be assisted in better life, and the life quality is improved.

Description

technical field [0001] The invention relates to the field of computer vision, in particular to a system and method for guiding the blind with visual content based on encoding and decoding technology. Background technique [0002] In recent years, with the increasing development of artificial intelligence, deep learning has been widely used in the field of computer vision; such as target detection technology, image recognition technology, video content interpretation technology and so on. These technologies have developed in stages and have been successfully referenced in many products. Deep learning has greatly promoted the development of machine learning, and has been valued by researchers and high-tech companies in related fields around the world. Speech, image, and natural language processing are the three main research areas where deep learning algorithms are most widely used. In the field of speech recognition: In 2011, Microsoft launched a speech recognition system b...

AI Technical Summary

Problems solved by technology

Due to the high cost of emerging artificial intelligence products, high resource consumption, and relatively large network restrictions, it is difficult to popularize those emerging intelligent products in consideration of the actual situation of users

[0004] As far as the current stage is concerned, the intelligent system that uses deep learning technology to help blind people navigate is not yet mature. The main reason is that guiding the blind needs to ensure the accuracy of interpretation of visual content, and the resources that need to be consumed are too large, and the equipment cannot support these huge computing power.

Images