Method, device and system for navigating blind person based on computer vision

Abstract

The invention relates to the technical field of computer vision, and concretely discloses a method for navigating a blind person based on computer vision. The method comprises the following steps: acquiring image data of a surrounding environment in real time through a camera; processing the image data through an algorithm to obtain the pose of the camera, the type of an object, the position of the object in the image data and depth information of each pixel; performing integrated processing on the pose of the camera, the type of the object, the position of the object in the image data and thedepth information of each pixel to obtain the position of the object in a three-dimensional coordinate system, and processing the pose of the camera to obtain the walking track of a user; and judgingwhether the user deviates from a walking route or not, and emitting prompt information about the existence or not of a barrier to the user according to the position of the object in the three-dimensional coordinate system. The invention also discloses a device and a system for navigating the blind person based on computer vision. The method navigating the blind person based on computer vision hasthe advantages of convenience for the blind person to use, and low cost.

Description

technical field [0001] The present invention relates to the technical field of computer vision, in particular to a computer vision-based blind navigation method, a computer vision-based blind navigation device and a computer vision-based blind navigation system including the computer vision-based blind navigation device. Background technique [0002] In recent years, with the improvement of hardware computing speed, deep learning algorithms have developed rapidly and have been widely used in the field of computer vision, such as face recognition, object detection, object tracking and other tasks. In these tasks, both accuracy and speed have surpassed traditional machine learning methods, and scientific and technological personnel are constantly looking for application scenarios, trying to apply these algorithms to actual products. Simultaneous Localization and Mapping (SLAM) technology can simultaneously solve the problem of precise positioning and map reconstruction. Posit...

AI Technical Summary

Problems solved by technology

Such a multi-sensor design increases the manufacturing cost, and the integration of multiple devices is inconvenient for users to carry, which causes difficulties for users and is not conducive to the popularization of this navigation technology.

Images