Indoor article searching and positioning method for visually impaired people

Abstract

The invention discloses an indoor article searching and positioning method for visually impaired people. The method comprises the following steps: S1, enabling the visually impaired people to input the name of a target article through a voice module and then collect images indoors through a binocular camera; s2, designing an adaptive sigmoid transfer algorithm (ASTF) based on a neural network, andcombining the ASTF with a Laplace operator to enhance the brightness of the acquired image and reduce the distortion degree; s3, designing a variable-scale convolutional neural network to convolve the images obtained in the step S2 to the same size; s4, designing a convolutional neural network fused with a multi-level attention mechanism to extract feature information of the image obtained in S3,and matching the feature information with feature data of a target object in a database; s5, if matching succeeds, obtaining the position of the target object, and outputing position information of the target object through a voice module; and if the matching is not successful, outputting the information that no information exists through the voice module. According to the invention, visually impaired people can be effectively helped to accurately search articles in a weak light environment.

Description

technical field [0001] The present invention relates to the technical field of image processing and recognition, in particular to a new adaptive sigmoid transfer algorithm (ASTF), a variable-scale convolutional neural network, and a method for extracting features of target items fused with a multi-level attention mechanism neural network. Background technique [0002] At present, there are many visually impaired people in our country. Due to the lack of visual information, visually impaired people cannot perceive and recognize common objects in life, which brings great challenges to their daily life. Although there have been many methods to help the visually impaired overcome visual difficulties in recent years, such as guide dogs and white canes for the blind, etc., these solutions can only serve as a navigation function, and cannot effectively identify and guide the blind. , especially in low-light environments, these methods play a weaker role. When the visually impaired...

AI Technical Summary

Problems solved by technology

This method only uses the attention mechanism for different video features, that is, extracts the overall feature information of different video features through the attention mechanism and fuses them. It also does not consider the overall (object), local (component) and minimum features of different videos. Characteristic information of constituent units (pixels)

Images