Intelligent blind assisting system and method based on auditory and tactile guidance

Abstract

The invention discloses an intelligent blind assisting system based on auditory and tactile guidance. The device comprises a sound acquisition module, a camera shooting module, an information processing module, an auditory stimulation module and a tactile stimulation module; the sound acquisition module acquires an external sound signal and outputs the external sound signal to the information processing module; the camera shooting module acquires external scene image information and outputs the external scene image information to the information processing module; the information processing module analyzes and processes the external sound signal and the scene image information and outputs a processing result to the auditory stimulation module and the tactile stimulation module through an auditory and tactile information distribution algorithm, the auditory stimulation module outputs a voice prompt according to the processing result, and the tactile stimulation module implements tactilestimulation according to the processing result. According to the method, the auditory stimulation module and the tactile stimulation module are combined for guidance; prompt voice which has a virtualthree-dimensional sound effect and contains position and space estimation distance information of a target object relative to the camera shooting module is transmitted to a user, and prompt information of the direction and distance of the target object relative to an object taking hand is given to the user through the tactile stimulation module so as to efficiently complete daily complex activities.

Description

technical field [0001] The invention relates to a technology in the field of biomedical engineering, in particular to an intelligent blind aid system and method based on auditory and tactile guidance. Background technique [0002] Existing blind aid devices only have the function of guiding the blind to get close to the required items, and do not involve the guidance of the process of reaching out for the blind; blind aid devices that only use voice prompts do not make use of the blind's keen tactile perception ability, so it is difficult to be efficient Completing more complex daily tasks; a blind aid device that uses a depth camera to obtain spatial depth information has high cost, high power consumption, and high complexity. Contents of the invention [0003] Aiming at the above-mentioned deficiencies in the prior art, the present invention proposes an intelligent blind aid system and method based on auditory and tactile guidance. Through the auditory and tactile stimul...

AI Technical Summary

Problems solved by technology

[0002] The existing blind aid devices only have the function of guiding the blind to get close to the required items, and do not involve the guidance of the process of reaching out for the blind; blind aid devices that only use voice prompts do not make use of the blind's keen tactile perception ability, so it is difficult to be efficient Completing more complicated daily tasks; a blind aid device that uses a depth camera to obtain spatial depth information has high cost, high power consumption, and high complexity

Images