Method for replacing vision based on the cognizing and target identification

Abstract

The invention relates to a visual replacement method based on cognition and target identification, the steps are: detecting objects in an environment image, obtaining category information and position information of each object; combining object information in an object information buffer to update existing objects Information, add newly discovered object information and delete expired object information, adjust the attention level of each object in the object information buffer accordingly; sort the objects according to the attention level of the objects in the object information buffer; sort the sorted The information in the object information buffer is converted into three-dimensional stereo sound or tactile signals corresponding to the category information of the object and the position information of the object, so that the blind can quickly obtain the position of the most recent and most accessible object in the object information buffer and category information. The invention enables the blind person to focus on newly appearing objects in the environment image while obtaining the category and position of each object in the environment through the method, so as to understand the environment more efficiently.

Description

technical field [0001] The invention relates to a method in the field of information technology, in particular to a visual substitution method based on cognition and target recognition. Background technique [0002] With the development of computer vision, pattern recognition technology and multimedia technology, people began to try to use information-based electronic devices to assist the life of the blind. In the field of life assistance for the blind, hearing or touch is generally used instead of vision to deliver information to the blind (the so-called "sensory substitution" or "visual substitution"). However, since human information acquisition is greatly dependent on vision, more than 80% of human information is obtained through visual channels, while hearing and tactile information transfer is very little, so how to use sound or tactile sense to properly represent the information in the environmental image, Making the most important information in the environment ava...

AI Technical Summary

Problems solved by technology

But its main problem is: first, when there are multiple objects in the environment, the blind person will hear the sound of all objects in the environment at the same time, making it difficult for the blind person to distinguish the sound of a single object

Second, if in practice the sounds heard by the blind person are made to have a certain interval before and after so that the blind person has time to hear each sound, the time taken to represent multiple objects in the entire environment will be extended, which undoubtedly reduces the blind person's The speed of obtaining environmental information

Third, when the position of the blind person changes or the objects in the environment move, new objects appear in the environment image. However, in the above invention, since the methods of representing each object after recognition are consistent, the newly recognized objects are very easy to recognize. Difficult to distinguish from objects that have already been identified

Finally, when the object detection unit of the above invention detects multiple objects of the same type in the environment image, a false negative error occurs, blind people may regard the recognized objects in the environment as the same object, causing the original object to move. illusion

[0004] The difficulty of the existing technology is that although there are ways to obtain the category and position of objects in the environment, since the amount of information transmitted by hearing is much smaller than that of vision, it is necessary to consider how to use a more efficient way to inform blind people that they can know the obstacles in the surrounding environment Information

Images