Synergistic visual search system and method capable of sharing attentions

Abstract

The invention relates to a synergistic visual search system and method capable of sharing attentions. The synergistic visual search system comprises a visual sampling and encoding module, a visual search module, a group cooperation module, an eye movement generating module, an eye movement sharing module and a group decision making module, wherein the virtual sampling and encoding module is respectively connected with the visual search module and the eye movement generating module and is used for receiving target encoding information of the virtual search module in the sampling process, generating a saliency map from top to bottom by utilizing a target searching, matching and eliminating method provided by the virtual search module, and generating two saliency maps which are respectively from top to bottom and from bottom to top on an eye movement sharing platform by eye movement information of the eye movement generating module; the group cooperation module is connected with the eye movement sharing module, shows behaviors on the eye movement sharing platform by coordinating the behaviors, and carries out interaction by utilizing various media mediums; and the group decision making module is connected with the eye movement sharing module by various media mediums and is used for analyzing current state information and determining a final decision by allocation of search strategies and tasks. According to the synergistic visual search system and method which are provided by the invention, unsmooth communication is eliminated, search failures generated by errors are indicated, and meanwhile, by utilizing multiple channels, cooperation efficiency can be effectively improved.

Description

technical field [0001] The invention relates to a technology in the field of image processing, in particular to a collaborative visual search system and method for shared attention. Background technique [0002] Most of human achievement is based on cooperation. Face-to-face communication is essential to good cooperation. With the development of computer science and network, a current hot issue is how to enable people in different places to cooperate through various communication networks, such as enabling experts scattered all over the world to cooperate to complete a certain project, just like face-to-face Cooperation is the same. On the surface, it seems that face-to-face conversation is so simple and natural, but in fact face-to-face conversation uses a variety of communication channels, such as words and sentences, tone of voice, gestures, facial expressions, body posture, eye gaze direction, etc. The brain hides from consciousness the details of how to control and c...

AI Technical Summary

Problems solved by technology

[0007] At present, there is no experimental platform in China that satisfies real-time interaction and complex visual search in a complete sense. The key lies in the fact that human beings have not fully analyzed the visual cognition of the objective world. Only through the eye movement measurement of the objective world, to verify the results of the search model

Images