Ultrasonic array interaction method and system fusing visual tactile perception

Abstract

The invention discloses an ultrasonic array interaction method and system fusing visual tactile perception. The method comprises the steps: collecting hand posture information, and calculating fingertip coordinates of a finger to form a position array; for the palm, calculating palm center coordinates and palm surface normal vector parameters to form a vector array; if the finger is detected, selecting to activate the ultrasonic array based on the distance according to the position array; if the palm is detected, starting a motion platform based on directivity selection according to the fingerposition array and the palm vector array, activating a corresponding ultrasonic array after the platform is parallel to the palm, and returning angle information; adopting focus information after homogeneous coordinate transformation to drive a transducer to emit ultrasonic waves to generate a focus point to form tactile feedback, and displaying the focus point, a virtual hand and surrounding scene information in real time, and completing visual tactile fusion perception. Multi-angle different forms of tactile feedback are provided for fingers and palms, the feeling is finer and more vivid, visual perception is fused, the interaction experience is enriched, and the interaction accuracy is improved.

Description

technical field [0001] The invention belongs to the technical field of visual-tactile fusion perception, and in particular relates to an ultrasonic array interaction method and system for fusion of visual-tactile perception. Background technique [0002] Nowadays, the recognition and processing technology of image, voice and other information has become more and more mature after years of development, followed by the wide application of visual perception, voice interaction and other means, which makes the human-computer interaction mainly focus on visual and auditory interaction. The ability to sense tactile interactions is very limited. The role played by the sense of touch in people's acquisition of environmental information is second only to vision, and it is the only perception channel with two-way information transmission capabilities. [0003] Compared with traditional contact tactile interaction, non-contact tactile interaction can obtain tactile perception without t...

AI Technical Summary

Problems solved by technology

Because it is a system to assist the blind, there is no visual perception

Moreover, the fixed space phased array is not easy to be loaded and unloaded modularly.

Images