An ultrasonic array interaction method and system integrating visual and tactile perception

Abstract

The invention discloses an ultrasonic array interaction method and system that integrates visual and tactile perception, collects hand posture information, and for fingers, calculates fingertip coordinates to form a position array; for palms, calculates palm center coordinates and palm surface normal vector parameters to form a vector array ;If a finger is detected, select and activate the ultrasonic array based on the position array and distance; if a palm is detected, select and start the motion platform based on the directionality based on the finger position array and the palm vector array, and activate the corresponding ultrasonic array when the platform is parallel to the palm , and return the angle information; use the focus information after the homogeneous coordinate transformation to drive the transducer to emit ultrasonic waves to generate the focus point to form tactile feedback, display the focus point, virtual hand and surrounding scene information in real time, and complete visual-tactile fusion perception. The present invention provides multi-angle and different forms of tactile feedback for fingers and palms, which makes the feeling more refined and realistic, integrates visual perception, enriches the interactive experience, and improves the accuracy of interaction.

Description

technical field [0001] The invention belongs to the technical field of visual-tactile fusion perception, and in particular relates to an ultrasonic array interaction method and system for fusion of visual-tactile perception. Background technique [0002] Nowadays, the recognition and processing technology of image, voice and other information has become more and more mature after years of development, followed by the wide application of visual perception, voice interaction and other means, which makes the human-computer interaction mainly focus on visual and auditory interaction. The ability to sense tactile interactions is very limited. The role played by the sense of touch in people's acquisition of environmental information is second only to vision, and it is the only perception channel with two-way information transmission capabilities. [0003] Compared with traditional contact tactile interaction, non-contact tactile interaction can obtain tactile perception without t...

AI Technical Summary

Problems solved by technology

Because it is a system to assist the blind, there is no visual perception

Moreover, the fixed space phased array is not easy to be loaded and unloaded modularly.

Images