Mid-Air Haptic Texture Mapping for Visual-Tactile Consistency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mid-air haptic technology has not adequately addressed the challenge of accurately rendering texture information, leading to potential discrepancies between visual and haptic feedback that can hinder user immersion in augmented and virtual reality experiences.
Innovation Solution
A method is developed to translate texture information from visual images into mid-air haptic sensations using modulated focused ultrasound, incorporating a haptic mapping function that accounts for both macro and micro-scale roughness, and utilizes machine learning to predict perceived roughness, ensuring congruence between visual and tactile feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If mid-air haptic technology is used to render texture information, then user interaction capability is improved, but accuracy of texture rendering deteriorates
Solution Approach 1:
The system incorporates feedback mechanisms where users provide input about their tactile perception of virtual textures, and this feedback is used to adjust and refine the texture rendering parameters in real-time, improving accuracy through iterative optimization
Solution Approach 2:
The invention dynamically adjusts multiple rendering parameters including frequency, amplitude, and spatial distribution of haptic feedback based on the desired texture characteristics and user feedback, enabling accurate texture synthesis through parameter optimization
2Device complexity
If visual and haptic feedback are rendered independently, then system complexity is reduced, but consistency between modalities deteriorates
Solution Approach 1:
The system merges visual and haptic rendering processes by using a unified texture representation that simultaneously drives both visual display and haptic feedback generation, ensuring consistency between modalities while managing system complexity through integrated processing
Solution Approach 2:
A universal texture representation framework is implemented that serves multiple functions - providing both visual rendering guidance and haptic feedback parameters from a single data source, thereby ensuring modality consistency without requiring separate processing pipelines
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The method effectively generates mid-air haptic textures that match perceived visual roughness, enhancing user immersion by aligning haptic and visual feedback, and is robust against variations in computer graphics rendering techniques.
Implementation Method 1
use ultrasonic phased arrays that electronically focus waves onto a user's hands and fingertips to create a vibro-tactile effect
Implementation Method 2
use ultrasonic phased arrays that electronically focus waves onto a user's hands and fingertips to create a vibro-tactile effect
Data Source
AI summary
Described is a method for instilling the haptic dimension of texture to virtual and holographic objects using mid-air ultrasonic technology. A set of features is extracted from imported images using their associated displacement maps. Textural qualities such as the micro and macro roughness are then computed and fed to a haptic mapping function together with information about the dynamic motion of the user's hands during holographic touch. Mid-air haptic textures are then synthesized and projected onto the user's bare hands. Further, mid-air haptic technology enables tactile exploration of virtual objects in digital environments. When a user's prior and current expectations and rendered tactile texture differ, user immersion can break. A study aims at mitigating this by integrating user expectations into the rendering algorithm of mid-air haptic textures and establishes a relationship between visual and mid-air haptic roughness.