Eye Tracking Transfer Function Adaptation in VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality systems face challenges in generating real-time realistic haptic feedback and adjusting transfer functions for immersive anatomical image visualization, as graphical interfaces compromise the immersive experience and are difficult to design due to complex relationships between transfer functions and image rendering.
Innovation Solution
A method and system that uses eye sensors in a head-mounted display to determine a region of interest viewed by the user for an extended period, automatically adjusting the transfer function's presentation characteristics, such as contrast, opacity, or color, to enhance visualization of specific voxels within the region of interest.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If graphical interfaces are used to adjust transfer functions, then transfer function design capability is improved, but immersive experience is compromised
Solution Approach 1:
The patent replaces the mechanical graphical user interface system with an eye-tracking based control system. Eye sensors detect user gaze and automatically adjust transfer function parameters, eliminating the need for manual graphical interface interactions while maintaining full transfer function design capability. This substitution preserves the immersive VR experience by removing the breaking graphical interface elements.
Solution Approach 2:
The system enables self-service transfer function adjustment by automatically detecting user interest through eye tracking and autonomously modifying transfer function parameters. The system serves itself by using gaze duration metrics to identify regions of interest and automatically optimizing visualization without user intervention, thus maintaining immersion while achieving design goals.
2Adaptability or versatility
If manual transfer function adjustment is used, then design flexibility is improved, but interaction complexity increases
Solution Approach 1:
The patent implements feedback loops where eye tracking data continuously monitors user gaze patterns, and this feedback automatically triggers transfer function parameter adjustments. The system measures gaze duration, identifies regions of interest, and adjusts transfer function parameters accordingly, creating a closed-loop system that maintains design flexibility while eliminating complex manual interactions.
Solution Approach 2:
The system automatically changes transfer function parameters (such as opacity, color, and contrast) based on eye tracking data. By dynamically adjusting these parameters in response to user gaze behavior, the system maintains design flexibility while removing the need for users to manually navigate complex adjustment interfaces.
3Manufacturing precision
If transfer function parameters are manually adjusted, then visualization precision is improved, but time consumption increases
Solution Approach 1:
The system performs preliminary action by pre-configuring transfer function parameters based on eye tracking predictions. As the user looks at a region, the system proactively adjusts parameters before the user would need to manually intervene, ensuring visualization precision is maintained while eliminating the time required for manual adjustment. The system anticipates user needs and prepares optimal parameters in advance.
Solution Approach 2:
The system performs self-service by automatically optimizing transfer function parameters based on real-time eye tracking data. It identifies regions of interest through gaze duration analysis and autonomously adjusts parameters to enhance visualization precision, eliminating the time-consuming manual adjustment process while maintaining or improving visualization quality.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for dynamic and intuitive adjustment of transfer functions within virtual reality environments, improving the immersive experience by enhancing the visibility of anatomical structures and facilitating interactive visualization of anatomical data without disrupting the natural interaction with the VR world.
Implementation Method 1
Eye sensors in the HMD are used to determine a region of interest being viewed by the user for longer than a predetermined amount of time
Data Source
AI summary
A method includes presenting an image in a head-mounted display (HMD) controlled by a user. The image is rendered with a transfer function that defines one or more presentation characteristics of voxels in the image. Eye sensors in the HMD are used to determine a region of interest being viewed by the user for longer than a predetermined amount of time. The region of interest comprises a subset of voxels included in the image. The transfer function is automatically adjusted to modify one or more of the presentation characteristics of at least the subset of voxels in response to the region of interest. The presentation of the image in the HMD is modified to present the subset of voxels with modified presentation characteristics.