Eye Tracking Compression for Head Mounted Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality display devices face challenges in transmitting high-resolution image data wirelessly due to limited bandwidth, and existing compression methods that rely on head movement can degrade image quality when the user's gaze is not aligned with the head movement, leading to noticeable losses in detail.
Innovation Solution
A method that determines whether the user's eye is directed at a fixed point by comparing the movement directions of the head and eye, adjusting compression levels accordingly to maintain image quality when the gaze is focused on a specific object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If compression is increased to reduce data transmission bandwidth, then wireless transmission efficiency is improved, but image quality deteriorates when the user's gaze is not aligned with head movement
Solution Approach 1:
The compression level is dynamically adjusted based on real-time detection of head movement and eye movement directions. When the eye movement direction differs from head movement direction (indicating gaze at a fixed point), compression is reduced to maintain quality. When directions align, compression is increased to improve transmission efficiency.
Solution Approach 2:
The system changes the compression parameter of image data based on the relationship between head movement direction and eye movement direction. By monitoring these movements, the system adapts the compression level to maintain quality where needed while optimizing bandwidth usage elsewhere.
2Quantity of substance
If compression level is increased during head movement, then data transmission bandwidth is reduced, but detail loss becomes noticeable when gaze is not aligned with head movement
Solution Approach 1:
The system applies different compression levels to different regions or time periods based on local conditions. When the user's gaze is detected to be fixed (eye movement direction differs from head movement direction), lower compression is applied to preserve detail in the foveal region, while higher compression can be applied when the gaze is not fixed.
Solution Approach 2:
The system uses feedback from eye tracking sensors and accelerometers to continuously monitor head and eye movement directions. This feedback loop allows the system to adjust compression levels in real-time based on whether the user is gazes at a fixed point or not, thereby minimizing noticeable detail loss.
3Productivity
If head movement-based compression is used, then wireless bandwidth utilization is improved, but image quality degrades when the user is looking at something stationary while the head moves
Solution Approach 1:
The compression strategy dynamically switches based on the relationship between head movement and eye movement. When eye movement direction differs from head movement direction (indicating stationary gaze), the system reduces compression to maintain quality. This dynamic adjustment ensures high bandwidth utilization while preserving quality when needed.
Solution Approach 2:
The system combines multiple inputs (head movement data from accelerometers and eye movement data from eye trackers) to make a composite judgment about gaze stability. This composite approach allows more accurate determination of when to apply compression, improving both bandwidth utilization and image quality.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for dynamic adjustment of compression based on the user's gaze direction, ensuring high-quality image transmission by reducing compression when the eye is focused on a point, thereby minimizing noticeable quality degradation during head movement.
Implementation Method 1
detecting a movement of the user's head comprises sensing movement of the head mounted display. Sensing movement of the head mounted display preferably comprises receiving data from an accelerometer mounted on the head mounted display
Implementation Method 2
detecting a movement of the user's eye comprises sensing movement of at least part of the user's eye. Sensing movement of at least part of the user's eye preferably comprises receiving data from a sensor mounted on the head mounted display
Data Source
AI summary
In virtual-reality display devices it is possible to use head movement as an input to compression, which assumes that the user is looking at something that is moving at approximately the same rate in the same direction as the user's head. This method determines whether an eye of a user of a head mounted display is directed at a relatively fixed point. The method involves detecting (S51) a movement of the user's head, including a lack of movement thereof, determining (S53) a direction of the movement of the user's head, detecting (S52) movement of at least one eye of the user, including a lack of movement thereof, and determining (S54) a direction of the movement of the user's eye. If the directions of movement of the user's head and at the user's eye are different (S55), within a predetermined threshold, it can be assumed that the user's eye is directed at a fixed point (S57), whereas if the directions of movement of the user's head and the user's eye are not different (S55), within a predetermined threshold, then it can be assumed that the user's eye is not directed at a fixed point (S56).