Gaze-Controlled Omnidirectional Display for Stable VR Viewpoint Movement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR head mount displays (HMDs) face issues with object shifting during viewpoint movement due to user interaction, especially when capturing omnidirectional images, as they require manual input which can lead to unintended positional changes.
Innovation Solution
A control apparatus and method that utilizes a line-of-sight detector to generate and display partial images based on user gaze, performing transformation processing to maintain the viewpoint without requiring manual input, allowing for smooth and controlled viewpoint movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual input methods (touch panel or cross key) are used to move the viewpoint, then the user can confirm the surroundings, but objects may shift from their intended position due to contact with operation members
Solution Approach 1:
The patent replaces mechanical input methods (touch panel, cross key) with an optical detection system (line-of-sight detector). The detector uses infrared light to track the user's gaze direction, enabling viewpoint movement without physical contact. This substitution eliminates the mechanical contact that causes object shifting while maintaining ease of operation.
Solution Approach 2:
The patent introduces an intermediary system (line-of-sight detector with infrared light) between the user and the viewpoint control mechanism. Instead of direct mechanical interaction, the user's gaze is detected optically and translated into viewpoint movement, serving as a mediator that prevents direct contact-induced object shifting.
2Area of stationary object
If the entire omnidirectional image is displayed at once, then the user can see all surroundings, but the display device would require a very large display surface
Solution Approach 1:
The patent segments the omnidirectional image into multiple partial images based on different viewing angles. Instead of displaying the entire image at once, it divides and displays relevant portions according to the user's line of sight, reducing the required display area while maintaining comprehensive surroundings visibility through dynamic viewpoint adjustment.
Solution Approach 2:
The patent transitions from a static two-dimensional display of the entire omnidirectional image to a dynamic three-dimensional virtual space representation. By mapping the omnidirectional image to a spherical coordinate system and allowing viewpoint movement, it enables comprehensive surroundings viewing on a limited display surface through depth and angle manipulation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables seamless viewpoint adjustment in omnidirectional image display by detecting user gaze, reducing the need for manual interaction and preventing unintended object shifts, thereby enhancing the VR experience.
Implementation Method 1
a line-of-sight detector 160 that detects a line of sight of the user
Data Source
AI summary
A control apparatus is configured to control a display apparatus for displaying a partial image based on a partial area of an omnidirectional image or hemispherical image on a display surface. The control apparatus includes a memory storing instructions; and a processor configured to execute the instructions to generate the partial image by performing transformation processing for the partial area of the omnidirectional image or hemispherical image, detect a first position of a line of sight of a user on the display surface, and generate a first partial image based on the first position and display the first partial image on the display surface in a case where the first position is located within a predetermined area for a predetermined duration.