Gaze-Controlled Partial-Image Display for VR Viewpoint Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR head mount displays (HMDs) face issues in capturing and viewing omnidirectional images without physical interaction, leading to potential misalignment of objects due to user interaction with operation members.
Innovation Solution
A control apparatus and method that generates partial images from omnidirectional or hemispherical images based on user line of sight, using perspective projection transformation and line-of-sight detection to control display without requiring physical interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If perspective projection display is used to show partial area of omnidirectional image, then the entire screen can be displayed, but the viewpoint must be moved to confirm surroundings which may cause object misalignment due to physical contact with operation members
Solution Approach 1:
The patent replaces the mechanical operation system (touch panel, cross key) with a gaze-based control system. The line-of-sight detection unit detects where the user is looking, and the control unit automatically adjusts the viewpoint based on gaze position, eliminating the need for physical contact with operation members and preventing object misalignment.
Solution Approach 2:
The patent introduces line-of-sight detection as an intermediary between the user and the display system. Instead of direct physical interaction with operation members, the user's gaze is detected and translated into viewpoint control commands, providing a non-contact interface that avoids the problems of manual operation.
2Ease of operation
If touch panel or cross key is used to move viewpoint, then user can navigate the display, but object may shift from intended position due to contact between user and operation member
Solution Approach 1:
The patent replaces mechanical operation members (touch panel, cross key) with a gaze-based control system. The line-of-sight detection unit tracks the user's gaze position, and the control unit automatically adjusts the viewpoint to match the gaze direction, eliminating physical contact that causes misalignment and achieving both ease of operation and high position accuracy.
Solution Approach 2:
The system uses the user's natural line of sight as the control input, requiring no additional physical interaction. The gaze direction automatically determines the viewpoint, making the system self-adjusting to user intent without the precision errors introduced by manual operation.
3Adaptability or versatility
If HMD is not brought to imaging site, then photos and videos can be viewed in image pickup apparatus body, but physical interaction with operation members is required
Solution Approach 1:
The patent replaces complex mechanical operation interfaces (touch panel, cross key, buttons) with a gaze-based control system. The line-of-sight detection unit automatically tracks user attention, and the control unit adjusts the display viewpoint accordingly, eliminating the need for physical interaction with operation members while maintaining viewing flexibility.
Solution Approach 2:
The system automatically detects user gaze direction and adjusts the viewpoint without requiring any physical operation. This self-service approach simplifies the operation interface while maintaining adaptability, as the system autonomously responds to user attention rather than requiring manual control.
Data Source
AI summary
A control apparatus is configured to control a display apparatus for displaying a partial image based on a partial area of an omnidirectional image or hemispherical image on a display surface. The control apparatus includes a memory storing instructions; and a processor configured to execute the instructions to generate the partial image by performing transformation processing for the partial area of the omnidirectional image or hemispherical image, detect a first position of a line of sight of a user on the display surface, and generate a first partial image based on the first position and display the first partial image on the display surface in a case where the first position is located within a predetermined area for a predetermined duration.