Stereoscopic Display Viewpoint Tracking With Adaptive Refresh
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing stereoscopic displays face inefficiencies in operation due to late estimation of viewpoint positions, leading to inefficient calculation and rendering of stereoscopic images when eye position changes.
Innovation Solution
An information processing apparatus that uses a fixed camera and an inertial measurement unit (IMU) to estimate the user's face position and orientation, combining their data to efficiently adjust the frequency of stereoscopic image updates based on the estimation process changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If the stereoscopic display operates at a constant refresh rate, then the display stability is maintained, but the calculation and rendering efficiency deteriorates when eye position changes frequency varies
Solution Approach 1:
The patent applies dynamics by making the display refresh rate variable rather than constant. The control unit dynamically adjusts the refresh rate of the stereoscopic display based on the detected frequency of eye position changes. When eye movement is frequent, the refresh rate increases to maintain accurate stereoscopic imagery; when eye movement is slow, the refresh rate decreases to improve energy efficiency and reduce unnecessary rendering calculations.
Solution Approach 2:
The patent changes the parameter of display refresh rate based on the frequency of viewpoint position updates. The control unit monitors how frequently the user's eye position changes and adjusts the display refresh rate accordingly. This parameter change allows the system to optimize between display stability and computational efficiency by matching the refresh rate to the actual needs of the user's eye movement patterns.
2Measurement precision
If the viewpoint position estimation is updated frequently, then the stereoscopic image accuracy is improved, but the processing time and computational load increases
Solution Approach 1:
The patent implements periodic action by updating the viewpoint position estimation at variable intervals based on detected eye movement patterns. Rather than continuously updating at a fixed high frequency, the system adjusts the update period according to how frequently the user's eyes are moving. When eye movement is detected, the update frequency increases; when the user's gaze is stable, the update frequency decreases, reducing unnecessary processing while maintaining accuracy when needed.
3Reliability
If the refresh rate of the stereoscopic display is high, then the display quality is improved, but the energy consumption increases
Solution Approach 1:
The patent applies dynamics by making the display refresh rate adaptive rather than fixed. The control unit dynamically adjusts the refresh rate based on the frequency of eye position changes detected by the camera. When the user's eyes are moving frequently, the system maintains a high refresh rate to ensure display quality and prevent motion artifacts. When eye movement is minimal, the system reduces the refresh rate to decrease energy consumption while maintaining acceptable display quality.
Solution Approach 2:
The patent changes the display refresh rate parameter based on detected eye movement frequency. This parameter adjustment allows the system to optimize energy consumption by reducing the refresh rate when high-quality display is not necessary (i.e., when the user's gaze is stable), while maintaining high refresh rates when eye movement requires more frequent updates for accurate stereoscopic rendering.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
An information processing apparatus includes a control unit. The control unit acquires a camera image from a camera whose relative position with respect to a stereoscopic display is fixed. The control unit executes an estimation process to estimate a position/orientation of a face of a user viewing the stereoscopic display, on the basis of the camera image. The control unit controls the stereoscopic display to display a stereoscopic image according to a change in the position/orientation of the face of the user. The control unit changes a frequency of update of the stereoscopic display when a frequency of update of the estimation process changes.