HMD Image Generation Using Reference Pixel Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays (HMDs) experience a delay in displaying images based on their attitude, leading to a feeling of strangeness for the observer due to the difference between the attitude used for image generation and the actual attitude at display time, and the limited size of generated images results in unnatural pixel values after transformation.
Innovation Solution
An image generating system that includes a first attitude data obtaining unit, a reference image generating unit, a corresponding position identifying unit, a pixel value identifying unit, and a display image generating unit, which generate and transform images to match the changing attitude of the HMD by identifying corresponding pixel values on a reference image based on attitude differences, ensuring accurate and natural image display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the generated image size is limited to reduce image processing load, then processing efficiency is improved, but pixel values become unidentified or unnatural after transformation
Solution Approach 1:
The system generates an auxiliary image with the same resolution as the display image before the transformation process. This auxiliary image serves as a reference to provide pixel values for regions that would otherwise be unidentified after transformation, preventing unnatural artifacts while maintaining processing efficiency
Solution Approach 2:
The auxiliary image acts as an intermediary between the limited-size generated image and the final display image. It provides the missing pixel information needed for complete image transformation without requiring the system to process a full-resolution image from scratch
2Ease of operation
If image transformation is applied to reduce feeling of strangeness, then observer comfort is improved, but pixel values become unidentified due to limited reference image size
Solution Approach 1:
The auxiliary image is generated in advance with complete pixel information matching the display image resolution. This preliminary preparation ensures that when transformation is applied for observer comfort, all necessary pixel values are available from the auxiliary image reference
Solution Approach 2:
The system creates a copy of the generated image at full display resolution as an auxiliary image. This copy preserves all pixel information that would be lost in the original limited-size image, enabling complete transformation without information loss
Data Source
AI summary
An image generating system includes a first attitude data obtaining unit obtaining first attitude data indicating an attitude of a head-mounted display in first timing; a reference image generating unit generating a reference image showing a state of looking at a virtual three-dimensional space from a viewpoint, a position and a sight line direction of the viewpoint being identified on a basis of the first attitude data; a second attitude data obtaining unit obtaining second attitude data indicating the attitude of the head-mounted display in second timing; a corresponding position identifying unit identifying a corresponding position for each pixel within a display image to be displayed on the head-mounted display; a pixel value identifying unit identifying a pixel value of the pixel within the display image, the pixel being associated with the corresponding position; and a display image generating unit generating the display image.