HMD Stereo Image Generation With Local Depth Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The communication volume between an image generation apparatus and a head-mounted display (HMD) increases when transmitting CG images and depth information for mixed reality applications.
Innovation Solution
The HMD processes and generates stereo images and depth information locally by receiving only a first image and depth information from an external apparatus, using perspective projection and other methods to create a second image and depth information, thereby reducing the need for full transmission of stereo images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If CG images and depth information for both left and right eyes are transmitted from an external apparatus to the HMD, then accurate depth representation and mixed reality display quality are improved, but communication bandwidth requirements increase
Solution Approach 1:
The patent extracts only the essential first image and first depth information from the external apparatus, eliminating the need to transmit complete stereo image pairs. The HMD then generates the second image and second depth information locally using perspective projection, thereby reducing communication volume while maintaining depth representation accuracy.
Solution Approach 2:
The HMD creates a copy of the second image and second depth information through perspective projection transformation based on the received first image and first depth information. This local generation approach replaces the need for direct transmission of complete stereo data, reducing communication requirements while preserving visual quality.
2Measurement precision
If the HMD receives and processes complete stereo images and depth information locally, then display quality is maintained, but processing load and computational complexity increase
Solution Approach 1:
The patent extracts only the necessary first image and first depth information from external transmission, reducing the amount of data that must be processed locally. The HMD generates only the difference components (second image and second depth information) through perspective projection, thereby reducing processing complexity compared to handling complete stereo data pairs.
Data Source
AI summary
An electronic device includes a communication interface and one or more processors configured to acquire a first image that is an image of a virtual object viewed from a first viewpoint and first depth information that is information regarding a distance in a depth direction when the virtual object is viewed from the first viewpoint; generate second depth information that is information regarding a distance in the depth direction when the virtual object is viewed from a second viewpoint having parallax with respect to the first viewpoint; generate a second image that is an image of the virtual object viewed from the second viewpoint; and generate a combined image of the second viewpoint in which a depth of the virtual object in a space viewed from the second viewpoint is expressed on a basis of the second depth information and the second image.