AR Display Image Generation Reducing Processing Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality (AR) and mixed reality (MR) systems, the accuracy of aligning computer graphics (CG) with captured images is critical for quality, but existing methods face challenges in processing speed and load, leading to potential delays and motion sickness when the user's field of view changes.
Innovation Solution
A display image generation device and method that acquires camera images, generates intermediate images of virtual objects in a three-dimensional space, and combines them with captured images using a virtual camera viewpoint, reducing processing load and ensuring accurate alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If precise positioning and alignment calculations are performed in three-dimensional space to ensure accurate alignment between CG and captured images, then alignment accuracy is improved, but processing time increases and display response delays occur
Solution Approach 1:
The patent segments the image generation process into two distinct stages: first generating an intermediate image from the captured image data, and then generating the final composite image by combining the CG with the intermediate image. This segmentation allows each stage to be optimized independently, reducing overall processing time while maintaining alignment accuracy.
Solution Approach 2:
The patent performs preliminary processing by generating an intermediate image that represents the captured scene from the camera's viewpoint before final composite image generation. This preliminary action prepares the data structure in advance, enabling faster and more accurate alignment calculations during the final composite image generation stage.
2Reliability
If complex processing is performed to maintain high image quality and accurate alignment, then content quality is improved, but processing load increases
Solution Approach 1:
By dividing the processing into intermediate image generation and composite image generation stages, the patent reduces the complexity of each individual processing step while maintaining overall content quality. Each stage handles specific tasks with optimized algorithms.
Solution Approach 2:
The intermediate image serves as an intermediary data structure that simplifies the relationship between captured images and CG elements. This intermediary representation enables more efficient processing by pre-organizing spatial and visual information before final composition.
3Ease of operation
If the system responds quickly to user movements to prevent motion sickness, then user comfort is improved, but processing speed may be compromised due to the need for high precision
Solution Approach 1:
The segmented processing approach enables the system to deliver preliminary results quickly through intermediate image generation, providing responsive feedback to user movements. The final high-precision composite image generation can then follow without causing noticeable delays.
Solution Approach 2:
The patent performs partial processing by generating an intermediate image that provides a usable approximation of the final result. This partial action delivers responsive performance to user movements, with the understanding that full precision processing will follow.
Data Source
AI summary
Disclosed herein is a display image generation device including a captured image acquiring section that acquires data of an image captured by a camera an intermediate image generating section that generates an intermediate image representing a virtual object arranged in a three-dimensional space for a display object, with the camera as a viewpoint, a display image generating section that generates a composite image representing the intermediate image and the captured image, with a virtual camera for display as a viewpoint, and an output unit that outputs data of the composite image as a display image.