Mixed Reality Still Image Generation via Intermediate Data Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for generating mixed reality (MR) still images from moving images result in low-quality still images due to the need for reduced computational resources to maintain real-time capabilities.
Innovation Solution
An image processing apparatus that obtains captured image data, generates computer graphics, and outputs generation information including captured image data, intermediate data for lighting processing, and rendering information to generate high-quality MR still images with reduced computational effort.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If computational resources are reduced to maintain real-time capability, then real-time processing is maintained, but image quality deteriorates
Solution Approach 1:
The system performs preliminary actions by capturing and storing intermediate data (depth information, normal vectors, material properties, lighting conditions) during moving image generation. When a still image is requested, these pre-captured intermediate data are reused to generate high-quality CG images without requiring full real-time computation, thus resolving the contradiction between real-time speed and image quality.
2Manufacturing precision
If high-quality CG is generated at arbitrary point of time, then image quality is improved, but computational complexity increases
Solution Approach 1:
The system extracts only the necessary intermediate data (depth maps, normal vectors, material properties, lighting information) from the real-time rendering process and stores them separately. When generating high-quality still images, only these extracted intermediate data are reused rather than regenerating all rendering parameters, significantly reducing computational complexity while maintaining image quality.
3Manufacturing precision
If full computational processing is used for still image generation, then image quality is improved, but processing time increases
Solution Approach 1:
The system performs preliminary capture of intermediate rendering data during the moving image generation process. When a still image is requested, the high-quality CG generation uses these pre-captured intermediate data instead of performing complete real-time rendering computations, dramatically reducing processing time while maintaining high image quality.
Data Source
AI summary
An image processing apparatus obtains data of a captured image, generates computer graphics corresponding to an appearance of a virtual object disposed in a virtual space from a virtual viewpoint, and generates a moving image by superimposing the computer graphics on the captured image. Generation information to be used in the case of generating a still image is outputted at time of acceptance of an obtainment request for data of the still image corresponding to a frame of the moving image. The generation information includes the data of the captured image and intermediate data to be generated in the case of generating the computer graphics, which are the data present at the time of acceptance of the obtainment request. The intermediate data is information used in lighting processing in the case of generating the computer graphics.