Mixed Reality CG Correction Using Predicted Image Parameters
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In mixed reality systems, the integration of computer graphics (CG) with reality space images often results in a sense of strangeness due to differences in image properties like gradation, white balance, and resolution, exacerbated by timing discrepancies in applying adjustment parameters to captured and CG images.
Innovation Solution
An image processing device and method that predicts and adjusts image processing parameters for CG based on captured image parameters and delay times to synchronize the properties of CG and captured images, using components like a prediction unit and delay time acquisition unit to ensure timely parameter application.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If CG rendering processing is performed to adjust position and posture of CG objects, then the image property matching between CG and reality space image is improved, but the processing time increases causing timing discrepancies in parameter application
Solution Approach 1:
The patent applies preliminary action by predicting image processing parameters for future frames before they are actually captured. The prediction unit uses parameters from current and past frames to forecast parameters for future frames, allowing CG rendering to be prepared in advance with the correct parameters, thus eliminating timing delays while maintaining image property matching.
2Stability of the object's composition
If parameter adjustment processing is applied to both captured image and CG simultaneously, then image property consistency is improved, but processing complexity increases due to separate processing timelines
Solution Approach 1:
The patent uses copying by having the prediction unit replicate the parameter adjustment logic from the captured image processing pipeline and apply it to CG rendering. Instead of maintaining completely separate processing timelines, the system copies the parameter adjustment approach and adapts it for predictive application to CG, simplifying the overall processing architecture while ensuring image property consistency.
Data Source
AI summary
An image processing device includes an acquisition unit, an adjustment unit, a prediction unit, and a generation unit. The acquisition unit acquires a first parameter for adjusting the property of a captured image of a first frame, and a second parameter for adjusting the property of a captured image of a second frame. The adjustment unit adjusts the property of the captured image of the second frame based on the second parameter. The prediction unit predicts a third parameter for matching the property of the captured image of the second frame adjusted by the adjustment unit and the property of a virtual object based on a delay time and the first parameter. The generation unit generates the virtual object whose property is adjusted based on the third parameter.