Mixed Reality Image Processing Apparatus Illumination Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality technologies using video see-through HMDs struggle to accurately adjust brightness and color of mixed reality image data to match the illumination environment of the external world, leading to unnatural sensations and impaired realism.
Innovation Solution
A mixed reality image processing apparatus that extracts illumination environment information from captured image data and converts mixed reality image data to match the external world's illumination conditions, using a combination of illumination environment information extraction, luminance conversion, and color conversion units.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If uniform brightness and color adjustment is applied to mixed reality image data, then processing simplicity is maintained, but realism and naturalness deteriorate due to mismatch with external illumination environment
Solution Approach 1:
The patent dynamically changes illumination parameters (brightness and color temperature) of the mixed reality image data based on detected external environment conditions. The system adjusts these parameters to match the external illumination environment, resolving the contradiction between processing simplicity and realism by adapting parameters rather than using fixed uniform adjustment
Solution Approach 2:
The system implements feedback by detecting the external illumination environment and using this information to adjust the mixed reality image data parameters. This closed-loop approach ensures realism while maintaining automated processing, eliminating the need for manual adjustment while preserving natural appearance
2Device complexity
If brightness and color are uniformly adjusted in CG data, then processing complexity is reduced, but color balance and naturalness worsen under varying external illumination conditions
Solution Approach 1:
The patent dynamically adjusts brightness and color temperature parameters of the CG data based on external environment detection. This resolves the contradiction by automatically adapting parameters to external conditions, maintaining color balance without requiring complex manual processing configurations
Solution Approach 2:
The system transitions from static uniform adjustment to dynamic parameter adjustment that adapts to changing external illumination conditions. This dynamic approach maintains color balance across varying environments while keeping the processing system relatively simple through automated adaptation
3Ease of operation
If display brightness is maintained at fixed levels, then device operation is simplified, but adaptability to different external illumination environments deteriorates
Solution Approach 1:
The patent implements dynamic parameter changes in display brightness based on detected external illumination conditions. This resolves the contradiction by automatically adapting brightness levels to match external environments, providing versatility across different conditions while maintaining simplified automated operation
Solution Approach 2:
The system uses feedback from external environment detection to automatically adjust display brightness parameters. This closed-loop control provides adaptability to different illumination environments while keeping device operation simple through automated adjustment without user intervention
Data Source
AI summary
There is provided a mixed reality image processing apparatus capable of forming mixed reality image data that matches an illumination environment of an external world. The mixed reality image processing apparatus includes a standard illumination environment processing unit configured to extract illumination environment information, which indicates the illumination information of the external world, from image data imaged by an imaging unit, and a local illumination environment processing unit configured to convert mixed reality image data, which is formed by combining virtual image data to the image data, into image data corresponding to the illumination environment of the external world based on the illumination environment information.