Background Display Luminance Correction for Multi-Camera Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging systems using LED displays for background images can result in image quality unevenness (luminance unevenness) when captured at angles other than directly opposite to the display, as current methods like Patent Document 1 do not account for multiple image pickup apparatuses capturing at different angles.
Innovation Solution
An information processing apparatus that distinguishes between object and background areas, acquires arrangement information on angle or distance between the display and pickup apparatus, and performs image processing to correct luminance values based on this information, reducing image quality unevenness in the background area.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If luminance correction is performed based on angle information from a single image pickup apparatus, then image quality unevenness is reduced for that apparatus, but image quality unevenness remains when other image pickup apparatuses capture at different angles
Solution Approach 1:
The patent creates a luminance correction value map that serves multiple image pickup apparatuses simultaneously. The map is generated by calculating luminance correction values for multiple angles in advance, allowing any image pickup apparatus within the angular range to use the appropriate correction values without requiring separate correction data for each device.
Solution Approach 2:
The system pre-calculates and stores luminance correction values for multiple angles before actual image capture. By anticipating the need for corrections at various angles and preparing the correction map in advance, the system eliminates the problem of inadequate correction for multi-apparatus scenarios without requiring real-time calculations during imaging.
2Adaptability or versatility
If the background display uses LED elements with viewing angle characteristics, then the display can be used for virtual production, but image quality unevenness occurs when captured at angles other than directly opposite
Solution Approach 1:
The patent applies luminance correction by changing the luminance parameter of background display pixels based on the viewing angle. The correction values are determined by the angle between the normal of the background display and the line of sight to the image pickup apparatus, allowing the system to compensate for LED viewing angle characteristics and maintain luminance uniformity across different capture angles.
3Device complexity
If luminance correction is applied without considering distance, then processing is simpler, but image quality unevenness remains when image pickup apparatuses are at different distances from the background display
Solution Approach 1:
The patent extends the correction approach from one-dimensional angle-based correction to two-dimensional correction by incorporating distance information. The luminance correction values are determined based on both the viewing angle and the distance between the image pickup apparatus and the background display, providing more comprehensive correction for varying capture conditions.
Data Source
Figure 1
Figure 2A~2B
Figure 3
AI summary
[SUMMARY] [PROBLEMS] To obtain image data with reduced image quality unevenness in an background image area, regardless of the arrangement of a background display and an image pickup apparatus. [SOLUTION MEANS] An information processing apparatus 105 acquires an input image obtained by capturing an image of an object OBJ and a background image displayed on a background display LD using an image pickup apparatus, distinguishes between an object area and a background image area in the input image, acquires arrangement information on at least one of an angle or a distance between the background display and the image pickup apparatus, and performs image processing on the background image area according to the arrangement information.