Video Wall Difference Matting for Moire Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video wall systems struggle with accurate image combination when the camera viewpoint exceeds the screen limits, leading to moire problems, color changes, reflections, glare, and deformations, which require manual human intervention to correct, resulting in high costs and inefficiencies.
Innovation Solution
An image processing method using a processor unit to determine camera position and viewpoint, access and edit the background image according to video wall display position and camera parameters, and automatically mask portions to replace pixels outside objects with virtual graphics, enabling real-time image acquisition and reducing costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual human intervention is used to mask objects and correct image errors, then image combination accuracy is improved, but time consumption and cost increase significantly
Solution Approach 1:
The system performs automatic image processing, background extraction, and error correction without human intervention. The processor unit autonomously analyzes the captured image, identifies the video wall region, extracts the background, and corrects errors including moire effects and color changes, eliminating the need for manual masking and post-processing operations.
Solution Approach 2:
Manual mechanical operations (human operators manually masking objects and correcting images) are replaced with an automated digital image processing system. The processor unit uses algorithmic operations to perform background extraction, error detection, and correction, substituting human labor with computational processes that achieve both high accuracy and efficiency.
2Area of stationary object
If a larger video wall screen is used to cover the shooting environment, then image coverage is improved, but system cost increases greatly
Solution Approach 1:
Instead of using a large video wall to cover the entire shooting environment, the system uses a smaller video wall and compensates by extracting and processing the background image digitally. The processor unit captures the background from the smaller screen, corrects errors, and composites it with the foreground objects, achieving full coverage without requiring a physically larger video wall.
Solution Approach 2:
The system creates a digital copy of the background image from the video wall screen and manipulates this copy through image processing operations. The extracted background is corrected for errors and then combined with the foreground, allowing a smaller physical video wall to effectively cover a larger visual area through digital reproduction and processing.
3Adaptability or versatility
If video wall screens are used to cover the shooting environment, then background display capability is improved, but moire problems, color changes, reflections, and deformations occur
Solution Approach 1:
The system performs preliminary error correction on the background image before compositing it with the foreground objects. The processor unit detects and corrects moire effects, color changes, reflections, and deformations in advance, ensuring that the final composite image is free from these artifacts. This preventive approach eliminates harmful factors before they affect the final output.
Solution Approach 2:
The system captures the harmful effects (moire patterns, color changes, reflections) as part of the background image and then uses image processing to identify and correct these errors. By treating the flawed background capture as the starting point for automated correction, the system converts the initially harmful artifacts into opportunities for algorithmic enhancement, ultimately producing a clean, error-free composite image.
Data Source
AI summary
An image processing method is carried out by a processor unit configured to input the first image from the camera to determine the portions to be masked in a first image comprising at least one object in front of a video wall display in which a displayed background image is shown and a captured background image of the displayed background image being captured by the camera. Accordingly, the method comprises the steps of determining a camera position and a camera point of view from which the camera receives the first image, accessing a background image that is the source of the displayed background image shown on the video wall display when the camera receives the first image, and creating an edited background image by editing the accessed background image according to a video wall display position information recorded in a memory unit.


