Image Processing Apparatus Distance-Based Background Separation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image processing technologies require significant time and effort for chroma key synthesis, especially when dealing with green screens, and often necessitate post-processing to remove reflected light, which can complicate background separation.
Innovation Solution
An image processing apparatus that can selectively output results of image processing by acquiring images from multiple viewpoints, converting them into distance information, and assigning these results to different output units based on operation conditions, allowing for flexible processing and output switching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If chroma key synthesis is performed using green screen or blue screen, then background separation can be achieved, but the process requires significantly long time and human effort including preparing specific color backgrounds, stretching wrinkles, adjusting illumination, and post-processing to remove reflected light
Solution Approach 1:
The patent replaces the mechanical chroma key synthesis process with a distance-based image synthesis method. Instead of using physical green/blue screens and manual wrinkle stretching operations, the system uses a distance measurement apparatus to capture depth information and automatically synthesizes images by separating objects from backgrounds based on distance data, eliminating the need for chroma key operations and post-processing to remove reflected light
Solution Approach 2:
The patent introduces distance information as an intermediary element between the image capture and background separation processes. By using distance measurement data as a mediator, the system can automatically separate objects from backgrounds without requiring chroma key synthesis, thereby reducing processing time and eliminating the need for manual operations
2Measurement precision
If distance measurement is performed using a separate distance measurement apparatus, then distance information can be acquired, but calibration work is required before capturing images due to different angles of view, resolutions, and non-coincident optical axes
Solution Approach 1:
The patent merges the distance measurement function with the image processing apparatus by integrating a distance measurement apparatus into the imaging device. This integration allows both image capture and distance measurement to be performed simultaneously with coincident optical axes, eliminating the need for separate calibration work while maintaining measurement precision
Solution Approach 2:
The patent creates a multi-functional imaging device that can perform both image capture and distance measurement using a single integrated apparatus. This universal device eliminates the need for separate calibration procedures required when using independent distance measurement equipment, reducing system complexity while maintaining measurement accuracy
3Productivity
If all arithmetic operations are performed within the imaging device, then distance information can be generated simultaneously with image capture, but the amount of arithmetic operation increases significantly which may require reducing resolution or frame rate for video processing
Solution Approach 1:
The patent segments the arithmetic operation process into two parts: the imaging device performs distance measurement and generates distance information simultaneously with image capture, while the image processing apparatus performs the complex image synthesis operations using both the captured images and distance information. This segmentation allows high-speed distance measurement without overwhelming the processing capacity for video applications
4Adaptability or versatility
If the imaging device performs minimum processing and outputs captured images to external video processing workflow, then processing flexibility is maintained, but post-processing is required in later stages
Solution Approach 1:
The patent performs preliminary distance measurement and generates distance information simultaneously with image capture in the imaging device. This preliminary action provides ready-to-use distance data to the image processing apparatus, enabling immediate image synthesis without requiring post-processing operations, thereby reducing post-processing time while maintaining processing flexibility
Data Source
AI summary
An image processing apparatus comprising: a plurality of output units outputting arithmetic operation results; a memory storing instructions; and a processor executing the instructions causing the image processing apparatus to: acquire images from a plurality of mutually different viewpoints, perform an arithmetic operation for converting the acquired images into distance information, and perform control to output arithmetic operation results from the plurality of output units, wherein the processor assigns the plurality of arithmetic operation results requiring different amounts of arithmetic operation obtained in the arithmetic operation process to the plurality of output units, and selectively switches the arithmetic operation results to be assigned in accordance with an operation condition of the image processing apparatus.