Image Processing Apparatus Background Image Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for generating virtual viewpoint images from multiple camera sources often result in increased transmission data amounts and processing delays due to simultaneous transmission of foreground and background images, leading to potential discontinuity and a strange user experience.
Innovation Solution
An image processing apparatus that acquires foreground and background images at different frame rates, divides the background image into smaller segments, and transmits them at the same frequency as the foreground image to manage network bandwidth efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If background images are transmitted at the same timing as foreground images, then the transmission process is simple, but the transmission data amount increases and may cause transmission failures
Solution Approach 1:
The background image is divided into multiple divided background images (first divided background image, second divided background image, etc.) and transmitted at different timings. This segmentation reduces the peak transmission data amount while maintaining complete background information delivery, resolving the contradiction between simple transmission process and reliable transmission.
2Manufacturing precision
If background images are transmitted at high frame rate, then image quality is maintained, but transmission data amount increases and processing load increases
Solution Approach 1:
The background image transmitted at low frame rate is divided into multiple segments that are transmitted at different timings. This allows the system to maintain adequate background image quality for virtual viewpoint generation while significantly reducing the peak transmission data amount compared to transmitting full-resolution background images at high frame rates.
3Ease of operation
If background images are transmitted at same timing as foreground images, then synchronization is simple, but processing completion time is exceeded
Solution Approach 1:
The background image transmission is segmented into multiple transmissions at different timings. The image processing apparatus accumulates these divided background images and combines them with foreground images to generate virtual viewpoint images. This segmentation distributes the processing load over time, allowing processing to complete before the next imaging timing while maintaining synchronization through the accumulation and combination process.
4Loss of information
If background images are transmitted continuously, then complete background information is provided, but network bandwidth is overwhelmed
Solution Approach 1:
The background image is segmented into multiple divided versions transmitted at different timings rather than continuously. This segmentation ensures complete background information is delivered to the image processing apparatus while distributing the data flow to prevent network bandwidth overload, resolving the contradiction between information completeness and bandwidth utilization.
Data Source
AI summary
An image processing apparatus, that transmits a foreground image including an object and a background image not including the object in order to reproduce a predetermined image generated by combining the foreground image and the background image, acquires the foreground image and the background image, divides the background image, and transmits the acquired foreground image and the divided background images.