Augmented Image Pixel Expansion for Virtual Studio Background Replacement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems face issues such as loss of picture details and color limitations due to compression when removing green screens and replacing backgrounds in virtual studios.
Innovation Solution
An image output device and method that converts source images into augmented images with additional pixels, allowing for the inclusion of auxiliary information like transparency and image data, which are then received and converted back into source images without data loss, using a processing unit and image ports, effectively managing pixel data to maintain image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If image compression is used in existing encoding methods, then transmission efficiency is improved, but picture details are lost and color limitations occur
Solution Approach 1:
The image is segmented into multiple layers including foreground layer, background layer, and auxiliary information layer. Each layer is processed and transmitted separately, allowing selective compression strategies for different layers while preserving critical picture details in the foreground layer.
Solution Approach 2:
The patent introduces a temporal dimension by storing multiple historical frames and using motion compensation techniques. This allows the system to transmit fewer actual image data while maintaining picture quality through predictive coding, thus improving transmission efficiency without losing picture details.
2Adaptability or versatility
If green screen removal and background replacement is performed through image processing system, then image richness is increased, but processing complexity and time consumption increase
Solution Approach 1:
The system performs preliminary chroma key processing during the recording phase, pre-separating foreground and background layers. This preliminary action reduces the complexity of real-time processing by pre-computing masks and separating image data, allowing faster background replacement while maintaining image richness.
Solution Approach 2:
The patent introduces an intermediary auxiliary information layer that carries transparency data, motion vectors, and layer segmentation information. This intermediary layer facilitates the complex background replacement process by providing pre-processed guidance data, reducing the computational burden on the main processing system.
3Reliability
If more auxiliary information is encoded into image stream, then image quality and interaction capabilities are enhanced, but data transmission volume increases
Solution Approach 1:
The system applies local quality by encoding auxiliary information selectively in different regions of the image. Critical regions (foreground objects) receive higher quality encoding with more auxiliary information, while less critical regions use lower quality encoding, thus enhancing image quality where needed while controlling overall data transmission volume.
Solution Approach 2:
The patent dynamically adjusts compression parameters and auxiliary information encoding density based on scene complexity, motion intensity, and regional importance. This adaptive parameter change allows the system to maintain high image quality when needed while reducing data transmission volume in simpler scenes, optimizing the balance between quality and data volume.
Data Source
AI summary
An image output device, an image receiving device, and an image transmission method are provided. The image transmission method includes the following. A source image is transformed into an augmented image by an image output device. The source image includes M source pixels and the augmented image includes N augmented pixels. The augmented image is received by an image receiving device. The augmented image is transformed into the source image. M is less than N.