Full-Length Image Background and Floor Replacement via Multi-Illumination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing background replacement systems are limited in generating full-length images where both the background and floor need to be changed, as they primarily focus on three-quarter length or head and shoulder images, failing to effectively handle images that require both background and floor modification.
Innovation Solution
A system that includes a floor lighting device with Lambertian characteristics and a floor mat, along with a controller to synchronize different illumination conditions during image capture, allowing for the capture of three images: background-illuminated, subject-illuminated, and floor-illuminated images, which are then processed to generate masks for background and floor replacement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If existing background replacement systems are used for three-quarter length or head and shoulder images, then the subject can be defined from the background effectively, but the system cannot handle full-length images requiring both background and floor modification
Solution Approach 1:
The patent segments the image processing task into distinct components: background replacement and floor replacement. By introducing separate lighting devices (background lighting system, subject lighting system, and floor lighting device) and capturing multiple specialized images, the system can independently process and replace the background and floor regions in full-length images, thereby achieving versatility across different image types while maintaining reliable subject definition.
2Adaptability or versatility
If multiple lighting systems are used to illuminate different regions (background, subject, floor), then full-length images with both background and floor can be modified, but the system complexity increases
Solution Approach 1:
The patent divides the lighting system into three independent, specialized subsystems: background lighting system for illuminating the background, subject lighting system for illuminating the subject, and floor lighting device for illuminating the floor. Each subsystem targets a specific region, allowing the system to handle full-length images requiring both background and floor modification while managing complexity through functional segmentation.
Solution Approach 2:
The controller synchronizes multiple lighting systems to work together in a coordinated illumination sequence, enabling the system to perform multiple functions (background illumination, subject illumination, floor illumination) using an integrated control architecture. This multi-functionality approach allows the system to handle various image types and replacement scenarios without requiring separate dedicated systems for each function.
3Manufacturing precision
If three separate images are captured under different illumination conditions (background-illuminated, subject-illuminated, floor-illuminated), then masks can be generated for comprehensive replacement, but the image capture time increases
Solution Approach 1:
The patent implements a pre-synchronized illumination sequence where the controller prepares and coordinates all lighting systems before image capture begins. The background lighting system, subject lighting system, and floor lighting device are programmed to illuminate their respective regions in a predetermined sequence, allowing high-quality region-specific images to be captured efficiently without manual setup time for each lighting condition.
Solution Approach 2:
The illumination sequence is designed to capture background-illuminated, subject-illuminated, and floor-illuminated images in a continuous, coordinated manner without interruption. The controller manages the transition between different illumination conditions seamlessly, ensuring that each region is properly illuminated for mask generation while minimizing total capture time through continuous operation of the lighting and capture systems.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the generation of full-length subject images with new backgrounds and floors by extracting the subject from the original images and seamlessly integrating new background and floor elements, providing a more comprehensive image processing solution.
Implementation Method 1
a floor mat having Lambertian characteristics that is positioned under a subject while images of the subject are captured
Data Source
AI summary
A system for performing background and floor replacement in full-length subject images is described. A set of three or more images of a subject can be captured under different illumination conditions. For example, at least one of the images is captured while a foot portion of the subject and surrounding floor, including a floor mat on which the subject is positioned, are illuminated by a floor lighting device. The floor mat has a Lambertian surface to reflect light in a particular manner such that a maximum contrast between the floor and the subject is captured in the image. Varying contrast between the background, floor, and subject among the images of the set can be leveraged by an image processing system to generate a background mask and a floor mask that are combined and seamlessly transitioned to yield a compiled mask for use in background and floor replacement.