Foreground Image Extraction Using Infrared Light and Dark Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for extracting foreground images, such as chroma key, background subtraction, and feature detection, are hindered by ambient light, background noise, and complex calculations, leading to incomplete or inaccurate foreground extraction.
Innovation Solution
The method employs infrared (IR) imaging to differentiate between foreground and background by capturing IR light and dark frame images, generating a binary image, and adjusting pixel values based on distance and color information to isolate foreground pixels, thereby simplifying the extraction process and reducing noise and light interference.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If chroma key technology is used to extract foreground by changing background to mono-colored, then foreground extraction can be achieved through color differences, but it requires user to set up a mono color screen which reduces ease of operation
Solution Approach 1:
The patent replaces the mechanical/manual setup of chroma key (requiring physical mono-color screen arrangement) with an automated infrared imaging system that captures and processes images through infrared emitters and sensors, eliminating the need for manual screen configuration while maintaining foreground extraction capability
Solution Approach 2:
The patent changes the operating parameter from visible light color detection to infrared radiation detection, allowing the system to automatically distinguish foreground from background based on infrared reflectance properties rather than requiring visible color differentiation and manual screen setup
2Productivity
If background subtraction method is used to extract foreground when there is a large difference between background and foreground pixel values, then foreground extraction can be performed, but the background image is easily affected by noise interference causing extracted foreground to include background portions
Solution Approach 1:
The patent replaces visible light-based background subtraction with infrared imaging technology, where the infrared emitter and sensor capture infrared reflectance differences between foreground and background, effectively filtering out visible light noise and improving extraction accuracy without sacrificing processing speed
Solution Approach 2:
The patent creates an infrared-based imaging environment that is immune to visible light noise interference, analogous to creating an inert atmosphere that protects against harmful factors. The infrared channel operates independently from visible light fluctuations, providing a stable basis for foreground extraction
3Measurement precision
If feature detection method is used to extract foreground from specific objects like human face, then foreground extraction can be performed, but the detection is easily affected by ambient light leading to unsuccessful detection and requires complicated calculations that prevent immediate processing
Solution Approach 1:
The patent replaces complex visible light-based feature detection algorithms with a simpler infrared imaging approach. The infrared emitter illuminates the scene and the sensor captures reflectance patterns that naturally highlight foreground objects, eliminating the need for complex ambient light compensation calculations and enabling immediate processing
Solution Approach 2:
The patent introduces infrared radiation as an intermediary between the light source and the detection system. The infrared emitter serves as a controlled light source that provides consistent illumination independent of ambient visible light conditions, simplifying the detection process and improving both accuracy and processing speed
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach effectively extracts foreground images, including human face and hair portions, with reduced computational complexity and improved accuracy, enabling immediate processing and background virtualization for a more realistic scene.
Implementation Method 1
acquire an IR light frame image indicating a light state, an IR dark frame image indicating a dark state and a color image
Implementation Method 2
receives an IR reflecting signal related to the IR signal
Data Source
AI summary
A method for extracting foreground image and electronic apparatus thereof is provided and implements infrared (IR) technology to perform the foreground image extraction to reduce ambient light effect and background noise. Furthermore, the method and electronic apparatus extract an IR light frame image indicating a light state, an IR dark frame image indicating a dark state, and a color image (e.g., RGB image, YUV image, or etc.) at different IR intensities. Then, the method and electronic apparatus calculate the relationship between the IR light frame image and the IR dark frame image to extract a better background image (including the user's face portion, body portion and hair portion) by a simple algorithm.