Synthetic Bokeh Video System Using Depth Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video conference displays often feature cluttered and distracting backgrounds, which can compromise privacy and efficiency, especially when conducted in workspaces or conference rooms with private information, and existing technologies fail to effectively blur backgrounds without degrading image quality or increasing bandwidth.
Innovation Solution
A system that uses a web camera and distance measuring technology to maintain the user in focus while artificially blurring the background, reducing distractions and privacy concerns, and includes an augmented reality feature to manage bandwidth by determining which image sections to transmit in full resolution, thereby enhancing video conference security and efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the background is captured in full resolution, then the image quality is high, but the bandwidth consumption increases and privacy is compromised
Solution Approach 1:
The image is segmented into two distinct regions: a foreground region containing the user in full resolution, and a background region that is blurred. This segmentation allows selective transmission of high-resolution data only for the foreground, reducing overall bandwidth consumption while maintaining image quality where needed.
Solution Approach 2:
Different quality levels are applied to different regions of the image. The foreground region (user) is transmitted in full HD resolution, while the background region is transmitted at lower resolution or blurred. This local quality approach ensures high image quality for the important subject while reducing bandwidth for less critical areas.
2Object-affected harmful factors
If the background is blurred, then privacy is protected and distractions are reduced, but image processing complexity increases
Solution Approach 1:
The system performs preliminary actions by capturing depth information and identifying the user's position in advance, before the video transmission begins. This pre-processing establishes the foreground-background separation early, making the subsequent blurring operation simpler and more efficient.
Solution Approach 2:
The system uses the web camera's existing depth-sensing capabilities and automated user detection algorithms to perform the segmentation and blurring operations autonomously, without requiring complex external processing equipment or manual intervention.
3Ease of manufacture
If web cameras with small apertures are used, then the device cost is low, but the depth of field is too deep and background blur is insufficient
Solution Approach 1:
Instead of relying on mechanical optical adjustments (changing aperture size or focal length) to achieve background blur, the system substitutes a computational approach using software-based synthetic bokeh. This replaces the need for complex mechanical optical systems with algorithmic image processing.
Solution Approach 2:
The system changes the effective depth of field parameter through software processing rather than through optical means. By applying synthetic bokeh algorithms, the system creates an artificial shallow depth of field effect from a camera that naturally produces deep depth of field, effectively decoupling the optical parameters from the final image characteristics.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system effectively reduces background clutter, maintains user privacy, and conserves bandwidth by selectively transmitting high-resolution images, allowing for more efficient and secure video conferencing even over slower connections.
Implementation Method 1
a distance measuring system to measure the first distance between the user and the web camera
Data Source
AI summary
A video system for creating a display in a video conference. The video system includes a web camera to capture an image of a user at a first distance from the web camera and a background that extends away from the camera at a second distance greater than the first distance. The video system also has a distance measuring system to measure the first distance between the user and the web camera. The video system establishes an artificial focal length at least as great as the first distance and less than the second distance to artificially blur the background while maintaining the user in focus. The display thus shows the user in focus and a blurred background. The purposefully-blurred background is known as synthetic bokeh.