Depth-Aware Color Compensation for Foreground-Background Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing technologies struggle to effectively implement distance-based effects and object tracking in color images due to their reliance solely on color data, failing to account for depth variations which affect object size and distance from the camera.

Innovation Solution

An image processing apparatus and method that utilizes a depth image to determine foreground and background regions, applying differential color compensation techniques such as histogram equalization, white balance adjustment, contrast, saturation, and hue adjustments to enhance image quality by emphasizing the foreground while blurring or adjusting the background based on depth values.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional image processing technology uses only color image data, then the processing is simple, but distance-based effects and object tracking cannot be implemented

Engineering Contradiction:
Improvedistance-based effects implementationVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The image is segmented into foreground and background regions using depth information from the depth map. This segmentation enables different processing to be applied to different regions, allowing distance-based effects to be implemented while maintaining manageable processing complexity through region-specific operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces depth information as an additional dimension beyond the traditional color image data. By utilizing the depth map's Z-axis information, the system can distinguish foreground from background and apply depth-aware processing, enabling distance-based effects without significantly increasing overall system complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Manufacturing precision

If histogram equalization is applied to the entire image, then overall contrast is improved, but foreground object colors become distorted

Engineering Contradiction:
Improvecolor accuracyVSAvoidcontrast enhancement
Core Design Contradiction:
Manufacturing precisionVSMeasurement precision

Solution Approach 1:

The patent applies histogram equalization selectively only to the background region rather than the entire image. By masking the foreground region and applying contrast enhancement only where needed in the background, the system maintains color accuracy of foreground objects while still achieving contrast improvement in the background areas.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If the same processing is applied to foreground and background regions, then processing is simple, but background distortion cannot be reduced

Engineering Contradiction:
Improvebackground distortion reductionVSAvoiddifferential processing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies different processing parameters to foreground and background regions based on depth information. The background region receives differential processing including histogram equalization and white balance adjustment, while the foreground region is protected from these operations. This region-specific processing reduces background distortion while maintaining manageable complexity through depth-based segmentation.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9542728B2Apparatus and method for processing color image using depth image
Publication Date: 2017.01.10 SAMSUNG ELECTRONICS CO LTD
  • US9542728B2 patent drawing
  • US9542728B2 patent drawing
  • US9542728B2 patent drawing

AI summary

An image processing apparatus and method using a depth image are provided. The image processing apparatus may include a region determination unit to determine a foreground region and a background region in a color image using a depth image, and a color compensation unit to compensate a color with respect to the foreground region and the background region.