Back-propagation Saliency Detection Using Depth Image Mining

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing saliency detection methods for images are not accurate and robust enough, especially when salient objects have low contrast with their backgrounds, leading to errors and inaccuracies in detection.

Innovation Solution

A multi-phase back-propagation saliency detection algorithm that utilizes depth image mining, incorporating color, depth, and distance information to enhance salient object detection, with preprocessing steps including background removal and multiple layers of processing optimized by a back-propagation mechanism.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If depth information is used to enhance salient object detection accuracy, then detection precision improves, but reliability deteriorates when salient objects have low contrast with background

Engineering Contradiction:
Improvedetection accuracyVSAvoiddetection robustness
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the saliency detection process into multiple processing phases (first processing phase, second processing phase, third processing phase), where each phase processes depth information at different levels. This segmentation allows the system to handle low-contrast objects by progressively refining detection results across phases, preventing early errors from propagating and improving overall reliability while maintaining precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a feedback mechanism where detection results from previous phases are used to guide subsequent processing. The back-propagation mechanism uses detection results from later phases to optimize earlier phase parameters, creating a closed-loop system that continuously improves reliability while maintaining detection accuracy, especially for low-contrast salient objects.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If multi-layer deep mining of depth image is performed, then detection accuracy improves, but computational complexity increases

Engineering Contradiction:
Improvesaliency detection accuracyVSAvoidalgorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the complex multi-layer depth image mining process into three distinct processing phases, each with specific functions. The first phase performs initial saliency detection, the second phase refines results with additional depth analysis, and the third phase conducts final optimization. This segmentation makes the complex algorithm more manageable and implementable while achieving high detection accuracy through systematic multi-layer processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary saliency detection in the first processing phase before conducting more complex multi-layer analysis. This preliminary action establishes a baseline that guides subsequent processing steps, reducing the computational burden of later phases by focusing resources on regions of interest identified earlier, thus balancing accuracy with computational complexity.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If back-propagation mechanism is used to optimize detection results, then detection reliability improves, but processing time increases

Engineering Contradiction:
Improvedetection robustnessVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary saliency detection and background removal in the first processing phase before applying the computationally intensive back-propagation mechanism. This preliminary action prepares optimized input data for the back-propagation step, reducing the time required for reliability optimization while maintaining robust detection results through the structured three-phase approach.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11227178B2Back-propagation image visual saliency detection method based on depth image mining
Publication Date: 2022.01.18 PEKING UNIV SHENZHEN GRADUATE SCHOOL
  • US11227178B2 patent drawing
  • US11227178B2 patent drawing

AI summary

A back-propagation significance detection method based on depth map mining, comprising: for an input image Io, at a preprocessing phase, obtaining a depth image Id and an image Cb with four background corners removed of the image Io; at a first processing phase, carrying out positioning detection on a significant region of the image by means of the obtained image Cb with four background corners removed and the obtained depth image Id to obtain the preliminary detection result S1 of a significant object in the image; then carrying out depth mining on a plurality of processing phases of the depth image Id to obtain corresponding significance detection results; and then optimizing the significance detection result mined in each processing phase by means of a back-propagation mechanism to obtain a final significance detection result map. The method can improve the detection accuracy of the significance object.