Foreground Extraction via Element Overlap Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods require manual specification of object areas, which is time-consuming and inaccurate, especially when dealing with multiple images or images with complex backgrounds.

Innovation Solution

An image processing device and method that automatically extracts foreground areas by setting element areas, specifying overlapped areas based on a degree of overlap, and using these areas to separate foreground from background, thereby reducing user effort and improving accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual specification of object areas is used (Grabcut method), then accuracy in extracting foreground area is improved, but user time and effort increase significantly

Engineering Contradiction:
Improveaccuracy in extracting foreground areaVSAvoiduser time and effort
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system automatically performs foreground area extraction by analyzing overlapping element areas without requiring user intervention. The computer itself serves to identify the foreground area by calculating overlap degrees of multiple element areas, eliminating the need for manual specification while maintaining extraction accuracy.

Inventive Principle:
Principle #25Self-service

2Loss of time

If bounding box is used to automatically extract foreground area, then user time and effort are saved, but accuracy deteriorates because bounding box includes many backgrounds

Engineering Contradiction:
Improveuser time and effortVSAvoidaccuracy in extracting foreground area
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

Instead of using a single bounding box, the system divides the image into multiple element areas corresponding to different elements. By calculating the overlap degree of these segmented element areas, the system identifies the precise foreground area, avoiding the inclusion of background regions that would occur with a single bounding box approach.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes the parameter from a simple bounding box definition to an overlap degree threshold. By setting a predetermined threshold for the degree of overlap, the system dynamically determines which pixels belong to the foreground area, achieving both automation and accuracy.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If multiple element areas are set to identify overlapped area, then accuracy in extracting foreground area is improved, but device complexity increases

Engineering Contradiction:
Improveaccuracy in extracting foreground areaVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system replaces complex manual or heuristic methods with a systematic computational approach. By using automated algorithms to calculate the overlap degree of multiple element areas and compare it against a predetermined threshold, the system manages processing complexity through structured computation rather than ad hoc methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10991104B2Image processing device, image processing method, and program
Publication Date: 2021.04.27 RAKUTEN GROUP INC
  • US10991104B2 patent drawing
  • US10991104B2 patent drawing
  • US10991104B2 patent drawing

AI summary

To increase accuracy in extracting a foreground area while saving a user time and effort. Image obtaining means of an image processing device obtains an image including a background and an object. Element area setting means sets, with respect to the image, a plurality of element areas respectively corresponding to a plurality of elements in the image. Overlapped area specifying means specifies an overlapped area in which a degree of overlap of the element areas is greater than or equal to a predetermined value in the image. Foreground area extracting means extracts a foreground area corresponding to the object from the image based on the overlapped area.