Moving Object Removal in Images via Background Region Replacement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Moving objects in photographs, such as vehicles or birds, can accidentally appear and detract from the aesthetic quality of images captured by electronic devices like cameras and smartphones, leading to a need for a method to remove these objects and enhance user experience.

Innovation Solution

An image processing method that involves inputting multiple images, matching them by corresponding positions, determining a background image, marking moving objects, and replacing the regions occupied by these objects with corresponding background regions from other images, using techniques like Harris corner detection and pixel color analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple input images are processed to remove moving objects, then the aesthetic quality of the photo is improved, but the processing complexity and time consumption increase

Engineering Contradiction:
Improveaesthetic quality of photoVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the image processing task into distinct steps: matching input images according to corresponding positions, determining a background image from the matched images, marking moving objects by comparing pixel colors, and replacing moving object regions with corresponding background regions. This segmentation allows complex processing to be broken down into manageable operations that can be executed systematically

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary matching of multiple input images to determine a stable background image before proceeding to moving object detection and removal. By pre-establishing the background reference through image matching and comparison, the subsequent moving object identification becomes more efficient and accurate, reducing overall processing complexity

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If multiple input images are processed to remove moving objects, then the aesthetic quality of the photo is improved, but the processing time increases

Engineering Contradiction:
Improveaesthetic quality of photoVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent compares pixel colors of each coordinate across multiple input images against the background image to identify moving objects. By performing targeted pixel-level comparisons only in regions where differences exceed a threshold, the processing time is reduced while still achieving effective moving object removal and maintaining photo aesthetic quality

Inventive Principle:
Principle #16Partial or excessive action

3Ease of operation

If automatic marking of moving objects is performed, then the ease of operation is improved, but the accuracy of moving object identification may deteriorate

Engineering Contradiction:
Improveease of operationVSAvoidaccuracy of moving object identification
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent calculates difference values by comparing pixel colors of each coordinate in the input images against the background image, and uses these difference values to automatically mark moving objects. This quantitative feedback mechanism provides objective criteria for moving object identification, improving accuracy while maintaining ease of operation through automation

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs self-service by automatically detecting and marking moving objects through pixel color comparison and difference value calculation, eliminating the need for manual intervention. The automated process identifies moving objects based on their visual differences from the background, achieving both ease of operation and acceptable identification accuracy

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS8913823B2Image processing method for removing moving object and electronic device
Publication Date: 2014.12.16 ARCSOFT CORP LTD
  • US8913823B2 patent drawing
  • US8913823B2 patent drawing
  • US8913823B2 patent drawing

AI summary

An image processing method for removing a moving object includes an input step of inputting input images; a matching step of matching the input images according to corresponding positions; a determining step of determining a background image from the input images; a marking step of marking at least one moving object from at least one of the input images; and a replacing step of replacing a region, occupied by the moving object in at least one of the input images with a corresponding regional background in another input image.