Seamless Object Replacement in Images via Multi-Source Region Matching

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current image editing tools lack the ability to automatically replace an object in an image while matching its background, leading to noticeable edits due to differences in image data, especially when capturing images in motion or with varying camera positions.

Innovation Solution

A method that captures multiple images, selects a base image, identifies and compares regions of an object and its surrounding area across images, adjusts the region sizes to match image data thresholds, and replaces the region in the base image with a corresponding region from another image using techniques like Laplacian pyramids and radiance maps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If object replacement is performed using prior art methods, then the replacement object can be inserted into the base image, but the edges of the replaced object do not match with the background due to movement or camera variation

Engineering Contradiction:

Improveease of object replacementVSAvoidedge matching precision

Core Design Contradiction:

Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent performs preliminary actions by capturing multiple images in advance and pre-identifying candidate regions containing the target object. This allows the system to have multiple pre-prepared options with varying degrees of background-object consistency, so when replacement is needed, a matching region can be quickly selected without real-time processing delays.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent employs feedback mechanisms by calculating matching degrees between candidate regions and the base image background, then using this feedback information to select the optimal replacement region. The system continuously refines the selection by comparing edge characteristics and background consistency, ensuring the chosen region achieves the best visual integration.

Inventive Principle:

Principle #23Feedback

2Ease of operation

If manual editing tools are used to replace objects, then the user has control over the replacement process, but the process is time-consuming and requires repeated capturing to get a preferred image

Engineering Contradiction:

Improveuser control over editingVSAvoidtime for capturing and editing

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent implements self-service by enabling automatic object identification, automatic candidate region selection, and automatic replacement execution. The system performs these tasks autonomously without requiring manual user intervention for each step, significantly reducing the time and effort users would otherwise spend on repetitive capturing and manual editing operations.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent performs preliminary actions by pre-capturing multiple images and pre-identifying candidate regions containing the target object. This allows the system to have multiple pre-prepared options with varying degrees of background-object consistency, so when replacement is needed, a matching region can be quickly selected without real-time processing delays.

Inventive Principle:

Principle #10Preliminary action

3Productivity

If simple object selection is used without background matching, then the replacement can be completed quickly, but the generated image shows obvious editing artifacts

Engineering Contradiction:

Improvespeed of image editingVSAvoidquality of generated image

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent applies parameter changes by adjusting the matching criteria and region selection parameters dynamically. The system modifies parameters such as region size, edge tolerance, and background similarity thresholds to optimize both the speed of selection and the quality of the final replacement, achieving a balance between productivity and reliability.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS9489727B2Method for generating a preferred image by replacing a region of a base image

Publication Date: 2016.11.08 ARCSOFT MULTIMEDIA TECH LTD

AI summary

To generate a preferred image, at least two images may be captured. From the at least two images, a base image is selected to be edited and another image is selected as a source of image data used for editing the base image. A user selects an object of the base image to be replaced. The object on the base image is compared to the object on the another image to generate a region on the base image and the another image. The region on the base image is replaced with the region on the another image.