Dynamic Object Removal in Photographs via Static Background Restoration

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods fail to effectively remove unwanted objects, such as people or moving vehicles, from photographs while preserving desired static elements like landmarks, leading to incomplete or cluttered images.

Innovation Solution

A method and system that classify objects in a photograph as static or dynamic, allowing for the removal of dynamic objects and integration of content from additional photographs with matching static objects, using metadata and image stitching algorithms to restore the background.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all objects are removed from a photograph, then unwanted objects are eliminated, but desired static elements like landmarks are also removed

Engineering Contradiction:

Improveaccuracy of object removalVSAvoidpreservation of desired elements

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent segments objects in the photograph into different categories (dynamic vs. static) based on their characteristics. By classifying objects into distinct groups, the system can apply different processing rules to each category, removing dynamic objects while preserving static elements like landmarks.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies different quality treatments to different parts of the image based on object type. Dynamic objects receive removal treatment while static objects receive preservation treatment, creating local differentiation in processing quality across the photograph.

Inventive Principle:

Principle #3Local quality

2Productivity

If dynamic objects are removed using existing methods, then some unwanted objects are eliminated, but the background becomes incomplete or cluttered

Engineering Contradiction:

Improveefficiency of object removalVSAvoidquality of background restoration

Core Design Contradiction:

ProductivityVSManufacturing precision

Solution Approach 1:

The patent performs preliminary classification of objects as dynamic or static before removal. This preliminary action ensures that only appropriate objects are removed and prepares the system to properly restore the background by identifying static elements that should remain.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary classification system that mediates between the original photograph and the final result. This intermediary step of categorizing objects enables precise control over what to remove and what to preserve, facilitating high-quality background restoration.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10013622B2Removing unwanted objects from a photograph

Publication Date: 2018.07.03 AIRBNB INC

AI summary

Methods, systems and computer program products for removing unwanted objects from a photograph are provided. Aspects include identifying a plurality of objects in the photograph and classifying each of the plurality of objects as one of a static object and a dynamic object. Aspects also include removing one or more of the plurality of objects classified as dynamic objects from the photograph and identifying one or more additional photographs, which include one or more of the plurality of objects classified as static objects. Aspects further include integrating content from at least one of the one or more additional photographs in a location of the removed dynamic objects in the photograph.