Image Inpainting Using Backup Pixel Blocks for Texture Preservation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing techniques for portrait beautification struggle to effectively remove defects like acne, moles, and spots while maintaining the natural texture and reality of the skin, often resulting in unnatural or abrupt transitions.

Innovation Solution

A method and device for inpainting images that determine an inpainting region, obtain original texture information, and use backup pixel blocks to inpaint pixels, weighting values and superimposing texture information to create a smooth and realistic image, with the backup pixel blocks selected based on similarity and edge strength.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If conventional inpainting techniques are used to remove defects, then the defective regions can be removed, but the original texture and reality of the skin are lost, resulting in unnatural transitions

Engineering Contradiction:
Improvedefect removal effectivenessVSAvoidtexture preservation accuracy
Core Design Contradiction:
Object-affected harmful factorsVSManufacturing precision

Solution Approach 1:

The image is divided into multiple pixel blocks, where some blocks are designated as inpainting blocks and others as backup blocks. This segmentation allows selective processing of defective regions while preserving texture information from non-defective regions through the backup blocks.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The method pre-pares backup pixel blocks from regions outside the inpainting area before performing the actual inpainting. These backup blocks contain original texture information that is superimposed during the inpainting process to maintain texture realism, rather than simply copying or interpolating values.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If simple pixel copying or interpolation is used for inpainting, then the processing speed is fast, but abrupt edges and unnatural transitions appear in the inpainted regions

Engineering Contradiction:
Improveinpainting processing speedVSAvoidinpainting quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The method changes the parameter approach from direct pixel value copying or linear interpolation to a superposition operation that combines multiple pixel blocks with different weights. This parameter transformation allows for smoother transitions and more natural blending while maintaining computational efficiency through the block-based approach.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11521303B2Method and device for inpainting image
Publication Date: 2022.12.06 BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
  • US11521303B2 patent drawing
  • US11521303B2 patent drawing
  • US11521303B2 patent drawing

AI summary

A method and device are provided for inpainting image. An electronic device can be used for: determining an inpainting region of the image, wherein the inpainting region includes a defective region; obtaining original texture information of the inpainting region; determining inpainting pixel blocks and backup pixel blocks, wherein the inpainting pixel blocks include inpainting pixels and first type pixels; inpainting all inpainting pixels of the inpainting pixel blocks based on the backup pixel blocks; and superimposing the original texture information in the inpainting region.