Image Deformation Texture Accumulation for Mobile Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing methods require multiple updates to the original image during deformation processing, leading to image blurring when multiple deformations are applied, especially on high-resolution images.

Innovation Solution

An image processing method that involves obtaining a deformation instruction sequence and sequentially superimposing deformation offsets on a lower-resolution image texture to accumulate total deformation offset information, followed by a single interpolation operation on the high-resolution image to maintain picture quality and reduce computational overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple deformation updates are applied directly to the high-resolution original image, then the deformation processing can be performed with high precision, but the image becomes blurred and computational overhead increases

Engineering Contradiction:
Improvedeformation precisionVSAvoidimage blurring
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent segments the image processing into two distinct resolution levels: a low-resolution texture map for accumulation of multiple deformation offsets, and a high-resolution original image for final rendering. This segmentation allows the harmful repeated interpolation operations to occur only once on the low-resolution map, while the high-resolution image undergoes a single clean interpolation, thereby preventing blurring while maintaining deformation precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a low-resolution texture map as an intermediary data structure to store accumulated deformation offsets. This intermediary absorbs the harmful effects of multiple interpolation operations, allowing multiple deformation instructions to be combined without directly affecting the high-resolution image quality. The texture map serves as a buffer that preserves the original high-resolution image from degradation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If multiple deformation updates are applied to the original image, then complete deformation information is achieved, but computational overhead increases

Engineering Contradiction:
Improvedeformation completenessVSAvoidcomputational overhead
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the computational workload into two resolution levels: low-resolution texture map operations for accumulation and high-resolution operations for final output. By performing the computationally intensive accumulation operations on a downsampled texture map, the overall computational overhead is significantly reduced while still achieving complete deformation information through the single final interpolation on the high-resolution image.

Inventive Principle:
Principle #1Segmentation

3Productivity

If the resolution of the processed image texture is reduced, then computation load is reduced and operation smoothness is improved, but image quality may be compromised

Engineering Contradiction:
Improveoperation smoothnessVSAvoidpicture quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies different quality requirements to different parts of the processing pipeline: the low-resolution texture map area is sufficient for accumulation operations where fine detail is not critical, while the high-resolution original image area is preserved for the final rendering where picture quality is essential. This local quality differentiation optimizes performance without sacrificing final output quality.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent creates a copy of the original image at low resolution (the texture map) specifically for the purpose of accumulating deformation offsets. This copy allows computationally efficient operations to proceed smoothly, while the original high-resolution image remains untouched and is used only for the final high-quality rendering, thus preserving picture quality while improving operation smoothness.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20240221257A1Image processing method and apparatus, device, medium and program product
Publication Date: 2024.07.04 BEIJING ZITIAO NETWORK TECH CO LTD
  • US20240221257A1 patent drawing
  • US20240221257A1 patent drawing
  • US20240221257A1 patent drawing

AI summary

The present disclosure provides an image processing method and apparatus, device, medium and program product. In the image processing method provided by the present disclosure, a deformation instruction sequence to be applied on a target object in a to-be-processed image is obtained, and then deformation offsets are sequentially superimposed on the to-be-processed image texture based on deformation instructions in the deformation instruction sequence to determine a superimposed deformation image texture. Finally, the target object in the to-be-processed image is deformed based on the superimposed deformation image texture to generate a processed image. Since the superimposition of deformation effect offset is performed on a lower-resolution picture, the overhead is smaller; when multiple effects are superimposed on the mobile side, smooth operation can still be guaranteed. In addition, since only a single interpolation operation is performed, these is less loss of the picture quality.