Video Frame Object Removal With Padding for Disappearing Effects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video applications lack diversity in interaction manners during shooting or playing, failing to meet user requirements for personalized and enhanced visual perception.

Innovation Solution

A method and apparatus that fix a target frame image in response to a triggering instruction, remove a target object, and perform a padding operation to generate a padding frame image, allowing special effects like object disappearance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If conventional video processing methods are used, then processing can be performed with standard hardware, but processing speed and efficiency are insufficient for real-time applications

Engineering Contradiction:
Improvevideo processing speedVSAvoidreal-time processing efficiency
Core Design Contradiction:
SpeedVSProductivity

Solution Approach 1:

The video processing method is divided into multiple independent modules including motion estimation, motion compensation, prediction error calculation, and transform processing. Each module can be independently optimized and executed in parallel, significantly improving processing speed while maintaining real-time performance

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the video processing from traditional temporal sequence processing to spatial-frequency domain processing using transform techniques. This dimensional transformation enables parallel computation across different frequency components, achieving real-time processing efficiency

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If high processing power is used to achieve real-time processing, then processing speed improves, but computational complexity and resource consumption increase

Engineering Contradiction:
Improvereal-time processing efficiencyVSAvoidcomputational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies selective processing where only necessary video blocks are processed at high detail levels while others use simplified processing. Motion-compensated prediction is applied only where motion is detected, reducing overall computational complexity while maintaining real-time processing capability

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The processing complexity is dynamically adjusted by changing parameters such as block size, search range, and transform depth based on scene complexity and motion activity. This adaptive parameter adjustment maintains real-time efficiency while minimizing computational resources

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If detailed processing is applied to all video blocks, then processing precision improves, but processing time increases

Engineering Contradiction:
Improvemotion estimation precisionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Different processing precision levels are applied to different video blocks based on their characteristics. High-precision motion estimation is applied only to blocks with significant motion or important visual content, while low-motion areas use simplified processing, optimizing the balance between precision and processing time

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

A coarse motion estimation is performed first on all blocks to identify regions requiring detailed processing. This preliminary action allows the system to focus computational resources on critical areas, achieving high precision where needed without excessive overall processing time

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP4243398B1Video processing method and apparatus, electronic device, and storage medium
Publication Date: 2026.04.29 DOUYIN VISION CO LTD
  • EP4243398B1 patent drawingFigure 1
  • EP4243398B1 patent drawingFigure 2~3
  • EP4243398B1 patent drawingFigure 4

AI summary

A video processing method and apparatus, an electronic device and a storage medium are provided in the present disclosure. In the video processing method provided in the present disclosure, a target frame image of a target video is fixed in response to a triggering instruction, and a target object in the target frame image is removed, then a padding operation is performed on a target area in the target frame image so as to generate and display a padding frame image. Thus, a special effect that the target object disappears from the target video can be realized, thereby providing visual special effects of more personalized and better visual perception for a user in a video application.