AR Special Effect Generation via Key-Point Detection and Template Automation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating special effects in augmented reality (AR) are inefficient and require manual programming, making it time-consuming and prone to errors in achieving dynamic and accurate effects on videos.

Innovation Solution

A method and apparatus for generating a special effect program file package that imports sub-materials, obtains playback parameter values, and performs key-point detection on video images to dynamically generate special effects, allowing for real-time processing and rendering without manual programming.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual programming is used to generate special effects, then customization and control are improved, but time consumption and error probability increase

Engineering Contradiction:
Improvemanual programming controlVSAvoidtime consumption
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent uses template copying to generate special effect program files. Pre-defined templates with standard AR special effects are stored in a database, and the system automatically copies and configures these templates based on video content analysis, eliminating the need for manual programming while maintaining customization capabilities through parameter adjustment.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs self-service by automatically analyzing video content, detecting key frames, and generating special effect program files without human intervention. The automated generation process includes extracting video features, selecting appropriate templates, and configuring parameters based on content characteristics, thereby reducing both time consumption and error probability.

Inventive Principle:
Principle #25Self-service

2Productivity

If automated generation is used to generate special effects, then efficiency is improved, but customization capability may deteriorate

Engineering Contradiction:
Improvegeneration efficiencyVSAvoidcustomization capability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements universal templates that can serve multiple customization needs. Each template is designed with configurable parameters that allow the same base template to generate different special effects for various video content types, maintaining high efficiency while providing adaptability through parameter adjustment rather than requiring separate programs for each case.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically configures template parameters based on real-time video content analysis. The automated generation process adapts template settings according to detected key frames, video characteristics, and content type, enabling efficient automated generation that maintains customization capability through dynamic parameter adjustment rather than static fixed templates.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If complex programming is used to achieve dynamic special effects, then effect accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveeffect accuracyVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the special effect generation process into distinct modules: video content analysis, key frame detection, template selection, and parameter configuration. This modular segmentation allows each component to be optimized independently, maintaining high effect accuracy through specialized processing while reducing overall system complexity through clear separation of concerns and standardized interfaces between modules.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11368746B2Method and device for generating special effect program file package, method and device for generating special effect, and electronic device
Publication Date: 2022.06.21 BEIJING SENSETIME TECH DEV CO LTD
  • US11368746B2 patent drawing
  • US11368746B2 patent drawing
  • US11368746B2 patent drawing

AI summary

A method for generating a special effect program file package includes: importing a group of sub-materials, where the group of sub-materials include a plurality of sub-materials; obtaining parameter values of playback parameters of the group of sub-materials; and generating a special effect program file package according to the group of sub-materials and the parameter values of the playback parameters.