Interactive Video Effects With Coordinate-Based Server Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video processing technologies fail to provide satisfactory real-time interactive effects during video shooting, with mainstream rendering technologies relying on real-time raster algorithms that yield poor rendering quality.

Innovation Solution

A method where a first effect is added interactively at a terminal device in real-time, and a second effect is added offline by a server based on coordinate information, using a preset scene format to ensure interactivity and high-quality rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If real-time raster algorithms are used for rendering effects during video shooting, then real-time interaction and user control are achieved, but rendering quality becomes poor

Engineering Contradiction:
Improvereal-time interaction speedVSAvoidrendering quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The patent divides the effect processing into two segments: real-time preview processing at the terminal device and final high-quality rendering at the server. This segmentation allows each part to optimize for its specific function - speed for preview and quality for final output.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces coordinate information as an intermediary data structure that bridges the real-time preview phase and the offline rendering phase. This intermediary contains the essential spatial information needed for both real-time interaction and high-quality final rendering without requiring full rendering capability at the terminal.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If all effects are processed offline by the server, then rendering quality is high, but real-time user interaction and preview capability are lost

Engineering Contradiction:
Improverendering qualityVSAvoidreal-time user interaction
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent performs preliminary actions at the terminal device by adding the first effect in real-time during video shooting. This preliminary effect application enables user interaction and preview, while the coordinate information collected during this phase is later used by the server for high-quality final rendering.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a dynamic workflow where the processing location (terminal vs. server) changes based on the phase of video production. During shooting, the terminal handles real-time effects interactively; after shooting, the server performs offline high-quality rendering. This dynamic allocation optimizes both interaction and quality.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If complex effect processing is performed at the terminal device, then real-time interaction is enabled, but device complexity and computational burden increase

Engineering Contradiction:
Improvereal-time interaction capabilityVSAvoidterminal device processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the computationally intensive final rendering task from the terminal device and relocates it to the server. The terminal only needs to perform lightweight real-time preview and collect coordinate information, while the server handles the complex offline rendering, significantly reducing terminal device complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12469233B2Video processing method and apparatus, and device, and storage medium
Publication Date: 2025.11.11 BEIJING ZITIAO NETWORK TECH CO LTD
  • US12469233B2 patent drawing
  • US12469233B2 patent drawing
  • US12469233B2 patent drawing

AI summary

Embodiments of the disclosure provide a method and a video processing apparatus, an electronic device, a computer-readable storage medium, a computer program product, and a computer program. A terminal device obtains coordinate information of a target part of a collected video picture in response to a selection operation for a first effect; displays the first effect on the target part of the video picture according to the coordinate information; transmits a collected video and the coordinate information of the target part in each video picture of the video are transmitted to a server in response to a collection completion instruction for the video. The server adds a second effect corresponding to the first effect to the target part of each video picture according to the coordinate information.