Real-Time Space Information Coding for Dynamic Image Overlay Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video effect virtual enhancement technologies cannot achieve real-time overlay rendering of camera space information, as they do not store space information data in real time, leading to manual post-processing and lack of unified perspective in continuous dynamic images.

Innovation Solution

A method for coding space information in continuous dynamic images by parsing and extracting camera physical parameters and depth information, constructing data packets, and encapsulating them with audio or image data for real-time storage and rendering, enabling real-time overlay rendering of three-dimensional graphics and virtual elements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If space information data is not stored in real time during video shooting, then the processing system remains simple, but real-time overlay rendering cannot be achieved and manual post-processing is required

Engineering Contradiction:
Improvereal-time overlay rendering capabilityVSAvoidcoding system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by extracting and encoding space information data (camera parameters, depth information) during the video shooting process itself, rather than performing these operations after video capture. This allows the data to be prepared in advance for real-time overlay rendering, resolving the contradiction between achieving real-time rendering and maintaining system simplicity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the video data stream by separating space information data (camera parameters, depth information) from the main video content. This segmentation allows independent processing and encoding of space information, enabling real-time overlay rendering without requiring complex reprocessing of the entire video stream.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If space information data is extracted and encoded for each frame, then real-time rendering is enabled, but data processing complexity increases

Engineering Contradiction:
Improvespace information data accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary space information data (camera parameters, depth information) from each video frame rather than processing the entire frame data. This selective extraction maintains measurement precision for rendering while significantly reducing data processing complexity by focusing only on relevant parameters.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transforms complex spatial and depth information into standardized parameter formats (camera parameters, depth values) that are easier to process and store. This parameter transformation maintains the accuracy needed for precise rendering while simplifying subsequent processing operations.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If manual post-processing is used to add virtual graphics, then system requirements are lower, but rendering efficiency and unified perspective are compromised

Engineering Contradiction:
Improverendering efficiencyVSAvoidpost-processing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent performs preliminary extraction and encoding of space information data during video capture, so that when virtual graphics need to be added, the necessary camera parameters and depth information are already prepared. This eliminates the need for time-consuming post-processing analysis and enables efficient real-time rendering.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11889220B2Method for coding space information in continuous dynamic images
Publication Date: 2024.01.30 IDEAPOOL CULTURE & TECH CO LTD
  • US11889220B2 patent drawing
  • US11889220B2 patent drawing
  • US11889220B2 patent drawing

AI summary

A coding method for space information in continuous dynamic images is provided, which includes the following steps: parsing and extracting space information data, constructing a space information data packet, and coding the space information data packet. According to the coding method in the present invention, the physical parameters, such as lens, position and orientation of a camera as well as space depth information in a plurality of continuous dynamic images can be recorded and stored in real time, and therefore, the coded and stored parameters of the camera and the space depth information are applied to virtual simulation and graphic vision enhancement scenarios, such that in many application scenarios, such as photographing movie and television, producing advertising, and personal video vlogs, abundant and integrated graphic text enhancement effects can be implanted, in real time, a plurality of thereby improving the final image display effect.