Fusing Objects into Panoramic Video via Color Parameter Parsing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing panoramic video playback technology cannot fuse additional content while playing the video, limiting the immersive experience.

Innovation Solution

A method and apparatus that acquire and parse a target object to set its color based on coordinate and material parameters, then fuse it into the panoramic video, allowing for the integration of objects during playback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If panoramic video playback technology is used to restore 720-degree panoramic effect, then the immersive experience is improved, but the system cannot fuse additional content while playing the video

Engineering Contradiction:
Improvecontent integration capabilityVSAvoidvideo processing system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the panoramic video playback function with the object fusion function into a single integrated system. The video processing unit processes both the panoramic video frames and the target object images, combining them into a unified output that displays both the 720-degree panoramic view and the fused objects simultaneously, thereby achieving content integration without requiring separate independent systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The video processing unit is designed with multi-functionality, serving both to render the panoramic video content and to fuse additional target objects into the video. This universal unit handles diverse input types (video frames and object images) and produces a combined output, enabling the system to perform multiple functions without proportionally increasing overall system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If object fusion is added to panoramic video playback, then content integration capability is improved, but the processing complexity increases

Engineering Contradiction:
Improveobject integration capabilityVSAvoidcolor setting and fusion process complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-obtaining color information about the panoramic video pixels before fusing the target object. The video processing unit acquires the color data of pixels in the region where the object will be fused, then uses this pre-acquired information to adjust the object's color to match the surrounding video content, thereby simplifying the fusion process and reducing processing complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies local quality by adjusting the color of the target object specifically in the region where it is fused into the panoramic video, while leaving other parts of the video and object unchanged. The color adjustment is localized to the fusion area, making the processing efficient and manageable without requiring global reprocessing of the entire video or object

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the fusion of objects into panoramic videos, enhancing the special effect and user experience by allowing content beyond the 720-degree panoramic view to be integrated.

Implementation Method 1

mapping the sequence frames to an inner surface of a preset panoramic video playing model; and projecting a portion of the panoramic video playing model corresponding to a viewing interface onto a projection surface

Methodology Applied
Scientific EffectProjection:

Implementation Method 2

determining, based on the material parameter, a reflection coefficient of the target object for light

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

determining the color of the each pixel of the target object when the target object is fused into the panoramic video, based on the two-dimensional coordinates, the reflection coefficient, a preset intensity of ambient light and a preset intensity of directional light

Methodology Applied
Scientific EffectLight illumination: Light

Data Source

PatentUS11188801B2Method and apparatus for fusing object into panoramic video
Publication Date: 2021.11.30 BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
  • US11188801B2 patent drawing
  • US11188801B2 patent drawing
  • US11188801B2 patent drawing

AI summary

Disclosed are method and apparatus for fusing an object into a panoramic video. The method may include: playing a panoramic video in a panoramic video player; obtaining a target object; parsing the target object to obtain a coordinates parameter and a material parameter of the target object; setting the color of each pixel of the target object when the target object is fused into the panoramic video according to the coordinate parameter and the material parameter, so as to obtain a colored target object; and fusing the colored target object into the panoramic video.