360-Degree Video Processing with Targeted View Area

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 360-degree camera systems face challenges in efficiently processing and transmitting high-resolution 360-degree videos due to significant bandwidth requirements and distortion issues, particularly when focusing on specific objects or areas of interest, which can lead to unpleasant viewing experiences in applications like live video conferencing.

Innovation Solution

A method and apparatus that determine an interest object and target viewing area in a 360-degree video, processing only that area while excluding the remainder, thereby reducing bandwidth requirements and correcting distortions, allowing for efficient transmission and improved viewing experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the entire 360-degree video is processed and transmitted at high resolution, then the viewing quality is improved, but the bandwidth requirements increase significantly

Engineering Contradiction:
Improveviewing qualityVSAvoidbandwidth requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by transmitting high-resolution video data only for the region of interest (ROI) while using lower resolution for the remaining 360-degree video. This is achieved by identifying the ROI based on user information, determining a target viewing area around the interest object, and processing only that specific area at high quality, thereby reducing overall bandwidth requirements while maintaining viewing quality where it matters most

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the 360-degree video into two distinct regions: the region of interest (ROI) and the remaining viewing area. This segmentation allows different processing and transmission strategies to be applied to each region independently, with the ROI receiving full processing resources while the rest of the video is handled more efficiently, resolving the contradiction between overall quality and bandwidth consumption

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If distortion correction is applied to the entire 360-degree video, then the viewing experience is improved, but the processing complexity and time increase

Engineering Contradiction:
Improveviewing experienceVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies distortion correction locally only to the determined target viewing area around the interest object rather than to the entire 360-degree video. This selective application of distortion correction maintains viewing experience quality in the important region while significantly reducing processing complexity and computational resources required

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs preliminary determination of the region of interest and target viewing area before applying distortion correction. By pre-identifying where distortion correction is needed based on user information and interest objects, the system avoids unnecessary processing of entire video frames, thereby reducing processing complexity while maintaining viewing experience

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11295541B2Method and apparatus of 360 degree camera video processing with targeted view
Publication Date: 2022.04.05 TENCENT AMERICA LLC
  • US11295541B2 patent drawing
  • US11295541B2 patent drawing
  • US11295541B2 patent drawing

AI summary

A method of and an apparatus for processing a 360 degree video are provided. The method includes determining an interest object in the 360 degree video, based on user information indicating the interest object, determining a target viewing area around the interest object, in the 360 degree video, and processing the target viewing area while refraining from processing a remaining viewing area excluding the target viewing area, in the 360 degree video.