Tiled Video Playback for 360 VR and Multi-Channel Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current streaming technologies face challenges in providing seamless high-quality streaming of large-sized media content, particularly for high-quality 360-degree VR videos and multiple 2D videos, due to bandwidth limitations and inconsistent internet quality, which hinders simultaneous playback.

Innovation Solution

An electronic device and method for tiled video multi-channel playback that establishes communication with a streaming server, detects regions of interest, transmits relevant information, receives and synthesizes video tiles and 2D videos, and uses two decoders for simultaneous playback, optimizing resolution and rendering for low latency and seamless delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If high-quality large-sized media files are transmitted, then video quality is improved, but bandwidth consumption increases and QoS cannot be guaranteed

Engineering Contradiction:
Improvevideo qualityVSAvoidbandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent segments the video content into multiple channels, with one channel dedicated to 360-degree VR video and other channels for 2D videos. This segmentation allows selective allocation of bandwidth resources to different video types based on quality requirements and network conditions, resolving the contradiction between high video quality and bandwidth consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements different quality levels for different video regions and channels. The 360-degree VR video channel receives high-quality transmission with detailed tile information, while other 2D video channels can use lower quality settings. This local quality differentiation maintains overall video quality while reducing total bandwidth consumption.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If multiple high-quality videos are streamed simultaneously, then video quality is improved, but seamless streaming becomes difficult due to bandwidth limitations

Engineering Contradiction:
Improvevideo qualityVSAvoidseamless streaming
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent segments video streaming into multiple independent channels, each handling different video types (360-degree VR and 2D videos). This channel segmentation allows independent quality control and error handling for each channel, ensuring that quality issues in one channel do not affect others, thereby maintaining seamless streaming across all channels.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts streaming parameters such as resolution, bitrate, and tile density for different video channels based on network conditions and device capabilities. This parameter optimization ensures high video quality where needed while maintaining seamless playback by adapting to available bandwidth.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If tiled video with high resolution is transmitted, then video quality in ROI is improved, but data transmission volume increases

Engineering Contradiction:
Improvevideo quality in ROIVSAvoiddata transmission volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality enhancement by transmitting high-resolution tiled video data only for regions of interest (ROI) identified in the 360-degree VR video. Non-ROI areas use lower resolution, significantly reducing data transmission volume while maintaining perceived video quality where the user is actually looking.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs preliminary analysis to identify regions of interest before transmitting high-quality video data. By detecting ROI in advance based on video content characteristics or user behavior patterns, the system pre-prepares and transmits high-resolution tiles only for those specific regions, optimizing the balance between video quality and data volume.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10880534B2Electronic device and method for tiled video multi-channel playback
Publication Date: 2020.12.29 KOREA ELECTRONICS TECH INST
  • US10880534B2 patent drawing
  • US10880534B2 patent drawing
  • US10880534B2 patent drawing

AI summary

An electronic device and a method for a tiled video multi-channel playback are disclosed. The electronic device includes a device communication unit and a device controller. The device communication unit establishes a communication channel with a streaming server. The device controller can detect a region of interest (ROI) of an image related to a media presentation description (MPD) tile provided by the streaming server, transmit ROI information to the streaming server and receive tiles of a tiled video having a first resolution and corresponding to the ROI information, a full video having a second resolution lower than the first resolution, and a plurality of 2D videos from the streaming server. The device controller can also generate a 360-degree VR video by synthesizing the video tiles and the full video, and control a simultaneous playback of the generated 360-degree VR video and the plurality of 2D videos.