Tile-Based VR Video Quality Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

There is a lack of objective quality assessment techniques for VR video, particularly in tile-based distribution services where the quality of high-quality tiles and low-quality tiles differs, affecting user experience as the line of sight moves.

Innovation Solution

A video quality estimation device and method that extract and utilize parameters representing the quality of high-quality and low-quality tiles to estimate the overall video quality experienced by users, using a model formula that accounts for quality deterioration due to line of sight movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If tile-based distribution is used to reduce distribution costs, then distribution efficiency is improved, but quality assessment accuracy deteriorates because conventional 2D video quality estimation methods cannot account for the different quality contributions of high-quality and low-quality tiles

Engineering Contradiction:
Improvedistribution efficiencyVSAvoidquality assessment accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments the VR video into multiple tiles with different quality levels (high-quality tiles in the viewing direction and low-quality tiles in other directions). The quality assessment is then performed separately for each tile type by extracting quality parameters from representative frames of each tile, and finally combining these segmented assessments to obtain the overall video quality. This segmentation approach enables accurate quality assessment that accounts for the different contributions of high-quality and low-quality tiles.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality assessment by recognizing that different regions (tiles) of the VR video have different quality characteristics based on their viewing importance. High-quality tiles located in the user's viewing direction are assessed with higher weight, while low-quality tiles in peripheral directions are assessed with lower weight. This local quality differentiation allows the system to accurately reflect the actual user experience in tile-based distribution.

Inventive Principle:
Principle #3Local quality

2Reliability

If high-quality video is distributed for the viewing direction to improve user experience, then quality in the viewing direction is improved, but distribution bandwidth increases

Engineering Contradiction:
Improveuser experience qualityVSAvoiddistribution bandwidth
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent implements local quality differentiation by distributing high-quality video data only for tiles in the user's viewing direction, while distributing low-quality or compressed data for tiles in peripheral directions. This approach ensures that bandwidth resources are concentrated on the most important regions that the user will actually view, thereby improving perceived user experience quality without proportionally increasing total distribution bandwidth.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent employs dynamic quality adaptation where the quality of distributed video tiles can change based on the user's viewing direction and head movement. As the user turns their head or changes viewing direction, the system dynamically identifies which tiles should be high-quality and which can be low-quality, adjusting the distribution strategy in real-time to optimize the balance between user experience quality and bandwidth consumption.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11671654B2Video quality estimation apparatus, video quality estimation method and program
Publication Date: 2023.06.06 NIPPON TELEGRAPH & TELEPHONE CORP
  • US11671654B2 patent drawing
  • US11671654B2 patent drawing
  • US11671654B2 patent drawing

AI summary

A video quality estimation device for estimating a quality experienced by a user in a tile-based video distribution service in which a video is divided into tiles and distributed includes a video quality parameter extraction unit that extracts a first parameter representing a quality of a first tile and a second parameter representing qualities of one or more second tiles, from a received tile-based video; and a video quality estimation unit that estimates a quality of the tile-based video by using the first parameter and the second parameter.