Video Display Control Information for Multi-Directional Video Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video display systems often fail to implement the intended display scheme chosen by content creators, leading to users not experiencing the video as intended, due to mismatched display settings between the content maker's intention and the selected display scheme.

Innovation Solution

An information processing device and method that selects and executes an optimum display scheme for multi-directional videos like omnidirectional or panorama videos by acquiring and applying video display control information, which defines the appropriate display scheme based on the device type, allowing users to manipulate the display process through user interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If applications execute predetermined display schemes selected by users, then users can freely change viewpoints and observe videos in different directions, but the display scheme may not match the content maker's intention, causing users to view videos differently than intended

Engineering Contradiction:
Improveuser freedom to select display schemeVSAvoidcontent maker's intended display scheme
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The content maker pre-defines the intended display scheme when creating the video content. This predetermined display scheme is stored alongside the video data, allowing the reproduction device to automatically apply the correct display scheme without requiring user selection, thereby preserving the content maker's original intent while still allowing user interaction within the defined parameters.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If multiple display schemes are provided for different device types, then videos can be displayed optimally on each device type, but the system complexity increases due to managing device-type-specific configurations

Engineering Contradiction:
Improvedisplay scheme compatibility across device typesVSAvoidmanagement of device-type-specific display schemes
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system provides different display schemes tailored to specific device types (PC, portable terminal, HMD, etc.). Each device type has its own optimized display scheme stored in the video data structure. The reproduction device automatically identifies its type and applies the corresponding display scheme, achieving device-specific optimization without requiring complex manual configuration management.

Inventive Principle:
Principle #3Local quality

3Reliability

If video display control information is embedded in video data, then the intended display scheme is preserved and automatically applied, but the data structure becomes more complex requiring additional processing

Engineering Contradiction:
Improvepreservation of content maker's display schemeVSAvoidvideo data structure and processing
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The display scheme information is merged with the video data structure, specifically embedded within the metadata section of the video file. This integration allows the reproduction device to automatically extract and apply the display scheme during video playback without requiring separate configuration files or complex external processing, thereby maintaining reliability while managing complexity through unified data structure handling.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3316247B1Information processing device, information processing method, and program
Publication Date: 2022.03.30 SONY GROUP CORP
  • EP3316247B1 patent drawingFigure 1
  • EP3316247B1 patent drawingFigure 2
  • EP3316247B1 patent drawingFigure 3(a)~3(b)

AI summary

In an information processing device including a display unit that is able to selectively display a multi-directional video and a data processing unit that executes video display control, the data processing unit applies a device-correspondent video display scheme recorded in video display control information and executes the video display process. The video display control information defines a type-based display scheme optimum for each type of information processing device executing a video display process. The data processing unit applies the display scheme associated with a type matching the type of the own device and executes the video display process.