Free Viewpoint Video Streaming via MPEG-DASH Metadata

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional free viewpoint video technologies are limited in accessibility and only available to onsite users, lacking effective methods for streaming in network environments.

Innovation Solution

A meta information structure based on MPEG-DASH is developed to enable the streaming of free viewpoint videos by defining a free-viewpoint relation, allowing users to select suitable media segments according to network and terminal environments, and providing meta information for image translation based on user viewpoint changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If free viewpoint video services are provided only to onsite users, then the service quality is maintained, but the accessibility and service environment are extremely limited

Engineering Contradiction:

ImproveaccessibilityVSAvoidservice environment complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The video content is segmented into multiple viewpoints captured by different cameras, with metadata describing the spatial relationships between these viewpoints. This segmentation enables remote users to selectively access and combine specific viewpoint segments to reconstruct free viewpoint video experiences over network environments without requiring complex onsite infrastructure.

Inventive Principle:

Principle #1Segmentation

2Adaptability or versatility

If conventional FVV technology is used, then onsite viewing experience is provided, but network streaming capability is lacking

Engineering Contradiction:

Improvenetwork environment adaptabilityVSAvoidviewpoint relation information

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

Metadata acts as an intermediary that bridges the gap between multiple viewpoint images and the user's desired viewpoint. The metadata contains photographing position information and viewpoint relation data that enables network transmission and remote reconstruction of free viewpoint video, preserving viewpoint relationship information while enabling network streaming capability.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If multiple viewpoints are provided for remote users, then accessibility is improved, but data transmission requirements increase

Engineering Contradiction:

Improveremote access capabilityVSAvoiddata transmission volume

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

Metadata describing viewpoint relationships and photographing positions is prepared in advance before network transmission. This preliminary organization of information allows the system to efficiently select and transmit only the necessary viewpoint data required for reconstructing the user's desired viewpoint, reducing overall data transmission volume while maintaining remote access capability.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11290752B2Method and apparatus for providing free viewpoint video

Publication Date: 2022.03.29 KOREA ELECTRONICS TECH INST

AI summary

Provided is a method of providing a plurality of images on the basis of meta information about a free viewpoint relation. In this case, the plurality of images includes a reference image and a surrounding image. Accordingly, a user at a remote site may view one piece of content at various viewpoints and the accessibility and convenience of use may be improved.