360 Degree VR Broadcasting Server Stream Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

There is a lack of methods for providing a 360 degree virtual reality broadcasting service that offers spatial, temporal, and 3D scalabilities through a hybrid network while maintaining existing ultra high definition (UHD) broadcasting services.

Innovation Solution

The method involves transmitting a 360 degree full image stream and a view of interest (Vol) region stream through a hybrid network, using a 3D VR camera to acquire source inputs, and segmenting the streams for spatial, temporal, and 3D scalability, with the broadcasting server selecting appropriate source inputs based on user selection and movement information to optimize resolution and frame rate.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a 360 degree VR broadcasting service is provided through a hybrid network, then spatial, temporal, and 3D scalabilities are achieved, but device complexity and service provision difficulty increase

Engineering Contradiction:
Improvespatial, temporal, and 3D scalabilitiesVSAvoidservice provision complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the 360 degree full image stream into multiple view regions (VOI - View of Interest, VOS - View of Surroundings) and transmits them separately through different networks. The broadcast network carries the full resolution stream while the Internet network carries selected region streams, enabling scalable service delivery without requiring complete system redesign.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The transmitting apparatus is designed to provide multiple broadcasting services (UHD, 360 degree VR, 3D VR) through a single hybrid network infrastructure. The system can selectively transmit different stream types based on user selection mode and movement information, making the infrastructure universally applicable to various service requirements.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If full resolution 360 degree image streams are transmitted, then image quality is improved, but data transmission volume and network bandwidth requirements increase

Engineering Contradiction:
Improveimage qualityVSAvoiddata transmission volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts specific regions of interest from the full 360 degree image stream and transmits them separately. Instead of transmitting the entire high-resolution stream to all devices, only the relevant VOI and VOS regions are extracted and transmitted through the Internet network based on user selection mode, significantly reducing data volume while maintaining quality where needed.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Different regions of the image stream are transmitted at different qualities and resolutions. The VOI region receives full resolution transmission while surrounding regions may be transmitted at lower resolutions, optimizing bandwidth usage by applying quality differentiation based on spatial location and user interest.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If high resolution image streams are transmitted through both broadcast and Internet networks, then service quality is improved, but network bandwidth consumption and transmission time increase

Engineering Contradiction:
Improveservice qualityVSAvoidtransmission time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary segmentation of the image stream into base layer (full stream) and enhancement layer (selected regions) before transmission. The broadcast network delivers the base layer in advance, while the Internet network supplements with enhancement layers, allowing receivers to progressively improve quality without waiting for complete high-resolution data.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges two network infrastructures (broadcast network and Internet network) to deliver different components of the same service. The broadcast network provides reliable baseline delivery while the Internet network provides flexible supplementation, combining their advantages to reduce overall transmission time and improve service quality simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

4Adaptability or versatility

If existing UHD broadcasting service is maintained while adding 360 degree VR service, then service compatibility is improved, but system complexity and service provision difficulty increase

Engineering Contradiction:
Improveservice compatibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The transmitting apparatus dynamically selects which streams to transmit based on user selection mode and movement information. The system can switch between providing only UHD service, only 360 degree VR service, or both simultaneously, adapting its operation mode to current requirements without requiring separate fixed infrastructure for each service type.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10931980B2Method and apparatus for providing 360 degree virtual reality broadcasting service
Publication Date: 2021.02.23 ELECTRONICS & TELECOMM RES INST
  • US10931980B2 patent drawing
  • US10931980B2 patent drawing
  • US10931980B2 patent drawing

AI summary

An apparatus for providing a 360 degree virtual reality broadcasting service uses an image acquired through a 3D virtual reality (VR) camera to transmit a 360 degree full image stream having first resolution and transmits an image stream of a view of interest (Vol) region having second resolution different from the first resolution according to a user selection mode and move information if the user selection mode and the movement information are received from a receiving apparatus.