Server Viewport Track Selection for 3D Image Transmission

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The transmission of 3D images for Virtual Reality (VR) and Augmented Reality (AR) is hindered by large data sizes, leading to increased data traffic and processing loads, necessitating efficient methods for constructing and selecting multiple tracks of 3D image data and configuring quality information to reduce traffic.

Innovation Solution

A method and device where a server receives viewport information from a terminal, selects appropriate tracks based on viewport and quality information, and transmits only the necessary data, allowing for region-wise packing and quality ranking of 2D image data to optimize data transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If data of all regions of the 3D image are transmitted with uniform high quality, then image quality is improved, but data traffic and transmission load increase significantly

Engineering Contradiction:
Improveimage qualityVSAvoiddata traffic
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by dividing the 3D image into multiple regions and assigning different quality levels to different regions based on their importance. The central region (corresponding to the user's viewport) is transmitted with high quality, while peripheral regions are transmitted with lower quality or omitted entirely. This resolves the contradiction by maintaining high image quality where needed while reducing overall data traffic.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the 3D image data into multiple tracks, where each track corresponds to a specific region of the image. This segmentation allows selective transmission of only necessary regions (e.g., viewport-related regions) rather than transmitting the entire image, thereby reducing data traffic while maintaining quality in critical areas.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If data of the entire 3D image is transmitted, then complete image information is provided, but transmission time and processing load increase

Engineering Contradiction:
Improveimage information completenessVSAvoidtransmission time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts and transmits only the necessary portions of the 3D image data corresponding to the user's viewport and relevant regions, rather than transmitting the entire image. This extraction approach maintains the essential image information needed for the user experience while significantly reducing transmission time and processing load.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements dynamic track selection where the server determines which tracks to transmit based on real-time viewport information from the terminal. This dynamic approach ensures that only currently relevant image data is transmitted, optimizing both information completeness and transmission efficiency as the user's view changes.

Inventive Principle:
Principle #15Dynamics

3Productivity

If multiple tracks with different qualities are constructed, then data transmission efficiency is improved, but system complexity increases

Engineering Contradiction:
Improvedata transmission efficiencyVSAvoidtrack construction complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent changes the quality parameter of different image regions by constructing multiple tracks with different quality levels. Each track represents a region with a specific quality setting, allowing the system to select appropriate tracks based on viewport information. This parameter-based approach improves transmission efficiency while managing complexity through systematic quality variation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent performs preliminary construction of multiple quality tracks before transmission, organizing the 3D image data into predefined tracks with different quality levels. This preliminary organization simplifies the transmission process by having all quality variations prepared in advance, reducing runtime complexity while maintaining high transmission efficiency.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10791316B2Method for transmitting data about three-dimensional image
Publication Date: 2020.09.29 SAMSUNG ELECTRONICS CO LTD
  • US10791316B2 patent drawing
  • US10791316B2 patent drawing
  • US10791316B2 patent drawing

AI summary

Provided is a method for transmitting data about an omnidirectional image by a server. The method comprises the steps of: receiving, from a terminal, information about a viewport of the terminal; selecting, on the basis of information about the viewport and the respective qualities of a plurality of tracks associated with the omnidirectional image, at least one track among the plurality of tracks; and transmitting data about the selected at least one track to the terminal.