360-Degree Image Display Apparatus Viewpoint Change Buffering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Viewers experience disruptions such as buffering or lowered resolution when changing viewpoints while watching 360-degree images due to unexpected changes in data reception states in existing display apparatuses.

Innovation Solution

A display apparatus and control method that process and display 360-degree images by segmenting and prioritizing data reception based on display quality, providing users with information about adjacent segment reception speeds, amounts, and resolutions to facilitate smooth viewpoint changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the display apparatus receives all segments of the 360 degree image at once, then the complete image data is available, but the data transmission time and network bandwidth requirements increase significantly

Engineering Contradiction:
Improveimage data completenessVSAvoiddata transmission time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The 360 degree image data is divided into multiple segments that can be received and processed independently. The display apparatus receives only the segments corresponding to the current viewpoint and adjacent viewpoints, rather than all segments simultaneously, reducing transmission time while maintaining image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The display apparatus predicts which segments will be needed based on the current viewpoint and user interaction patterns, and prioritizes receiving those segments in advance. This preliminary action ensures that data is ready before it is actually needed for display, reducing perceived loading time.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If the display apparatus uses adaptive streaming to change resolution based on network environment, then the image can be displayed under various network conditions, but the resolution may be lowered when network bandwidth is limited

Engineering Contradiction:
Improvenetwork environment adaptationVSAvoidimage resolution
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

Different segments of the 360 degree image are transmitted with different resolutions based on their importance. Segments corresponding to the current viewpoint and adjacent viewpoints are transmitted in high resolution, while segments for distant viewpoints are transmitted in lower resolution, optimizing overall image quality within network constraints.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The display apparatus dynamically adjusts the resolution parameter for different image segments based on network bandwidth availability. When bandwidth is sufficient, higher resolutions are used; when bandwidth is limited, resolutions are adaptively reduced, maintaining smooth playback while preserving quality where most needed.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If the viewer changes viewpoint quickly while watching the 360 degree image, then the user can explore the content dynamically, but buffering may occur due to unexpected data reception states

Engineering Contradiction:
Improveviewpoint change responsivenessVSAvoidviewing smoothness
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The display apparatus pre-loads segments corresponding to adjacent viewpoints and predicts future viewpoint changes based on user interaction patterns. By having this data ready in advance, the system can handle quick viewpoint changes without buffering, maintaining both responsiveness and viewing smoothness.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system monitors user interaction patterns and viewpoint change rates, using this feedback to dynamically adjust which segments are prioritized for reception. When rapid viewpoint changes are detected, the system increases priority for segments that will be needed soon, preventing buffering while maintaining smooth operation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3507646B1Display apparatus and control method thereof
Publication Date: 2021.04.28 SAMSUNG ELECTRONICS CO LTD
  • EP3507646B1 patent drawingFigure 1
  • EP3507646B1 patent drawingFigure 2~3
  • EP3507646B1 patent drawingFigure 4

AI summary

A display apparatus and a control method thereof are provided. The display apparatus includes a receiver, an image processor, a display and a controller. The receiver receives an image of content in the form image segments. The image processor processes the image of content received via the receiver. The display displays the processed image of content. The controller controls the image processor to display an image corresponding to one viewpoint of the image of content, and display information about a display quality of at least one image segment based on reception states of the image segments. With this, the display apparatus may provide the information about display quality for the at least one segment of the image of content, thereby allowing a user to watch the image of content while smoothly moving a viewpoint.