Hierarchical Image Display System with Local-Remote Data Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems face challenges in efficiently displaying various images, particularly high-definition images, with sufficient responsiveness and quality, especially when the display area needs to be scaled or moved based on user input, due to limitations in storage and network resources.

Innovation Solution

An image display system comprising a client terminal and a server that collaboratively manage image data storage and transmission, using area parameters to determine the position and size of the display area, and sequentially transmitting movement information to switch between image data stored locally and remotely, ensuring seamless display and responsiveness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If image data is stored locally in the client terminal, then display responsiveness is improved, but storage capacity is exceeded

Engineering Contradiction:
Improvedisplay responsivenessVSAvoidstorage capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent divides the storage system into two segments: local storage (first storage) for frequently accessed or critical image data, and remote storage (second storage on server) for the complete image dataset. The client terminal stores only a portion of image data locally, while the server stores the remaining image data remotely. This segmentation allows the system to maintain fast local access for stored images while avoiding local storage capacity constraints.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an image generation unit that acts as an intermediary between the local/remote storage systems and the display device. This unit synthesizes the displayed image by combining locally stored image data with remotely stored image data according to display area movement information. The intermediary processes coordinate transformations and composes the final image, enabling seamless access to both local and remote storage resources without requiring all data to be present locally.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Quantity of substance

If all image data is transmitted from the server, then storage capacity is reduced, but network bandwidth is consumed

Engineering Contradiction:
Improvelocal storage usageVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Quantity of substanceVSLoss of energy

Solution Approach 1:

The patent extracts only the necessary portions of image data from remote storage and transmits them to the client terminal. Instead of transmitting complete high-definition images, the system extracts and transmits only the image data corresponding to the current display area, which is a fraction of the total image data. This extraction approach significantly reduces network bandwidth consumption while maintaining the ability to display high-definition images.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements partial action by transmitting only the portion of image data that is currently needed for display rather than transmitting complete images. The image generation unit receives partial image data from both local and remote storage, combines them according to display area coordinates, and generates the complete displayed image. This partial transmission approach minimizes network bandwidth usage while achieving the display objective.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If high-definition image data is processed, then image quality is improved, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-storing frequently accessed or critical image data in the client terminal's local storage before it is needed for display. The system anticipates that certain image portions will be displayed and prepares them in advance by storing them locally. This preliminary local storage of image data eliminates the need for real-time retrieval and processing of high-definition data from remote storage during display operations, thereby maintaining high image quality while reducing processing time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2731077B1Image display system, information processing device, server, and image processing method
Publication Date: 2018.11.28 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP2731077B1 patent drawingFigure 1
  • EP2731077B1 patent drawingFigure 2
  • EP2731077B1 patent drawingFigure 3

AI summary

Links are set among three hierarchical data 170, 172, and 174 and one moving image data 182. When a display area overlaps with a link area 176 while an image is being displayed by using the hierarchical data 170, switching to display by use of the 0-th hierarchical level of the hierarchical data 172 is made (link a). When the display area overlaps with a link area 178 while an image is being displayed by using the hierarchical data 172, switching to display by use of the 0-th hierarchical level of the hierarchical data 174 is made (link b). The link destination of another link area 180 of the hierarchical data 170 is the moving image data 182 (link c) and moving image reproduction is started as a result of zoom-up of this area. The hierarchical data 170 and 172 are held on the client terminal side and the data existing on the other side of a switching boundary 184 are transmitted by a server to the client terminal in a data stream format.