Image Management Server Tile Image Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Network response delays lead to a decline in responsiveness when transmitting and receiving image data between the server and client devices in telepathology systems, as existing techniques do not effectively account for network delays in accessing cached image data, resulting in reduced user convenience.

Innovation Solution

An image management server that acquires microscopic images, creates meta information, and predicts which tile images are likely to be requested based on hint information from the image display apparatus, prioritizing and caching these images to improve response performance by pre-fetching and sequencing tile image delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If image data is transmitted over the network between server and client devices, then telepathology functionality is enabled, but network response delays cause a decline in responsiveness

Engineering Contradiction:
ImproveresponsivenessVSAvoidnetwork response delay
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The server performs preliminary actions by predicting which tile images the client will request next based on hint information (current display position, motion vectors, user operations). The server pre-fetches and caches these predicted images before they are actually requested, so when the client needs them, they are already available locally or in the cache, eliminating network wait time and improving responsiveness.

Inventive Principle:
Principle #10Preliminary action

2Speed

If cache is used to store image data, then access speed is improved, but network response delays are not accounted for in the caching strategy

Engineering Contradiction:
Improveimage access speedVSAvoidnetwork response delay
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system uses feedback from the client in the form of hint information (current display position, motion vectors indicating user operation direction, zoom level) to continuously adjust the caching strategy. The server analyzes this feedback to predict future image requests and dynamically updates the cache with predicted images, ensuring the cache contains exactly what the client needs next, thereby maximizing access speed while accounting for network delays.

Inventive Principle:
Principle #23Feedback

3Loss of energy

If multiple tile images are provided sequentially, then network bandwidth is conserved, but response performance declines due to repeated network round trips

Engineering Contradiction:
Improvenetwork bandwidth usageVSAvoidresponse performance
Core Design Contradiction:
Loss of energyVSProductivity

Solution Approach 1:

Instead of providing images sequentially one at a time, the server performs preliminary action by predicting multiple future images and caching them in advance. This allows the client to retrieve multiple images from the cache simultaneously without additional network round trips, improving response performance while still conserving bandwidth compared to transmitting all possible images.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8682046B2Image management server, image display apparatus, image provision method, image acquisition method, program, and image management system
Publication Date: 2014.03.25 SONY GROUP CORP
  • US8682046B2 patent drawing
  • US8682046B2 patent drawing
  • US8682046B2 patent drawing

AI summary

An image management server is provided including a microscopic image acquisition portion acquiring a microscopic image of a sample made of a plurality of tile images picked up by a microscope before placing the acquired microscopic image into a predetermined storage area. The image management server also includes a meta information creation portion creating meta information determining the microscopic image according to a result of data analysis acquired by the microscopic image acquisition portion; an image provision processing portion providing the meta information and the microscopic image to an image display apparatus in response to a request from the image display apparatus capable of viewing microscopic images. The image management server also includes a provided image prediction portion predicting the tile image highly likely to be requested by the image display apparatus based on hint information which is transmitted from the image display apparatus and which represents content of a microscopic image display process performed by the image display apparatus.