Hierarchical Image Structure with Prefetch for Fast Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-definition and complex image display requires efficient data preparation and processing, especially when images need to be altered by user operation or according to predetermined settings, posing challenges in rendering complex movements quickly and efficiently.

Innovation Solution

The implementation of a hierarchical image structure with tile images of varying resolutions, where images are divided into multiple levels, allowing for efficient switching between levels during display, and the use of prefetch processing to load and decode data ahead of time, enabling seamless enlargement, reduction, and shifting of images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-definition and complex images are displayed, then image quality is improved, but data preparation time and complexity increase

Engineering Contradiction:
Improveimage definitionVSAvoiddata preparation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides images into multiple hierarchical levels with different resolutions (level 0, level 1, level 2, level 3), where each level contains tile images that are segments of the complete image at that resolution. This segmentation allows the system to prepare and store image data in an organized manner, enabling efficient retrieval and display without requiring complete preparation of all high-definition data at once.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements prefetch processing that loads and decodes image data from hierarchical levels in advance before they are actually needed for display. The system predicts which image data will be required based on current display conditions and retrieves it beforehand, reducing the time needed when high-definition images need to be displayed suddenly.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If images are frequently enlarged, reduced, or shifted according to user operation, then adaptability is improved, but processing speed decreases

Engineering Contradiction:
Improveimage transformation capabilityVSAvoidrendering speed
Core Design Contradiction:
Adaptability or versatilityVSSpeed

Solution Approach 1:

The patent creates a dynamic image display system where the hierarchical image structure allows flexible switching between different resolution levels and tile images based on real-time user operations. The system can dynamically adjust which image level and which tile are displayed without requiring complete reprocessing, maintaining speed while enabling frequent transformations.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

By prefetching and pre-decoding image data from multiple hierarchical levels in advance, the system prepares image data before it is needed for user operations. This preliminary action ensures that when users perform enlargement, reduction, or shifting operations, the required image data is already ready for immediate display, maintaining high processing speed despite frequent transformations.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If multiple hierarchical levels of image data are prepared, then image processing efficiency is improved, but device complexity increases

Engineering Contradiction:
Improveimage processing efficiencyVSAvoiddata structure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments image data into a hierarchical structure with four levels (level 0, level 1, level 2, level 3), where each level contains tile images that are further divided into smaller tiles. This segmentation organizes the complexity into a manageable pattern, allowing the system to process images efficiently by working with appropriate resolution levels without overwhelming the device with complete high-definition data at all times.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a hierarchical dimension to image storage and processing, organizing images not just by their pixel data but by their resolution level and tile composition. This dimensional organization allows the system to navigate and access image data more efficiently, managing complexity through structured layers rather than flat data structures.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP2463762B1Information processing device, information processing method, and data structure for content files
Publication Date: 2021.07.21 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP2463762B1 patent drawingFigure 1
  • EP2463762B1 patent drawingFigure 2
  • EP2463762B1 patent drawingFigure 3~4

AI summary

As a user inputs instruction to start up content to an information processing apparatus (10), an initial image is displayed (S10, S12). A viewpoint shift request is made (Y of S14), viewpoint coordinates are calculated according to the viewpoint shift request (S16). Then verified is whether a hierarchical level has been changed in hierarchical image data due to a shift of the viewpoint coordinates or not (S18). If the hierarchical level has been changed, the node of a hierarchical image is extracted from image correspondence data and then a coordinate transform matrix associated with the node is read out and modified (S20). A new elemental image is decoded (S22), each image is subjected to the coordinate transform based on the image correspondence data so as to evaluate the coordinates on display coordinates (S24). Each elemental image is placed on the evaluated coordinates, which in turn integrates the elemental images and updates a displayed imaged (S26, S28). As an instruction to terminate the content is inputted, the processing is terminated (Y of S30).