Gigapixel Image Rendering via Tile Segmentation and Dynamic Scheduling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image rendering technologies struggle to render gigabit pixel images in real-time on standard devices due to high memory and video memory requirements, leading to high costs and network demands.

Innovation Solution

A method involving offline data reorganization, data decoding, and dynamic scheduling strategies to optimize memory usage, including image slicing, file structure optimization, and queue management, reduces memory requirements and enables real-time rendering of gigabit pixel images on conventional devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If gigabit pixel images are rendered using conventional image rendering technologies, then image quality and resolution are improved, but memory and video memory requirements increase to over 40G

Engineering Contradiction:
Improveimage resolutionVSAvoidmemory requirement
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent divides the gigabit pixel image into multiple tiles or segments that can be processed and stored separately. This segmentation allows the system to handle large images by breaking them into manageable chunks, reducing the peak memory requirement from over 40G to 1G-4G while maintaining the ability to render high-resolution images through progressive loading and processing of tile segments

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-processing and organizing image data into optimized formats before rendering. This includes pre-computing tile boundaries, pre-organizing data structures for efficient access patterns, and pre-loading necessary image segments into memory, which reduces the memory burden during actual real-time rendering operations

Inventive Principle:
Principle #10Preliminary action

2Productivity

If gigabit pixel images are rendered in real-time on conventional devices, then rendering speed and responsiveness are improved, but memory configuration requirements become unfeasible

Engineering Contradiction:
Improverendering speedVSAvoidvideo memory configuration
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent implements dynamic memory management where video memory allocation and data loading are adapted in real-time based on the current rendering state, viewport position, and priority of different image regions. This dynamic approach allows the system to maintain real-time rendering performance on conventional devices with 1G-4G video memory by flexibly allocating resources to the most critical rendering tasks while streaming less critical data as needed

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent transitions from a traditional single-dimension memory allocation approach to a multi-dimensional strategy that considers spatial distribution of image tiles, temporal priority of rendering tasks, and memory hierarchy levels. This dimensional expansion allows efficient utilization of limited video memory by organizing data access patterns across multiple dimensions of the memory system

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If custom hardware solutions are used for gigabit pixel rendering, then rendering capability is improved, but cost and network requirements increase

Engineering Contradiction:
Improverendering capabilityVSAvoidhardware configuration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent creates optimized data representations and intermediate formats that can be efficiently copied and transferred between storage and memory systems. By establishing standardized data structures and transfer protocols for tile-based image data, the system achieves high rendering capability through software optimization rather than specialized hardware, reducing both cost and complexity while maintaining reliability

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent changes key parameters of the rendering system by transitioning from full-image processing to tile-based processing, from uniform memory allocation to hierarchical memory usage, and from synchronous rendering to progressive rendering. These parameter changes enable conventional hardware to achieve gigabit pixel rendering capability without requiring custom hardware solutions

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11164358B2Method for real-time rendering of giga-pixel images
Publication Date: 2021.11.02 PLEX VR DIGITAL TECH CO LTD
  • US11164358B2 patent drawing

AI summary

The present invention discloses a method for real-time rendering of giga-pixel images. Image data are subject to offline pre-processing, and then are subject to data decoding and redirection through a decoding module. A corresponding scheduling strategy is determined according to different image inputs, and rendering is executed by a renderer. The present invention may realize the real-time rendering of a giga-pixel panoramic view in a conventional display device, to greatly reduce the resource allocated for rendering of giga-pixel images. The present invention may render an image originally requiring a 40G or more video memory capacity on a common video card with a 1G-4G video memory capacity.