Hierarchical Video Data Structure for Responsive Zooming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in displaying high-definition moving images with good responsiveness, particularly when users request to zoom in or move the image area, as they require efficient processing of large image data in real-time, which is not adequately addressed by existing compression, transmission, and display technologies.
Innovation Solution
A moving image data generation and display system that generates hierarchical data by representing image frames at multiple resolutions, allowing layer switching based on user input, and includes a compressed data structure that uses difference images to reduce data size, enabling efficient display and compression of moving images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If hierarchical data structures with multiple resolutions are used to enable random access and responsive display, then responsiveness to user input is improved, but data size and processing complexity increase
Solution Approach 1:
The patent segments image data into multiple resolution layers (full-resolution layer and reduced-resolution layers), allowing the system to selectively access appropriate resolution levels based on user input. This segmentation enables responsive display by providing pre-processed data at various scales, reducing the need for real-time processing while maintaining data organization complexity through structured layer management.
Solution Approach 2:
The patent adds a resolution dimension to the traditional single-resolution data structure by creating hierarchical layers at different scales. This dimensional expansion allows the system to navigate through resolution levels in response to user input, improving responsiveness without requiring complex real-time transformations, as the additional resolution dimension provides direct access to scaled data.
2Quantity of substance
If difference images are used to reduce data size, then data compression is improved, but processing complexity for image restoration increases
Solution Approach 1:
The patent extracts only the essential difference information between full-resolution and reduced-resolution layers, storing merely the differential data rather than complete image sets. This extraction approach significantly reduces data size by eliminating redundant information, while the processing complexity remains manageable because the difference data can be efficiently applied to restored images using straightforward addition operations.
3Adaptability or versatility
If multiple resolution layers are generated for each image frame, then adaptability to different display requirements is improved, but data generation time and computational load increase
Solution Approach 1:
The patent performs preliminary action by pre-generating multiple resolution layers and storing them in advance before actual display needs arise. This advance preparation includes creating full-resolution images and their corresponding reduced-resolution versions, along with difference data. When user input occurs, the system can immediately retrieve appropriate pre-processed layers without requiring time-consuming real-time processing, thus improving responsiveness while distributing computational load over time.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An objective of the present invention is to make a video image frame into a hierarchical structure represented with a plurality of resolutions. With a zeroth layer (30), a first layer (32), a second layer (34), and a third layer (36) in order by increasing resolution, layer data which denotes a frame at a time (t1) treats the zeroth layer (30) and the second layer (34) as base image layers, and the first layer (32) and third layer (36) as difference image layers. In such a circumstance, when a region (124a) is displayed with the resolution of the third layer (36), an image of a corresponding region (126a) which the second layer (34) retains is enlarged to the resolution of the third layer (36) and each pixel value added to a difference image of a region (124a) which the third layer (36) retains. The layer which is treated as the difference image layer is switched with the passage of time (t2, t3, ...).