Image Encapsulation Metadata for Tile-Based Region Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image file formats, such as the ISO/IEC 23008-12 standard, lack sufficient descriptive metadata for efficiently accessing and extracting tiles from high-resolution still images and video data, particularly for applications involving computational photography, video summarization, and interactive video streaming on mobile devices, without requiring additional processing.
Innovation Solution
The method involves providing tile description information with spatial parameters for dividing images into tiles, associating tile picture items with reference information, and encapsulating this data in a standardized file format to enable easy identification, extraction, and access to regions of interest within still images and video sequences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If image data is stored with descriptive metadata in a media container, then access to image data and portions of image data is enabled, but the file format complexity increases
Solution Approach 1:
The patent segments the image data into tiles, where each tile can be independently accessed and processed. The media container is divided into multiple boxes (e.g., 'mdat' for media data, 'moov' for metadata, 'stbl' for sample tables) that organize different aspects of the image data. This segmentation enables selective access to specific tiles without processing the entire image, improving ease of operation while maintaining manageable complexity through standardized box structures.
Solution Approach 2:
The patent implements a nested box structure within the media container, where metadata boxes contain references to sample tables, which in turn reference individual tile data. This nested organization allows the system to manage complexity by hierarchical structuring - the outer boxes contain high-level descriptions while inner boxes contain detailed tile information, enabling efficient access without requiring parsing of the entire file structure.
2Productivity
If tile description information is provided for high-resolution images, then extraction of regions of interest is enabled, but the amount of metadata increases
Solution Approach 1:
The patent performs preliminary organization of image data into tiles during the encoding process, with tile boundaries and descriptions being established in advance. The sample table and metadata boxes are pre-configured with references to specific tile locations and descriptions. This preliminary action eliminates the need for post-processing analysis to identify regions of interest, as the tile structure is already in place, thereby improving extraction efficiency without requiring excessive metadata to be added later.
Solution Approach 2:
The patent designs the tile description structure to serve multiple functions: the same tile metadata structure supports various applications including region of interest extraction, computational photography operations, and video summarization. The sample table and box references are designed to be universally applicable across different use cases, reducing the need for application-specific metadata and minimizing overall metadata quantity while maintaining high productivity across diverse tasks.
3Manufacturing precision
If video data is split into tiles for interactive streaming, then quality is maintained for sub-parts, but the processing complexity increases
Solution Approach 1:
The patent segments video data into temporal slices and spatial tiles, creating a two-dimensional division where each tile corresponds to a specific time frame and spatial region. This segmentation allows the system to maintain high quality for selected sub-parts by processing only relevant tiles rather than the entire video stream. The standardized box structure for organizing these segmented units simplifies the processing complexity by providing clear demarcation and reference points for each tile.
Solution Approach 2:
The patent implements a dynamic tile selection mechanism where the system can adaptively choose which tiles to process and transmit based on user interaction and content importance. The sample table structure enables dynamic referencing of specific tiles without requiring reprocessing of the entire video. This dynamic approach maintains manufacturing precision for quality-critical regions while reducing overall processing complexity by focusing computational resources only on selected tiles rather than the complete video sequence.
Data Source
AI summary
There is provided a method of encapsulating an encoded bitstream representing one or more images, the encapsulated bitstream comprising a data part and a metadata part. The method comprises: providing image item information identifying a portion of the data part representing a sub-image or an image of a single image and/or a set of single images; providing image description information comprising parameters including display parameters and/or transformation operators relating to one or more images and outputting said bitstream together with said provided information as an encapsulated data file. Said image item information comprises one or more properties including at least part of the image description information dedicated to the considered sub-image or single image or set of single images, said image description information being defined in one or more boxes.


