Image Encapsulation Metadata for Tile-Based Region Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image file formats, such as the ISO/IEC 23008-12 standard, lack sufficient descriptive metadata for efficiently accessing and extracting tiles from high-resolution still images and video data, particularly for applications involving computational photography, video summarization, and interactive video streaming on mobile devices, without requiring additional processing.

Innovation Solution

The method involves providing tile description information with spatial parameters for dividing images into tiles, associating tile picture items with reference information, and encapsulating this data in a standardized file format to enable easy identification, extraction, and access to regions of interest within still images and video sequences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If image data is stored with descriptive metadata in a media container, then access to image data and portions of image data is enabled, but the file format complexity increases

Engineering Contradiction:
Improveaccess to image dataVSAvoidfile format complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the image data into tiles, where each tile can be independently accessed and processed. The media container is divided into multiple boxes (e.g., 'mdat' for media data, 'moov' for metadata, 'stbl' for sample tables) that organize different aspects of the image data. This segmentation enables selective access to specific tiles without processing the entire image, improving ease of operation while maintaining manageable complexity through standardized box structures.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a nested box structure within the media container, where metadata boxes contain references to sample tables, which in turn reference individual tile data. This nested organization allows the system to manage complexity by hierarchical structuring - the outer boxes contain high-level descriptions while inner boxes contain detailed tile information, enabling efficient access without requiring parsing of the entire file structure.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Productivity

If tile description information is provided for high-resolution images, then extraction of regions of interest is enabled, but the amount of metadata increases

Engineering Contradiction:
Improveextraction efficiencyVSAvoidmetadata quantity
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent performs preliminary organization of image data into tiles during the encoding process, with tile boundaries and descriptions being established in advance. The sample table and metadata boxes are pre-configured with references to specific tile locations and descriptions. This preliminary action eliminates the need for post-processing analysis to identify regions of interest, as the tile structure is already in place, thereby improving extraction efficiency without requiring excessive metadata to be added later.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent designs the tile description structure to serve multiple functions: the same tile metadata structure supports various applications including region of interest extraction, computational photography operations, and video summarization. The sample table and box references are designed to be universally applicable across different use cases, reducing the need for application-specific metadata and minimizing overall metadata quantity while maintaining high productivity across diverse tasks.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If video data is split into tiles for interactive streaming, then quality is maintained for sub-parts, but the processing complexity increases

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments video data into temporal slices and spatial tiles, creating a two-dimensional division where each tile corresponds to a specific time frame and spatial region. This segmentation allows the system to maintain high quality for selected sub-parts by processing only relevant tiles rather than the entire video stream. The standardized box structure for organizing these segmented units simplifies the processing complexity by providing clear demarcation and reference points for each tile.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a dynamic tile selection mechanism where the system can adaptively choose which tiles to process and transmit based on user interaction and content importance. The sample table structure enables dynamic referencing of specific tiles without requiring reprocessing of the entire video. This dynamic approach maintains manufacturing precision for quality-critical regions while reducing overall processing complexity by focusing computational resources only on selected tiles rather than the complete video sequence.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250379964A1Image data encapsulation
Publication Date: 2025.12.11 CANON KK
  • US20250379964A1 patent drawing
  • US20250379964A1 patent drawing
  • US20250379964A1 patent drawing

AI summary

There is provided a method of encapsulating an encoded bitstream representing one or more images, the encapsulated bitstream comprising a data part and a metadata part. The method comprises: providing image item information identifying a portion of the data part representing a sub-image or an image of a single image and/or a set of single images; providing image description information comprising parameters including display parameters and/or transformation operators relating to one or more images and outputting said bitstream together with said provided information as an encapsulated data file. Said image item information comprises one or more properties including at least part of the image description information dedicated to the considered sub-image or single image or set of single images, said image description information being defined in one or more boxes.