Panorama Image Encapsulation in HEIF Files

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The HEIF and MIAF file formats do not efficiently store panorama images, human-readable textual descriptions, or timing information for images or groups of images, including panoramas.

Innovation Solution

A method and device for encapsulating panorama images by encoding reference images, generating image items to describe the panorama, creating association information, and embedding these items and parameters within a file, allowing for efficient storage and retrieval of panorama data, including human-readable descriptions and timing information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If HEIF and MIAF file formats are used to store panorama images, then image compression and storage efficiency are improved, but the ability to efficiently store panorama-specific metadata (human-readable descriptions, timing information) deteriorates

Engineering Contradiction:
Improvestorage efficiencyVSAvoidmetadata storage capability
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

The patent segments the file structure into distinct components: image data items and separate metadata items. Each panorama image is represented as an individual item, and metadata (descriptions, timing information) are stored as separate associated items. This segmentation allows efficient storage of image data while providing dedicated spaces for various types of metadata, resolving the contradiction between storage efficiency and metadata versatility.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism (item references and association structures) that links image items with their corresponding metadata items. This intermediary layer enables the file format to efficiently store compressed image data while simultaneously supporting rich metadata without requiring the image container itself to be overly complex, thus maintaining both storage efficiency and metadata adaptability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If multiple images are captured in panorama mode with bracketing, then image quality and dynamic range are improved, but file size and data complexity increase

Engineering Contradiction:
Improveimage qualityVSAvoidfile size
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent merges multiple panorama images (captured in bracketing mode) into a single derived image item that represents the complete panorama. Instead of storing multiple separate full-resolution images, the system combines them into one consolidated image structure, significantly reducing file size while preserving the quality benefits of bracketing through the merged result.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent performs preliminary processing of multiple captured images by generating a derived panorama image before final storage. This preliminary action (combining and processing images during capture) reduces the amount of data that needs to be stored, as the derived image consolidates the information from multiple bracketed shots into a single optimized representation.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If detailed metadata including human-readable descriptions and timing information is stored, then information completeness and usability are improved, but data structure complexity increases

Engineering Contradiction:
Improveinformation completenessVSAvoiddata structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent implements a universal item structure that can accommodate multiple types of metadata (human-readable descriptions, timing information, technical parameters) within a single standardized framework. This multi-functional item design allows the same basic structure to hold diverse information types, improving information completeness without proportionally increasing structural complexity, as the framework handles different metadata types uniformly.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11853351B2Method and apparatus for encapsulating panorama images in a file
Publication Date: 2023.12.26 CANON KK
  • US11853351B2 patent drawing
  • US11853351B2 patent drawing
  • US11853351B2 patent drawing

AI summary

A method of encapsulation media data in a file, wherein the method comprises: encoding a set of reference images; generating a set of image items to describe the set of reference images; generating an image item describing a derived image corresponding to a panorama based on the set of reference images; generating an association information that associates the image item describing the derived image with the set of image items; generating a parameter data structure containing parameters of the panorama, the parameter data structure being associated with the image item describing the derived image; and embedding the set of image items, the image item describing the derived image, and the association information in the file.