ISOBMFF Region of Interest Metadata Signaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding methods fail to effectively associate and signal region of interest (ROI) visual tracks within the ISO base media file format (ISOBMFF), limiting the ability to efficiently process and deliver visual data for specific regions of interest in multimedia content.
Innovation Solution
The proposed solution involves an apparatus and method that uses interface and processing circuitry to receive and parse metadata associating ROIs with visual tracks, generating images for selected ROIs by requesting and receiving visual data from corresponding tracks, and encapsulating this information in ISOBMFF files, allowing for efficient signaling and delivery of ROI-related visual content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If metadata associating ROI visual tracks is not signaled in ISOBMFF, then the file format remains simple and compatible, but the ability to efficiently process and deliver visual data for specific regions of interest is lost
Solution Approach 1:
The patent embeds ROI metadata structures within the existing ISOBMFF container format, nesting region visual track associations inside standard track boxes and metadata schemas. This allows the file format to maintain structural simplicity while incorporating sophisticated ROI processing capabilities through layered metadata encapsulation.
Solution Approach 2:
The patent segments visual content into multiple independent visual tracks, each representing a specific region of interest, and associates them with a main visual track through metadata. This segmentation enables selective processing and delivery of individual ROI regions without requiring complex modifications to the overall file structure.
2Measurement precision
If all visual tracks are processed to generate ROI images, then complete visual coverage is achieved, but processing time and computational resources increase
Solution Approach 1:
The patent extracts only the specific visual track data corresponding to the selected region of interest from the multi-track visual content, rather than processing all visual tracks. The metadata enables direct identification and extraction of relevant ROI regions, significantly reducing processing time while maintaining accurate visual representation of the selected region.
Solution Approach 2:
The patent implements partial processing by selectively generating images only for the currently selected ROI region rather than processing all possible visual tracks. This partial action approach processes only the necessary subset of visual data required for the current viewing context, minimizing computational overhead.
3Area of stationary object
If multiple visual tracks are associated with a single ROI, then comprehensive region coverage is achieved, but the association signaling becomes more complex
Solution Approach 1:
The patent merges multiple visual track associations with a single ROI through a unified metadata structure that lists multiple contributing visual track identifiers. This combining approach allows comprehensive region coverage by aggregating data from multiple tracks while maintaining a single, manageable association record in the metadata.
Solution Approach 2:
The patent creates a universal metadata association structure that can handle any number of visual track-to-ROI mappings through standardized syntax. This multi-functional metadata design enables the same structural pattern to accommodate simple one-to-one associations as well as complex many-to-one associations without requiring different signaling mechanisms.
4Productivity
If ROI metadata is embedded in ISOBMFF files, then efficient ROI delivery is enabled, but file size and parsing complexity increase
Solution Approach 1:
The patent implements local quality optimization by embedding metadata only where ROI associations are actually needed within the ISOBMFF file structure. Rather than adding comprehensive metadata to all files, the solution selectively incorporates ROI signaling elements only in files containing region visual tracks, minimizing unnecessary data overhead.
Data Source
AI summary
Aspects of the disclosure provide an apparatus that includes interface circuitry and processing circuitry. The interface circuitry is configured to receive signals carrying metadata that associates a region of interest in a first visual view provided by a first visual track with the first visual track and a second visual track that provides a second visual view that is a part of the first visual view. The processing circuitry is configured to parse the metadata, determine, when the region of interest is selected, the second visual track to provide visual data, and generate images for the region of interest based on the visual data from the second visual track.