Video Imaging Metadata Prioritization for Low-Latency Frame Output
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video imaging systems experience delays in metadata output, which can influence development processing, particularly when the data size exceeds the transmissible limit in one frame.
Innovation Solution
A video imaging apparatus and method that generates metadata indicating imaging conditions in association with frame data, adding it to the frame data before demosaicing, and prioritizes metadata output based on importance for development processing, using a processor to manage metadata addition and output.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If all metadata associated with frame data is added and transmitted, then complete development processing information is provided, but transmission data volume exceeds the addable data amount limit
Solution Approach 1:
The patent segments metadata into multiple groups based on priority levels, where essential metadata for development processing is transmitted first in the current frame, and non-essential metadata is transmitted in subsequent frames. This segmentation resolves the contradiction by dividing the complete metadata set into manageable portions that fit within the addable data amount limit while ensuring critical information is delivered.
Solution Approach 2:
The patent extracts and identifies essential metadata items that are necessary for development processing, separating them from non-essential metadata. By taking out only the critical metadata components and transmitting them with the current frame data, the system maintains information completeness for essential processing while staying within the data amount constraint.
2Quantity of substance
If metadata is transmitted in subsequent frames due to data amount limits, then transmission capacity is maintained, but delay in metadata output occurs affecting development processing
Solution Approach 1:
The patent performs preliminary classification and prioritization of metadata before transmission, identifying which metadata items are essential for development processing. By preparing and marking essential metadata in advance with high priority flags, the system ensures these critical items are transmitted immediately in the current frame, preventing delays in development processing while maintaining overall data amount constraints.
3Loss of time
If metadata is prioritized and selected based on importance, then development processing can proceed without delay, but some metadata may be omitted from current frame transmission
Solution Approach 1:
The patent implements a dynamic metadata transmission strategy where the composition of transmitted metadata changes based on frame-by-frame priorities. Essential metadata is dynamically selected and transmitted in the current frame, while non-essential metadata is dynamically deferred to subsequent frames. This dynamic approach resolves the contradiction by adapting the transmitted metadata set to meet both the urgency of processing and the requirement for eventual completeness.
Data Source
AI summary
An imaging unit generates image data of a video as a plurality of frame data that are continuous in a temporal order. An imaging control unit generates metadata indicating an imaging condition of the imaging unit in association with the frame data in a case in which the imaging condition is changed. An output control unit and an external output I/F add the metadata to the frame data and output the frame data to which the metadata is added as video data before demosaicing. In addition, in a case in which a data amount of the metadata associated with the frame data exceeds an addable data amount, the output control unit and the external output I/F add metadata selected based on a priority from among the metadata associated with the frame data to the frame data.