Image Capture Metadata Timing for Real-Time Video Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image capturing systems face challenges in synchronizing metadata with video due to system limitations and lens communication characteristics, leading to delays and increased costs, especially when handling RAW video signals, which affects real-time video processing and increases manufacturing costs.
Innovation Solution
An image capturing apparatus that generates metadata for each video frame, including a delay amount to synchronize with the video output, allowing for metadata to be added without delaying the video, and enables selective metadata usage based on downstream processing needs, reducing memory requirements and video delays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video is delayed in the image capturing apparatus to synchronize metadata with video output, then synchronization between metadata and video is improved, but a large-capacity memory is required and manufacturing cost increases
Solution Approach 1:
Instead of delaying the video signal to synchronize with metadata, the patent inverts the approach by delaying the metadata generation timing. The video signal is output immediately without delay, while metadata is generated and output with a deliberate delay to achieve synchronization. This inversion eliminates the need for large-capacity memory buffers for video storage while maintaining synchronization reliability.
2Reliability
If video is delayed in the image capturing apparatus to synchronize metadata with video output, then synchronization between metadata and video is improved, but real-time property of the synthesized image deteriorates
Solution Approach 1:
The patent applies inversion by shifting the delay from the video path to the metadata path. Video frames are processed and output in real-time without artificial delays, preserving the real-time property of synthesized images. Metadata generation is deliberately delayed to match video output timing, achieving synchronization without compromising real-time performance.
3Reliability
If a large-capacity memory is mounted to store delayed video, then synchronization between metadata and video is improved, but device complexity increases
Solution Approach 1:
The patent inverts the conventional approach by not delaying video in a large-capacity memory buffer. Instead, video is output immediately and metadata is generated with delayed timing. This eliminates the need for large-capacity memory dedicated to video storage, significantly reducing device complexity while maintaining synchronization reliability.
4Loss of information
If metadata is generated and added to video frames, then information completeness is improved, but processing time increases
Solution Approach 1:
The patent applies preliminary action by generating metadata in advance during video capture, but outputting it with delayed timing to synchronize with video frames. This allows metadata to be prepared beforehand (ensuring information completeness) while controlling the output timing to minimize overall processing time and maintain real-time performance.
Data Source
AI summary
An image capturing apparatus performs generating metadata related to capturing by an image capture element for each video frame of the video, and outputting a video frame to which the generated metadata has been added, wherein the generated metadata includes information indicating a delay amount based on a difference between a video frame that the generated metadata corresponds to and a video frame that is outputted after the generated metadata is added thereto in the outputting.