Frame-Level Fingerprint Matching for Real-Time Media Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing media content identification systems that enforce temporal consistency in fingerprint matching are computationally complex and require significant memory, making them unsuitable for real-time applications, especially on devices like mobile phones.
Innovation Solution
The system performs frame-level fingerprint matching and uses a trellis configuration with a Viterbi sequence detector to identify media content by matching query video frames against reference frames, reducing computational complexity and memory requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If temporal consistency is enforced through temporal fusion on fingerprint matching results, then identification accuracy is improved, but computational complexity and memory requirements significantly increase
Solution Approach 1:
The patent segments the temporal consistency enforcement into frame-level independent fingerprint matching followed by a separate sequence detection stage using Viterbi algorithm. This divides the complex temporal fusion problem into manageable segments: individual frame matching and then sequence optimization, reducing overall computational complexity while maintaining accuracy.
Solution Approach 2:
The patent performs preliminary frame-level fingerprint matching for all query frames against the reference database before applying temporal constraints. By pre-computing individual frame matches and storing them in a trellis structure, the system prepares data in advance for the Viterbi sequence detection, avoiding redundant computations during the temporal fusion stage.
2Measurement precision
If temporal fusion is performed on batch of video frames to enforce temporal consistency, then identification accuracy is improved, but memory requirements significantly increase
Solution Approach 1:
The patent segments memory usage by processing frames in a sequential manner through the Viterbi algorithm, where only the previous state needs to be retained in memory at any given time. The trellis structure allows the system to store match results in a compact form that requires minimal memory while still enabling temporal consistency enforcement across the entire video sequence.
3Measurement precision
If frame-level fingerprint matching is performed against large database of reference content, then identification accuracy is improved, but processing speed decreases
Solution Approach 1:
The patent performs preliminary indexing and organization of the large reference content database before fingerprint matching. By pre-processing the reference database and organizing it in an efficient structure, the system enables faster retrieval and comparison operations during actual fingerprint matching, reducing the time penalty associated with processing large databases.
4Reliability
If complex temporal fusion algorithms are used to enforce temporal consistency, then identification reliability is improved, but ease of operation deteriorates
Solution Approach 1:
The patent introduces the Viterbi algorithm as an intermediary that bridges frame-level fingerprint matching and temporal consistency enforcement. This intermediary component implements the complex temporal fusion logic in a standardized, well-defined manner that simplifies the overall system design and makes the implementation more manageable while maintaining high identification reliability.
Data Source
AI summary
Systems and methods of identifying media content, such as video content, that employ fingerprint matching at the level of video frames. The presently disclosed systems and methods of identifying media content can extract one or more fingerprints from a plurality of video frames included in query video content, and, for each of the plurality of video frames from the query video content, perform frame-level fingerprint matching of the extracted fingerprints against fingerprints extracted from video frames included in a plurality of reference video content. Using the results of such frame-level fingerprint matching, the presently disclosed systems and methods of identifying media content can identify the query content in relation to an overall sequence of video frames from at least one of the plurality of reference content, and/or in relation to respective video frames included in a sequence of video frames from the reference content.