Display Device Video Audio Fingerprint Matching Logic
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display devices consume unnecessary resources by extracting and processing audio fingerprints even when video fingerprints are single-matched, leading to inefficient content identification.
Innovation Solution
A display device that extracts an audio fingerprint only when the corresponding video fingerprint is multi-matched, reducing resource usage by stopping audio fingerprint extraction when video fingerprints are single-matched and transmitting the audio fingerprint to the server for matching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If audio fingerprint extraction is performed for all content regardless of video fingerprint matching results, then content identification accuracy is maintained, but resource consumption increases
Solution Approach 1:
The content identification process is segmented into two stages: first video fingerprint matching is performed, and only when multi-matching occurs does the system proceed to audio fingerprint extraction. This segmentation allows the system to handle the majority of content cases with the less resource-intensive video fingerprint method while reserving audio fingerprint processing for ambiguous cases.
Solution Approach 2:
Instead of performing both video and audio fingerprint extraction for all content, the system applies partial action by extracting audio fingerprints only when necessary (when video fingerprint multi-matching occurs). This reduces overall resource consumption while maintaining identification accuracy for cases that require it.
2Reliability
If audio fingerprint extraction is always performed, then identification accuracy for content with same video frames but different audio frames is ensured, but processing time increases
Solution Approach 1:
The identification process is divided into sequential stages where video fingerprint matching is performed first as a quick filter. Only when this stage yields multiple matches does the system proceed to the more time-consuming audio fingerprint extraction, thereby reducing overall processing time while maintaining accuracy when needed.
Solution Approach 2:
Video fingerprint matching is performed as a preliminary action before audio fingerprint extraction. This preliminary step quickly resolves most identification cases without requiring the more time-intensive audio processing, thereby reducing overall processing time while ensuring accuracy is maintained for ambiguous cases.
3Productivity
If video fingerprint matching alone is used for content identification, then processing efficiency is improved, but identification accuracy decreases for content with same video frames but different audio frames
Solution Approach 1:
The identification system is segmented into a primary video fingerprint stage for efficient processing of most content, and a secondary audio fingerprint stage for resolving ambiguous cases. This segmentation maintains high processing efficiency for the majority of content while ensuring accurate identification when video frames are identical but audio differs.
Solution Approach 2:
Video fingerprint matching serves as an intermediary step that filters content before audio fingerprint extraction. It efficiently handles clear-cut cases and only passes ambiguous multi-matched cases to audio fingerprint analysis, thereby maintaining both processing efficiency and identification accuracy.
Data Source
AI summary
Provided is a display device including: a display; a communicator; a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, to perform control to extract a video fingerprint from current content being displayed on the display, transmit the extracted video fingerprint to a server, receive, from the server, a first response comprising a matching result of the extracted video fingerprint and video fingerprints stored in the server, extract an audio fingerprint from the current content being displayed on the display in case that the extracted video fingerprint matches a plurality of video fingerprints stored in the server according to the first response, transmit the extracted audio fingerprint to the server, and receive, from the server, a second response comprising a matching result of the extracted audio fingerprint and audio fingerprints stored in the server.