Multimedia Fingerprint Trigger Detection Without Signal Modification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for marking and detecting trigger instants in multimedia signals, such as video and audio content, are unreliable and require cooperation from the entire broadcast chain, and can be affected by signal modifications or delays, with solutions like MPEG transport streams and watermarking having limitations.
Innovation Solution
Generating and using fingerprints of multimedia signal segments to identify trigger points, allowing for accurate and reliable detection of trigger actions without modifying the signal, using a fingerprint stream comparison with a database to retrieve associated actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If watermarking is used to embed trigger information in video frames, then trigger detection can be performed, but the video/audio signal is necessarily modified
Solution Approach 1:
The patent extracts the trigger information embedding from the main multimedia signal by using a separate audio channel to carry trigger markers. This separation allows trigger detection without modifying the video content, resolving the contradiction between reliable detection and signal integrity.
Solution Approach 2:
The patent introduces an intermediary approach by using audio watermarks as a separate carrier for trigger information. The audio channel serves as a mediator that can convey trigger data without directly modifying the video frames, thus avoiding harmful signal modification while maintaining detection reliability.
2Ease of manufacture
If MPEG transport stream fields are used to hold marking information, then time marking can be performed, but re-multiplexing operations can easily remove the marking information
Solution Approach 1:
The patent extracts trigger information from vulnerable transport stream fields and relocates it to the audio channel. This extraction protects the marking information from being removed during re-multiplexing operations, as audio watermarks are more resilient to such processing.
Solution Approach 2:
The patent applies preliminary encoding of trigger information into audio watermarks before the signal undergoes re-multiplexing operations. This preliminary action ensures that the marking information is already protected in a robust format that can withstand subsequent processing steps.
3Adaptability or versatility
If vertical blanking interval is used to carry trigger information, then marking can be embedded, but standards converters and other equipment may not retain all information
Solution Approach 1:
The patent uses the audio channel, which is a universal component present in all multimedia systems, to carry trigger information. This multi-functional approach allows the same audio channel to serve both as content carrier and trigger marker carrier, ensuring compatibility across different equipment and standards converters.
Solution Approach 2:
The patent employs audio watermarks that can be easily regenerated and are not dependent on specific equipment characteristics. These digital watermarks can be recreated from the audio content itself, making them more reliable than equipment-specific markings that may be lost in standards conversion.
4Reliability
If broadcaster cooperation is required to insert triggers, then trigger information can be embedded, but enhancement service provider becomes dependent on broadcaster
Solution Approach 1:
The patent extracts the trigger embedding function from the broadcaster's domain and relocates it to the audio processing stage. This allows enhancement service providers to independently insert trigger markers into the audio channel without requiring broadcaster cooperation, reducing dependency while maintaining reliable embedding.
Solution Approach 2:
The patent enables the audio channel to serve itself as a carrier for trigger information. By using the existing audio stream that is already present in the multimedia signal, the system can independently embed and detect triggers without external coordination, making the process self-sufficient and reducing complexity.
Data Source
AI summary
This invention relates to a device and a method of relating one or more trigger actions with a multimedia signal and corresponding method and device for detecting one or more trigger actions in a multimedia signal. One fingerprint is generated on the basis of a segment of the multimedia signal at each trigger time point. The generated fingerprint(s) is stored in a database and communicated to playback devices. During playback fingerprints of the multimedia signal are generated and matched against fingerprints in the database. When a match is found, associated trigger actions is retrieved. The trigger time point is determined as a time point near or at a segment of the multimedia signal that caused a fingerprint to match. In this way, a simple and reliable way of detecting trigger markers for trigger actions is enabled without modifying the multimedia signal.