Stereoscopic Video Fingerprinting via Frame Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing fingerprinting techniques struggle to identify copyrighted content in stereoscopic videos, particularly when the content is misclassified as two-dimensional or when the uploaded video content includes three-dimensional content encoded for left and right eyes, leading to failed matches in reference databases.
Innovation Solution
Generating fingerprints for multiple portions of a video frame, including the entire frame and encoded portions for left and right eyes, to detect matches in a reference database, regardless of the content's dimensionality or user classification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If fingerprinting is performed on the entire video frame, then the detection covers all content, but stereoscopic video content encoded for left and right eyes is misclassified as two-dimensional, leading to failed matches
Solution Approach 1:
The video frame is segmented into multiple portions including the entire frame and encoded portions for left and right eyes. Fingerprinting is performed on each portion separately to ensure that stereoscopic content is properly identified regardless of how it is encoded or classified.
2Device complexity
If fingerprinting is performed only on two-dimensional content, then the process is simpler, but it fails to detect stereoscopic video content that is misclassified or encoded in three-dimensional formats
Solution Approach 1:
The fingerprinting system is designed to handle multiple types of video content universally. It generates fingerprints for the entire frame and for encoded portions for left and right eyes, making it capable of detecting both two-dimensional and stereoscopic video content regardless of classification or encoding format.
3Reliability
If multiple fingerprints are generated for different portions of the frame, then stereoscopic content detection is improved, but the processing time and computational resources increase
Solution Approach 1:
The system determines whether a video content item includes stereoscopic video content before performing fingerprinting. This preliminary classification allows the system to optimize the fingerprinting process by generating fingerprints for multiple portions only when stereoscopic content is detected, reducing unnecessary processing time for standard two-dimensional content.
Data Source
Figure 1
Figure 2A~2B
Figure 3
AI summary
Methods, systems, and media for identifying content in stereoscopic videos and, more particularly, for detecting abusive stereoscopic videos by generating fingerprints for multiple portions of a video frame are provided. The method comprises: receiving, from a user device, a video content item for uploading to a content provider; selecting a frame from a plurality of frames of the video content item for generating one or more fingerprints corresponding to the video content item; generating a first fingerprint corresponding to the selected frame, a second fingerprint corresponding to a first encoded portion of the selected frame, and a third fingerprint corresponding to a second encoded portion of the selected frame; comparing each of the first fingerprint, the second fingerprint, and the third fingerprint to a plurality of reference fingerprints corresponding to reference video content items; determining whether at least one of the first fingerprint, the second fingerprint, and the third fingerprint match a reference fingerprint of the plurality of reference fingerprints; and, in response to determining that at least one of the first fingerprint, the second fingerprint, and the third fingerprint match the reference fingerprint, causing an indication of the match to be presented on the user device.