Metadata Scoring for Duplicate Electronic Content Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies face challenges in identifying and managing duplicate electronic content across devices, particularly when files are encoded in different formats or have varying metadata, leading to inefficiencies in storage and display.

Innovation Solution

A method is developed to generate a score for electronic content items based on metadata matching, where exact matches are given more weight than partial matches, and a threshold is set to determine potential duplicates, allowing for the filtering or display of only one item, thereby simplifying user lists and storage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of substance

If metadata comparison is performed to identify duplicate electronic content, then storage efficiency is improved, but computational complexity increases

Engineering Contradiction:

Improvestorage redundancyVSAvoidcomputational complexity

Core Design Contradiction:

Loss of substanceVSDevice complexity

Solution Approach 1:

The metadata comparison process is segmented into multiple stages: first comparing critical fields (title, artist, album) to generate initial matches, then progressively comparing additional fields (track number, genre, release date) only for candidates that passed previous stages. This hierarchical segmentation reduces the overall computational complexity while maintaining effective duplicate detection.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different metadata fields are assigned different weights based on their discriminatory power. Title, artist, and album fields are given higher weights as they more uniquely identify electronic content, while less distinctive fields receive lower weights. This local quality differentiation optimizes the comparison process by focusing computational resources on the most informative fields.

Inventive Principle:

Principle #3Local quality

2Measurement precision

If exact metadata matches are prioritized in scoring, then duplicate identification accuracy is improved, but flexibility in handling varied metadata formats decreases

Engineering Contradiction:

Improveduplicate identification accuracyVSAvoidmetadata format flexibility

Core Design Contradiction:

Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system performs partial matching by comparing only the most critical metadata fields (title, artist, album) with exact match requirements to generate initial duplicate candidates. Less critical fields are then used to refine the matching, allowing the system to maintain high accuracy for primary identification while being more flexible with secondary attributes that may have formatting variations.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS8280861B1Identifying duplicate electronic content based on metadata

Publication Date: 2012.10.02 GOOGLE LLC

AI summary

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for de-duplicating electronic content based on comparing metadata. In one aspect, a method includes comparing first metadata associated with a first item of electronic content to second metadata associated with a second item of electronic content, and generating a score based on the comparison. The method also includes establishing that the first and second items of electronic content comprise potentially duplicate content when the score is greater than a predetermined threshold value, and providing information identifying either the first or second items of electronic content for display when establishing that the first and second items of electronic content comprise potentially duplicate content.