Nested Reverse Indexing for Scalable Reference Signature Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing media monitoring systems face challenges in efficiently scaling to handle large numbers of monitored sites and reference media, leading to increased query response times and reduced capacity to identify media in real-time.
Innovation Solution
A scalable architecture using a nested distributed map for storing a reverse index, allowing workload distribution across clusters, and dynamic scaling in response to changes in client devices, media items, and response time dimensions, utilizing device meters and reference signature capturers to generate and match site signatures with reference signatures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a centralized processing site is used to compare site signatures with reference signatures, then media identification accuracy is improved, but query response time increases and system scalability deteriorates
Solution Approach 1:
The patent divides the centralized processing system into multiple distributed matcher/storer clusters that process signature matching in parallel. Each cluster handles a subset of reference signatures, enabling concurrent processing that reduces query response time while maintaining identification accuracy through distributed comparison across multiple nodes.
Solution Approach 2:
The patent introduces a hierarchical dimension to the processing architecture by implementing reverse indexes that map signature values to cluster locations. This adds a preprocessing layer that directs queries to appropriate clusters, reducing the search space and enabling faster response times without sacrificing matching accuracy.
2Productivity
If the number of monitored sites and reference media increases, then system capacity and coverage are improved, but processing complexity and query response time worsen
Solution Approach 1:
The patent segments the large-scale signature matching problem into manageable portions by distributing reference signatures across multiple matcher/storer clusters. Each cluster manages a subset of the total reference media, allowing the system to scale capacity linearly by adding clusters while keeping individual cluster complexity manageable.
Solution Approach 2:
The patent introduces reverse indexes as intermediary data structures that simplify the complexity of searching through large numbers of reference signatures. The reverse indexes pre-organize signature data by value, providing a direct path from site signature to matching reference media without requiring complex search algorithms across the entire reference database.
3Productivity
If more reference signatures are stored to identify more media pieces, then identification coverage is improved, but memory requirements and processing overhead increase
Solution Approach 1:
The patent distributes the storage of reference signatures across multiple matcher/storer clusters, with each cluster holding a portion of the total reference signature database. This segmentation allows the system to achieve high identification coverage through collective storage capacity while keeping individual node memory requirements manageable and enabling parallel access patterns.
Solution Approach 2:
The patent adds an organizational dimension through reverse indexes that structure reference signature data by signature value rather than by media metadata. This dimensional reorganization enables efficient retrieval of matching signatures without requiring linear searches through entire media catalogs, reducing processing overhead despite storing large numbers of references.
Data Source
AI summary
Methods, apparatus, systems and articles of manufacture are disclosed for scalable architectures for reference signature matching and updating. An example method for scalable architectures for reference signature matching and updating includes accessing site signatures to be compared to reference signatures from a first group of media sources. Determining if a first reference node is an owner of a first one of the site signatures. Comparing a neighborhood of site signatures including the first site signature to reference signatures in a first subset of reference signatures when the first reference node is the owner of the first site signature, the first subset of references signatures stored in a first memory partition associated with the first reference node. Not comparing site signature to reference signatures when the first reference node is not the owner of the first one of the site signatures.