Secondary Device Media Identification via Local Signature Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for identifying media content using mobile devices often overload servers with simultaneous requests, leading to slow response times and potential service disruptions due to the need for feedback-based processes.

Innovation Solution

A communication system that includes a primary device, a server, and a secondary device, where the secondary device generates data signatures from primary media content and matches them with signature chunks provided by the server, allowing for efficient retrieval of secondary media content without overloading the server, using push and pull communication modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a feedback-based process is used where mobile devices upload media samples to a server for identification, then additional information related to media content can be obtained, but the server becomes overloaded with simultaneous requests from countless users, resulting in slow response times and potential service disruptions

Engineering Contradiction:
Improveservice continuityVSAvoidresponse speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the media identification process into two parts: (1) the server provides signature chunks to mobile devices, and (2) mobile devices independently perform matching locally. This segmentation distributes the computational workload from the server to individual client devices, preventing server overload while maintaining identification functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent enables mobile devices to perform self-service by locally matching received signature chunks against captured media samples without requiring continuous server intervention. This allows devices to independently complete identification tasks, reducing dependency on server resources and eliminating bottlenecks caused by simultaneous requests.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If a feedback-based process is used where mobile devices upload media samples to a server for identification, then media content identification can be achieved, but server load increases with multiple simultaneous users, causing slow response times

Engineering Contradiction:
Improvemedia identification accuracyVSAvoidresponse time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements preliminary action by having the server pre-generate and distribute signature chunks to mobile devices before actual media identification is needed. This preparation phase allows the heavy computational work of creating signatures to be done in advance, so that during actual use, devices only need to perform lightweight matching operations, significantly reducing response time while maintaining identification accuracy.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If conventional feedback-based identification is used, then media content can be identified by uploading samples to a server, but service disruptions occur due to server overload from countless simultaneous requests

Engineering Contradiction:
Improveuser accessibilityVSAvoidservice stability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces signature chunks as an intermediary element between the server and media samples. Instead of directly comparing entire media samples on the server, the system uses pre-extracted signature chunks as intermediaries that can be distributed to devices. This intermediary approach maintains the identification function while dramatically reducing the computational burden on the server, ensuring service stability during high-concurrency usage.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11812073B2Identifying media on a mobile device
Publication Date: 2023.11.07 GOOGLE TECHNOLOGY HOLDINGS LLC
  • US11812073B2 patent drawing
  • US11812073B2 patent drawing
  • US11812073B2 patent drawing

AI summary

Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.