Client Device Content Identification Using Local Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing content identification systems require user interaction and are computationally intensive, leading to delays in identifying media content due to limited server capacity, often missing opportunities for timely identification.

Innovation Solution

A method where a client device determines the identity of media content and its rendering source using local information, then sends relevant data to a content recognition server for confirmation, allowing for continuous and passive content identification without relying solely on server processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a central server performs computational intensive procedures to identify content of media samples, then content identification accuracy is improved, but response time deteriorates due to limited server capacity and high request volume

Engineering Contradiction:
Improvecontent identification accuracyVSAvoidresponse time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The content identification system is segmented into multiple independent content identification servers instead of relying on a single central server. Each server can independently process media sample requests, distributing the computational load across multiple nodes. This segmentation increases overall system capacity and reduces response time while maintaining identification accuracy through parallel processing of identical algorithms.

Inventive Principle:
Principle #1Segmentation

2Use of energy by moving object

If content identification requests are processed only after user initiation, then server computational load is reduced, but identification timing is delayed causing missed opportunities for real-time content recognition

Engineering Contradiction:
Improveserver computational loadVSAvoididentification timing
Core Design Contradiction:
Use of energy by moving objectVSLoss of time

Solution Approach 1:

The client device performs preliminary content identification processing locally before submitting requests to the server. The client extracts features from media samples and attempts local matching against a database of known content. This preliminary action reduces the volume of requests requiring server processing and enables faster local identifications, while still allowing server assistance for unrecognized content.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If multiple content identification servers are deployed to reduce delays, then response time is improved, but system complexity increases

Engineering Contradiction:
Improveresponse timeVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

A load balancer or intermediary component is introduced to manage traffic distribution across multiple content identification servers. This intermediary receives requests from client devices, distributes them appropriately across available servers, and aggregates responses. This approach enables multiple servers to work in parallel reducing response time, while the intermediary abstracts the complexity of server management from client devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9451048B2Methods and systems for identifying information of a broadcast station and information of broadcasted content
Publication Date: 2016.09.20 APPLE INC
  • US9451048B2 patent drawing
  • US9451048B2 patent drawing
  • US9451048B2 patent drawing

AI summary

Methods and systems for identifying information of a broadcast station and information of broadcasted content are provided. In one example, a method includes receiving at a client device media content rendered by a media rendering source, and the client device making an attempt to determine an identity of the media content based on information stored on the client device. The method also includes based on the attempt of the client device to determine the identity of the media content, determining an identity of the media rendering source. The method further includes based on the attempt of the client device to determine the identity of the media content and on determining the identity of the media rendering source, sending information indicative of the media content to a content recognition server to determine the identity of the media content.