Server-Side Video Identification via Acoustic Fingerprinting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional information processing systems cannot effectively present additional information, such as advertisements, alongside video content being streamed from a server to a terminal device, limiting user engagement and advertising effectiveness.

Innovation Solution

An information processing system that includes a terminal device with a microphone to sense sound and transmit sound information to a server, which specifies both the video content and corresponding presentation information, allowing the server to transmit and the terminal to display relevant information, including advertisements, simultaneously with the video content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If video content is streamed from server to terminal device for display, then video content delivery is achieved, but additional information (advertisements, etc.) cannot be presented alongside the video content

Engineering Contradiction:
Improveadditional information presentationVSAvoidinformation presentation capability
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent introduces a spatial dimension separation by using two different display devices: the main display device for video content and a portable display device for additional information. This dimensional change allows simultaneous presentation of video content and additional information without interfering with each other, resolving the contradiction between delivering video content and presenting additional information.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If advertisement information is displayed on the same display device as video content, then advertising effectiveness improves, but the primary video content becomes obstructed

Engineering Contradiction:
Improveadvertising information deliveryVSAvoidvideo content obstruction
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent segments the information presentation function into two separate display devices. The main display device dedicates its full screen to video content without obstruction, while the portable display device separately presents advertisement information and additional content. This segmentation eliminates the harmful effect of obstruction while maintaining effective advertising delivery.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If sound information from video content is transmitted to server for specification, then accurate video content identification is achieved, but system complexity increases

Engineering Contradiction:
Improvevideo content identification accuracyVSAvoidsound sensing and transmission system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The terminal device utilizes its existing microphone (a component already present for other purposes) to capture sound information from the video content. The device then transmits this sound information to the server for automatic video content identification. This self-service approach leverages existing hardware resources, minimizing additional system complexity while achieving accurate video content identification.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the effective presentation of additional information to users alongside video content, enhancing user experience and improving advertising impact without obstructing the primary video content on the main display device.

Implementation Method 1

a microphone provided in the terminal device senses a sound in the vicinity of the terminal device

Methodology Applied
Scientific EffectMicrophone sound sensing:

Data Source

PatentUS9161076B2Information processing system, server system, terminal system, information processing program, and information presentation method
Publication Date: 2015.10.13 NINTENDO CO LTD
  • US9161076B2 patent drawing
  • US9161076B2 patent drawing
  • US9161076B2 patent drawing

AI summary

An information processing system comprises a terminal system which includes a terminal device and also comprises a server system. In the terminal system, a microphone provided in the terminal device senses a sound in the vicinity thereof. Sound information representing the sound sensed by the microphone or a feature of the sound is transmitted to the server system. In the server system, the sound in the vicinity of the terminal device is specified based on the sound information. Also, presentation information to be presented by the terminal device is specified based on the specified sound, and the presentation information is transmitted to the information processing device. The terminal system receives displays the presentation information transmitted from the server, and presentation information is displayed on a display unit of the terminal device.