Media Synchronization via Audio Sampling and Offset Calculation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing synchronized media systems, such as Karaoke systems, require an integral connection between the music playback apparatus and lyrics display apparatus, limiting the ability to enjoy synchronized media in environments where the music is played without a connected display system.

Innovation Solution

A client device captures a media sample from a media rendering source, determines a time offset using a position identification module, and renders a synchronized media stream without needing direct operational coupling to the music playback apparatus, allowing for standalone synchronization of lyrics or other media content with ambient music.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the lyrics display apparatus is designed as an integral part of the music playback apparatus, then the synchronization reliability is improved, but the adaptability to different environments deteriorates

Engineering Contradiction:
Improvesynchronization reliabilityVSAvoidenvironmental adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent divides the synchronized media system into separate functional modules: the music playback apparatus and the lyrics display apparatus are independent entities that communicate through standardized interfaces. This segmentation allows the system to maintain reliable synchronization through protocol-based communication while adapting to various environmental configurations and device combinations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements universal synchronization mechanisms that can work across different music playback devices and display devices. The lyrics display apparatus can synchronize with multiple types of music sources (streaming services, local files, radio) and can be displayed on various devices (smartphone screens, TV displays, dedicated karaoke machines), providing multi-functional adaptability while maintaining consistent synchronization performance.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If the music playback apparatus and lyrics display apparatus are operationally coupled, then the synchronization precision is improved, but the ease of operation deteriorates

Engineering Contradiction:
Improvesynchronization precisionVSAvoidsystem setup ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent implements automatic synchronization establishment where the lyrics display apparatus autonomously detects the music playback source, extracts timing information, and establishes synchronization without requiring manual configuration. The system automatically identifies the music track, retrieves corresponding lyrics, and synchronizes display timing, eliminating complex setup procedures while maintaining high synchronization precision through automated timing extraction and adjustment.

Inventive Principle:
Principle #25Self-service

3Loss of information

If the system requires direct operational coupling between playback and display apparatus, then the information accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvetiming information accuracyVSAvoidsystem connection complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces standardized communication interfaces and protocols as intermediaries between the music playback apparatus and lyrics display apparatus. These intermediaries transmit timing information and synchronization commands through well-defined data exchange formats, ensuring accurate timing information transmission while simplifying the physical and logical connections between devices. The intermediary layer handles protocol conversion and data formatting, reducing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3418917B1Methods and systems for synchronizing media
Publication Date: 2022.08.17 APPLE INC
  • EP3418917B1 patent drawingFigure 1
  • EP3418917B1 patent drawingFigure 2
  • EP3418917B1 patent drawingFigure 3A

AI summary

Systems and methods of synchronizing media are provided. A client device may be used to capture a sample of a media stream being rendered by a media rendering source. The client device sends the sample to a position identification module to determine a time offset indicating a position in the media stream corresponding to the sampling time of the sample, and optionally a timescale ratio indicating a speed at which the media stream is being rendered by the media rendering source based on a reference speed of the media stream. The client device calculates a real-time offset using a present time, a timestamp of the media sample, the time offset, and optionally the timescale ratio. The client device then renders a second media stream at a position corresponding to the real-time offset to be in synchrony to the media stream being rendered by the media rendering source.