Synchronized Text Display with Audio Playback Coordination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Music enthusiasts face difficulties in synchronizing song lyrics with audio playback, requiring manual scrolling through static lyrics pages to find the exact line being sung, which is inefficient and lacks real-time synchronization.

Innovation Solution

A system and method that receive an audio signal, determine the audio track identity and position, and display synchronized text, automatically scrolling it in pace with the audio, with a current text indicator visually synchronized to the audio playback, allowing users to interactively control playback positions and update synchronization dynamically.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a static lyrics page is displayed manually scrolled through, then the user can view song lyrics, but the user cannot real-time synchronize lyrics with audio playback

Engineering Contradiction:
Improvesynchronization precisionVSAvoidmanual scrolling operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies dynamics by transforming the static lyrics display into a dynamic system where lyrics automatically scroll and synchronize with audio playback. The lyrics display adapts its scrolling speed and position in real-time based on the audio playback state, enabling precise synchronization without manual user intervention.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs self-service by automatically tracking audio playback position and updating the lyrics display accordingly. The synchronization mechanism operates autonomously, continuously adjusting the visible lyrics portion based on the audio stream without requiring active user control or manual scrolling.

Inventive Principle:
Principle #25Self-service

2Productivity

If text is automatically scrolled in pace with audio, then real-time synchronization is achieved, but the system complexity increases

Engineering Contradiction:
Improvesynchronization efficiencyVSAvoidaudio-text coordination system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary synchronization layer that coordinates between audio playback and text display. This mediator component processes audio timing information and translates it into appropriate text scrolling behavior, simplifying the overall system architecture while achieving precise synchronization.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by pre-loading and buffering lyrics data before it is needed during playback. The synchronization mechanism anticipates upcoming lyrics based on audio timing and prepares the display in advance, improving synchronization efficiency without adding significant complexity.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If a current text indicator is visually synchronized to audio, then user identification of current lyrics is enhanced, but the display complexity increases

Engineering Contradiction:
Improvecurrent lyrics identificationVSAvoiddisplay system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent employs color changes to enhance the visibility and identification of current lyrics. The current text indicator uses distinct color coding that changes or updates in synchronization with audio playback, making it easy for users to identify the current lyrics at any moment without adding complex display mechanisms.

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS8433431B1Displaying text to end users in coordination with audio playback
Publication Date: 2013.04.30 SOUNDHOUND AI IP LLC
  • US8433431B1 patent drawing
  • US8433431B1 patent drawing
  • US8433431B1 patent drawing

AI summary

Technologies described relate to coordination between audio and tracking of the corresponding text in an audio recognition mode and an audio playback mode. Optionally, audio recognition includes receiving a signal corresponding to an audio track; determining an identity of the audio track and a current audio position within the audio track; displaying on a display a portion of a text that is linked and synchronized to the audio track identified and automatically scrolling the portion of the text displayed in pace with the audio track playing; and displaying a current text indicator that emphasizes current text, wherein the current text indicator is visually synchronized on the display to current audio playing from the audio track. Optionally include redetermining the current audio position in the audio track from the signal received and updating synchronization of the current text indicator with the current audio playing.