Live Stream Audio Synchronization via Host Mixing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing live stream processing systems fail to synchronize singing audio with accompaniment audio, resulting in a poor singing experience due to desynchronization issues.

Innovation Solution

A method and system that synchronizes the playing of accompaniment audio with singing audio by using target song information, including a target song identifier, to ensure that both audio streams are synchronized and sent as a live stream, with optional calibration and timestamp insertion for improved synchronization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If each user plays accompaniment audio through their own equipment and sends singing audio to host equipment, then users can sing together remotely, but the singing audio is not synchronized with the accompaniment audio

Engineering Contradiction:
Improveremote singing capabilityVSAvoidaudio synchronization
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The host equipment merges the accompaniment audio from its own playback with the singing audio received from remote users, combining these separate audio streams into a unified live stream that ensures synchronization between accompaniment and vocals

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The host equipment acts as an intermediary that receives singing audio from multiple users, synchronizes it with the accompaniment audio being played locally, and redistributes the synchronized mix to all participants, thereby mediating the synchronization problem

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the host equipment collects and redistributes audio streams, then all users can participate in the live stream, but the audio synchronization between singing and accompaniment deteriorates

Engineering Contradiction:
Improvelive stream distributionVSAvoidaudio synchronization
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The host equipment preliminarily synchronizes the accompaniment audio playback and prepares the audio mixing before distributing the live stream to users, ensuring that synchronization is established in advance rather than during distribution

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback mechanisms where the host equipment monitors the audio streams from all users, adjusts synchronization based on timing information, and continuously refines the audio mixing to maintain synchronization across the distributed network

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11315535B2Live stream processing method, apparatus, system, electronic apparatus and storage medium
Publication Date: 2022.04.26 BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
  • US11315535B2 patent drawing
  • US11315535B2 patent drawing
  • US11315535B2 patent drawing

AI summary

The present disclosure provides a live stream processing method, apparatus and system, electronic device and a storage medium. The first electronic device acquires target song information provided by second electronic device, and the target song information at least includes a target song identifier. Afterwards, the first electronic device plays the accompaniment audio synchronously with the second electronic device according to a target song identifier when the notification information is received, that is, when the second electronic device plays the accompaniment audio of the target song, and the first electronic device acquires the singing audio sent by the second electronic device through a server. Finally, the first electronic device takes the played accompaniment audio and the singing audio as a live stream and sends the live stream to the server.