Live Audio-Video Stream Pre-Pulling for Low-Latency Connections

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing live connection methods in live streaming systems suffer from inefficient screen rendering and latency due to the need for users to wait for permission messages before rendering the opposite side's audio and video streams, leading to delayed live interaction experiences.

Innovation Solution

A method where clients pre-pull and pre-process the live audio and video streams upon initiating a connection request, merging them upon receiving permission messages to reduce latency and improve rendering efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If clients wait for permission messages before rendering audio and video streams, then connection control and authorization are ensured, but screen rendering efficiency deteriorates and latency increases

Engineering Contradiction:
Improveconnection authorizationVSAvoidscreen rendering efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-pulling the opposite side's audio and video streams before receiving the permission message. When the connection request is initiated, the client immediately starts downloading the remote stream in advance, so that when permission is granted, the stream is already available for immediate rendering without waiting time, thus resolving the contradiction between authorization control and rendering efficiency

Inventive Principle:
Principle #10Preliminary action

2Productivity

If clients pre-pull and pre-process streams before permission, then screen rendering efficiency improves and latency reduces, but device complexity increases

Engineering Contradiction:
Improvescreen rendering efficiencyVSAvoidstream processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the stream processing into distinct phases: pre-pulling phase (downloading remote stream), permission waiting phase (receiving authorization), and merging phase (combining streams). This segmentation allows each module to be independently optimized and managed, reducing overall system complexity while maintaining high rendering efficiency

Inventive Principle:
Principle #1Segmentation

3Ease of operation

If clients merge streams immediately upon connection, then live interaction responsiveness improves, but waiting times and latency increase due to sequential processing

Engineering Contradiction:
Improveinteraction responsivenessVSAvoidconnection latency
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent implements continuity of useful action by performing stream pre-pulling continuously in parallel with the permission message waiting process. Instead of sequential processing (wait for permission → then pull stream), the system continuously downloads the remote stream throughout the permission waiting period, ensuring that when permission arrives, merging can occur immediately without any gaps or delays

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS20250260846A1Method and apparatus for processing live audio and video stream, and device and medium
Publication Date: 2025.08.14 BEIJING ZITIAO NETWORK TECH CO LTD
  • US20250260846A1 patent drawing
  • US20250260846A1 patent drawing
  • US20250260846A1 patent drawing

AI summary

The embodiments of the present disclosure relate to a method and apparatus for processing a live audio and video stream, and a device and a medium. The method comprises: in response to a live connection operation with a second client, a first client sending a live connection request for the second client; receiving a second live audio and video stream corresponding to the second client; and in response to a received live connection permission message corresponding to the second client, playing a merged audio and video stream, wherein the merged audio and video stream is obtained by means of performing merging processing according to the second live audio and video stream and a first live audio and video stream, and the live connection permission message is a permission message for the live connection request.