Live Video Streaming System Server-Side Compositing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video sharing systems face inefficiencies, inflexibility, and inaccuracies in broadcasting public combined live video streams from multiple client devices, particularly in terms of scalability, hardware limitations, and synchronization of video streams across different client devices.

Innovation Solution

A live video streaming system that combines live video streams from multiple participant devices into a single public combined live video stream, utilizing server-side processing to efficiently manage and broadcast the stream, while dynamically adding or removing participant devices and providing dynamic user interfaces for various digital rooms such as preparation, waiting, post-participation, and after broadcast rooms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video sharing systems are used to broadcast public combined live video streams from multiple client devices, then basic video sharing functionality is provided, but efficiency, flexibility, and accuracy deteriorate due to hardware limitations and synchronization issues

Engineering Contradiction:
Improveefficiency of broadcastingVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces a server as an intermediary between multiple client devices to manage video stream combination and distribution. The server receives video streams from participant devices, combines them into a public combined live video stream, and distributes it to viewer devices, thereby improving broadcasting efficiency while centralizing complexity management.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent merges multiple video streams from different participant devices into a single public combined live video stream on the server side. This combining approach improves efficiency by consolidating multiple streams into one distributed stream rather than having each client device independently manage multiple streams.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If multiple participant devices are added to the public combined live video stream, then flexibility and adaptability improve, but synchronization accuracy and video quality deteriorate due to increased system load

Engineering Contradiction:
Improveflexibility of participant managementVSAvoidsynchronization accuracy
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The server acts as a central intermediary that manages the addition and removal of participant devices. It maintains synchronization by controlling the timing and sequence of stream integration, ensuring that even as participants are dynamically added or removed, the combined video stream remains synchronized and maintains quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically adjusts to participant device changes by allowing flexible addition and removal of devices during the live stream. The server dynamically manages the video stream composition, maintaining synchronization accuracy despite changing participant configurations.

Inventive Principle:
Principle #15Dynamics

3Productivity

If server-side processing is used to combine video streams, then productivity and video quality improve, but device complexity and processing requirements increase

Engineering Contradiction:
Improvevideo stream processing efficiencyVSAvoidserver processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The server combines multiple video streams into a single public combined live video stream, improving productivity by centralizing processing. While this increases server processing requirements, it simplifies the architecture compared to having each client device independently process multiple streams.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent replaces complex client-side video processing mechanics with server-side processing. Instead of requiring each client device to handle multiple video streams and synchronization logic, the mechanical complexity is substituted with a centralized server that performs all video stream combination and distribution operations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Ease of operation

If dynamic user interfaces are provided for digital rooms, then ease of operation improves, but device complexity and interface management overhead increase

Engineering Contradiction:
Improveuser interface usabilityVSAvoidinterface management complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The server acts as an intermediary that generates and manages dynamic user interfaces for digital rooms such as waiting rooms and post-participation rooms. This improves ease of operation by providing users with context-aware interfaces, while the server centralizes the complexity of interface generation and management.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The user interfaces are dynamically generated based on the user's current state and context within the digital room system. The server dynamically adjusts interface content and functionality, improving ease of operation while managing interface complexity centrally rather than requiring complex client-side interface logic.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11683538B2Live group video streaming
Publication Date: 2023.06.20 META PLATFORMS INC
  • US11683538B2 patent drawing
  • US11683538B2 patent drawing
  • US11683538B2 patent drawing

AI summary

The present disclosure relates to systems, non-transitory computer-readable media, and methods for accurately, flexibly, and efficiently broadcasting public combined live video streams from multiple participant devices, which change over the course of the live broadcast, as well as generating dynamic user interfaces that streamline adding, removing, and swapping participant devices from the public combined live video stream. In particular, a live video streaming system facilitates compositing live video streams from multiple participant devices into a public combined live video stream within a digital room before broadcasting the public combined live video stream to viewer devices. In addition, the live video stream smoothly and efficiently transitions new participant devices from a digital waiting room to the public combined live video stream as well as switches current participant devices from the public combined live video stream to a digital waiting room, all while maintaining live video stream of the participant devices.