Dynamic Cloud Video Composition for Conference Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video conferencing, devices with insufficient hardware, software, or network capabilities struggle to process multiple video streams, leading to unacceptable video quality or dropped frames, as they cannot handle the processing resources, bandwidth, or resolution required for individual streams.
Innovation Solution
A media conferencing service combines multiple video streams into a single composite stream, adjusting encoding parameters such as resolution, frame rate, and codec to match the capabilities of participating devices, ensuring an acceptable video experience by reducing resource requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple video streams are sent individually to each participant device, then video quality and processing accuracy are improved, but device processing capability and network bandwidth requirements increase
Solution Approach 1:
The patent combines multiple individual video streams into a single composite video stream that contains all participant videos. This composite stream is then sent to participant devices, reducing the number of separate streams each device must process while maintaining the ability to display multiple participant videos simultaneously.
Solution Approach 2:
The composite video stream is segmented into multiple video tiles or regions, each containing a different participant's video. This allows the device to receive one consolidated stream but still access and display individual participant videos by processing the segmented regions within the composite stream.
2Manufacturing precision
If multiple video streams are sent individually to each participant device, then video quality is improved, but network bandwidth consumption increases
Solution Approach 1:
Multiple video streams are merged into a single composite stream, reducing network bandwidth consumption by eliminating redundant transmission of multiple separate streams to each device. The composite stream efficiently packages all participant videos in one transmission.
3Device complexity
If video streams are combined into a single composite stream, then device processing requirements and network bandwidth are reduced, but video quality and resolution may deteriorate
Solution Approach 1:
Different regions or tiles within the composite video stream are allocated different quality levels based on importance. For example, the active speaker's video tile may be rendered at higher resolution and quality, while other participant tiles use lower resolution, optimizing overall video quality while managing device processing constraints.
4Quantity of substance
If video streams are combined into a single composite stream, then network bandwidth is reduced, but adaptability to different device capabilities decreases
Solution Approach 1:
The system dynamically adjusts the composition and quality parameters of the composite video stream based on the capabilities of the receiving device. Devices with higher processing capabilities receive composite streams with more video tiles or higher resolution, while devices with limited capabilities receive simplified composite streams with fewer tiles or lower resolution, ensuring optimal performance across diverse device types.
Data Source
AI summary
Implementations for combining at least two video streams received from devices of a plurality of participants of a video conference into a composite video stream are described. A video conference including the video streams received from the devices of the plurality of participants is established. A capability associated with consuming at least two of the video streams is received from at least one of the devices. The at least two video streams are then combined into a composite video stream based on the capability associated with consuming the at least two video streams. The composite video stream is transmitted to the at least one of the devices.