Spatially Multiplexed Video Decoder for MCU-Free Conferencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multi-way video conferencing systems require a multipoint control unit (MCU) to composite and transmit video images from different endpoints, which can be complex and inefficient.
Innovation Solution
A video conferencing device generates and transmits video frames with multiple images from different endpoints, using metadata for image separation and composition, allowing endpoints to implement multi-way conferences without an MCU, using spatially multiplexed output decoders and virtual decoders to manage and display these images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a multipoint control unit (MCU) is used to composite and transmit video images from different endpoints, then video conferencing functionality is achieved, but system complexity and infrastructure requirements increase
Solution Approach 1:
The patent divides the video frame into multiple independent image regions, each containing video content from different endpoints. Each endpoint receives a single video stream with a composite frame containing all other participants' images, eliminating the need for centralized MCU composition while maintaining multi-way conferencing functionality.
Solution Approach 2:
Instead of having the MCU compose and send separate video streams to each endpoint, the patent inverts the approach by having each endpoint receive a single composite stream containing all images and perform local separation. This reversal eliminates the MCU's composition function and distributes the processing burden to individual endpoints.
2Device complexity
If video frames with multiple images are transmitted between endpoints, then MCU infrastructure is eliminated, but endpoints must handle complex image separation and composition operations
Solution Approach 1:
The patent embeds metadata (such as position information and identification data) into the transmitted video frame before sending it to endpoints. This preliminary action provides endpoints with the necessary information to automatically separate and identify different video images without requiring complex manual processing or configuration.
Solution Approach 2:
The patent introduces metadata as an intermediary element that facilitates the separation and identification of multiple video images within a single frame. This metadata acts as a guide for endpoints, simplifying their processing tasks by providing structured information about image positions and sources without requiring complex analysis algorithms.
3Reliability
If traditional MCU-based systems are used, then centralized control is maintained, but system flexibility and scalability are limited
Solution Approach 1:
The patent enables each endpoint to independently process and separate video images from the received composite frame using embedded metadata. This self-service approach allows endpoints to autonomously reconstruct their local views without relying on centralized MCU control, thereby improving system flexibility and scalability while maintaining reliable video conferencing functionality.
Data Source
AI summary
In some embodiments, a spatially multiplexed output decoder may spatially multiplex video packets received in a time multiplexed video stream. A video stream with video packets from two or more sources may be received along with metadata. In some embodiments, a decoder may organize the video packets into respective buffers (e.g., each buffer including video packets for a respective video image). The spatially multiplexed output decoder may spatially multiplex the video images (which are made up of data from the respective video packets) into a video frame to be outputted (e.g., to a separate buffer). The video images in the video frame may then be demultiplexed in other parts of the system (e.g., in a virtual decoder) using information provided about the video frame (e.g., in metadata formed with the video frame).