Video Synthesis Picture Stitching for Multi-Angle Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video processing technologies face challenges in synchronizing video streams from multiple visual angles, leading to low overall video display fluency and poor time synchronization due to backend storage, network, and caching strategies.
Innovation Solution
A method and apparatus that stitch video stream data from multiple video acquisition devices into a synthesis picture based on region division information, allowing for synchronous rendering across participating clients, enabling simultaneous playback of videos from different angles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple video players independently pull video streams from backend storage through network, then each video stream can be played separately, but time synchronization between different videos deteriorates and overall video display fluency decreases
Solution Approach 1:
The patent merges multiple independent video streams into a single synthesized video stream by combining video data from multiple acquisition devices at the backend. This unified stream is then distributed to clients, ensuring all video content is synchronized at the source level, eliminating synchronization issues that would occur with multiple independent streams.
Solution Approach 2:
The patent introduces a video synthesis device as an intermediary between video acquisition devices and clients. This intermediary device receives video streams from multiple sources, synchronizes and synthesizes them into a unified stream, and then distributes it to clients, acting as a mediator that ensures time synchronization across all video content.
2Ease of manufacture
If backend codes each video stream separately and outputs multiple playable video streams, then each video stream can be independently processed, but network transmission complexity increases and synchronization becomes difficult to maintain
Solution Approach 1:
The patent combines multiple video streams into a single synthesized stream at the backend, reducing the number of separate video streams that need to be transmitted over the network. This merging approach simplifies network transmission architecture while maintaining the ability to process different visual angles.
Solution Approach 2:
The patent transitions from processing multiple independent video streams in parallel to processing a single synthesized video stream that contains multiple visual angles. This dimensional change from multiple separate streams to one composite stream simplifies the transmission system while preserving all necessary video content.
3Adaptability or versatility
If multiple video players are launched at the client side to pull video streams, then clients can view multiple visual angles, but client device resource consumption increases and synchronization control becomes harder
Solution Approach 1:
The patent merges multiple visual angles into a single video stream that is transmitted to the client. The client then receives one unified stream containing all visual angle information, eliminating the need to run multiple video players and significantly reducing client device resource consumption while maintaining multi-angle viewing capability.
Solution Approach 2:
The patent creates a synthesized copy of multiple video streams that contains all visual angle information in a single stream. This synthesized video stream is then transmitted to clients, allowing them to access multiple visual angles without needing to process or play multiple separate streams, thus reducing resource consumption.
Data Source
AI summary
A video processing method includes: obtaining video stream data from N video acquisition devices, N being a positive integer, and each video acquisition device corresponding to one visual angle; stitching N pieces of video stream data into a video synthesis picture based on region division information for video picture synthesis, the region division information indicating locations of the N pieces of video stream data in the video synthesis picture; and transmitting the video synthesis picture to a participating client, to enable the participating client to split the video synthesis picture into the N pieces of video stream data based on the region division information, and perform synchronous rendering on the N pieces of video stream data based on video display region information corresponding to the participating client.