Adaptive Video Transmission With Server-Side Screen Composition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for distributing multiple videos to clients face challenges due to client processing limitations and network bandwidth constraints, leading to potential delays or reduced service levels, necessitating flexibility in setting the number of videos transmitted for optimal display.
Innovation Solution
An image processing system that dynamically adjusts the number of videos transmitted to a client based on given rules, switching between individual video frames and composite images, considering client attributes and network conditions to optimize screen generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the client decodes and generates screens by combining multiple video streams, then the client can display multiple videos, but the client processing load increases and may cause delays or failures
Solution Approach 1:
The system dynamically adjusts the number of video streams transmitted based on client processing capabilities. The server determines whether to transmit multiple individual video streams or a single composite screen image based on real-time assessment of client performance, thereby optimizing the balance between display capability and processing load.
Solution Approach 2:
The server acts as an intermediary that performs video composition processing. Instead of requiring the client to combine multiple video streams, the server pre-combines them into composite screen images and transmits these to the client, transferring the processing burden from the client to the server.
2Adaptability or versatility
If multiple video streams are transmitted to the client, then more videos can be displayed, but network bandwidth is consumed
Solution Approach 1:
The system merges multiple video streams into a single composite screen image transmitted to the client. By combining multiple video data streams into one unified image stream, the total network bandwidth consumption is reduced while still delivering the content of multiple videos to the client display.
Solution Approach 2:
The system dynamically selects between transmitting multiple individual video streams or a single composite image based on network conditions and client capabilities, optimizing bandwidth utilization while maintaining display quality.
3Reliability
If the server generates composite screen images, then the service level is maintained, but the server processing load increases when serving multiple clients
Solution Approach 1:
The server dynamically adjusts its processing mode based on the number of connected clients and overall system load. When serving multiple clients, the system can switch between generating composite images for each client or transmitting individual video streams, thereby managing server processing load while maintaining service quality.
4Ease of manufacture
If the client has low processing performance, then hardware costs are reduced, but the client cannot handle multiple video streams effectively
Solution Approach 1:
The server acts as a processing intermediary that performs video composition tasks that would otherwise require high client processing power. By offloading the composite image generation to the server, clients with lower processing capabilities can still display multiple videos effectively.
Solution Approach 2:
The system dynamically adapts the transmission format based on client processing capability. For low-performance clients, the server transmits pre-composed composite images rather than multiple individual video streams, enabling these clients to display multiple videos without requiring high processing power.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
Provided is an image processing system capable of increasing flexibility in setting the number of videos that are transmitted from a video transmitting device to a video receiving device to constitute the basis for a screen to be presented to a user. A data transmitting unit (44) of a cloud service (10) transmits a video to a client (12). A screen generating unit (66) of the client (12) generates a screen that contains frame images of videos which are received as videos to be placed in one screen. The data transmitting unit (44) of the cloud service (10) transmits, to the client (12), as videos to be placed in one screen, videos in a number determined in accordance with a given rule. The screen generating unit (66) of the client (12) generates a screen that contains as many frame images of videos as the determined number.