Cloud-Based Video Effects Offloading for Stable Videoconferencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Not all client devices, such as laptops, tablets, and smartphones, are powerful enough to render visual effects in videotelephony applications without degrading performance, leading to overheating and poor display quality.
Innovation Solution
Offload video processing tasks, including visual effects, to a cloud-based server system that applies effects to video streams and transmits modified streams to client devices, relieving the client devices of CPU/GPU load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If visual effects are applied on client devices, then visual effects can be rendered, but client device performance degrades and overheating occurs
Solution Approach 1:
The patent extracts the visual effects processing function from the client device and relocates it to a cloud-based server. The client device sends the original video stream to the server, which applies the visual effects and returns the modified stream, thereby eliminating the performance degradation and overheating issues on client devices while maintaining visual effects rendering capability
Solution Approach 2:
The patent introduces a cloud-based server as an intermediary between the client device and the video display. The server acts as a mediator that receives the video stream from the client, applies the visual effects, and transmits the modified stream back to the client for display, thereby offloading the processing burden from the client device
2Ease of manufacture
If visual effects are applied on client devices, then visual effects can be rendered, but video quality and frame rate decrease
Solution Approach 1:
The patent extracts the visual effects processing from resource-constrained client devices and relocates it to powerful cloud-based servers with superior computing resources. This enables the application of complex visual effects while maintaining high video quality and frame rates, as the servers can process the video streams with much higher performance capabilities than typical client devices
3Reliability
If cloud-based server applies visual effects, then client device CPU usage is reduced, but network bandwidth is consumed
Solution Approach 1:
The patent introduces a cloud-based server as an intermediary that handles the computationally intensive visual effects processing. The client device only needs to transmit the original video stream and receive the modified stream, significantly reducing its CPU usage and energy consumption. The network bandwidth consumption is traded for client device energy savings, leveraging the server's unlimited processing capacity
Data Source
AI summary
A server system receives, from a first client device, a video stream relating to a videoconferencing session and receives, from the first client device, visual effects information relating to one or more visual effects to be applied to the video stream. The server system applies, based on the received visual effects information, the one or more visual effects to the video stream to generate one or more modified video streams, and transmits the one or more modified video streams to one or more other client devices participating in the videoconferencing session.