Cloud Desktop Video Rendering via Terminal Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing cloud desktop video playback methods face issues with high CPU consumption and network bandwidth usage, leading to poor playback experiences due to inefficient handling of video playback windows and cloud desktop application windows, resulting in delays and blocking relationships.

Innovation Solution

The method involves receiving video data and cloud desktop picture streams, determining and rendering a combined picture to be displayed, which includes fusing video data with cloud desktop picture streams and using position information to ensure proper alignment and rendering, thereby avoiding separate rendering of video and cloud desktop picture streams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video files are directly played and rendered in the cloud desktop, then video playback quality is improved, but CPU consumption and network bandwidth usage increase significantly

Engineering Contradiction:
Improvevideo playback qualityVSAvoidCPU consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts the video rendering function from the cloud desktop system and relocates it to the terminal device. The cloud desktop system sends video data and playback area information to the terminal, which then renders the video locally. This extraction resolves the contradiction by maintaining high video quality while eliminating the high CPU consumption and network bandwidth usage that would occur if rendering happened in the cloud desktop.

Inventive Principle:
Principle #2Taking out (Extraction)

2Use of energy by moving object

If video data is redirected to terminal for playback, then CPU consumption is reduced, but blocking relationships between video playback window and cloud desktop application window cause delays

Engineering Contradiction:
ImproveCPU consumptionVSAvoidplayback delay
Core Design Contradiction:
Use of energy by moving objectVSLoss of time

Solution Approach 1:

The patent merges the video playback window management with the cloud desktop application window management at the terminal level. The terminal receives both video data and cloud desktop picture stream, determines the video playback area based on received position information, and renders both video and application windows in a coordinated manner. This merging eliminates the blocking relationships and delays that occur when video and application windows are handled separately, while maintaining the CPU efficiency benefits of terminal-based rendering.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If separate rendering of video and cloud desktop picture streams is performed, then rendering flexibility is improved, but display effect and coordination between windows deteriorate

Engineering Contradiction:
Improverendering flexibilityVSAvoiddisplay effect
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent introduces position information as an intermediary that coordinates between video data and cloud desktop picture stream. The terminal receives position information indicating the video playback area, uses this intermediary information to determine where to render the video window, and ensures proper spatial coordination between video and application windows. This intermediary mechanism maintains rendering flexibility while achieving precise display effects and proper window coordination.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240414399A1Cloud desktop display method, terminal, cloud desktop system, device, and readable medium
Publication Date: 2024.12.12 ZTE CORP
  • US20240414399A1 patent drawing
  • US20240414399A1 patent drawing
  • US20240414399A1 patent drawing

AI summary

Provided in the present disclosure is a cloud desktop display method, including: receiving video data, cloud desktop video playback area information and a cloud desktop picture stream sent from a cloud desktop system; determining a picture to be rendered according to the video data, the cloud desktop video playback area information and the cloud desktop picture stream; and rendering the picture to be rendered and displaying the rendered picture. Further provided in the present disclosure are a terminal, a cloud desktop system, an electronic device, and a computer-readable medium.