Dynamic Screen Transfer Mode Selection for Virtual Desktop GPU Load

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In virtual desktop systems, the simultaneous use of graphics processing unit (GPU) for screen encoding and other processes leads to delays, reducing user operability due to increased response time.

Innovation Solution

An image processing apparatus that dynamically selects between moving image and still image transfer processes based on the frame rate and GPU processing load, optimizing screen transfer by using either moving image transfer mode or still image and moving image transfer mode to manage GPU resources effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the GPU is used for both screen encoding and other image processing tasks simultaneously, then the processing capacity and versatility of the system is improved, but the response time increases and user operability deteriorates

Engineering Contradiction:
ImproveGPU processing capacityVSAvoidResponse time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent segments the screen transfer process into two independent transfer processes: a first transfer process for moving image data and a second transfer process for still image data. This segmentation allows the system to handle different types of image data through separate pathways, preventing resource contention and reducing response time when the GPU is engaged in other tasks.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic selection between the first and second transfer processes based on real-time monitoring of GPU state and frame rate. The control process dynamically switches between transfer modes depending on system conditions, allowing the system to adapt to varying GPU availability and optimize response time under different operating scenarios.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If the frame rate of screen transfer is increased to improve user operability, then the responsiveness is improved, but the network bandwidth consumption increases

Engineering Contradiction:
ImproveUser operabilityVSAvoidNetwork bandwidth
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The patent separates screen transfer into moving image data transfer and still image data transfer processes. This segmentation enables the system to transmit only necessary image data at high frame rates while excluding redundant information, thereby improving user operability through smoother display without proportionally increasing network bandwidth consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the transfer parameters dynamically by selecting between different transfer processes based on frame rate and GPU state. When frame rate is high, the system optimizes the transfer process to maintain quality while managing bandwidth, and adjusts parameters based on real-time system conditions to balance user operability with network efficiency.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If the system uses still image transfer mode to reduce network bandwidth, then the network efficiency is improved, but the image quality and frame rate performance deteriorates

Engineering Contradiction:
ImproveNetwork bandwidthVSAvoidImage quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent segments the transfer process into separate moving image and still image transfer pathways. This allows the system to use still image transfer mode for static content to reduce bandwidth while maintaining image quality through dedicated still image processing, and switch to moving image transfer mode when motion content requires higher bandwidth, thus balancing network efficiency with image quality.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11557018B2Image processing apparatus and computer-readable recording medium storing screen transfer program
Publication Date: 2023.01.17 FUJITSU LTD
  • US11557018B2 patent drawing
  • US11557018B2 patent drawing
  • US11557018B2 patent drawing

AI summary

An image processing apparatus of transferring a display image to a client machine, the display image being an image to be displayed on a display device associated with the client machine, the image processing apparatus including: a memory; and a processor coupled to the memory, the processor being configured to perform processing, the processing including: executing a first transfer process configured to transfer only moving image data as the display image; executing a second transfer process configured to transfer moving image data and still image data as the display image; and executing a control process configured to select either the executing of the first transfer process or the executing of the second transfer process, by using a frame rate of the display image and a state of a graphics processing unit (GPU) circuitry configured to perform a process related to an image.