Paravirtual Display Model for Virtual Machine Framebuffer Posting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtualized graphics processing unit (GPU) systems, such as those using Single Root I/O Virtualization (SR-IOV), are unable to directly post display requirements to local display hardware or expose guest frame buffers to the host, limiting their ability to drive local displays and remote display configurations, especially in In-Vehicle Infotainment (IVI) systems and Cloud servers.

Innovation Solution

A paravirtualization (PV) virtual display model is introduced, allowing virtual machines to directly post framebuffers to local displays or share them with the host by using a framebuffer descriptor page, which invokes a backend display service to configure hardware through a physical function driver, enabling scalable and efficient display support across different operating systems, including real-time operating systems (RTOS).

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If SR-IOV is used to implement virtualized GPU, then virtual machine can access GPU resources, but the virtual machine cannot directly post display requirements to local display hardware or expose guest frame buffers to the host

Engineering Contradiction:
Improvedisplay configuration capabilityVSAvoiddisplay posting capability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a paravirtualization display model that acts as an intermediary between the virtual machine and the display hardware. The VF GPU posts display requirements to a paravirtual display driver, which then interfaces with the host display service, enabling indirect but functional access to display capabilities without direct hardware posting

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The display functionality is segmented into separate components: the VF GPU handles graphics rendering, the paravirtual display driver manages display protocol translation, and the host display service coordinates with physical display hardware. This segmentation allows each component to operate independently while maintaining overall display functionality

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If a paravirtualization display model is introduced to enable direct framebuffer posting, then display configuration flexibility improves, but system complexity increases

Engineering Contradiction:
Improvedisplay configuration flexibilityVSAvoidvirtualization architecture complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The paravirtualization display model provides universal support for multiple operating systems and display configurations through a single standardized interface. The host display service can manage both local and remote display connections, and support multiple guest OS types, reducing the need for OS-specific virtualization implementations

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses framebuffer descriptor pages that are copied and shared between the guest virtual machine and the host system. This allows the guest OS to post framebuffers as if having direct hardware access, while the host maintains control and can redirect these framebuffers to appropriate display devices

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12020054B2Apparatus and method for a virtualized display
Publication Date: 2024.06.25 INTEL CORP
  • US12020054B2 patent drawing
  • US12020054B2 patent drawing
  • US12020054B2 patent drawing

AI summary

Apparatus and method for implementing a virtual display. For example, one embodiment of a graphics processing apparatus comprises at least one configuration register to store framebuffer descriptor information for a first guest running on a first virtual machine (VM) in a virtualized execution environment of a host processor, the framebuffer descriptor information to indicate one or more display pipes assigned to the first guest; and execution circuitry to execute a first driver assigned to the first guest, the first guest to use the first driver to display a framebuffer in a plane associated with one of the display pipes in accordance with the framebuffer descriptor information.