Graphics Plane Virtualization for Automotive Display Flexibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current automotive display systems using Single-root Input/output Virtualization (SRIOV) face limitations in flexibility due to hardware-accelerated virtualization, which restricts dynamic display assignment and increases complexity, particularly in accommodating diverse customer designs.

Innovation Solution

Implementing a graphics processing system with a plane-based assignment method that allows multiple virtual machines to share display resources, using a global graphics translation table (GGTT) to allocate large address spaces and eliminate the need for host composition, enabling flexible and efficient display virtualization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If hardware-accelerated virtualization is used to isolate functions, then performance and code complexity are improved, but flexibility in display assignment deteriorates

Engineering Contradiction:
ImproveperformanceVSAvoidflexibility in display assignment
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The display system is segmented into multiple independent display planes (e.g., plane 0, plane 1, plane 2) that can be independently assigned to different virtual machines. Each plane operates as a separate rendering target with its own framebuffer, allowing flexible allocation of display resources to multiple guests simultaneously while maintaining isolation and performance.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If hardware-accelerated virtualization is used to isolate functions, then code complexity is reduced, but flexibility in display assignment deteriorates

Engineering Contradiction:
Improvecode complexityVSAvoidflexibility in display assignment
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The display controller is designed with universal plane assignment capability, where any display plane can be assigned to any virtual machine dynamically. The system uses a unified plane assignment mechanism that supports multiple assignment modes (exclusive, shared, composite) and can accommodate different customer designs and display configurations without requiring separate hardware paths for each scenario.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If multiple virtual machines share display resources, then flexibility is improved, but latency and overhead increase

Engineering Contradiction:
ImproveflexibilityVSAvoidlatency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system implements dynamic plane assignment where display planes can be hot-swapped between virtual machines without system restart. The plane assignment is controlled through runtime configuration (e.g., IGT tools, device tree) allowing the system to adapt to changing display requirements while maintaining low latency through direct hardware access for each VM to its assigned planes.

Inventive Principle:
Principle #15Dynamics

4Reliability

If dedicated display planes are allocated, then security is enhanced, but resource utilization may deteriorate

Engineering Contradiction:
ImprovesecurityVSAvoidresource utilization
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system provides dynamic plane assignment that can switch between dedicated and shared modes based on workload requirements. When security is paramount, planes can be exclusively assigned to specific VMs. When resource utilization is prioritized, planes can be shared or composite-displayed across multiple VMs. This dynamic flexibility allows the system to optimize both security and resource efficiency depending on operational context.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11514550B2Apparatus and method for display virtualization using mapping between virtual and physical display planes
Publication Date: 2022.11.29 INTEL CORP
  • US11514550B2 patent drawing
  • US11514550B2 patent drawing
  • US11514550B2 patent drawing

AI summary

An apparatus and method for managing pipes and planes within a virtual graphics processing engine. For example, one embodiment of a graphics processing apparatus comprises: a graphics processor comprising one or more display pipes to render one or more display planes, each of the one or more display pipes comprising a set of graphics processing hardware resources for executing graphics commands and rendering graphics images in the one or more display planes; and pipe and plane management hardware logic to manage pipe and plane assignment, the pipe and plane management hardware logic to associate a first virtual machine (VM) with one or more virtual display planes and to maintain a mapping between the one or more virtual display planes and at least one physical display plane.