Virtual Context Caching for Hardware Resource Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In virtualization environments, existing systems face inefficiencies in sharing a limited number of physical resources among multiple virtual machines, as not all virtual machines require these resources simultaneously, leading to underutilization and resource wastage.

Innovation Solution

A method and device that dynamically assign virtual contexts to available physical instances of a hardware resource, using a scheduler to manage access based on request timing, frequency, priority, and anticipated duration, allowing multiple virtual machines to share fewer physical instances efficiently, with the option to power off unused instances during low demand.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple physical instances of a hardware resource are provided for each virtual machine, then accessibility and resource availability are improved, but device complexity and resource cost increase

Engineering Contradiction:
Improveresource availabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Multiple virtual machine contexts are merged into a single physical instance through time-multiplexed sharing. The patent consolidates N physical instances into fewer shared instances by rapidly switching between virtual contexts, reducing the total number of physical resources needed while maintaining service availability for all virtual machines.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

A single physical instance is made universal by allowing it to serve multiple virtual machine contexts sequentially. The patent enables one physical instance to perform the functions of multiple physical instances by dynamically loading different virtual contexts, making the resource multi-functional and adaptable to different virtual machines' needs.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If fewer physical instances are shared among virtual machines, then device complexity is reduced, but resource utilization efficiency worsens due to underutilization

Engineering Contradiction:
Improvedevice complexityVSAvoidresource utilization efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The system implements periodic time-slicing where a single physical instance rapidly cycles through serving different virtual machine contexts. The patent uses periodic context switching to ensure each virtual machine receives regular access to the shared resource, maintaining high utilization efficiency while reducing the total number of physical instances required.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent introduces dynamic context switching mechanisms that allow the system to adaptively allocate the shared physical instance to different virtual machines based on current demand and priority. This dynamic allocation ensures high resource utilization efficiency by keeping the physical instance actively engaged with relevant virtual contexts rather than remaining idle or statically assigned.

Inventive Principle:
Principle #15Dynamics

3Use of energy by moving object

If physical instances are powered off during low demand, then energy consumption is reduced, but resource availability may be compromised

Engineering Contradiction:
Improveenergy consumptionVSAvoidresource availability
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The system performs preliminary context loading into memory before the physical instance is activated. The patent stores virtual contexts in advance in memory, allowing the physical instance to be quickly powered on and switched to a pre-loaded context when demand arises, minimizing startup delay and ensuring resource availability is maintained despite power cycling.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the operational state parameter of the physical instance between active and powered-off states based on demand conditions. By monitoring usage patterns and switching the power state accordingly, the system reduces energy consumption during low demand while maintaining the capability to rapidly restore availability when needed through context retrieval from memory.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10042659B1Caching virtual contexts for sharing of physical instances of a hardware resource
Publication Date: 2018.08.07 XILINX INC

AI summary

A method for providing access by a virtual context to a physical instance includes receiving a request to access a physical instance of a plurality of physical instances of a hardware resource of a device. The request is associated with a virtual machine of a plurality of virtual machines. The method next determines that one of the physical instances is available, and assigns a virtual context associated with the virtual machine to access the one of the physical instances when the one of the physical instances is available. The assigning comprises retrieving the virtual context from a memory of the device and loading the virtual context into the one of the physical instances. The method then stores the virtual context in the memory after the one of the physical instances is accessed by the virtual context.