On-Chip Resource Virtualization for QoS and VM Isolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing time-slice rotation scheduling algorithms in computer systems, particularly in artificial intelligence chips, fail to guarantee quality of service, isolation, and head-of-line blocking, leading to inefficient resource configuration and operation.
Innovation Solution
A virtualization method that divides resources of an on-chip system into multiple virtual components, allowing simultaneous use by multiple virtual machines, providing resource sharing, parallelism, isolation, and configuration flexibility through technologies like SR-IOV and QEMU.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If time-slice rotation scheduling is used to configure computer resources, then processor resources can be allocated to multiple processes, but quality of service, isolation and head-of-line blocking are not guaranteed
Solution Approach 1:
The patent segments the physical computing device into multiple virtual computing devices (first virtual computing device, second virtual computing device, etc.), each assigned to different processes. This segmentation enables independent resource allocation and execution contexts, eliminating head-of-line blocking and ensuring quality of service guarantees for each process while maintaining high resource utilization efficiency.
2Productivity
If time-slice rotation scheduling is used, then multiple processes can share processor resources, but isolation between processes is not guaranteed
Solution Approach 1:
The patent creates distinct virtual computing devices for each process, with each virtual device having its own independent resources and execution context. This segmentation ensures complete isolation between processes while allowing efficient resource sharing at the virtualization layer, resolving the contradiction between resource sharing capability and process isolation.
3Adaptability or versatility
If time-slice rotation scheduling is used, then processor resources can be dynamically allocated, but head-of-line blocking occurs
Solution Approach 1:
By segmenting the computing device into separate virtual instances, each process obtains dedicated resources without sharing. This eliminates head-of-line blocking that occurs in time-slice scheduling, while maintaining dynamic allocation capability through the virtualization framework. The operation efficiency is improved as processes execute without waiting for time-slice rotations.
4Reliability
If virtualization is implemented to provide isolation and security, then resource utilization is enhanced, but device complexity increases
Solution Approach 1:
The patent uses virtualization technology to create virtual copies of computing devices (first virtual computing device, second virtual computing device) that mirror the physical device's functionality. This copying approach provides isolation and security through virtual machine monitoring and management, while the virtualized architecture actually reduces physical hardware complexity by consolidating multiple physical devices into a single managed system.
Data Source
AI summary
The present disclosure relates to a method, device, a board card, and a computer-readable storage medium for virtualizing a computer framework, where the computer framework includes a user space, a kernel space and an on-chip system. The on-chip system includes a computing device, a video encoding and decoding device, a JPEG encoding and decoding device and a storage device, where the devices interact with the user space and the kernel space to jointly perform specified computing operations.