This invention relates to the fields of
cloud computing,
artificial intelligence infrastructure, and container
resource scheduling technology, specifically an Agent-Schedule-based GPU
scheduling system. The
system includes: a Scheduler Center for receiving resource request and release requests from service callers, maintaining the real-time status of all hosts, GPUs, and containers in the cluster, generating and issuing container operation instructions, and
processing execution callbacks from Agent nodes; Agent Resource Nodes for registering their local GPU hardware information, periodically reporting container running status and resource usage, receiving and executing container operation instructions, and sending callbacks of execution results; and a
database for persistently storing resource configuration, running status, and instruction flow records, providing data support for global lock
concurrency control, instruction execution closed-loop, and container state
machine management. This solves the problems of slow resource
request response, low GPU memory utilization, and poor scheduling execution reliability in existing technologies.