Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

2472 results about "Scheduling (computing)" patented technology

In computing, scheduling is the method by which work is assigned to resources that complete the work. The work may be virtual computation elements such as threads, processes or data flows, which are in turn scheduled onto hardware resources such as processors, network links or expansion cards.

Scheduling automation system application state management method

The invention relates to the technical field of dispatching automation, and discloses a dispatching automation system application state management method which comprises the following steps: dynamic task state management: monitoring dynamic state indexes of various computing tasks in real time; according to different characteristics of task types, making differentiated priority management strategies; the task priority is dynamically adjusted, and it is ensured that key tasks are preferentially and efficiently executed; dynamic resource state management: continuously monitoring dynamic state indexes of various computing resources, wherein the dynamic state indexes comprise utilization rates and load conditions; dynamically adjusting a resource allocation scheme according to the resource state; dynamically optimizing resource allocation to ensure that the overall resource utilization rate of the system is continuously improved; and optimizing a self-adaptive scheduling strategy: introducing a self-adaptive scheduling algorithm based on reinforcement learning. According to the application state management method of the dispatching automation system, dynamic state management is adopted, a traditional static dispatching mode is abandoned, and the method can better adapt to a complex and changeable computing environment.
Owner:STATE GRID XINJIANG ELECTRIC POWER CO LTD CHANGJI POWER SUPPLY CO

Federated distributed graph-based computing platform with hardware management

A federated distributed AI reasoning and action platform utilizing decentralized, partially observable hierarchical computing for neuro-symbolic reasoning. It features a federated Distributed Computational Graph (DCG) system integrating core components like pipeline orchestration, transformers, and marketplaces. The platform enables privacy-preserving dynamic resource allocation, intelligent task scheduling, and variable information sharing across diverse computing environments. By coordinating with an AI-based operating system and analyzing performance metrics, environmental conditions, and resource availability, the system optimizes efficiency across AI workloads and decision-making processes. This results in an adaptive, power-efficient, and scalable AI-enabled data processing system capable of handling complex tasks while maintaining peak performance under various operating conditions.
Owner:QOMPLX INC

Method for evaluating real-time performance of computing power network based on analytic hierarchy process

The invention relates to the technical field of computer networks, and discloses a computing power network real-time performance evaluation method based on an analytic hierarchy process, and the method comprises the steps: collecting a node operation state and task demand data through a sensor, and generating a local performance index in combination with an edge quantum algorithm; simulating a future network state by using digital twinning, and fusing to generate a multi-dimensional performance data set; the AHP weight is dynamically adjusted based on resource deviation and a geological classification model, high-frequency updating is started for high load / fault, and the weight range is expanded for low load; introducing a risk assessment algorithm to quantify a performance-cost-carbon effect conflict level, and triggering resource recovery, optimization prompt or single index suggestion; scheduling strategies are triggered in a grading mode according to evaluation results, and active intervention is started in combination with anomaly detection; the AHP weight is dynamically updated through reinforcement learning, and quantum-classical hybrid algorithm parameters and block chain verification weight are automatically optimized. The real-time response efficiency and the resource utilization rate of the computing power network can be improved.
Owner:GUANGZHOU ZHANGDONG INTELLIGENT TECH CO LTD

Computing system and method for GPU (Graphics Processing Unit) computing power scheduling

The invention provides a computing system and method for GPU computing power scheduling, and the method comprises the following steps: 1, obtaining computing task data, and carrying out the information collection of each task through receiving a to-be-processed computing task queue; according to the invention, through task information collection and deep analysis, and GPU resource omnibearing monitoring and workload prediction, deep understanding of tasks and GPU resources is realized, highly accurate computing power distribution can be carried out, resource waste is avoided, and the resource utilization rate is improved; advanced technologies such as a knowledge graph, mixed integer programming and deep reinforcement learning are fused through the intelligent scheduling model, the fusion mode is innovative in the GPU computing power scheduling field, the limitation of singleness of a traditional scheduling model is overcome, the method can better adapt to a complex and changeable computing environment, the task execution efficiency is optimized, and the task scheduling efficiency is improved. The adaptability and competitiveness of the whole system in a complex environment are remarkably improved, and an excellent solution is provided for the GPU computing power scheduling problem in the field of high-performance computing.
Owner:HUNAN EXCELLENT INTELLIGENT COMPUTING TECHNOLOGY CO LTD

Computing resource optimization method and system for analyzing tasks

The invention provides a computing resource optimization method and system for analysis tasks, and belongs to the technical field of computers.The computing resource optimization method comprises the steps that the priority of each analysis task is determined according to feature information of each analysis task and current available computing resource state information of the system, and a priority queue is generated; obtaining a task load prediction value according to the historical task load data and the real-time system state data; according to the type of the analysis task, the data scale and the data source position, the analysis task with the real-time requirement higher than a preset standard is allocated to an edge node to be executed, and resource allocation of the edge node is dynamically adjusted according to a task load predicted value; and dynamically allocating available resources from the computing resource pool according to the priority queue and the task load prediction value so as to execute the plurality of parallel analysis tasks. According to the resource management method based on task priority dynamic adjustment, task load prediction and edge computing optimization scheduling, real-time prediction and dynamic self-adaptive scheduling of computing resources are achieved.
Owner:INSPUR TIANYUAN COMM INFORMATION SYST CO LTD

GPU computing power scheduling method based on one-cloud multi-core heterogeneous computing power platform

The invention provides a GPU computing power scheduling method based on a one-cloud multi-core heterogeneous computing power platform, and the method comprises the following steps: S1, carrying out heterogeneous resource registration and modeling, accessing hardware equipment containing multiple types of GPUs through a resource registration module, collecting the equipment model, the video memory capacity and performance index data, and carrying out heterogeneous resource modeling; constructing a resource feature database containing a topological relation, and supporting hybrid access of chips; s2, virtualized resource reconstruction: pooling a physical GPU into virtual GPU resources by adopting a hardware abstraction layer technology, realizing video memory isolation and calculation unit division through a containerization technology, and configuring each virtual GPU instance with an independent drive stack and a security sandbox; and S3, submitting a multi-modal task, receiving a CUDA / OpenCL calculation task submitted by a user, analyzing task demand parameters including a calculation core number, a video memory occupation amount and a data throughput threshold, and generating a task descriptor containing a priority label.
Owner:SAISI TECH (XIAN) CO LTD

Heterogeneous resource computing power intelligent scheduling method and system

The invention relates to the technical field of computing power scheduling, and discloses a heterogeneous resource computing power intelligent scheduling method and system. According to the method, real-time state monitoring is conducted on heterogeneous computing resources, and resource state parameters such as the computing unit utilization rate and the memory occupancy rate are obtained; task attributes and user request parameters of the task queue are collected, historical task data are processed based on the genetic algorithm optimization model to execute task demand prediction, and predicted demand parameters are generated. A dependency graph containing resource unit nodes and communication link roadsides is constructed through a resource topology analysis tool, predicted demand parameters are input into a scheduling priority classifier trained by a graph neural network, and an actual scheduling priority is identified. And executing resource conflict prediction based on the priority, inputting task feature vectors into a conflict resolution module of a fuzzy logic decision maker, outputting actual conflict resolution parameters, and finally integrating to generate a scheduling scheme containing a resource allocation sequence and an execution time table.
Owner:BEIJING WEICHENG TECHNOLOGY CO LTD

Intelligent large-scale task scheduling method and system based on computing power host business characteristics

The invention discloses an intelligent large-scale task scheduling method and system based on computing power host business characteristics, and belongs to the technical field of cloud computing and edge computing, and the method comprises the following steps: data acquisition and preprocessing of tasks and computing power host nodes; performing multi-dimensional quantitative analysis on the task business characteristics; dynamically monitoring the performance state of the computing power host node; constructing and optimizing a dynamic computing power matching model; task scheduling is optimized in an auxiliary mode based on an intelligent prediction mechanism; and finally distributing and executing the task. The problems that when an existing computing power host processes large-scale concurrent tasks, due to the fact that a scheduling strategy lacks accurate recognition and adaptation on different service characteristics, resources are wasted, tasks are stacked, and response is delayed are solved. The utilization rate of computing power resources can be improved, task response delay is reduced, and user experience and system overall performance are improved.
Owner:INSPUR COMM TECH CO LTD

Large model scheduling method and device based on NPU computing power

The invention relates to a large model scheduling method and device based on NPU computing power, and the method specifically comprises the steps: splitting a large model into a plurality of subtasks according to layers, and analyzing the dependency relationship between the subtasks; performing operation demand prediction on the large model and the subtasks to obtain an operation amount factor and a memory demand factor; training a computing power evaluation model, and predicting real-time computing power evaluation data of each NPU node; selecting a scheduling strategy, calculating the initial priority of each to-be-scheduled sub-task according to the scheduling strategy, and allocating each sub-task to an optimal NPU node for execution by using a greedy algorithm in combination with resource demand information and NPU computing power evaluation data; and monitoring the operation condition of the subtask on each NPU node in real time, and when the execution of the subtask is abnormal, triggering an alarm and taking countermeasures. Compared with the prior art, the method has the advantages that the NPU resource utilization rate and the computing power scheduling efficiency are improved, and the equipment safety is guaranteed.
Owner:SHANGHAI DRAGONNET TECH +1

Distributed computing power scheduling method and system based on dynamic load balancing

The invention relates to the technical field of distributed computing, and discloses a distributed computing power scheduling method and system based on dynamic load balancing. The method comprises the following steps: acquiring real-time resource state data of a plurality of nodes in the distributed system and demand characteristics of a task to be allocated, generating a dynamic task allocation strategy, allocating the task to a target node for execution, monitoring a resource state of the target node in real time, and triggering task reallocation when the resource state deviates from a preset threshold value. The system comprises a monitoring acquisition module, a task analysis module, a strategy generation module, a scheduling execution module and a resource abstraction module. According to the method, tasks and node resources can be accurately matched, the resource utilization rate is improved, the real-time performance and reliability of the tasks are guaranteed, the overall performance of a distributed system is optimized through heterogeneous resource unified scheduling and a resource reserving and recycling mechanism, and the method is suitable for various distributed computing scenes.
Owner:SHANGHAI YUSUAN INTELLIGENT TECHNOLOGY CO LTD

Computing power scheduling method and system based on dynamic load prediction and resource priority ranking

The invention discloses a computing power scheduling method and system based on dynamic load prediction and resource priority ranking. The computing power scheduling method comprises the following steps: collecting historical load data, task submission data and resource state data of each node in a computing power cluster; on the basis of the preprocessed multi-dimensional load feature data set, constructing an improved hybrid prediction model, optimizing model parameters through training, and predicting the load change trend of each computing power node in a future preset time period by using the trained model to obtain a node load prediction result; extracting a service level protocol parameter, a resource demand type and historical execution efficiency data of a to-be-scheduled task, and establishing a multi-dimensional resource priority evaluation index system; according to the computing power scheduling method, the problems of low resource utilization rate and high task response delay caused by low load prediction precision and mismatching of resource allocation and task priority in a traditional computing power scheduling method are solved, and the overall operation efficiency and service quality of a computing power cluster are improved.
Owner:SHAOGUAN DATA IND RESEARCH INSTITUTE

Task collaborative scheduling method and apparatus, device and medium

The present application relates to the field of information collaborative processing. Provided are a task collaborative scheduling method and apparatus, a device and a medium. The task collaborative scheduling method is applied to a collaborative computing system comprising a plurality of nodes, and the method comprises: first, on the basis of original task description information of a target task, performing splitting and orchestration on the target task to obtain a plurality of sub-tasks and a task logic topological relationship between the sub-tasks; then allocating, on the basis of node information of the nodes, from the collaborative computing system a corresponding execution node for each sub-task, and generating sub-task description information; and finally, issuing the sub-task description information to the execution nodes, such that all the execution nodes can complete all the sub-tasks according to the orchestrated logic topological relationship, thereby obtaining an output result of the target task. The present application can cover diversified task collaborative scheduling scenarios and enables compatibility with access and scheduling of devices having different capabilities, thereby meeting the collaborative processing requirements for diverse service types and scales.
Owner:PENG CHENG LAB

Federated distributed graph-based computing platform

A federated distributed AI reasoning and action platform utilizing decentralized, partially observable hierarchical computing for neuro-symbolic reasoning. It features a federated Distributed Computational Graph (DCG) system integrating core components like pipeline orchestration, transformers, and marketplaces. The platform enables privacy-preserving dynamic resource allocation, intelligent task scheduling, and variable information sharing across diverse computing environments. By coordinating with an AI-based operating system and analyzing performance metrics, environmental conditions, and resource availability, the system optimizes efficiency across AI workloads and decision-making processes. This results in an adaptive, power-efficient, and scalable AI-enabled data processing system capable of handling complex tasks while maintaining peak performance under various operating conditions.
Owner:QOMPLX INC

Dynamic scheduling method for cloud computing resource pool

The invention discloses a dynamic scheduling method for a cloud computing resource pool in the technical field of cloud computing. Comprising the following steps: S1, analyzing resource demands; s2, performing performance prediction on the resource pool through load prediction; s3, predicting task demand resources; s4, resource allocation decision making; s5, task scheduling; and S6, resource monitoring and feedback. According to the invention, load prediction is carried out through the long-short-term memory network, an adaptive mechanism is introduced, and a load prediction model is updated along with continuous change of data, so that the accuracy is improved; the resource demand of the task is predicted through a machine learning algorithm, a reasonable resource allocation decision is made according to the state of the current resource pool and the resource demand predicted by the task, the utilization rate of the resource is improved, stable operation calculation of the task is guaranteed, efficient task allocation and scheduling are achieved, resource utilization maximization is guaranteed, and the resource utilization rate is increased. And the change of the system load is effectively responded.
Owner:YANGZHOU POLYTECHNIC INST

Task scheduling method, system and device based on cloud computing and storage medium

The embodiment of the invention provides a task scheduling method, system and device based on cloud computing and a storage medium, and belongs to the technical field of computers. According to the method, task priorities are initialized according to task resource requirements, task types and task timeliness requirements, task scheduling strategies are determined according to task metadata and computing resource information, the task metadata comprise the task priorities and the task resource requirements, and the task scheduling strategies are used for representing task scheduling sequences and task allocation objects; task scheduling is carried out according to the task scheduling strategy, load fluctuation information and task demand change information of each computing node are obtained, the task scheduling strategy is adjusted according to the load fluctuation information and the task demand change information, and the step of task scheduling according to the task scheduling strategy is repeatedly executed, so that the task scheduling efficiency is improved in the task execution process. Task scheduling and allocation are adaptively adjusted based on load changes and task demand changes, and the task execution efficiency and the system resource utilization rate are improved.
Owner:CHINA TELECOM CORP LTD

Heterogeneous computing node task scheduling method and system based on intelligent algorithm

The invention discloses a heterogeneous computing node task scheduling method and system based on an intelligent algorithm, the core idea is that task load prediction, node state monitoring and an intelligent scheduling algorithm are combined to realize efficient matching and load balancing of tasks and computing nodes, and the method mainly comprises task load prediction, node resource evaluation and scheduling strategy optimization. The method aims at achieving efficient matching and load balancing of tasks and computing nodes through an intelligent algorithm (reinforcement learning and a genetic algorithm are combined), and particularly optimizing the utilization rate of computing resources and the task execution efficiency under the condition that a dynamic computing environment and resources are limited.
Owner:EAST CHINA INST OF COMPUTING TECH

Multi-hardware mixed large model reasoning method, system and related device

The invention discloses a multi-hardware mixed large model reasoning method and system and a related device, which are used for improving the reasoning efficiency and flexibility of a complex modal task. The method comprises the following steps: decomposing a target reasoning task in a task queue according to structure information of a multi-modal large model and modal change characteristics of different task stages to obtain a plurality of sub-tasks and a plurality of calculation units corresponding to each sub-task; formulating a scheduling strategy according to the hardware adaptation report and the task resource demand, and allocating the computing unit to proper hardware for execution according to the scheduling strategy; performing dynamic modal change monitoring by using a multi-modal semantic fusion model and a time sequence prediction model in a task execution process, analyzing a modal change trend in the task execution process in real time, and dynamically adjusting a scheduling strategy according to the modal change trend; after all the subtasks are completed, results of the subtasks are merged and verified, and a final reasoning result is output.
Owner:SHENZHEN EXTREME VISION TECH CO LTD

Heterogeneous computing power scheduling method and device, equipment, storage medium and product

The invention relates to the technical field of computers, in particular to a heterogeneous computing power scheduling method and device, equipment, a storage medium and a product. The method comprises the following steps: generating an equipment topological graph based on equipment information in a node resource pool; performing partition management on the computing devices in the device topological graph; based on a partition management result, analyzing the to-be-calculated task through a preset flow gateway, and determining a task request data position, a task scale and a task feature; determining a to-be-calculated node according to the task request data position, the task scale and the task feature; and distributing the to-be-calculated task to the to-be-calculated node, and generating a target scheduling strategy based on the real-time performance index and the historical execution data of the to-be-calculated node. According to the method, the utilization efficiency of computing resources is improved by generating the equipment topological graph and performing partition management, the scheduling strategy is optimized by combining real-time performance data, it is ensured that scheduling optimization can be performed according to the real-time state, and the effect of heterogeneous computing power scheduling is improved.
Owner:MATRIX ORIGIN (SHENZHEN) INFORMATION TECHNOLOGY CO LTD

Self-adaptive deployment method and system oriented to credential heterogeneous environment

The invention relates to the technical field of automatic deployment of cloud computing platforms, in particular to a self-adaptive deployment method and system oriented to a credential heterogeneous environment. Aiming at three technical bottlenecks of low multi-CPU architecture adaptation efficiency, frequent software dependence conflicts and complex security baseline configuration in a localization process, a heterogeneous computing resource intelligent scheduling engine and a dynamic security policy generation mechanism are innovatively provided. The method comprises the following steps: constructing a heterogeneous resource portrait through a hardware feature automatic identification technology, and realizing component installation sequence optimization based on a DAG dependency relationship analysis algorithm and Kahn topological sorting; and creating an adaptive network security policy, and sensing the firewall state of the target system in real time through a probe. Compared with a traditional deployment mode, the method supports cross-architecture compatibility, solves the problem of dependency conflicts, improves deployment efficiency, and guarantees consistency and safety of the system.
Owner:TONGFANG KNOWLEDGE DIGITAL PUBLISHING TECH CO LTD

Multi-level heterogeneous computing power network task scheduling and resource allocation method and system

The invention provides a multi-level heterogeneous computing power network task scheduling and resource allocation method and system. In a computing power network, each hierarchical network is connected with an intelligent agent for task scheduling and resource allocation. In the training process, the intelligent agent obtains local observation information of the computing power node in the hierarchical network. And the intelligent agent aggregates and converts local observation information according to the relation feature map to generate a feature matrix and an adjacent matrix. Local feature embedding is calculated by using a graph convolutional network, and feature aggregation is carried out in combination with information of a cooperative agent to obtain a local embedding state; and the intelligent agent executes a joint action according to the local embedding state, wherein the joint action comprises task scheduling and resource allocation. And according to an execution result, the agent obtains a reward value and state information and stores the reward value and the state information into an experience playback buffer area. And sampling data from a buffer area, and updating a value function and strategy parameters by taking optimization of calculation task completion time and resource use efficiency as a target. And after a preset training round, obtaining a trained model. The resource overhead of information interaction can be reduced, and the scheduling efficiency is improved.
Owner:BEIJING UNIV OF POSTS & TELECOMM

Hyper-computing center computing task dynamic scheduling method and system based on artificial intelligence

The invention provides a supercomputing center computing task dynamic scheduling method and system based on artificial intelligence, and the method comprises the steps: firstly obtaining a current to-be-processed computing task request data set of a supercomputing center, and extracting a task feature set of each computing task; calling a pre-trained task scheduling strategy decision model to analyze the task feature set, generating a real-time scheduling priority parameter and a resource allocation constraint condition set of the calculation task, and calculating the task feature set based on the real-time scheduling priority parameter and the resource allocation constraint condition set of the calculation task; according to the method, the dynamic resource allocation instruction set of the computing nodes of the super-computing center is generated, the computing nodes are controlled to execute the task scheduling operation, intelligent and efficient scheduling of the computing tasks of the super-computing center is achieved by updating the resource occupancy state of the computing nodes and the task queue execution progress in real time, and the resource utilization rate and the task execution efficiency are remarkably improved.
Owner:POWERCHINA RAILWAY CONSTR +2

Calculation task scheduling method and device in multivariate heterogeneous environment and medium

The invention discloses a computing task scheduling method and device in a multivariate heterogeneous environment and a medium, and relates to the technical field of parallel computing. The method comprises the following steps: monitoring resource states of various computing resources in a multivariate heterogeneous environment in real time, and quantifying the resource states to obtain corresponding resource information; under the condition that the to-be-processed calculation task is generated in the scheduling task list, performing demand analysis on the to-be-processed calculation task to determine a task demand report; calculating the task demand report and the resource information by using a preset scheduling strategy generation model to generate an intelligent scheduling strategy; according to the intelligent scheduling strategy, various computing resources are called to execute the to-be-processed computing task; and continuously monitoring the scheduling task list and the resource state so as to update the intelligent scheduling strategy corresponding to the to-be-processed calculation task based on the scheduling strategy strategy optimization logic.
Owner:SHANDONG INSPUR SCI RES INST CO LTD

Intelligent computing power scheduling method in distributed computing environment

The invention provides an intelligent computing power scheduling method in a distributed computing environment, and relates to the technical field of distributed computing, and the intelligent scheduling method specifically comprises the steps of collecting resource information data, constructing a resource and task model, evaluating a computing power demand, formulating an adjustment strategy, distributing and scheduling the computing power, monitoring and adjusting in real time, and feeding back and optimizing. Through comprehensive modeling and dynamic computing power evaluation of computing nodes and tasks and in combination with multiple intelligent scheduling strategies, accurate allocation of computing power resources can be realized, the problems of resource waste and node load imbalance are effectively avoided, the overall utilization rate of resources in a distributed computing environment is remarkably improved, and the computing power of the distributed computing environment is improved according to the characteristics and requirements of the tasks. The execution nodes are reasonably selected, the resource allocation is optimized, the task correlation is considered, the data transmission overhead is reduced, the task execution speed can be increased, the task completion time can be shortened, and the processing capacity and response speed of the system are improved.
Owner:NAT IND INFORMATION SECURITY DEV RES CENT

GPU heterogeneous computing resource allocation method and system based on task scheduling

The invention provides a GPU heterogeneous computing resource allocation method and system based on task scheduling, and the method comprises the steps: carrying out the feature analysis of a to-be-scheduled task, so as to extract the calculation intensity, video memory demands, inter-task data dependence and historical execution data of the to-be-scheduled task, and obtaining a task feature vector; constructing a performance model of heterogeneous GPU resources to predict execution efficiency and resource consumption of the GPU under the target task based on hardware performance parameters and running states of the GPU; and matching the to-be-scheduled task with the GPU resources according to the task feature vector and the performance model of the heterogeneous GPU resources. Through task feature analysis and GPU resource performance modeling, the adaptive relation between tasks and GPU resources can be deeply mined, to-be-scheduled tasks are accurately allocated to the most appropriate GPU, the resource utilization rate is greatly increased, the task execution sequence and resource allocation are dynamically planned, and the task execution time is effectively shortened.
Owner:HEFEI SUMICROELECTRONICS TECH CO LTD

Edge node scheduling method and system based on sinking distributed network

PendingCN119276943ASolving Data Consistency IssuesTransmissionData synchronizationEdge node
The invention provides an edge node scheduling method and system based on a sinking distributed network. The method comprises the following steps: determining a scheduling strategy of an edge node based on a preset load balancing algorithm; receiving a service request from the terminal equipment; identifying a proper service node based on the data type of the service request; distributing the service node to process the service request; and adjusting the scheduling strategy based on the real-time monitored data feedback. Through the scheme of the embodiment of the invention, the problem of data consistency caused by insufficient data synchronization mechanism under the condition of high concurrent requests can be solved. And the problem of communication delay increase caused by lack of an adaptive routing protocol under the condition of dynamically changing network topology is solved. And the problem of computing resource waste caused by an unreasonable task allocation strategy under the condition of resource-limited edge nodes is solved. And under the condition of data intensive application, the problem of data processing bottleneck caused by an imperfect data caching mechanism is solved.
Owner:JIANGSU CLOUD FACTORY INFORMATION TECH CO LTD

Heterogeneous computing multi-target adaptive task scheduling method based on deep reinforcement learning

The invention discloses a heterogeneous computing multi-target adaptive task scheduling method based on deep reinforcement learning, and the method comprises the following steps: S1, constructing a multi-dimensional dynamic perception model of a heterogeneous computing environment, and collecting and computing node performance indexes, task feature parameters and network states in real time; s2, defining a reward function as a multi-target weighted combination, fusing task completion time, energy consumption, resource utilization rate and cost, and dynamically adjusting the weight by a fuzzy comprehensive evaluation algorithm; s3, establishing a dual-channel deep reinforcement learning network architecture based on an attention mechanism; s4, establishing an adaptive exploration mechanism, combining an epsilon-greedy strategy and entropy regularization, and balancing exploration and utilization; the method has the beneficial effects that dynamic balance of multiple indexes such as task completion time, energy consumption and resource utilization rate is realized through combination of deep reinforcement learning and multi-objective optimization, a dual-channel network and a cross attention mechanism are adopted, and a task time sequence characteristic and a topological dependency relationship are modeled at the same time, so that a scheduling strategy is more accurate.
Owner:王立强

Load-aware scheduling method of inference system and inference system

One or more embodiments of the invention provide a load-aware scheduling method of an inference system and the inference system. The method is applied to a global scheduler in the inference system. The inference system further comprises an inference engine. The inference engine comprises at least one computing instance deployed on each computing node in a computing cluster; computing resources of the computing examples comprise GPUs carried on the computing nodes where the computing examples are located; the global scheduler maintains dynamically updated GPU load information of each calculation instance; the method comprises the steps of obtaining a to-be-executed target reasoning request; based on the maintained GPU load information of each calculation instance, determining a target calculation instance of which the GPU load meets a preset condition; and sending the target reasoning request to the target calculation instance, so that the target calculation instance executes the target reasoning request.
Owner:ALIPAY (HANGZHOU) INFORMATION TECH CO LTD

Distributed computing power resource dynamic fusion and cooperative computing system

The invention relates to the related technical field of distributed computing power resources, and discloses a distributed computing power resource dynamic fusion and cooperative computing system which comprises a resource sensing module, a task analysis module, a dynamic scheduling module, a virtualization adaptation layer, a cooperative computing engine, a global controller and a hierarchical communication bus. The resource sensing module collects and quantifies the hardware computing power of the heterogeneous computing nodes in real time. According to the invention, a complete closed-loop control system is formed through a five-layer dynamic fusion architecture (a sensing layer, an analysis layer, a scheduling layer, a virtualization layer and a collaboration layer), so that a distributed computing system can adapt to a scene that edge nodes are dynamically added and pushed out; meanwhile, through the purpose of developing virtualization middleware supporting cross-platform instruction real-time conversion and based on a multi-target dynamic weight adjustment mechanism of online learning, the heterogeneous task scheduling success rate can be greatly improved through the overall structure of the system, and the fault recovery time is shortened.
Owner:ZHEJIANG WATONE CLOUD DATA TECH CO LTD

Large language model reasoning calculation service energy consumption optimization scheduling method based on task length prediction

The invention discloses a task length prediction-based large language model reasoning calculation service energy consumption optimization scheduling method, which comprises the following steps of: firstly, reasoning by taking an Alpaca-52k instruction data set as an input source and a large language model (such as Llama3-8B), counting the number of output tokens of the large language model, and labeling each piece of input data; then, a Qwen2-1. 5B large language model is finely tuned by using an Alpaca-52k instruction data set and the response length of Llama3-8B reasoning, and computing resources of the prediction method are reduced on the premise that the prediction performance is guaranteed; then, the response length of the Llama3-8B reasoning task is predicted through the fine-tuned Qwen2-1. 5B model, task balanced sorting scheduling is carried out according to the response length so as to improve the large language model reasoning speed, and finally, a deep reinforcement learning power selection algorithm is used to reduce the calculation power as much as possible on the premise that the large language model reasoning task time delay is met so as to improve the large language model reasoning efficiency. Therefore, the energy consumption of large language model reasoning calculation is reduced.
Owner:SOUTHEAST UNIV