Resource allocation method and device, electronic equipment and storage medium
By obtaining resource transaction configuration information and historical transaction data, and training decision generation models based on genetic search and reward functions, the problems of low efficiency and poor accuracy of existing resource allocation are solved, efficient and accurate resource allocation is achieved, and medical device inventory is reduced risk of loss.
Patent Information
- Application Number
- CN202411375925.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-29
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2044-09-29
AI Technical Summary
Existing resource allocation methods are inefficient and prone to human errors, especially in the risk of loss caused by market fluctuations in the allocation of medical device inventory, which requires improving the efficiency and accuracy of resource allocation.
By obtaining the resource transaction configuration information and historical transaction data of the target resource, genetic search is performed based on the candidate reward model, the target reward function is obtained, and the preset decision generation model is trained based on the target reward function to form an efficient resource allocation decision that can make efficient resource allocation decisions Target decision generation model.
It improves the efficiency and accuracy of resource allocation, reduces human errors, optimizes the reward value of resource allocation, and reduces the loss risk of inventory medical devices.
Smart Images

Figure CN119324039A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of artificial intelligence technology, and in particular to a resource allocation method and device, an electronic device, and a storage medium. Background Art
[0002] Resource allocation can be used to allocate production materials, equipment, funds, etc., as well as computer software resources and hardware resources. For example, it can allocate medical device products in inventory. Since the value of medical device inventory products is affected by market fluctuations and there are holding costs for inventory medical devices, there is a risk of loss for inventory medical device products. Therefore, it is necessary to allocate medical device products in a timely manner. The current resource allocation method is mainly manual inventory and allocation, which has low allocation efficiency and is prone to human errors. Therefore, how to improve the efficiency and accuracy of resource allocation has become an urgent problem to be solved. Summary of the invention
[0003] The main purpose of the embodiments of the present application is to propose a resource allocation method and device, an electronic device and a storage medium, aiming to improve the efficiency and accuracy of resource allocation.
[0004] To achieve the above object, a first aspect of an embodiment of the present application proposes a resource allocation method, the method comprising:
[0005] Obtain resource transaction configuration information of the target resource, and obtain historical transaction data of the target resource;
[0006] Acquire a candidate reward model based on the resource transaction configuration information;
[0007] Performing a genetic search based on the candidate reward model and the historical transaction data to obtain a target reward function;
[0008] Training a preset decision generation model based on the target reward function and the historical transaction data to obtain a target decision generation model;
[0009] The current resource transaction data of the target resource is acquired, and allocation decision is made on the current resource transaction data based on the target decision generation model to obtain target resource allocation data.
[0010] In some embodiments, performing a genetic search based on the candidate reward model and the historical transaction data to obtain a target reward function includes:
[0011] Performing chromosome encoding on the candidate reward model to obtain an initial function population;
[0012] Perform fitness screening on the initial function population according to the historical transaction data to obtain a first function population;
[0013] Performing crossover and mutation processing on the initial function population to obtain a second function population;
[0014] Performing a local search based on the second function population and the historical transaction data to obtain a third function population;
[0015] Performing population fitness replacement on the second function population according to the first function population to obtain a fourth function population;
[0016] Merging the populations according to the third function population and the fourth function population to obtain a merged function population;
[0017] The fitness of the combined function population is screened according to the historical transaction data to obtain the target reward function.
[0018] In some embodiments, the step of performing fitness screening on the combined function population according to the historical transaction data to obtain the target reward function includes:
[0019] Calculate the reward value of the merged function population according to the historical transaction data to obtain target reward value data;
[0020] Allocate resources to the historical transaction data according to the reward value data to obtain resource income data and resource withdrawal value data;
[0021] Performing fitness calculation according to the resource income data and the resource withdrawal value data to obtain population fitness data;
[0022] The combined function population is screened according to the population fitness data to obtain the target reward function.
[0023] In some embodiments, the step of calculating the reward value according to the combined function population and the historical transaction data to obtain target reward value data includes:
[0024] Calculating the resource reservation reward value for the merged function population according to the historical transaction data to obtain resource reservation reward value data;
[0025] Calculate the resource output reward value of the merged function population according to the historical transaction data to obtain resource output reward value data;
[0026] Calculate the resource input reward value of the merged function population according to the historical transaction data to obtain resource input reward value data;
[0027] The resource retention bonus value data, the resource output bonus value data, and the resource input bonus value data are used as the target bonus value data.
[0028] In some embodiments, the preset decision generation model includes experience samples, an initial decision layer, and an initial prediction layer; the experience samples include an execution action, a current state, and a next state; the preset decision generation model is trained based on the target reward function and the historical transaction data to obtain a target decision generation model, including:
[0029] Performing a decision evaluation according to the execution action, the current state and the initial decision layer to obtain initial decision evaluation data; wherein the initial decision evaluation data is used to indicate the rationality of the decision of the initial decision layer;
[0030] Performing prediction evaluation according to the execution action, the next state and the initial prediction layer to obtain initial prediction evaluation data; wherein the initial prediction evaluation data is used to indicate the rationality of the decision of the initial prediction layer;
[0031] Calculate a reward value according to the historical transaction data, the current state, the executed action, the next state, and the target reward function to obtain a training reward value;
[0032] Optimizing the parameters of the initial decision layer according to the training reward value, the initial prediction evaluation data and the initial decision evaluation data to obtain a target decision layer;
[0033] The target decision generation model is formed according to the experience samples, the target decision layer and the initial prediction layer.
[0034] In some embodiments, the step of optimizing parameters of the initial decision layer according to the training reward value, the initial prediction evaluation data, and the initial decision evaluation data to obtain a target decision layer includes:
[0035] Performing aggregate calculation based on the training reward value and the initial prediction evaluation data to obtain a training label value;
[0036] Performing mean square error calculation based on the training label value and the initial decision evaluation data to obtain a training loss value;
[0037] Optimize the parameters of the initial decision layer according to the training loss value to obtain the target decision layer.
[0038] In some embodiments, the acquiring a candidate reward model based on the resource transaction configuration information includes:
[0039] Perform semantic extraction on the resource transaction configuration information according to a preset semantic extraction model to obtain transaction loss data and transaction number limit data;
[0040] Constructing a loss model according to the transaction loss data to obtain a loss sub-model;
[0041] Constructing a restriction model according to the transaction number restriction data to obtain a restriction sub-model;
[0042] The candidate reward model is obtained by constructing a model based on the loss sub-model, the restriction sub-model, the preset risk control sub-model and the preset benefit control sub-model.
[0043] To achieve the above object, a second aspect of an embodiment of the present application provides a resource allocation device, the device comprising:
[0044] A data acquisition module is used to acquire resource transaction configuration information of a target resource and acquire historical transaction data of the target resource;
[0045] A model acquisition module, used for acquiring a candidate reward model based on the resource transaction configuration information;
[0046] A genetic search module, used for performing a genetic search based on the candidate reward model and the historical transaction data to obtain a target reward function;
[0047] A model training module, used to train a preset decision generation model based on the target reward function and the historical transaction data to obtain a target decision generation model;
[0048] The allocation decision module is used to obtain the current resource transaction data of the target resource, and make an allocation decision on the current resource transaction data based on the target decision generation model to obtain the target resource allocation data.
[0049] To achieve the above objectives, a third aspect of an embodiment of the present application proposes an electronic device, which includes a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the method described in the first aspect is implemented.
[0050] To achieve the above-mentioned purpose, the fourth aspect of an embodiment of the present application proposes a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in the first aspect is implemented.
[0051] The present application proposes a resource allocation method and device, an electronic device and a storage medium, which obtain resource transaction configuration information and historical transaction data of the target resource, generate a candidate reward model based on the resource transaction configuration information, and perform genetic search based on the reward function model and the historical transaction data to obtain the target reward function, and then train the preset decision generation model based on the target reward function and the historical transaction data, so that the preset decision generation model can be trained into a target decision generation model that can make resource allocation decisions with high allocation efficiency under the reward incentive of the target reward function, thereby improving the efficiency and accuracy of resource allocation; further, the current resource transaction data of the target resource is obtained, and an allocation decision is made on the current resource transaction data based on the target decision generation model to obtain the target resource allocation data, thereby achieving efficient and accurate resource allocation. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] Figure 1 is a flow chart of a resource allocation method provided in an embodiment of the present application;
[0053] Figure 2 yes Figure 1 Flow chart of step S102 in FIG.
[0054] Figure 3 yes Figure 1 Flow chart of step S103 in FIG.
[0055] Figure 4 yes Figure 3 Flow chart of step S307 in FIG.
[0056] Figure 5 yes Figure 4 Flow chart of step S401 in FIG.
[0057] Figure 6 yes Figure 1 Flow chart of step S104 in FIG.
[0058] Figure 7 yes Figure 6 Flow chart of step S604 in FIG.
[0059] Figure 8 is a schematic diagram of the structure of a resource allocation device provided in an embodiment of the present application;
[0060] Fig. 9 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION
[0061] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0062] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.
[0063] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.
[0064] First, some nouns involved in this application are analyzed:
[0065] Genetic search: is a biomimetic optimization algorithm that aims to simulate the process of biological evolution in nature to solve complex optimization problems. Genetic search is based on the theory of genetic algorithms and uses operations such as selection, crossover and mutation to iteratively find the optimal solution to the problem through population evolution. Genetic search selects individuals with high fitness for reproduction, gradually improves the solution in the population, and eventually approaches the optimal solution. Genetic search can handle a variety of optimization problems, especially those with high nonlinearity, complex constraints or large-scale search space. The core concepts involved in genetic search include fitness evaluation, individual encoding, selection strategy, crossover and mutation operations, etc.
[0066] Deep Q-Network (DQN): is an algorithm that combines deep learning and reinforcement learning to solve decision-making problems in complex environments. Based on the Q-learning algorithm, the Deep Q-Network uses a deep neural network to approximate the Q-value function and evaluate the value of taking an action in a specific state. The goal of the Deep Q-Network is to maximize the accumulated rewards through training strategies. The Deep Q-Network has strong expressiveness in complex, high-dimensional state spaces. The Deep Q-Network uses the experience replay mechanism to store and randomly sample the interaction data of the intelligent agent to avoid the impact of data correlation on training stability. At the same time, the Deep Q-Network introduces a target network to reduce the problem of training instability.
[0067] Reward function: It is a core concept in reinforcement learning, which is used to measure the feedback or reward obtained by the agent after taking an action in the environment. The reward function provides the agent with immediate feedback on the quality of its behavior. Through this feedback, the agent can adjust its strategy to maximize the cumulative reward. The reward function defines the goal in the environment and guides the agent towards the optimal solution. In the reinforcement learning process, the agent continuously learns through interaction with the environment. When an action can maximize the value of the reward function in a specific state, the action is considered to be optimal.
[0068] Fitness function: It is a core concept in genetic algorithms and evolutionary computing, and is used to evaluate the quality of candidate solutions for a specific problem. The fitness function guides the algorithm to gradually optimize the solution set by quantifying the performance of each individual, simulating the "survival of the fittest" process in nature. The fitness function's evaluation of individuals is usually given in numerical form, representing the fitness level of the individual. Individuals with high fitness are more likely to be selected for crossover and mutation, thereby generating the next generation of solutions.
[0069] Resource allocation can be used to allocate production materials, equipment, funds, etc., as well as computer software resources and hardware resources. For example, it can allocate medical device products in inventory. Since the value of medical device inventory products is affected by market fluctuations and there are holding costs for inventory medical devices, there is a risk of loss for inventory medical device products. Therefore, it is necessary to allocate medical device products in a timely manner. The current resource allocation method is mainly manual inventory and allocation, which has low allocation efficiency and is prone to human errors. Therefore, how to improve the efficiency and accuracy of resource allocation has become an urgent problem to be solved.
[0070] Based on this, the embodiments of the present application provide a resource allocation method and device, an electronic device and a storage medium, aiming to improve the efficiency and accuracy of resource allocation.
[0071] A resource allocation method and device, electronic device and storage medium provided in the embodiments of the present application are specifically described through the following embodiments. First, the resource allocation method in the embodiments of the present application is described.
[0072] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.
[0073] AI basic technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. AI software technologies mainly include computer vision technology, robotics technology, biometrics technology, speech processing technology, natural language processing technology, and machine learning / deep learning.
[0074] The resource allocation method provided in the embodiment of the present application relates to the field of artificial intelligence technology. The resource allocation method provided in the embodiment of the present application can be applied to the terminal, can also be applied to the server side, and can also be software running in the terminal or the server side. In some embodiments, the terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc.; the server side can be configured as an independent physical server, or it can be configured as a server cluster or distributed system composed of multiple physical servers, and can also be configured as a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms; the software can be an application that implements the resource allocation method, etc., but is not limited to the above forms.
[0075] The present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.
[0076] It should be noted that in each specific implementation of the present application, when it comes to the need to perform relevant processing based on data related to user identity or characteristics such as user information, user behavior data, user historical data, and user location information, the user's permission or consent will be obtained first, and the collection, use, and processing of these data will comply with relevant laws, regulations, and standards. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the embodiment of the present application will be obtained.
[0077] Figure 1 is an optional flowchart of the resource allocation method provided in an embodiment of the present application. Figure 1 The method may include but is not limited to steps S101 to S105.
[0078] Step S101, obtaining resource transaction configuration information of a target resource and obtaining historical transaction data of the target resource;
[0079] Step S102, obtaining a candidate reward model based on resource transaction configuration information;
[0080] Step S103, performing genetic search based on candidate reward models and historical transaction data to obtain a target reward function;
[0081] Step S104, training a preset decision generation model based on the target reward function and historical transaction data to obtain a target decision generation model;
[0082] Step S105, obtaining current resource transaction data of the target resource, and making allocation decisions on the current resource transaction data based on the target decision generation model to obtain target resource allocation data.
[0083] In steps S101 to S105 shown in the embodiment of the present application, resource transaction configuration information and historical transaction data of the target resource are obtained, candidate reward models are generated based on the resource transaction configuration information, and genetic search is performed based on the reward function model and historical transaction data to obtain the target reward function, and then the preset decision generation model is trained based on the target reward function and historical transaction data, so that the preset decision generation model can be trained into a target decision generation model that can make resource allocation decisions with high allocation efficiency under the reward incentive of the target reward function, thereby improving the efficiency and accuracy of resource allocation; further, the current resource transaction data of the target resource is obtained, and an allocation decision is made on the current resource transaction data based on the target decision generation model to obtain the target resource allocation data, thereby achieving efficient and accurate resource allocation.
[0084] In step S101 of some embodiments, the target resource is an item, which can be an electronic item or an actual physical item, such as a medical device product in stock. Since the product value of medical device products is affected by market fluctuations and there are holding costs for medical products in stock, such as natural damage during storage or inventory storage fees, there is a risk of loss for medical device products in stock, so it is necessary to allocate the medical device products in stock in a timely manner. When allocating resources, there is resource transaction configuration information, which refers to the rules for the target resource when allocating resources, such as inventory shipment quantity restrictions, such as natural loss during transportation, etc. Historical transaction data refers to historical transaction value data of the target resource.
[0085] See also Figure 2 In some embodiments, step S102 may include but is not limited to steps S201 to S204:
[0086] Step S201, performing semantic extraction on resource transaction configuration information according to a preset semantic extraction model to obtain transaction loss data and transaction number limit data;
[0087] Step S202, constructing a loss model according to the transaction loss data to obtain a loss sub-model;
[0088] Step S203, constructing a restriction model according to the transaction number restriction data to obtain a restriction sub-model;
[0089] Step S204, constructing a model according to the loss sub-model, the restriction sub-model, the preset risk control sub-model and the preset benefit control sub-model to obtain a candidate reward model.
[0090] In steps S201 to S204 shown in the embodiment of the present application, semantic extraction is performed on the resource transaction configuration information according to a preset semantic extraction model to obtain transaction loss data and transaction frequency limit data, thereby significantly reducing the time and effort required for manual operations, improving allocation efficiency and avoiding human errors. A loss model is then constructed based on the transaction loss data to obtain a loss sub-model. A restriction model is then constructed based on the transaction frequency limit data to obtain a restriction sub-model. Thus, through the loss sub-model and the restriction sub-model, the target reward function can comprehensively consider the reward value of resource optimization from the dimensions of transaction loss and transaction restriction. Finally, a model is constructed based on the loss sub-model, the restriction sub-model, the preset risk control sub-model and the preset benefit control sub-model to realize the construction of a candidate reward model that can comprehensively evaluate the reward value of resource configuration from multiple aspects.
[0091] In step S201 of some embodiments, the resource transaction configuration information is the rules for the target resource during the transaction, such as the shipping loss rate, holding cost, etc. The resource transaction configuration information can be recorded in text or XML, etc., which is not limited by this application. In one embodiment, the resource transaction configuration information is code information, and the preset semantic extraction model is a large-scale natural language model. The code recording the resource transaction configuration information is input into the large-scale natural language model for semantic extraction, and the transaction loss data and transaction number limit data of the target resource during the transaction are obtained.
[0092] In step S202 of some embodiments, a loss model is constructed based on transaction loss data, where the transaction loss data is the loss of the target resource when the transaction is carried out. For example, when trading medical equipment inventory, logistics transportation is required, so there is transaction loss data for logistics transportation. The loss model is constructed as shown in formula (1):
[0093] ∈ TC (1),
[0094] Among them, ∈ is the weight coefficient of the loss sub-model, which is the preset value when constructing the loss sub-model, and T is the transaction loss data.
[0095] In step S203 of some embodiments, the transaction number limit is a daily transaction number limit. For example, in a medical inventory, the number of external configurations can be limited, the number of internal configurations can be limited, or the number of configurations can be limited. This application does not make specific restrictions. The restriction model is constructed as shown in formula (2):
[0096] ζ·NF (2),
[0097] Among them, ζ is the weight coefficient of the restriction sub-model, which is the preset value when constructing the restriction sub-model, and NF is the transaction number restriction data.
[0098] In step S204 of some embodiments, the preset risk control sub-model is a sub-model for controlling the target resources to adopt an extreme resource allocation strategy. For example, when the value of medical devices fluctuates greatly, in order to avoid risks, risk aversion will be considered and a conservative inventory allocation strategy will be adopted. The preset benefit control sub-model is the value benefit generated by the control target resources in resource allocation. For example, when the value trend of medical devices is upward, timely external allocation of medical devices will generate value benefits. The candidate reward model obtained by model construction is shown in formula (3):
[0099] α·P-γ·MD-δ·RE-∈·TC-ζ·NF (3),
[0100] Among them, α is the weight coefficient of the preset benefit control sub-model, P is the preset benefit control sub-model, the preset risk control sub-model includes the maximum drawdown sub-model and the risk exposure sub-model, γ is the weight coefficient of the maximum drawdown sub-model, MD is the maximum drawdown sub-model, δ is the weight coefficient of the risk exposure sub-model, and α·P-γ·MD-δ·RE-∈·TC-ζ·NF is the candidate reward model.
[0101] See also Figure 3 In some embodiments, step S103 may include but is not limited to steps S301 to S307:
[0102] Step S301, chromosome encoding the candidate reward model to obtain an initial function population;
[0103] Step S302, screening the initial function population for fitness according to historical transaction data to obtain a first function population;
[0104] Step S303, performing crossover mutation processing on the initial function population to obtain a second function population;
[0105] Step S304, performing a local search based on the second function population and historical transaction data to obtain a third function population;
[0106] Step S305, replacing the second function population with a population fitness according to the first function population to obtain a fourth function population;
[0107] Step S306, merging the populations according to the third function population and the fourth function population to obtain a merged function population;
[0108] Step S307, performing fitness screening on the merged function population according to the historical transaction data to obtain the target reward function.
[0109] Steps S301 to S307 shown in the embodiment of the present application are to obtain an initial function population by chromosome encoding the candidate reward model, and then the initial function population is screened for fitness based on historical transaction data to obtain a first function population, and then a crossover mutation process is performed on the initial function population to obtain a second function population, and then a local search is performed based on the second function population and historical transaction data to obtain a third function population, and then the second function population is replaced with the first function population based on the population fitness to obtain a fourth function population, and then the third function population and the fourth function population are merged to obtain a merged function population, and finally the merged function population is screened for fitness based on the historical transaction data, thereby obtaining a target reward function that can comprehensively evaluate the losses, transaction times, resource allocation risks, and resource allocation benefits in resource allocation, thereby improving the accuracy of resource allocation.
[0110] In step S301 of some embodiments, chromosome encoding refers to the process of chromosome encoding the weight coefficients of each model of the candidate reward model, where the candidate reward model includes five weight coefficients (α, γ, δ, ∈, ζ), and then the five weight coefficients are converted into arrays, and then random values are assigned to the five weight coefficients to obtain multiple groups of arrays, which constitute the initial function population.
[0111] In step S302 of some embodiments, the initial function population is screened for fitness based on the historical transaction data. First, the fitness is calculated in the historical transaction data based on the initial function population, and then the population with high fitness is selected to obtain the first function population. In one embodiment, the fitness of the initial function population is calculated based on the historical transaction data to obtain the population in the top ten percent of fitness, and the first function population is obtained. It should be noted that the threshold for fitness screening can be set as needed, and this application does not impose a specific numerical limit.
[0112] In step S303 of some embodiments, crossover and mutation processing is performed on the initial function population to obtain a second function population, the crossover processing is to perform chromosome crossover on the individuals in the initial function population, and the mutation processing is to perform random mutation on the values of the individuals in the initial function population, and then the population after the crossover processing and the population after the mutation processing are used as new populations to obtain the second function population.
[0113] In step S304 of some embodiments, a local search is performed based on the second function population and the historical transaction data. The local search is to perform fitness screening on the second function population based on the historical transaction data, screen out individuals whose fitness meets the threshold based on a preset local search threshold, and then search based on a preset search value to obtain new individuals, that is, to obtain a third function population. In one embodiment, individuals whose fitness meets the threshold are screened out based on a preset local search threshold as (3, 2.1, 2, 1, 0.5), and the search value set by the cosine is positive 0.1 or negative 0.1, and then 0.1 is added or subtracted based on each value in (3, 2.1, 2, 1, 0.5) to obtain 32 new individuals, and these new 32 individuals form a new population, that is, the third function population.
[0114] In step S305 of some embodiments, the population fitness is replaced by first calculating the fitness of the second function population based on the historical transaction data, then obtaining the number of individuals in the first function population, obtaining the number of replacements, and then replacing the individuals corresponding to the number of replacements of the reciprocal fitness in the second function population with the individuals in the first function population. For example, there are 5 individuals in the first function population, and then replacing the individuals with the reciprocal fitness values in the second function population with the individuals in the first function population to obtain the fourth function population.
[0115] In step S306 of some embodiments, the third function population and the fourth function population are merged. When merging the populations, the third function population and the fourth function population are first merged, and then the merged population is removed for deduplication to obtain a merged function population.
[0116] See also Figure 4 In some embodiments, step S307 may include but is not limited to steps S401 to S404:
[0117] Step S401, calculating the reward value of the merged function population according to the historical transaction data to obtain the target reward value data;
[0118] Step S402, allocating resources to the historical transaction data according to the reward value data to obtain resource income data and resource withdrawal value data;
[0119] Step S403, performing fitness calculation according to the resource income data and the resource withdrawal value data to obtain population fitness data;
[0120] Step S404, screening the merged function population according to the population fitness data to obtain the target reward function.
[0121] In steps S401 to S404 shown in the embodiment of the present application, a reward value is calculated for the merged function population based on the historical transaction data to obtain target reward value data, and then resources are allocated to the historical transaction data based on the reward value data to obtain resource income data and resource withdrawal value data, and then fitness is calculated based on the resource income data and resource withdrawal value data to obtain population fitness data, and finally the merged function population is screened based on the population fitness data to obtain the target reward function, thereby obtaining a reward function that can perform reasonable resource allocation evaluation, thereby improving the accuracy of resource allocation.
[0122] See also Figure 5 In some embodiments, step S401 includes but is not limited to steps S501 to S504:
[0123] Step S501, calculating the resource reservation reward value for the merged function population according to the historical transaction data to obtain the resource reservation reward value data;
[0124] Step S502, calculating the resource output reward value of the merged function population according to the historical transaction data to obtain resource output reward value data;
[0125] Step S503, calculating the resource input reward value for the merged function population according to the historical transaction data to obtain the resource input reward value data;
[0126] Step S504: taking the resource retention reward value data, the resource output reward value data and the resource input reward value data as target reward value data.
[0127] In steps S501 to S504 shown in the embodiment of the present application, a resource retention reward value is calculated for the merged function population based on the historical transaction data to obtain resource retention reward value data, and then a resource output reward value is calculated for the merged function population based on the historical transaction data to obtain resource output reward value data, and a resource input reward value is calculated for the merged function population based on the historical transaction data to obtain resource input reward value data, and finally the resource retention reward value data, the resource output reward value data and the resource input reward value data are used as target reward value data.
[0128] In step S501 of some embodiments, the historical transaction data includes the value data of the target resource in multiple time periods, for example, on the first day, the resource value is the first value, and on the second day, the resource value is the second value. On the first day, a decision is made based on the allocation decision of resource reservation, that is, the medical device inventory is resource-preserved, and then the reward value in the combined function population is calculated based on the first value on the first day and the second value on the second day. The resource reservation reward value calculation is shown in formula (4):
[0129] R(s, a1)=α·P-γ·MD-δ·RE-∈·TC-ζ·NF (5),
[0130] Among them, R(s, a1) is the resource reservation reward value data, a1 is the allocation decision of resource reservation, and s is the resource value under a specific number of days. For example, on the first day, the resource value is the first value, that is, s is the first value, and on the second day, the resource value is the second value, that is, s is the second value. Then, based on the allocation decision of resource reservation a1, the benefit data P, maximum drawdown MD, risk exposure RE, transaction loss data TC, and transaction number limit data NF after resource reservation are calculated. When the allocation decision of resource reservation is made, the benefit data P is 0, the transaction loss data TC is 0, the transaction number limit data NF is 0, the maximum drawdown MD is the maximum drawdown value calculated based on the historical value data and the allocation strategy of resource reservation, and the risk exposure RE is the risk exposure value calculated based on the historical value data and the allocation strategy of resource output.
[0131] In step S502 of some embodiments, the resource reservation reward value is calculated as shown in formula (5):
[0132] R(s, a2)=α·P-γ·MD-δ·RE-∈·TC-ζ·NF (5),
[0133] Among them, a2 is the allocation decision of resource output, and R(s, a2) is the resource output reward value data.
[0134] In step S503 of some embodiments, the resource input reward value is calculated as shown in formula (6):
[0135] R(s, a3)=α·Py·MD-δ·RE-∈·TC-ζ·NF (6),
[0136] Among them, a3 is the allocation decision of resource input, and R(s, a3) is the resource input reward value data.
[0137] In step S504 of some embodiments, resource retention reward value data, resource output reward value data and resource input reward value data are used as target reward value data. The target reward value data is in the form of (R(s, a1), R(s, a2), R(s, a3)). This application does not impose specific restrictions on the form of the target reward value data.
[0138] In step S402 of some embodiments, the reward value data includes resource retention reward value data, resource output reward value data and resource input reward value data, and the largest data is selected from the reward value data as the resource allocation decision. For example, if the largest data in the reward value data is the resource output reward value data, the resource output is used as the resource allocation decision. The historical transaction data includes the value data of the target resource in multiple time periods, and a resource allocation decision is made in each time period based on the merged function population, and the current resource income data and the current resource withdrawal value data are calculated based on the next time period, and the cycle is repeated until a resource allocation decision is made in each time period until each time period of the historical transaction data is calculated, and finally the overall resource income data and resource withdrawal value data are calculated.
[0139] In step S403 of some embodiments, fitness calculation is performed based on resource revenue data and resource withdrawal value data, and the fitness calculation is shown in formula (7):
[0140] Fitness=t1·Total Profit+t2·Max Drawdown (7),
[0141] Among them, Fitness is the fitness data, Total Profit is the resource income data, t1 is the preset resource income data weight, Max Drawdown is the resource drawdown value data, and t2 is the resource drawdown value data weight.
[0142] In step S404 of some embodiments, the function population is merged based on the population fitness data, and the individual with the highest fitness is selected as the target reward function.
[0143] See also Figure 6In some embodiments, the preset decision generation model includes experience samples, an initial decision layer, and an initial prediction layer; the experience samples include an execution action, a current state, and a next state. Step S104 includes but is not limited to steps S601 to S605:
[0144] Step S601, performing decision evaluation according to the execution action, the current state and the initial decision layer to obtain initial decision evaluation data; wherein the initial decision evaluation data is used to indicate the rationality of the decision of the initial decision layer;
[0145] Step S602, performing prediction evaluation according to the execution action, the next state and the initial prediction layer to obtain initial prediction evaluation data; wherein the initial prediction evaluation data is used to indicate the rationality of the decision of the initial prediction layer;
[0146] Step S603, calculating the reward value according to the historical transaction data, the current state, the executed action, the next state and the target reward function to obtain the training reward value;
[0147] Step S604, optimizing the parameters of the initial decision layer according to the training reward value, the initial prediction evaluation data and the initial decision evaluation data to obtain a target decision layer;
[0148] Step S605, generating a target decision model based on the experience sample, the target decision layer and the initial prediction layer.
[0149] In steps S601 to S605 shown in the embodiment of the present application, decision evaluation is performed according to the execution action, the current state and the initial decision layer to obtain initial decision evaluation data, and then prediction evaluation is performed according to the execution action, the next state and the initial prediction layer to obtain initial prediction evaluation data, and reward value calculation is performed according to historical transaction data, the current state, the execution action, the next state and the target reward function to obtain a training reward value, and then the parameters of the initial decision layer are optimized according to the training reward value, the initial prediction evaluation data and the initial decision evaluation data, so that the initial decision layer can perceive the next state under the current state and predict the further state based on the next state to obtain the target decision layer, and finally, the experience sample, the target decision layer and the initial prediction layer are used as the target decision generation model to obtain a target decision generation model that can accurately make resource allocation decisions.
[0150] In step S601 of some embodiments, the preset decision generation model is a deep Q network (Deep Q-Network, DQN), and DQN includes experience samples, an initial decision layer, and an initial prediction layer. The initial decision layer and the experience sample are a buffer pool that stores execution actions, current states, and next states. The execution actions include three actions: resource output, resource input, and resource retention. The current state is the total value of the current medical device inventory, and the next state is the total value of the medical device inventory after the next state is executed based on the current state. The initial decision layer and the initial prediction layer are both composed of fully connected layers. First, an experience sample is extracted from the prediction decision generation model, and the current state, that is, the total value of the current medical device inventory, is obtained from the experience sample. The execution action is obtained from the experience sample, and the execution action may be resource input, resource retention, or resource output. The next state is the state after the execution action is performed based on the current state. For example: the experience sample is (current state: total value of medical device inventory: 100, execution action: retain, next state is medical device inventory value 105), and then a decision evaluation is performed based on the current state and the initial decision layer to obtain the evaluation data for executing the retention action in the current state.
[0151] In step S602 of some embodiments, in one embodiment, the experience sample is (current state: total value of medical device inventory: 100, execution action: reserve, next state is medical device inventory value 105), and according to the initial prediction layer in the next state, that is, when the total value of medical device inventory is 105, the decision evaluation values of the three execution actions of resource reservation, resource input and resource output are predicted, and the largest decision evaluation value is selected as the initial prediction evaluation data.
[0152] In step S603 of some embodiments, a reward value is calculated based on historical trading data, a current state, an executed action, a next state, and a target reward function to obtain a training reward value, that is, the benefit is calculated based on the current state and the next state, the loss is calculated based on the executed action, the number of transaction limits is calculated based on the executed action, and the maximum drawdown value and risk exposure are calculated based on historical trading data, the current state, and the next state. Finally, the training reward value is calculated by combining the benefit, loss, number of transaction limits, maximum drawdown value, risk exposure, and the target reward function.
[0153] See also Figure 7 In some embodiments, step S604 may include but is not limited to steps S701 to S703:
[0154] Step S701, performing aggregation calculation based on the training reward value and the initial prediction evaluation data to obtain a training label value;
[0155] Step S702, calculating the mean square error based on the training label value and the initial decision evaluation data to obtain a training loss value;
[0156] Step S703, optimizing the parameters of the initial decision layer according to the training loss value to obtain the target decision layer.
[0157] In steps S701 to S703 shown in the embodiment of the present application, aggregation calculation is performed based on the training reward value and the initial prediction evaluation data to obtain the training label value, and then the mean square error is calculated based on the training label value and the initial decision evaluation data to obtain the training loss value. Finally, the parameters of the initial decision layer are optimized based on the training loss value to obtain the target decision layer, so that the target decision layer can have a good perception of the resource allocation decision, thereby making accurate resource allocation decisions.
[0158] In step S701 of some embodiments, an aggregate calculation is performed based on the training reward value and the initial prediction evaluation data as shown in formula (8):
[0159] r+Δmax a′ Q(s′, a′) (8),
[0160] Among them, r is the training reward value, Δ is the preset initial prediction evaluation data weight, and max a , Q(s′, a′) is the initial prediction data, and the training label value is r+Δmax a′ Q(s′, a′).
[0161] In step S702 of some embodiments, the mean square error is calculated based on the training label value and the initial decision evaluation data as shown in formula (9):
[0162] (r+Δmax a′ Q(s′, a′)-Q(s, a)) 2 (9)
[0163] Among them, Q(s, a) is the initial decision evaluation data, (r+Δmax a′ Q(s′, a′)-Q(s, a)) 2 is the training loss value.
[0164] In step S703 of some embodiments, the parameters of the initial decision layer are optimized based on the training loss value, that is, the initial decision layer is back-propagated through the training loss value to obtain the target decision layer.
[0165] In step S605 of some embodiments, the experience samples, the target decision layer and the initial prediction layer are model merged to obtain a target decision generation model. It should be noted that in one embodiment, the target decision layer and the initial decision layer are network structures of the same dimension and structure. When training the network, the decision layer is first trained. After iterating to the preset conditions, the network value of the decision layer is assigned to the prediction layer, and then the decision layer is trained again, and finally the target decision layer, the target prediction layer and the experience samples are obtained. In the embodiments of the present application, only the training of the decision layer to obtain the target decision layer is described. In other embodiments, the network structure can be trained as needed, and this application does not make specific restrictions.
[0166] In step S105 of some embodiments, after obtaining the current transaction data of the target resource, the current transaction data is input into the target decision generation model, and the target decision generation model outputs the evaluation values of the three execution actions of resource input, resource output, and resource retention. The execution action corresponding to the largest evaluation value is selected as the resource allocation decision, so as to obtain the target resource allocation data.
[0167] See also Figure 8 The embodiment of the present application further provides a resource allocation device, which can implement the above resource allocation method, and the device includes:
[0168] The data acquisition module 801 is used to acquire resource transaction configuration information of the target resource and acquire historical transaction data of the target resource;
[0169] A model acquisition module 802 is used to acquire a candidate reward model based on resource transaction configuration information;
[0170] Genetic search module 803, used to perform genetic search based on candidate reward models and historical transaction data to obtain a target reward function;
[0171] A model training module 804 is used to train a preset decision generation model based on a target reward function and historical transaction data to obtain a target decision generation model;
[0172] The allocation decision module 805 is used to obtain the current resource transaction data of the target resource, and make an allocation decision on the current resource transaction data based on the target decision generation model to obtain the target resource allocation data.
[0173] The specific implementation of the resource allocation device is substantially the same as the specific implementation of the resource allocation method described above, and will not be described in detail herein.
[0174] The embodiment of the present application also provides an electronic device, the electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the above resource allocation method when executing the computer program. The electronic device can be any intelligent terminal including a tablet computer, a car computer, etc.
[0175] See also Fig. 9 , Fig. 9 The hardware structure of an electronic device of another embodiment is illustrated, and the electronic device includes:
[0176] The processor 901 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;
[0177] The memory 902 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 902 can store an operating system and other applications. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 902, and the processor 901 calls and executes the resource allocation method of the embodiment of this application;
[0178] Input / output interface 903, used to implement information input and output;
[0179] Communication interface 904, used to realize communication interaction between the device and other devices, which can be realized by wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.);
[0180] A bus 905 that transmits information between various components of the device (e.g., the processor 901, the memory 902, the input / output interface 903, and the communication interface 904);
[0181] The processor 901 , the memory 902 , the input / output interface 903 and the communication interface 904 are connected to each other in communication within the device via a bus 905 .
[0182] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned resource allocation method is implemented.
[0183] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0184] The resource allocation method, resource allocation device, electronic device and storage medium provided in the embodiments of the present application obtain resource transaction configuration information and historical transaction data of the target resource, generate a candidate reward model based on the resource transaction configuration information, and perform genetic search based on the reward function model and historical transaction data to obtain the target reward function, and then train the preset decision generation model based on the target reward function and historical transaction data, so that the preset decision generation model can be trained into a target decision generation model that can make resource allocation decisions with high allocation efficiency under the reward incentive of the target reward function, thereby improving the efficiency and accuracy of resource allocation; further, the current resource transaction data of the target resource is obtained, and an allocation decision is made on the current resource transaction data based on the target decision generation model to obtain the target resource allocation data, thereby achieving efficient and accurate resource allocation.
[0185] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0186] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.
[0187] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0188] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.
[0189] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0190] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.
[0191] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0192] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0193] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0194] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.
[0195] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.
Claims
1. A resource allocation method, characterized in that: The method comprises: Obtain resource transaction configuration information of the target resource, and obtain historical transaction data of the target resource; Acquire a candidate reward model based on the resource transaction configuration information; Performing a genetic search based on the candidate reward model and the historical transaction data to obtain a target reward function; Training a preset decision generation model based on the target reward function and the historical transaction data to obtain a target decision generation model; The current resource transaction data of the target resource is acquired, and allocation decision is made on the current resource transaction data based on the target decision generation model to obtain target resource allocation data.
2. The method according to claim 1, characterized in that: The performing genetic search based on the candidate reward model and the historical transaction data to obtain a target reward function includes: Performing chromosome encoding on the candidate reward model to obtain an initial function population; Perform fitness screening on the initial function population according to the historical transaction data to obtain a first function population; Performing crossover and mutation processing on the initial function population to obtain a second function population; Performing a local search based on the second function population and the historical transaction data to obtain a third function population; Performing population fitness replacement on the second function population according to the first function population to obtain a fourth function population; Merging the populations according to the third function population and the fourth function population to obtain a merged function population; The fitness of the combined function population is screened according to the historical transaction data to obtain the target reward function.
3. The method according to claim 2, characterized in that The step of performing fitness screening on the combined function population according to the historical transaction data to obtain the target reward function includes: Calculate the reward value of the merged function population according to the historical transaction data to obtain target reward value data; Allocate resources to the historical transaction data according to the reward value data to obtain resource income data and resource withdrawal value data; Performing fitness calculation according to the resource income data and the resource withdrawal value data to obtain population fitness data; The combined function population is screened according to the population fitness data to obtain the target reward function.
4. The method according to claim 3, characterized in that The reward value calculation is performed according to the combined function population and the historical transaction data to obtain target reward value data, including: Calculating the resource reservation reward value for the merged function population according to the historical transaction data to obtain resource reservation reward value data; Calculate the resource output reward value of the merged function population according to the historical transaction data to obtain resource output reward value data; Calculate the resource input reward value of the merged function population according to the historical transaction data to obtain resource input reward value data; The resource retention bonus value data, the resource output bonus value data, and the resource input bonus value data are used as the target bonus value data.
5. The method according to any one of claims 1 to 4, characterized in that: The preset decision generation model includes experience samples, an initial decision layer and an initial prediction layer; the experience samples include an execution action, a current state and a next state; the preset decision generation model is trained based on the target reward function and the historical transaction data to obtain a target decision generation model, including: Performing a decision evaluation according to the execution action, the current state and the initial decision layer to obtain initial decision evaluation data; wherein the initial decision evaluation data is used to indicate the rationality of the decision of the initial decision layer; Performing prediction evaluation according to the execution action, the next state and the initial prediction layer to obtain initial prediction evaluation data; wherein the initial prediction evaluation data is used to indicate the rationality of the decision of the initial prediction layer; Calculate a reward value according to the historical transaction data, the current state, the executed action, the next state, and the target reward function to obtain a training reward value; Optimizing the parameters of the initial decision layer according to the training reward value, the initial prediction evaluation data and the initial decision evaluation data to obtain a target decision layer; The target decision generation model is formed according to the experience samples, the target decision layer and the initial prediction layer.
6. The method according to claim 5, characterized in that The step of optimizing the parameters of the initial decision layer according to the training reward value, the initial prediction evaluation data and the initial decision evaluation data to obtain a target decision layer includes: Performing aggregate calculation based on the training reward value and the initial prediction evaluation data to obtain a training label value; Performing mean square error calculation based on the training label value and the initial decision evaluation data to obtain a training loss value; Optimize the parameters of the initial decision layer according to the training loss value to obtain the target decision layer.
7. The method according to any one of claims 1 to 4, characterized in that: The acquiring a candidate reward model based on the resource transaction configuration information includes: Perform semantic extraction on the resource transaction configuration information according to a preset semantic extraction model to obtain transaction loss data and transaction number limit data; Constructing a loss model according to the transaction loss data to obtain a loss sub-model; Constructing a restriction model according to the transaction number restriction data to obtain a restriction sub-model; The candidate reward model is obtained by constructing a model based on the loss sub-model, the restriction sub-model, the preset risk control sub-model and the preset benefit control sub-model.
8. A resource allocation device, characterized in that: The device comprises: A data acquisition module is used to acquire resource transaction configuration information of a target resource and acquire historical transaction data of the target resource; A model acquisition module, used for acquiring a candidate reward model based on the resource transaction configuration information; A genetic search module, used for performing a genetic search based on the candidate reward model and the historical transaction data to obtain a target reward function; A model training module, used to train a preset decision generation model based on the target reward function and the historical transaction data to obtain a target decision generation model; The allocation decision module is used to obtain the current resource transaction data of the target resource, and make an allocation decision on the current resource transaction data based on the target decision generation model to obtain the target resource allocation data.
9. An electronic device, characterized in that: The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor implements the resource allocation method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the resource allocation method according to any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
Resource allocation prediction method and device, equipment and storage medium
CN113672375A
Calculation unloading method based on optimal resource allocation quantity and search algorithm
CN114339819A
Heterogeneous cluster zero communication target allocation method based on multi-agent reinforcement learning
CN116340737A
Material scheduling method based on deep reinforcement learning improved genetic algorithm and related device
CN117455143A
Strategy determination method and device, equipment and storage medium
CN117714292A
Cited By
Artificial intelligence-based computing power operation management system and method
CN120687246A