230 results about "Decision-making models" patented technology

The invention provides a decision model construction method based on a big data environment. The method belongs to the economic data decision field. The method comprises the following steps: firstly, acquiring multi-source heterogeneous data including sensor time sequence data, an expert rule base and equipment causal priori knowledge, and constructing a standardized training data set; then, extracting an explicit causal relationship from the historical data by utilizing a causal discovery algorithm, and generating an interpretable knowledge graph in combination with priori knowledge of an equipment manual; thirdly, constructing a neural symbol joint model; neural network parameters and rule confidence coefficients are synchronously adjusted, and collaborative learning of data driving and knowledge driving is realized. And then, carrying out multi-dimensional logic verification on the trained model, including rule conflict detection, anti-factual reasoning and decision path traceability verification. The method can effectively improve the accuracy and interpretability of the decision model, and is suitable for processing decision tasks in a big data environment.

The invention provides a perception collaborative decision-making method and system based on multi-modal heterogeneous data fusion, and relates to the technical field of artificial intelligence, and the method comprises the steps: inputting a global environment situation perception graph into a pre-trained multi-target collaborative decision-making model; the multi-target collaborative decision-making model forms a multi-target decision-making feature set by analyzing the resource entities and the incidence relation in the graph; based on the multi-target decision feature set, decision optimization is carried out to obtain a comprehensive collaborative scheduling scheme; performing instruction analysis and packaging on the comprehensive collaborative scheduling scheme to obtain an executable instruction sequence; and issuing the executable instruction sequence to a corresponding decision node and a control terminal in parallel through a distributed communication architecture to complete real-time scheduling of resources and collaborative issuing of control instructions. According to the invention, by constructing a linkage mechanism of multi-modal data fusion, dynamic environment perception and collaborative decision execution, intelligent perception and quick response to a complex environment are realized.

The invention discloses a power system load dynamic optimization method based on reinforcement learning. The method comprises the following steps: S1, collecting power system data to construct a state space; s2, constructing a hierarchical reinforcement learning model based on the state space, and dividing a high-level decision and a low-level execution task; s3, training a high-level decision model, and outputting a scheduling task target category instruction in a high-level state; s4, training a low-layer execution model, and outputting a control action in combination with a current node state and a high-layer instruction; s5, introducing an evolutionary mechanism to generate a strategy population and optimizing a low-layer execution model; s6, fusing an evolutionary mechanism and a strategy gradient to synchronously optimize individuals with excellent performance; s7, deploying the trained model to a power dispatching system; s8, performing model parameter fine tuning based on scheduling feedback; and S9, continuously applying the fine-tuned model to load scheduling control. According to the invention, power load accurate scheduling and strategy efficient adaptive optimization are realized, and system responsiveness and operation stability are improved.

The invention discloses a reinforcement learning method and system for source network load storage collaborative multi-scene optimization, and the method comprises the steps: constructing a power distribution network optimization model with the minimum cost, and converting a mixed integer nonlinear problem into a solvable mixed integer second-order cone optimization problem; converting a mixed integer second-order cone optimization problem into a reinforcement learning decision model, and performing multi-round assignment on boundary condition parameters by using different operation scene data to form a multi-scene training task set; designing a reinforcement learning decision model multi-scene training loss function, combining the reinforcement learning decision model to construct a strategy neural network, an evaluation network neural network and a scene representation embedded neural network, and completing reinforcement learning decision adaptive to multi-scene optimization; and training a power distribution network multi-scene optimization decision model based on the multi-scene training task set, the multi-scene training reinforcement learning loss function and the neural network structure, and deploying the power distribution network multi-scene optimization decision model to an actual system to complete reinforcement learning decision model application oriented to source network load storage collaborative multi-scene optimization.

The invention relates to a digital twin workshop management and control method and system based on data multilayer fusion, and belongs to the field of service-oriented industrial system data science, and the method comprises the steps: obtaining the global multi-source heterogeneous data of a digital twin workshop, and carrying out the data classification, data processing and data storage of the global multi-source heterogeneous data, carrying out data-level fusion to obtain digital twin workshop standard data; extracting standard data of the digital twin workshop, performing semantic association, feature extraction and feature analysis on the standard data of the digital twin workshop, and performing feature level fusion to obtain key state features of the digital twin workshop; the method comprises the following steps: constructing a decision-making model oriented to a digital twin workshop, inputting key operation features of the digital twin workshop, performing decision-making level fusion based on the decision-making model, decision-making optimization and decision-making method solution, and outputting a workshop production management and control decision. The method can provide support for digital twin workshop operation data governance analysis and production management and control accurate decision.

The invention provides a multi-agent-based decision-making method and device, equipment and a medium, and the method comprises the steps: collecting data of a plurality of data sources, and constructing a plurality of knowledge bases in different knowledge fields; aiming at different task requirements contained in the target social measure, adopting a corresponding decision model and a knowledge base of a corresponding knowledge field to construct a plurality of sub-agents; and controlling the plurality of sub-agents to formulate respective preliminary social measure implementation schemes for the target social measure, and performing debate aiming at the plurality of preliminary social measure implementation schemes to obtain a final social measure implementation scheme. According to the method, decision making is carried out by integrating the multiple sub-agents representing different perspectives, multi-field and multi-dimensional insights can be formed, then social measure implementation schemes of the multiple sub-agents are fused through a debate mechanism of the multiple sub-agents, the agents can generate more comprehensive and diversified decision making results, and the decision making efficiency is improved. And complex and changeable decision problems can be effectively solved.

The invention provides an industrial equipment energy efficiency evaluation and maintenance decision-making method and system based on reinforcement learning, and relates to the technical field of reinforcement learning, and the method comprises the steps: collecting equipment operation data and extracting features, constructing a maintenance time sequence decision-making model based on deep reinforcement learning, and achieving the model optimization through the combination of transfer learning; and generating a maintenance decision scheme according to the energy efficiency index analysis and the time sequence causal relationship, executing maintenance, and recording process data for online learning and updating of the model. The energy efficiency management level of industrial equipment is improved, the service life of the equipment is prolonged, and the operation and maintenance cost is reduced.

The invention discloses a coordinated control method and system for comprehensive energy multi-agent coordinated group control and autonomous decision making. The method comprises the following steps: establishing a relaxation strategy of an agent corresponding to a distributed power supply; the main coordinator iteratively solves to determine a global coordination signal according to the global operation data of the integrated energy system and the operation data of each agent by taking the lowest total cost, the highest system energy efficiency, the minimum carbon emission and the minimum global penalty coefficient meeting the global relaxation constraint as a relaxation global optimization target; the minimum operation cost of each intelligent agent, the minimum response deviation to a global coordination signal and the minimum deviation between an actual state and a reference state are taken as control targets; establishing an electricity price autonomous decision-making model of each agent and a response power boundary autonomous decision-making model for a global coordination signal; and based on the control target of each agent, the electricity price autonomous decision-making model and the response power boundary autonomous decision-making model, predicting to obtain a control target value of each agent, and realizing balance between a global optimization target and local autonomy.

Disclosed in the present application are a training method for an action decision-making model of an intelligent agent, and an action decision-making method and apparatus. The training method comprises: constructing a state topology graph on the basis of historical trajectories; on the basis of the state topology graph, training an action feedback model of an intelligent agent, wherein the action feedback model is used for providing a feedback signal of an environment where the intelligent agent resides in respect of an action executed by the intelligent agent; on the basis of the state topology graph and the action feedback model, training an action value model of the intelligent agent, wherein the action value model is used for providing an estimated action value of the action executed by the intelligent agent, and the estimated action value indicates a metric value used for measuring the impact of the action executed by the intelligent agent on the environment; and on the basis of the action value model, training an action decision-making model of the intelligent agent, wherein the action decision-making model is used for deciding an action to be executed by the intelligent agent in a given state.

The invention provides a bridge group maintenance priority dynamic decision-making method and device based on reinforcement learning, and relates to the technical field of bridge intelligent maintenance. The method comprises the following steps: constructing a topological structure of a bridge network and a road; defining a state space, a maintenance action space and a state transition matrix of the bridge; defining a reliability index corresponding to the state of the bridge, and designing a comprehensive reward function based on maintenance cost, asset risk and traffic network capacity loss risk based on the topological structure; constructing a bridge maintenance decision problem; the method comprises the following steps of: describing a bridge maintenance decision problem as a Markov decision process, establishing a pointer network strategy model by adopting a pointer network, and training the pointer network strategy model by adopting an Actor-Critic algorithm to obtain a maintenance decision model based on reinforcement learning; and training the maintenance decision model based on reinforcement learning until convergence, and outputting a bridge maintenance action sequence under limited constraints. By adopting the method, the limitation problem of traditional single bridge assessment can be solved.

The invention discloses a training method of an action decision model of an intelligent agent and an action decision method and device, and belongs to the technical field of computers. According to the method, the state topological graph is constructed on the basis of the historical trajectory, experience distribution of actions of the intelligent agent can be fully reflected, the information utilization rate of the historical trajectory is higher, more information is brought, the action feedback model is guided and trained on the basis of the state topological graph, the accuracy of the action feedback model is improved, and the accuracy of the action feedback model is improved. A state topological graph, an action feedback model and a training process of a constraint action value model are combined to obtain an action value model with better accuracy and better performance, and the action value model is utilized to assist in training to obtain an action decision model with better accuracy, so that an accurate decision on which action is executed by an intelligent agent in a given state is facilitated; and the action decision model can be combined with a large model to mutually promote training, so that the performance of the two parties is improved.

The invention belongs to the technical field of power systems, and relates to a power transaction decision optimization method under power, green certificate and carbon market interaction, which comprises the following steps: 1, constructing a power transaction decision operation three-layer model framework under power, green certificate and carbon market interaction; 2, establishing a lower-layer power centralized market model; 3, establishing a lower-layer power distributed market model; 4, establishing a lower-layer green evidence market model; 5, establishing a lower-layer carbon market clearing model; 6, establishing a middle-layer power consumer equilibrium decision model; 7, establishing an upper DSO power distribution network operator operation decision model; 8, reconstructing a middle-lower layer model, and constructing a three-layer model iterative solution algorithm; according to the invention, through collaborative transaction decision-making of the power centralized and distributed markets, new energy consumption and traditional energy utilization are balanced, so that social welfare maximization and improvement of multi-subject economic benefits are realized.

The present invention relates to the technical field of supply chain scheduling, and discloses a multiple supply chain scheduling method and system based on a global Critic multi-agent algorithm. The method includes: constructing a multi-agent supply chain environment; introducing a global Critic network, and using the multi-agent deep deterministic policy gradient algorithm to perform reinforcement learning on the multi-agent supply chain environment to construct a multi-agent decision-making model; inputting supply chain demand data into the multi-agent decision-making model for optimized scheduling processing to generate a scheduling strategy that maximizes the overall profit of the supply chain. The present invention introduces a global Critic network to reduce multi-agent competition and optimize the overall performance. The multi-agent deep deterministic policy gradient algorithm is used to construct a decision-making model to adapt to complex supply chain environments. With the goal of maximizing the overall profit, it solves the problems of low efficiency and low returns. The environment has strong adaptability and can handle scheduling problems of different scales. By continuously learning to optimize decisions, the reliability is improved, and the efficiency and returns are significantly enhanced.

The invention provides a single agent decision-making method and device based on deep reinforcement learning, and the method comprises the steps: obtaining agent sample data in an experience playback buffer pool, the sample data at least comprising an observation state, a next observation state, a decision-making action and a reward value of an agent in an environment; inputting the agent sample data into the estimation network and the target network for training; the estimation network comprises a strategy network and an evaluation network, and the target network comprises a target strategy network and a target evaluation network; respectively calculating a strategy gradient of the estimation network and a loss function of the target network; if the strategy gradient and the loss function meet preset conditions, the network model corresponding to the strategy gradient and the loss function is determined as the decision model of the agent, an actor-commentator reinforcement learning architecture is adopted, the problem that correlation exists before and after each parameter updating of a neural network in an actor-commentator structure is solved, and the decision model of the agent is determined to be the decision model of the agent. And meanwhile, the defect that deep reinforcement learning cannot be used for continuous actions is overcome.

The present application provides a task dynamic adjustment system and method based on an intelligent decision model, which relates to the field of intelligent task management. The system first verifies and parses the received task request, extracts task information such as task description, expression form, priority, deadline and task amount, and stores it in a task management database. Then, after extracting the target task from the task management database, the target task is allocated to multiple resource nodes according to the task information and system load status. During the task execution process, the resource utilization of multiple resource nodes and the remaining execution information of the target task are monitored in real time, and these data are input into the intelligent decision model. Through model analysis, the resource allocation optimization and adjustment of the remaining execution part of the target task are performed. In this way, the task can be efficiently executed under the condition of meeting its needs, and the system resources can be fully utilized.

The invention relates to the technical field of green product analysis, and discloses a green product full life cycle analysis system based on big data. The system comprises a data acquisition module, a preprocessing module, an environmental impact assessment module, a resource consumption optimization module, an association modeling and result generation module and a visual interaction module. The system collects data of all stages of a full life cycle and related element data of environment, resources, carbon emission and the like, after preprocessing of abnormal value elimination, entropy weight method weighting and the like, environment influence is dynamically evaluated through a fuzzy membership function, resource consumption is subjected to multi-objective optimization by utilizing a genetic algorithm, and the resource utilization rate is improved. A key stage is determined by means of grey relational degree, an analysis result is generated in combination with a multi-target decision model, and finally the analysis result is visually presented in the form of a three-dimensional map and a dynamic thermodynamic diagram. The system realizes efficient analysis and comprehensive evaluation of full-life-cycle data of green products, and provides scientific support for product environment performance optimization and decision making.

The invention discloses a multi-robot cooperation interaction control method and system based on deep learning, and the method comprises the steps: obtaining historical interaction data, carrying out the environment state coding and feature extraction, and carrying out the correlation score matrix calculation, and obtaining a dynamic interaction weight coefficient; according to the situation representation vector and the interaction weight coefficient, performing future behavior prediction to obtain intention probability distribution data; performing encryption processing on the sensitive information according to historical interaction data to obtain encrypted shared data, performing weighted average aggregation in combination with pre-trained decision model parameters to generate a global collaborative decision model, and inputting the encrypted shared data into the global collaborative decision model to obtain a collaborative action scheme; and according to the cooperative action scheme and the intention probability distribution data, performing multi-constraint task allocation optimization to obtain an optimal task allocation scheme, and performing adaptive path planning to obtain a final action path. According to the method, real-time efficient collaborative decision making in a high-dynamic complex environment can be realized.

The invention relates to the technical field of patent value evaluation. The invention provides a Markov decision-based patent value evaluation method, which is used for constructing a state-action-reward-transfer decision-making model for patent life cycle dynamic characteristics. Through multi-source data processing, state construction, strategy screening, value function iteration and optimal strategy generation, quantitative evaluation of patent dynamic values and operation suggestion output are realized, and the problem that strategy evolution and dynamic earnings cannot be described by an existing method is solved.

The invention provides a machine authority management method based on a customer autonomous decision-making mechanism, comprising the following steps: firstly, acquiring a current account authority configuration set of a target machine, the current account authority configuration set comprising a plurality of authority level nodes and corresponding operation range identifiers, associated account identifiers and verification features, then performing authority feature extraction on the current account authority configuration set; generating a dynamic decision node set representing permission change trigger conditions and verification paths on the basis of a preset autonomous decision model according to hierarchical constraint features and operation behavior features of the permission level nodes, and calling a permission verification model to perform multi-dimensional matching processing on the related characteristics and the node set, generating a permission change verification result, updating a current account permission configuration set according to the permission change verification result, and finally synchronizing the updated configuration set to a target machine operation control module to enable the permission to take effect, thereby realizing flexible and intelligent machine permission management.

The invention discloses an offshore wind power configuration energy storage participation spot electricity market decision-making model and decision-making method, and the model comprises a data collection module, a virtual environment module, an algorithm model module, and a test updating module. The data acquisition module is used for collecting basic operation information of the offshore wind power configuration water storage and energy storage system and scheduling information provided by a power grid; the virtual environment module is used for constructing an operation environment of the offshore wind power configuration energy storage system according to short-term power dispatching requirements of a power grid department and forming a virtual environment; the algorithm model module performs mathematical modeling on the offshore wind power configuration energy storage system according to the basic operation information, and constructs a deep double-Q network model based on a system model for training an intelligent agent to make a decision and participate in short-term spot electricity market transaction; and the test updating module is used for evaluating the training effect of the current deep double-Q network model and performing parameter updating until the decision model output accords with an expected set evaluation standard. The model and the method improve the operation efficiency and benefits of the system.

The invention discloses an optimization system and method for participation of an electric vehicle cluster in an electric power standby market, and is applied to the field of an electric power auxiliary service market, and the system comprises a market uncertainty modeling module which is used for constructing a joint uncertainty model of market price and standby calling probability, wherein the model comprises a probability distribution model and a conditional probability model; the risk quantitative evaluation module is used for evaluating risk exposure degrees of different decision-making schemes, including establishing a multi-period risk accumulation model, and comprehensively evaluating balance indexes of expected income, risk openness and opportunity cost; the robust optimization decision-making module constructs a decision-making model according to the market uncertainty modeling module and the risk quantitative evaluation module, and generates an optimal strategy that the electric vehicle cluster participates in the standby market; the adaptive learning optimization module is used for optimizing the decision model through reinforcement learning; according to the invention, risk-controllable revenue maximization can be realized, so that the electric vehicle cluster can efficiently participate in the electric power standby market.

The invention discloses a task request processing method, computing equipment, electronic equipment and a storage medium, and relates to the technical field of artificial intelligence. The method comprises the following steps: in response to a received task request sent by a target client, constructing a cue word based on the task request; the cue word is input into an intelligent decision model, decision reasoning is conducted on the cue word through the intelligent decision model, an initial processing result and a calling decision result of the task request are obtained, and the calling decision result is used for representing whether the task request needs to be processed through a calling tool or not; and processing the task request based on the initial processing result and the calling decision result to obtain a target processing result. The technical problem of relatively low task processing efficiency in related technologies is solved.

The invention discloses an air combat intelligent decision-making method combining imitation learning and reinforcement learning, and belongs to the field of air combat, and the method comprises the steps: processing battlefield situation information through an air combat intelligent decision-making model, and obtaining a decision-making result used for guiding a local machine. The pre-trained air combat intelligent decision-making model is obtained through the following steps: for sparse expert strategy data with coarse granularity, using a behavior cloning algorithm to train a neural network architecture for imitation learning and reinforcement learning to obtain a strategy network Q1; taking the strategy network Q1 as an initial network in a generative adversarial imitation learning algorithm, and performing imitation learning on a fine-granularity dense expert strategy to obtain a strategy network Q2; and taking the strategy network Q2 as an initial network of a decision network in the reinforcement learning algorithm framework, and carrying out network training by adopting a strategy gradient method until convergence to obtain an air combat intelligent decision model. According to the invention, the sample utilization rate can be effectively improved, and accumulative errors are reduced.

The invention provides a flexible power distribution network intelligent management and control method based on cloud side-end cooperation, and belongs to the technical field of intelligent power grids. An intelligent decision-making model is constructed and issued to an edge server through the cloud, the power grid state is monitored, and a management and control strategy is formulated. The edge servers exchange strategy information and work cooperatively. The sending end edge server computes policy utility based on multi-edge collaboration. And if the strategy is rejected, the sending end edge server updates the intelligent regulation and control judgment and decision model parameters based on the abnormal operation index probability. And if the strategy is accepted and the strategy utility exceeds the utility threshold, the edge server updates the model according to the operation condition of each regional power grid. If the strategy is rejected for multiple times or does not meet the multi-threshold stability requirement, the cloud side uses a ternary loss function containing multiple deviation factors to update the model, and the self-adaptive learning rate and the ternary loss function are introduced by judging the multi-domain stability requirement. According to the invention, the real-time performance and accuracy of decision making are improved.

The invention discloses a super-multi-target vehicle path planning method based on deep reinforcement learning assisted evolution, and aims to dynamically guide a search direction through deep reinforcement learning for multi-target optimization and path planning problems. The core of the method comprises the following steps: 1) constructing a super-multi-target vehicle path problem mathematical model; 2) designing a deep Q network as a decision model, and adaptively selecting a high-potential search direction in iteration; 3) designing a global search strategy, and balancing global search and local optimization; 4) generating a filial generation and evaluating the fitness, and executing environment selection to update the population; and 5) calculating a reward value according to a population evolution effect, and optimizing DQN network parameters. According to the method, through a collaborative mechanism of reinforcement learning and an evolutionary algorithm, a search strategy is dynamically adjusted, the convergence speed and stability of the algorithm are effectively improved, the adaptability to a complex path planning problem is enhanced, and the method has remarkable advantages in solving efficiency, solution set quality and dynamic environment response.

The invention discloses a communication radiation source target confrontation decision-making method based on unsupervised learning. The method comprises the following steps of obtaining an IQ signal of a communication signal and performing signal preprocessing; training a contrast predictive coding CPC model based on the IQ data after signal preprocessing, and extracting IQ data features; inputting the IQ data features into a ResNet network for closed set individual classification, and outputting closed set scores; correcting the closed set score based on an OpenMax algorithm to obtain an open set score, and identifying a radiation source individual according to the open set score; constructing a target adversarial decision model based on a GBDT algorithm, extracting individual features of a communication radiation source and interference adversarial parameter features, and constructing a data set to train the target adversarial decision model; and inputting individual characteristic parameters of the communication radiation source to the trained target adversarial decision model, and outputting interference adversarial parameters. According to the method, the identification accuracy of the communication signals is improved, and the robustness in the face of signals of unknown categories is enhanced.

The invention provides a deep counterfeit multimedia identification method and system based on artificial intelligence, and relates to the technical field of artificial intelligence security. According to the method, high-precision forged content detection is realized through multi-modal feature extraction and link generation reasoning. The method specifically comprises the steps of multi-modal data acquisition and feature extraction, generated link reasoning and knowledge graph adaptation, multi-modal correlation analysis and dynamic threshold setting, forged path rule construction and decision model training, and self-adaptive identification strategy generation. According to the method, multi-modal features are fused, links are generated based on dynamic analysis of the knowledge graph, adaptive threshold judgment and targeted countering are achieved, the problems that a traditional method is insufficient in generalization ability, low in calculation efficiency and the like are solved, and the method can be widely applied to content authenticity identification in the fields of social media, public opinion and the like.

The invention provides a power grid intelligent decision-making method, a model construction method, equipment and a medium, and the method comprises the steps: carrying out the feature extraction of historical power grid metadata and power grid regulation and control strategy data, carrying out the clustering of the obtained historical data features, generating a corresponding label, constructing a knowledge graph through employing the label and strategy features, and carrying out the calculation of the knowledge graph. And the power grid intelligent decision-making model is constructed based on the knowledge graph and the deep learning algorithm, so that the internal semantic relation of the historical power grid metadata can be accurately, fully and quickly mined without relying on the labeling of the rule basis by utilizing the automatic label generation and the knowledge graph construction; therefore, reliable basis and guarantee are provided for timely and accurate power grid intelligent decision making.

The invention provides a dialogue task model training method, a related method, a related device, equipment and a medium. Comprising the following steps: obtaining dialogue problem information in a dialogue task, and inputting a thinking chain cue constructed based on the dialogue problem information into a task decision-making model for task decision-making processing to obtain target dialogue intention information and target task decision-making information; constructing a task decision prompt through the dialogue problem information, the task context information, the task attribute configuration information and the task execution strategy information; the task decision prompt words are input into a task decision model for task decision processing, and predicted dialogue intention information and predicted task decision information are obtained; determining target loss based on the difference between the predicted dialogue intention information and the target dialogue intention information and the difference between the predicted task decision information and the target task decision information; and training the task decision model according to the target loss to obtain a trained task decision model. The method can improve the dialogue accuracy of the dialogue task model.

The invention relates to the technical field of artificial intelligence, and discloses a business process configuration method based on Activiti and AI decision, and the method comprises the steps: collecting the historical execution data of a business process through a process instance monitoring module, generating a process behavior feature data set, carrying out the training processing of an AI decision model based on the process behavior feature data set, and carrying out the analysis of the AI decision model. A business process decision tree model is constructed, AI decision routing labels are configured for decision nodes in an Activiti process engine, non-intrusive intelligent decision integration is achieved, and when a process instance is executed to a key decision node, a system automatically calls the pre-trained business process decision tree model to conduct real-time path analysis and generate an optimal dynamic routing instruction. The problem of decision stiffness caused by the fact that a traditional workflow depends on artificial experience configuration is solved, the accuracy and adaptability of flow branch selection in a complex service scene are improved, and meanwhile the compatibility and stability of an original flow engine are guaranteed.