Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

3493 results about "Decision process" patented technology

Dynamic data pipeline construction method based on artificial intelligence and multi-modal data processing

The invention relates to a dynamic data pipeline construction method based on artificial intelligence and multi-modal data processing, and belongs to the technical field of data fusion treatment and artificial intelligence. According to the method, a multi-modal deep learning model is adopted, semantic analysis is performed on business documents, user requirements and function specification instructions, and key indexes, data requirements and logic constraints are extracted; constructing a multi-modal knowledge graph, performing unified representation and feature extraction on structured and unstructured data resources, and performing embedded learning by using a graph neural network; based on a deep semantic matching model and a hybrid recommendation system, realizing accurate matching of business requirements and data resources; modeling generation of a data processing flow into a Markov decision process by adopting a reinforcement learning strategy, and automatically generating an optimized data processing workflow; the adaptability of the model to new business requirements is improved by utilizing a meta-learning algorithm; and dynamic scheduling and execution of tasks are realized through a workflow engine. According to the invention, the data processing efficiency can be improved.
Owner:BEIJING INST OF COMP TECH & APPL

Agent policy learning method with privacy protection in mobile edge computing

An agent policy learning method with privacy protection in mobile edge computing, which belongs to the technical field of mobile communications. The method comprises: establishing an edge collaborative computing unloading model which comprises a service caching model, a task unloading model and a system cost model; on the basis of the edge collaborative computing unloading model, using the minimization of the processing cost of a task as a target to establish an optimization problem of joint task unloading, service caching, computing power resource allocation and transmission power control; abstracting an optimal problem into a partially observable Markov decision process; and on the basis of the Markov decision process, using a multi-agent deep reinforcement learning algorithm based on a federated learning method to autonomously learn a task unloading, service caching, computing power resource allocation and transmission power control policy. In the present invention, an edge collaborative computing unloading model is established, such that an agent network protects privacy security of data and sensitive information of users by means of training based on federated learning.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Big data-based AI agent design platform decision optimization method

The invention discloses an AI agent design platform decision optimization method based on big data, and particularly relates to the field of artificial intelligence, comprising multi-modal data sensing layer construction, a streaming feature calculation engine, a dynamic index fusion center and an adaptive decision matrix. According to the method, accurate synchronous monitoring of the utilization rate of hardware resources and dynamic collaborative optimization of heterogeneous computing units are achieved, and the resource scheduling efficiency in a complex computing scene is remarkably improved; knowledge system degradation caused by long-term learning is effectively prevented, and the continuous reliability of a cognitive system is ensured. The provided multi-dimensional decision credibility verification system is fused with interpretability penetration analysis, environment coupling modeling and logic drift detection technologies, the limitation of a traditional single credibility index is broken through, the risk prediction and fault-tolerant capability of the decision process is remarkably enhanced, and a full-dimensional safety decision guarantee system is constructed for an intelligent agent.
Owner:SHANDONG HAILIANXUN INFORMATION TECH CO LTD

Method and system for collecting decision data by multi-modal large model driven intelligent agent

The invention discloses a method and a system for collecting decision data by an intelligent agent driven by a multi-modal large model. The method comprises the following steps: collecting original data of a predetermined sensor, calculating information entropy and a normalized mass score, and generating a fusion feature vector through self-adaptive multi-modal information fusion; time sequence sensitive multi-mode alignment processing is carried out on the image, and time sequence alignment features are obtained by combining timestamp embedding and a self-attention mechanism; based on this, decision distribution is generated by using a Bayesian neural network, uncertainty is evaluated, and a final decision and index set is generated; evaluating a task score in combination with task description, and making an execution plan according to a resource state; initializing the model, generating synthetic data, optimizing the model and storing experience. According to the invention, the efficient decision-making process of the intelligent trolley is realized, and the execution capability and task completion precision of the intelligent trolley are improved.
Owner:NANJING ARTIFICIAL INTELLIGENCE CHIPS RES INST OF AUTOMATION CHINESE ACAD OF SCI +1

Predictive maintenance method for light storage and charging integrated power station based on deep learning

The invention discloses a predictive maintenance method for an optical storage and charging integrated power station based on deep learning, and the method comprises the steps: constructing an efficient equipment state evaluation and prediction model based on multi-source data fusion, an intelligent prediction algorithm and a closed-loop optimization feedback mechanism, collecting multi-source data, and carrying out the fusion processing, an improved Attention-LSTM model is utilized to evaluate and predict the state of equipment, a transfer learning method is adopted to improve generalization ability, Bayesian optimization and an adaptive sliding window technology are combined at the same time, dynamic threshold adjustment is performed, a deep reinforcement learning algorithm based on a Markov decision process is adopted to optimize a maintenance strategy, and the maintenance efficiency is improved. Weibull distribution is introduced for failure probability modeling, the maintenance cost and the fault risk are balanced, continuous optimization and dynamic adaptive adjustment of a predictive maintenance scheme are realized through a closed-loop feedback mechanism, the prediction accuracy and the intelligent level of maintenance decision are remarkably improved, planned maintenance and sudden fault maintenance are reduced, and the maintenance efficiency is improved. And the reliability of the charging station is improved.
Owner:NANJING INST OF MECHATRONIC TECH

Decision generation execution method and system based on AI intelligent agent

The invention provides a decision generation and execution method and system based on an AI agent, and the method comprises the steps: analyzing a user demand document through a natural language processing technology, and extracting key information to construct a structured cue word; then inputting the cue word into a private domain AI agent based on a large model, and generating a preliminary decision scheme in combination with a professional domain database; automatically generating adversarial introspection probe cues, and guiding an AI agent to carry out consistency, risk and constraint conformity evaluation on the preliminary scheme; the system collects feedback response of the AI intelligent agent, analyzes the feedback through a pre-trained graph neural network, and calculates a confidence score of a decision scheme; when the confidence reaches a preset threshold value, automatically generating an execution script according to the decision scheme; and the execution script automatically operates the target system through the preset API and generates an execution document. The whole process realizes a closed-loop intelligent decision-making process from demand understanding, scheme generation, self-verification and automatic execution, and the decision-making efficiency and reliability are remarkably improved.
Owner:DEEP PERCEPTION (WUHAN) TECHNOLOGY CO LTD

Commodity tracing method and system for cross-border logistics

The invention provides a commodity tracing method and system for a cross-border e-commerce supply chain. The method comprises the following steps: designing a block chain network in which multiple parties participate in the cross-border e-commerce supply chain by adopting an alliance chain architecture; designing a hierarchical data storage scheme, and storing high-frequency transaction data in an off-chain database; integrating the graph neural network model in the block chain network; constructing a reinforcement learning model, and modeling a supply chain operation process as a Markov decision process; a data management scheme based on the block chain and the Internet of Things is designed for the demand of supply chain full-process tracking; a hybrid architecture is deployed in a distributed environment, and a containerization technology and micro-service design are adopted; for the interpretability demand of a complex architecture, an attention mechanism and a causal reasoning technology are introduced, and visual interpretation is carried out on the decision process of the model. According to the invention, the efficiency and profitability of the supply chain are improved, and a new direction and solution are provided for commodity traceability of cross-border logistics.
Owner:TIANSHENG CROSS -BORDER SUPPLY CHAIN (GUANGDONG) CO LTD

Optical storage charging and discharging station aggregation control and optimization method based on virtual power plant

The invention provides an optical storage charging and discharging station aggregation control and optimization method based on a virtual power plant, and aims to solve the problems of multi-target collaborative optimization, dynamic resource response and uncertainty robustness. By introducing a Markov decision process and an adaptive clustering algorithm, the system can dynamically aggregate photovoltaic, energy storage and charging pile resources according to equipment characteristics, and power dispatching is optimized. A multi-objective optimization model is adopted, economical, technical and environmental objectives are combined, a dynamic weight factor is introduced, and optimal scheduling is generated in combination with a fuzzy decision theory. And real-time compensation is carried out by adopting a rolling time domain control framework and deep reinforcement learning, so that the scheduling precision and the response speed are improved. The edge computing and cloud collaboration mechanism reduces the communication load through a lightweight federated learning model, and improves the scheduling response efficiency. According to the invention, the scheduling efficiency of the optical storage charging station can be obviously improved, the operation cost is reduced, the system stability is improved, and the system has good adaptability and expandability.
Owner:NANJING INST OF MECHATRONIC TECH

Marketing strategy optimization method based on big language model analysis and evaluation driving

The invention provides a marketing strategy optimization method based on big language model analysis and evaluation driving, and the method comprises the steps: obtaining historical data including user behavior data, label data and statistical data, carrying out the analysis, and constructing a basic marketing strategy; user content data are collected in real time through Kafka, deep analysis is conducted on user content through a large language model, and a personalized marketing scheme is matched from a knowledge base based on the deep analysis result of the large language model and basic rule matching; through a feedback circulation mechanism, feedback of the user to marketing activities is collected, and a feedback result is stored in a knowledge base and used for optimizing a marketing strategy and a large language model; meanwhile, the decision-making process is logged, textualized and vectorized and is stored in a vector library, and the decision-making process and the marketing scheme are optimized in combination with a continuously optimized large language model, so that dynamic adjustment and matching are realized. According to the invention, the accuracy and effect of the marketing strategy are improved by using the large language model.
Owner:BEIJING NANTIAN INFORMATION ENG CO LTD +1

Multi-modal fusion and reinforcement learning collaborative retrieval enhancement generation method and system

The invention relates to the technical field of information retrieval, and discloses a multi-modal fusion and reinforcement learning collaborative retrieval enhancement generation method and system. The method comprises the following steps: receiving an original query input by a user, and generating a sub-query based on a large language model in combination with a multi-modal context of a current iteration step; forming a current state in combination with the sub-query and the multi-modal context, modeling a retrieval enhancement generation task as a Markov decision process, and adaptively selecting an optimal action from a predefined action set in the current state by utilizing a large language model according to a decision strategy; executing a corresponding multi-modal retrieval operation according to the optimal action, fusing the obtained multi-modal information, generating an intermediate answer or a final answer of the sub-query, and updating a multi-modal context by using the intermediate answer; off-line training optimization is carried out on the large language model through imitation learning and a calibration chain, and decision strategies and sub-queries are inferred online through the model after fine adjustment. According to the invention, more efficient and accurate complex query processing is realized.
Owner:DATA SPACE RES INST

City updating intelligent expert system architecture and method based on large language model

The invention discloses a city updating intelligent expert system architecture and method based on a large language model, and relates to the technical field of city planning and construction. The knowledge base management module supports efficient retrieval and application of professional domain knowledge; the expert agent group comprises a user-defined core expert and a system dynamic supplement expert; the expert team collaborative decision-making module is used for executing multiple rounds of hierarchical collaborative decision-making processes; the meta-agent module is responsible for project feature analysis and expert team dynamic configuration; the auxiliary agent module comprises a host agent which is responsible for guiding the decision making process; the recorder agent generates a decision summary report; the verification agent is responsible for verifying and evaluating the professional ability of the expert agent; and the scoring agent evaluates the decision quality. According to the method, the problems of dispersed professional knowledge, low cross-domain expert cooperation efficiency, high decision-making cost and the like in the existing city updating decision-making process are solved, and the decision-making efficiency and quality of city updating early-stage planning are comprehensively improved.
Owner:BEIJING UNIV OF TECH

Comprehensive energy system economic dispatching model method based on deep reinforcement learning

The invention discloses an integrated energy system economic dispatching model method based on deep reinforcement learning, and the method comprises the steps: constructing a park equipment environment model, and carrying out the mathematical description of a park integrated energy system low-carbon economic dispatching problem through taking economy and carbon emission as targets; secondly, the scheduling problem is expressed as a Markov decision process framework, and a state space, an action space and a reward mechanism of the system are reasonably designed; then, a near-end strategy optimization algorithm is adopted to carry out low-carbon economic dispatching decision making, and an action noise dynamic updating strategy is provided to gradually improve the exploration capability and learning capability of a network model; according to the method, the action space, the state space, the reward mechanism, the neural network structure and the like of the intelligent agent are designed in detail, the minimization of the system operation cost is considered on the basis, and a deep reinforcement learning method is adopted for scheduling simulation. The method provided by the invention can perform optimal scheduling according to the load demand of the system, and has good scheduling performance and self-learning ability.
Owner:JINGCHU UNIV OF TECH

Agricultural disease and insect pest question-answering method based on knowledge graph adaptive mixed retrieval enhancement

The invention discloses an agricultural pest question-answering method based on knowledge graph adaptive hybrid retrieval enhancement. The method comprises the following steps: 1) data acquisition and arrangement; 2) construction of a knowledge graph and a vector library; 3) constructing a question and answer pre-classification system; 4) building and training a question type automatic classification model: automatically identifying and classifying the questions input by the user by using a small classification model to form a self-adaptive retrieval classifier; 5) self-adaptive knowledge retrieval based on question types: according to the queried question types, self-adaptively and dynamically selecting different retrieval methods of the knowledge graph and the vector library; 6) selecting a corresponding thinking chain reasoning method according to retrieval results of the knowledge graph and the vector library, and constructing a Prompt cue word with high pertinence; according to the method, the knowledge graph and vector library retrieval are fused, so that the answering precision and accuracy are improved, and by integrating a thinking chain (CoT) reasoning framework, the decision-making process of disease and insect pest problem analysis and answering has a clear logic chain.
Owner:YANGZHOU UNIV +1

Intelligent low-code development method and system based on deep learning model optimization

The invention discloses an intelligent low-code development method and system based on deep learning model optimization, and relates to the technical field of deep learning. A multi-dimensional domain knowledge graph is constructed, a three-dimensional space-time fusion training sample set is constructed based on the domain knowledge graph, and cross-modal feature alignment is performed on the training sample set, so that the multi-dimensional domain knowledge graph is constructed; the method comprises the following steps: generating an executable logic flow template, encoding the executable logic flow template into a Markov decision process, and performing joint strategy optimization on an optimization target of logic flow by integrating a feature importance index generated by a gradient back propagation path and a multi-target reinforcement learning framework of a Pareto leading edge analysis module. Extracting a strategy parameterization sequence after joint strategy optimization, injecting the strategy parameterization sequence into a dynamic verification sandbox environment, and performing abnormal mode detection and feedback type parameter distillation iteration on an execution track through an online variational auto-encoder to complete dynamic adjustment of the strategy; and the elasticity, the stability and the expandability of the low-code platform are improved.
Owner:NANJING NINE-SIDED TECH CO LTD

DCS system autonomous controllable upgrading and system fault prediction method and system

The invention provides a DCS system autonomous controllable upgrading and system fault prediction method and system, and relates to the technical field of fault prediction, and the method comprises the steps: obtaining historical operation data and real-time operation data of a DCS system, carrying out the preprocessing, and generating an autonomous controllable upgrading scheme through a deep reinforcement learning algorithm; the method comprises the following steps of: setting specified time for upgrading time, carrying out consistent backup on the state of the DCS, executing software updating, hardware configuration adjustment and system parameter optimization according to upgrading steps, analyzing indexes of the DCS in real time in the process of executing the autonomous controllable upgrading scheme, and recovering the DCS to the state before upgrading when an abnormal condition is detected. And verifying and optimizing the real-time fault prediction result based on a knowledge graph, and generating an explanatory report including a fault prediction and upgrade decision process according to the optimized fault prediction result and the autonomous controllable upgrade scheme.
Owner:HEBEI YUZHOU ENERGY INTEGRATED DEV CO LTD

Standard substance and standard substance retrieval and sorting method and system based on search engine

The invention provides a search engine-based standard substance and standard substance retrieval and sorting method, which relates to the technical field of data processing, and comprises the following steps: acquiring retrieval keywords input by a user, constructing a standard substance and standard substance knowledge base, mapping to a low-dimensional semantic space, calculating the semantic correlation between the retrieval keywords and the standard substance knowledge, and constructing a heterogeneous information network. Generating comprehensive relevancy measurement, and performing multi-granularity semantic matching to obtain candidate retrieval results; for structural features corresponding to the candidate retrieval results, adaptive feature weights are distributed, independent clustering is carried out, subspace clustering results are obtained, optimization is carried out, global optimal clustering results are obtained, high-order semantic association features are mined, cross-category semantic association is carried out, and high-quality retrieval results are generated; performing low-rank decomposition to obtain an initial comprehensive score, modeling a sorting problem as a Markov decision process, determining an action space and a state space, constructing a reward function, determining a sorting position, and obtaining an optimal sorting result.
Owner:TAN-MO TECH CO LTD

Monitoring fault analysis method fused with multi-modal knowledge base

The invention relates to the technical field of fault analysis, and particularly provides a monitoring fault analysis method fused with a multi-modal knowledge base, which comprises the following steps: collecting original data of a monitoring fault log, and preprocessing and storing the original data; performing data cleaning and feature extraction on the obtained original data of the monitoring fault log; constructing a searchable knowledge base based on the cleaned data; when the system triggers an alarm, mixed retrieval is executed through a dynamic routing mechanism; aggregating the plurality of retrieval results to generate an executable repair scheme; iteratively optimizing the decision process through manual feedback; and continuously optimizing the knowledge base and the diagnosis model to form a closed loop iteration mechanism. According to the scheme, the accuracy and response efficiency of fault diagnosis are improved.
Owner:ADVANCED OPERATING SYST INNOVATION CENT (TIANJIN) CO LTD

Intelligent flow arrangement method based on fusion expert network and deep reinforcement learning

The invention discloses an intelligent flow arrangement method based on fusion expert network and deep reinforcement learning, which comprises the following steps: collecting network node and link state data in real time, and constructing a time sequence input vector and a topological graph structure; a time sequence neural network and a graph neural network are used for extracting traffic spatial-temporal features and node topological features respectively, future traffic is predicted through a classification network after fusion, and coarse-grained arrangement of network slices of different service levels is completed; modeling resource scheduling into a multi-agent Markov decision process, and designing a state space, an action space and a reward function; a deep reinforcement learning agent is initialized, and training is carried out through interaction experience; fusing a pre-trained expert strategy network, and constructing a total loss function to optimize network parameters; and finally generating an intelligent strategy capable of dynamically optimizing the flow path and resource allocation according to the real-time state. According to the invention, efficient resource scheduling under multi-service differentiation service quality requirements can be realized.
Owner:NARI INFORMATION & COMM TECH

Large model agent interactive question and answer task decision-making method, device and equipment and medium

The invention relates to a large model agent interactive question and answer task decision-making method, device and equipment and a medium. The method comprises the following steps: constructing an agent strategy model based on a partially observable Markov decision-making process; acquiring an instruction input by a user, and generating an information search track by adopting the agent strategy model; constructing a decision tree of an information search trajectory by adopting a Monte Carlo tree search algorithm to obtain a preference data set labeled by a Q value; setting a large language model, and training the large language model by adopting the step-level optimization objective function according to the preference data set marked by the Q value to obtain a trained large language model; constructing a Q value model according to the trained large language model, and then outputting Q value estimation according to the Q value model; and according to Q value estimation and information search trajectory selection actions, generating a question and answer process. According to the method, the expression and generalization ability of the large model agent in the autonomous reasoning and decision-making process can be remarkably enhanced.
Owner:NAT UNIV OF DEFENSE TECH

Method for realizing large-scale language model training through computing power of intelligent computing center

The invention provides a method for realizing large-scale language model training through computing power of an intelligent computing center, and relates to the technical field of computing power infrastructure and artificial intelligence, and the method comprises the following steps: S1, a first agent receives and understands a large-scale language model training task given by a user on a dialogue interface; s2, the first intelligent agent divides the task into a plurality of sub-tasks, and the sub-tasks are distributed to a plurality of second intelligent agents; s3, the first agent determines an execution plan of the task and notifies the second agent to execute the allocated sub-task based on the execution plan; and S4, the first agent or the second agent generates a report result of the task and reports the report result to the user. Due to the adoption of cooperation of multiple agents, the computing power of the intelligent computing center can be fully utilized to process a relatively complex task for training the large language model, and meanwhile, in the process of executing the task for training the large language model, a dialogue interface is adopted to display a communication process and a decision process, so that the processing process is clearer.
Owner:DATACANVAS LTD

Satellite-ground collaborative edge network resource allocation method based on depth deterministic strategy gradient

The invention discloses a satellite-ground collaborative edge network resource allocation method based on depth deterministic strategy gradient, belongs to the field of network resource optimization in satellite internet, and adopts a DRL method to optimize allocation of bandwidth resources and computing resources. Firstly, a satellite-ground collaborative edge network resource allocation model containing a physical space and a digital twin space is designed. Secondly, establishing an allocation problem of communication resources and computing resources to balance the time delay and energy consumption of the system, and modeling a joint target optimization problem in the satellite-ground collaborative edge network as a Markov decision process (MDP); then, an algorithm based on a depth deterministic policy gradient (DDPG) is provided to intelligently decide allocation of bandwidth resources and calculate the allocation proportion of the resources, and system time delay and energy consumption are reduced to the maximum extent under the condition that constraints are met.
Owner:BEIJING UNIV OF TECH

Cloud edge computing power network routing optimization method

The invention discloses a cloud edge computing power network routing optimization method in the technical field of computing power networks. The method comprises the following steps: acquiring high-dimensional computing power node embedding representation and edge embedding representation of a network topology structure of a cloud edge computing power network; acquiring a hidden state set of each link in the network topology structure when message transmission is carried out between the computing power nodes; according to the high-dimensional computing power node embedding representation, the edge embedding representation and the hidden state set, predicting future traffic of each link in the network topology structure to obtain state information of each link; a pre-constructed routing scheduling problem is converted into a Markov decision process; based on a Markov decision process, a multi-agent near-end strategy optimization algorithm is adopted to train agents, and an optimal routing strategy is obtained; wherein the routing scheduling problem is constructed and acquired by taking minimization of a link utilization rate standard deviation and task transmission time as targets. According to the method, the problems of low routing optimization efficiency and poor flexibility in the existing cloud edge computing power network are solved.
Owner:NANJING UNIV OF POSTS & TELECOMM

Air-space-ground network congestion control method based on deep reinforcement learning

The invention discloses an air-space-ground network congestion control method based on deep reinforcement learning. The method comprises the following steps: acquiring data information of a target air-space-ground network; setting an optimization target and carrying out modeling; setting a state space, an action space and a reward function of the decision process; constructing a state prediction module, a reward redistribution module and an optimization strategy module of the decision process; and performing congestion control of the space-air-ground network based on deep reinforcement learning according to the constructed module. According to the invention, through obtaining the data information of the plurality of target air-space-ground networks, based on the setting of the state space, the action space and the reward function, and the realization of state prediction, reward redistribution and optimization strategies, the congestion control of the air-space-ground network based on deep reinforcement learning is realized, the reliability is higher, and the method is more suitable for large-scale popularization and application. The precision is better, and the effect is better.
Owner:CENT SOUTH UNIV

Satellite multi-hop task unloading optimization method and system based on edge calculation

The invention discloses a satellite multi-hop task offload optimization method and system based on edge computing, and the method comprises the steps: obtaining a task offload optimization problem through employing an on-demand routing protocol under a constraint condition based on environment exploration information with the minimum energy consumption of a system model as a target when the access satellite computing resources of a ground user are insufficient; and constructing a task unloading optimization problem into a Markov decision process, and solving by combining a deep reinforcement learning algorithm to obtain a task unloading and routing optimization strategy. In the invention, under the condition of insufficient computing resources of an access satellite, an on-demand routing protocol is combined to support efficient multi-hop task transmission unloading, so that energy consumption is comprehensively considered and selection of an intermediate satellite node on a routing path from a source satellite node to a target satellite node is optimized on the basis of the minimum hop count of the task; and the processing nodes are dynamically reached through multiple hops, and meanwhile, the control overhead of the whole network topology in the task unloading process is reduced to the greatest extent.
Owner:GUANGDONG UNIV OF TECH

Unmanned aerial vehicle cluster task planning algorithm based on hierarchical multi-agent deep reinforcement learning and evaluation method thereof

The invention discloses an unmanned aerial vehicle cluster task planning algorithm based on hierarchical multi-agent deep reinforcement learning and an evaluation method thereof, belongs to the technical field of unmanned aerial vehicles, and solves the problems of low online solving efficiency, large calculation amount, poor stability and high efficiency generally existing in a conventional unmanned aerial vehicle cluster cooperative task planning problem solving algorithm. And the method is difficult to adapt to complex dynamic scenes. The method comprises the following steps: firstly, respectively establishing a Markov decision process model of a cluster task allocation problem part and a Markov decision process model of a track planning problem part; secondly, a layered deep reinforcement learning framework based on multi-agent deep reinforcement learning is provided, and synchronous solving of task allocation and route planning association coupling problems is achieved through coupled training and a layered solving mode; in addition, an unmanned aerial vehicle cluster combat simulation environment is established based on UE4 and Airsim, evaluation indexes are designed, and the result shows that the method has good performance in cluster task planning, and the intelligent and actual combat level of cluster combat can be effectively improved.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Smart grid fault self-healing method and system based on generative artificial intelligence

The present invention discloses a method and system for smart grid fault self-healing based on generative artificial intelligence, which relates to the field of smart grid fault self-healing. The method includes: obtaining and preprocessing multi-source heterogeneous data; generating a pre-trained language model and performing domain adaptability fine-tuning, adding a task-specific output layer; performing feature fusion using a multimodal data fusion method, and using annotated historical fault data sets for supervised training to obtain fault diagnosis results. Fault self-healing is modeled as a Markov decision process, and a deep reinforcement learning algorithm is used to interactively learn the optimal decision-making strategy with a power grid simulation environment, and an optimal fault self-healing plan is generated and converted into specific operation instructions. The present invention integrates multi-source heterogeneous data, performs accurate positioning and description generation, improves the reliability and self-healing ability of the smart grid, and ensures rapid recovery of normal operation when a power grid fails.
Owner:STATE GRID LIAONING ECONOMIC TECHN INST

Multi-modal data processing method and system, computer equipment and readable storage medium

The invention discloses a multi-modal data processing method and system, computer equipment and a readable storage medium, which can realize deep association and complementarity mining of multi-modal information and improve the accuracy and robustness of multi-modal understanding. The method comprises the following steps: an environment sensing module adjusts an environment sensing strategy according to feedback information transmitted by a self-adaptive decision module, and acquires multi-modal data according to the environment sensing strategy; the multi-modal encoding module encodes the multi-modal data into multi-modal feature vectors of the same dimension; a cross-modal fusion module fuses the multi-modal feature vectors to obtain fusion features; the self-adaptive decision-making module selects a decision-making network matched with the task type from a predefined network library according to the task type of the current decision-making task, inputs the fusion features into the decision-making network, and generates feedback information according to the decision-making process of the decision-making network; and the meta-learning controller evaluates the system performance of the current multi-modal data processing system and adjusts system parameters according to an evaluation result.
Owner:SHENZHEN QIANHAI HUANRONG LIANYI INFORMATION TECHNOLOGY SERVICES CO LTD

Precast beam field production scheduling analysis management method and system based on large model

The invention discloses a precast beam field production scheduling analysis management method and system based on a large model, and the method comprises the steps: combing precast beam production technological processes, constructing a beam field Internet of Things sensing network, and collecting production information in real time; defining a general engineering data format, establishing a unified standardized beam field production knowledge base, and performing multi-modal data fusion on production elements; analyzing feasibility constraint rule conditions, describing a precast beam production scheduling problem, and establishing a beam field self-organizing scheduling decision mechanism; defining production state characteristics, establishing a beam field scheduling decision process model, and training a large scheduling model based on a PPO algorithm; and developing a beam field scheduling analysis management platform, automatically generating a production scheduling scheme in combination with a real-time production state, and realizing dynamic management of beam field production scheduling. The problems that in the prior art, the resource utilization efficiency is low, scheduling decision making depends on artificial experience, and continuous learning and self-optimization capacity is lacked are solved, and the intelligent level and the management effect of the precast beam field are improved.
Owner:武汉数字建造产业技术研究院有限公司

Multi-aircraft cooperative formation route planning method based on leader and follower model

The invention discloses a multi-aircraft cooperative formation flight path planning method based on a leader and follower model, and relates to the technical field of environment perception and unmanned aerial vehicle cluster cooperation. The method comprises the following steps of: firstly, designing a multi-agent double delay depth deterministic strategy gradient (LFMATD3) based on a leader-follower model, and converting an optimization problem model into a Markov decision process model by introducing an artificial potential field model and a reward function; and secondly, constructing an independent agent for each unmanned aerial vehicle, optimizing a behavior strategy of the unmanned aerial vehicle by combining a reward function based on an algorithm framework of deep reinforcement learning, and performing flight path planning and realizing dynamic formation control. The method provided by the invention can effectively improve the formation stability and collaboration of the unmanned aerial vehicles in a complex environment.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Individualized exercise recommendation method and recommendation system integrating reinforcement and comparative learning

The invention discloses a personalized exercise recommendation method fusing reinforcement and comparative learning, and the method employs a self-supervised reinforcement learning method, enables an exercise recommendation process to be formalized into a Markov decision process, carries out the interaction between a student and an intelligent agent, and obtains a feature representation. Meanwhile, a comparative learning thought is integrated, similar learning histories are drawn together, and different learning histories are separated, so that effective characterization is learned; splicing the hidden states to obtain spliced representations # imgabs0 # and # imgabs1 #, and further obtaining a whole exercise and interaction history representation; # imgabs2 # and # imgabs3 # are used as input, and a final Q value is obtained through calculation and splicing of a Q value function; then, through a self-supervised reinforcement learning method, the accumulated reward is maximized; and in combination with self-supervision, reinforcement and learning loss comparison, model training is performed by using gradient descent, a final exercise recommendation result is obtained by using the model, and more suitable exercises are recommended to students. The invention also discloses a system for realizing the method.
Owner:EAST CHINA NORMAL UNIV