Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

19303 results about "Reinforcement learning" patented technology

Reinforcement learning (RL) is an area of machine learning concerned with how software agents ought to take actions in an environment so as to maximize some notion of cumulative reward. Reinforcement learning is one of three basic machine learning paradigms, alongside supervised learning and unsupervised learning.

Convergent Intelligence Fabric for Multi-Domain Orchestration of Distributed Agents with Hierarchical Memory Architecture and Quantum-Resistant Trust Mechanisms

A system and method for implementing a convergent intelligence fabric (CIF) for distributed artificial intelligence operations. The CIF architecture integrates tensor-theoretic foundations, probabilistic cache management, precision-aware memory operations, quantum-resistant security, and neural-based optimization within a unified framework. The system orchestrates asynchronous, multi-hop data flow among computational resources while maintaining data security through per-block encryption and identity-based access control. Key components include a universal multi-model KV cache subsystem, agent-parallel disaggregation pipelines, reinforcement learning-based orchestration, and neuromorphic memory integration. Advanced implementations incorporate graphon-enhanced memory for sparse graph sequences, multi-modal cognitive persistent memory, and quantum-resistant asynchronous multi-domain trust protocols. The system enables efficient cross-agent collaboration, sophisticated knowledge sharing, and secure cross-domain operations while optimizing computational resources and maintaining strict privacy guarantees across distributed AI deployments.
Owner:QOMPLX INC

Multi-modal dynamic optimization educational resource recommendation system and method

The invention relates to a multi-modal dynamic optimization educational resource recommendation system and method, and the system comprises the following modules: a multi-modal data collection module integrates video behaviors, answer tracks, physiological signals and other data through edge calculation, and constructs a learning feature map; the student portrait module adopts an LSTM-Attention network in combination with a graph neural network to dynamically model knowledge mastery and learning styles; the resource matching engine realizes multi-objective optimization of knowledge gain, cognitive load and interest matching based on reinforcement learning and knowledge graph analysis; the tag adaptive module dynamically adjusts resource weights through causal inference and comparative learning, the personalized recommendation module generates a dynamic learning path and pushes adaptive resources based on student portraits and real-time behavior data, and the learning progress tracking module monitors a learning state in real time and feeds back the learning state to the resource matching engine to optimize a recommendation strategy in a closed loop mode. The technical defects that resource recommendation of a traditional education platform is rigid and personalized adaptation is lacked are overcome.
Owner:WUHAN YOUYOU TECHNOLOGY CO LTD

Smart park full-life-cycle management system and method based on digital twinning and Internet of Things

The invention discloses a smart park full life cycle management system and method based on digital twinning and Internet of Things, and relates to the technical field of smart park management, and the system comprises a sensing edge module, a data governance module, an intelligent analysis module, a life cycle module and a twinning modeling module. According to the invention, multi-protocol access and edge computing capability are supported, and the data transmission efficiency and stability are greatly improved; the intelligent analysis module outputs an accurate analysis result by constructing a multi-class feature matrix and deep multi-task joint modeling mechanism, and provides data support and model guidance for dynamic management and intelligent decision making of the park; the life cycle module integrates a Kepler optimization algorithm and a multi-agent reinforcement learning and simulated annealing algorithm, establishes a collaborative optimization mechanism, realizes combination of global search and local fine tuning of resource scheduling, and effectively optimizes energy consumption, response time, space utilization and safety risks; and the twin modeling module constructs a park three-dimensional model, so that the interactivity and operability of the system are improved.
Owner:SUQIAN NANYOU DIGITAL ECONOMY IND RES INST +1

Computing resource scheduling method based on user demands and task priorities

The invention discloses a computing resource scheduling method based on user demands and task priorities, which relates to the technical field of resource scheduling, and comprises the following steps: receiving a computing task request submitted by a user, analyzing and verifying explicit demand parameters and implicit demand parameters, and generating a standardized demand description object; acquiring cluster state data and external environment parameters in real time, constructing a user-task-environment three-dimensional feature tensor, and outputting a standardized feature vector group; and collecting a performance data flow of the container instance group, triggering an elastic scaling decision based on a pre-trained LSTM prediction model, dynamically adjusting cluster resource configuration and executing abnormal task rescheduling. According to the method, a user-task-environment three-dimensional feature tensor is constructed, and a dynamic mixed weighted priority score is generated in combination with a reinforcement learning model, so that space alignment and time sequence cumulative effect fusion of multi-dimensional features is realized.
Owner:WUHAN SPARK ZHONGDA INFORMATION TECH CO LTD

Industrial robot walking control system based on obstacle recognition

The invention relates to the technical field of industrial robots, in particular to an industrial robot walking control system based on obstacle recognition. Comprising an environment sensing unit; the obstacle analysis and decision-making unit is used for processing the multi-dimensional data output by the environment sensing unit based on a deep reinforcement learning framework, accurately identifying static obstacle and dynamic obstacle types, motion trails and interaction influences, constructing a two-dimensional decision-making model of static obstacle avoidance and dynamic obstacle avoidance, and carrying out obstacle avoidance and obstacle avoidance on the basis of the two-dimensional decision-making model. A differential obstacle avoidance strategy is triggered; the path planning unit is based on a dynamic game path algorithm under space-time constraint; and an instruction transceiving unit. Through the multi-modal fusion sensing technology and the adaptive parameter adjustment module, space-time alignment and feature fusion of multi-source data such as three-dimensional point cloud, texture features and vibration spectrum are realized, a high-dimensional environment state model is constructed, and the problem of insufficient data fusion depth in the prior art is effectively solved.
Owner:JIANGSU ZHENG MAO MFG CO LTD

Dynamic sensitive data outbound risk assessment method and system based on multi-source risk information

The invention discloses a dynamic sensitive data outbound risk assessment method and system based on multi-source risk information in the technical field of data cross-border. The system is mainly composed of a multi-source risk information acquisition module, a dynamic security identifier generation module, a risk collaborative assessment engine, a dynamic weight adjustment module, a disposal range dynamic calculation module and a flexible emergency disposal module, and an acquisition-identifier-assessment-calculation-disposal full-process closed-loop architecture is formed. A full-process closed-loop processing framework of collection-identification-evaluation-calculation-disposal is innovatively proposed, and by combining a dynamic risk evaluation model, a reinforcement learning intelligent technology and a block chain evidence storage technology, the problems of insufficient dynamic nature, lack of collaboration and lack of closed-loop capability in the prior art are systematically solved; and high-precision evaluation, real-time response and traceable management and control of the cross-border data flow risk are realized.
Owner:积至(海南)信息技术有限公司

Intelligent programming auxiliary method and system based on multi-mode AI language model

The invention discloses an intelligent programming auxiliary method and system based on a multi-modal AI language model, and belongs to the technical field of programming auxiliary tools. The method comprises the following steps: a multi-modal input processing stage; a dynamic context modeling stage; a hierarchical semantic analysis stage; in the code generation stage, codes are generated in two stages by adopting a Codex-Plus large model; the reinforcement learning driven code optimization stage is used for carrying out multi-objective optimization and reward function design on the codes generated in the code generation stage; a multi-dimensional feedback stage; an interaction and visualization stage; code semantic deep analysis, dynamic context sensing, multi-target optimization generation and real-time interactive feedback are realized by fusing code texts, natural language description, developer behavior data and a domain knowledge graph, and programming efficiency and code quality can be remarkably improved.
Owner:积至(海南)信息技术有限公司

Wind power plant booster station multi-source data fusion anti-misoperation locking intelligent decision and early warning method

The invention discloses a wind power plant booster station multi-source data fusion anti-misoperation locking intelligent decision-making and early warning method, and relates to the technical field of intelligent misoperation prevention of a power system, and the method comprises the following steps: collecting multi-source heterogeneous data, obtaining the data through a distributed sensor network, and carrying out the edge calculation preprocessing; performing data space-time alignment and fusion, performing equipment state evaluation, and constructing a deep belief network and Bayesian network hybrid model to calculate a health index; anti-misoperation rule modeling is carried out, and operation logic verification is carried out based on a Petri network and an expert knowledge base; risk early warning decision making: fusing multi-source early warning information to divide risk levels; intelligent locking control is carried out, and a locking strategy is optimized through reinforcement learning; and performing decision support and visualization, constructing a three-dimensional digital twinborn model, and displaying operation guidance and risk early warning in combination with an AR technology. Through multi-source data fusion and intelligent decision making, the anti-misoperation locking accuracy and efficiency are improved, and the safety and the operation and maintenance level of the booster station are remarkably enhanced by equipment fault early warning three months ahead of time.
Owner:BEIJING YANENG ELECTRIC EQUIP CO LTD

Knowledge graph construction method and system based on large language model

The invention relates to a knowledge graph construction method and system based on a large language model, and the method and system achieve the automatic construction and dynamic maintenance of a knowledge graph through multi-modal data fusion, reinforcement learning and comparative learning joint optimization, teacher-student model knowledge migration, time sequence dynamic analysis and an incremental updating mechanism. Constructing a reinforcement learning framework, and taking accuracy and integrity as reward indexes to train a large model to extract an entity relationship; a large-scale knowledge graph is used as a teacher model, and conflict resolution and semantic alignment of newly added knowledge and an existing graph are realized through a graph attention network; a verification rule is dynamically generated based on historical data and domain knowledge, and relation periodicity and mutation points are detected in combination with Fourier transform and a CUSUM algorithm; and finally, generating a traceable knowledge graph through incremental updating and version control. And the multi-modal data processing precision, the entity relationship extraction dynamic adaptability and the knowledge graph maintenance efficiency are improved.
Owner:SICHUAN UNIV JINCHENG INST

Multi-element sales planning agent system and method

The invention discloses a multi-element sales planning agent system and method, and aims to improve the intelligence and precision of sales planning. The system comprises a collection module, an analysis module, an optimization module, a creation module and a generation module. The collection module is used for receiving multi-modal data such as marketing targets and extracting key marketing elements. The analysis module is used for generating a target user portrait and extracting marketing strategy analysis data. And the optimization module is used for calculating a medium putting weight by utilizing reinforcement learning and generating a medium strategy scheme. And the creation module generates a propagation theme and marketing content by adopting a generative artificial intelligence technology. And the generation module predicts a delivery effect by using a machine learning model and dynamically optimizes a medium strategy and a content scheme. Through multi-modal data fusion, intelligent analysis and optimization, closed-loop processing from data acquisition to marketing execution is realized, the marketing decision-making efficiency is improved, and brand promotion accuracy and market adaptability are enhanced.
Owner:SUZHOU DUOYUAN DATA CO LTD

Intelligent agent autonomous decision control method based on multi-modal data fusion

The invention discloses an agent autonomous decision control method based on multi-modal data fusion. The method comprises the following steps: S1, synchronously collecting multi-source heterogeneous data; s2, dynamic weight adaptive fusion is carried out; s3, generating a task-driven decision; and S4, performing autonomous decision closed-loop optimization. According to the method, through dynamic weight distribution and space-time correlation modeling, the problems of heterogeneity and environment adaptation in multi-modal data fusion are solved; furthermore, a risk-sensitive reinforcement learning framework and a closed-loop feedback mechanism are combined, so that full-link cooperative control from data fusion, strategy generation to optimization execution is realized. In the mechanism level, the method breaks through the limitations of static fusion, single-target optimization and offline training, can adapt to a dynamic environment, ensures that the intelligent agent is in a complex scene such as noise interference, illumination abrupt change and task emergency switching, and meets the requirements of decision-making efficiency, safety and environment robustness at the same time.
Owner:NANJING CHOYEA INFOTECH CO LTD

Method for evaluating real-time performance of computing power network based on analytic hierarchy process

The invention relates to the technical field of computer networks, and discloses a computing power network real-time performance evaluation method based on an analytic hierarchy process, and the method comprises the steps: collecting a node operation state and task demand data through a sensor, and generating a local performance index in combination with an edge quantum algorithm; simulating a future network state by using digital twinning, and fusing to generate a multi-dimensional performance data set; the AHP weight is dynamically adjusted based on resource deviation and a geological classification model, high-frequency updating is started for high load / fault, and the weight range is expanded for low load; introducing a risk assessment algorithm to quantify a performance-cost-carbon effect conflict level, and triggering resource recovery, optimization prompt or single index suggestion; scheduling strategies are triggered in a grading mode according to evaluation results, and active intervention is started in combination with anomaly detection; the AHP weight is dynamically updated through reinforcement learning, and quantum-classical hybrid algorithm parameters and block chain verification weight are automatically optimized. The real-time response efficiency and the resource utilization rate of the computing power network can be improved.
Owner:GUANGZHOU ZHANGDONG INTELLIGENT TECH CO LTD

Ai large model reasoning method based on knowledge graph enhancement

The invention relates to a cross-domain intelligent reasoning method based on knowledge graph enhancement, and the method achieves the precise reasoning in a complex scene through the construction of a hierarchical knowledge expression framework and a dynamic optimization mechanism. A multi-source heterogeneous data fusion technology is adopted, subject fine-grained knowledge units are generated through multi-modal feature extraction, and a three-dimensional knowledge graph structure comprising a core common concept layer, a subject feature ontology layer and a dynamic semantic mapping layer is established; based on a path exploration algorithm driven by reinforcement learning, cross-domain implicit association is mined while subject independence is reserved, and controllability and interpretability of the reasoning process are achieved in combination with an attention fusion mechanism of a large language model. According to the method, the limitation of traditional unified ontology modeling is broken through, the problems of concept drift and path deviation existing in reasoning in the cross fields of medicine-finance, engineering-law and the like are effectively solved, and the accuracy and knowledge traceability of complex decision tasks are remarkably improved.
Owner:HUNAN SANY IND VOCATIONAL & TECH COLLEGE

Intelligent operation decision analysis method and system based on cross-domain data fusion

The invention relates to the technical field of data analysis, in particular to an operation decision intelligent analysis method and system based on cross-domain data fusion. The method comprises the following steps: firstly, based on an enterprise multi-domain ontology knowledge base, performing entity identification and relation mapping on heterogeneous data from different business systems through a semantic mapping-based multi-source heterogeneous data dynamic fusion algorithm, and establishing a unified data model; then, a causal reasoning and deep learning fused hybrid intelligent decision engine is adopted to analyze and process the model; then, a multi-level causal relationship network among business variables is constructed through a causal relationship discovery algorithm by utilizing an analysis result of the hybrid intelligent decision engine, and an adaptive business scene analysis model based on reinforcement learning is used to dynamically adjust an analysis strategy according to business environment changes; generating a Pareto optimal decision scheme set through a multi-objective optimization algorithm, and outputting operation decision suggestions; according to the invention, the comprehensiveness and accuracy of intelligent analysis of enterprise operation decisions are improved.
Owner:BEIJING SHENGBI TECHNOLOGY CO LTD

Resistor disc defect online detection system and grading method based on machine vision

The invention discloses a machine vision-based resistor disc defect online detection system and a grading method, relates to the technical field of industrial machine vision detection, and solves the defect problems in the aspects of multi-scale defect dynamic perception, cross-level feature interaction and process adaptive optimization in the prior art. According to the scheme, metal reflection interference is inhibited through Retinex illumination correction and a combined denoising model; adopting a deformable convolution kernel and cavity space pyramid pooling to realize gradient entropy driving dynamic sensing of the multi-scale defect; constructing a bidirectional cross-layer attention network to realize early fusion of high-resolution details and high-level semantics; modeling local-global feature physical association based on a graph attention network and a self-supervised message passing mechanism; integrating reinforcement learning and a memristor random calculation unit to form a closed-loop parameter optimization system; according to the method, the multi-scale defect detection precision, the cross-modal feature fusion efficiency and the system adaptive capacity under complex working conditions are remarkably improved.
Owner:NANYANG GOLDEN CROWN IND CO LTD

Network topology intelligent generation method and system based on deep learning and topology analysis

The invention provides a network topology intelligent generation method and system based on deep learning and topology analysis, and relates to the technical network intelligence field, and the method comprises the steps: obtaining historical topology data, carrying out the feature extraction based on time sequence division, constructing a graph neural network model, training, and evaluating the evolution trend and stability of a network topology structure. And constructing a deep reinforcement learning model to generate an optimization strategy, and carrying out iterative optimization until a network topology structure meeting requirements is generated. The network structure can be adaptively optimized, the network performance is improved, the operation and maintenance cost is reduced, and the network stability is enhanced.
Owner:BEIJING TAIHE LITONG TECH CO LTD

Clean workshop production environment quality control method and system

The invention discloses a clean workshop production environment quality control method and system, and relates to the technical field of environment control, and the method comprises the steps: constructing a multi-layer sensing network, deploying temperature and humidity, particle concentration, pressure difference and VOC gas sensors, and carrying out the preprocessing data of each node through edge calculation; fusing the data based on a dynamic weight distribution algorithm, adjusting the weight according to the confidence score, and generating an environment quality comprehensive index; an LSTM pollution diffusion prediction model is established, a diffusion path is calculated in combination with airflow field simulation when pollution suddenly occurs, and an emergency response partition strategy is generated; fresh air system control parameters are optimized through reinforcement learning, a dynamic ventilation frequency adjusting model is established based on a real-time environment quality index and historical energy consumption data, and energy consumption is minimized through a Q-learning algorithm on the premise that cleanliness is guaranteed; a double-threshold early warning mechanism is set, local supercharging purification is started when a comprehensive index exceeds a first-level threshold, a second-level threshold is linked with adjacent areas to form a dynamic isolation barrier, and an intervention scheme effect is simulated through a digital twin system.
Owner:GUANGDONG GUANGYIN CONSTR CO LTD

Multi-modal public opinion risk early warning system and method based on dynamic mapping knowledge domain and federal reinforcement learning

The invention relates to a multi-modal public opinion risk early warning system and method based on a dynamic knowledge graph and federal reinforcement learning, and belongs to the technical field of public opinion analysis. The system comprises a data acquisition module, a modal fusion module, a knowledge graph construction module, a comparative learning module, a federal reinforcement learning modeling module and a response output module. The system is based on multi-source heterogeneous data, multi-modal semantic alignment of texts, images, videos and the like is achieved, entity relations and propagation paths are mined through a dynamically updated knowledge graph, collaborative modeling under privacy protection among terminals is achieved by fusing federal reinforcement learning, and then real-time sensing, level early warning and multi-level response strategy recommendation of public opinion risks are achieved. Based on the system, the method has the advantages of high fusion precision, high response speed and strong visual propagation path, and is widely applied to the fields of enterprise crisis management, government affair and public opinion monitoring and public safety.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Systems and Methods for Protecting Machine Learning (ML) Units, Artificial Intelligence (AI) Units, Large Language Model (LLM) Units, Deep Learning (DL) Units, and Reinforcement Learning (RL) Units

Systems and methods for protecting and fortifying machine learning engines, artificial intelligence (AI) engines, large language models, deep learning engines, reinforcement learning engines, and AI-based agentic units. An Offline Protection Unit analyzes characteristics of a Protected Engine, and performs offline fortification of the Protected Engine against attacks; by changing operational properties or operational parameters of the Protected Engine to reduce its vulnerability to attacks. An Online Protection Unit performs analysis of at least one of: (i) inputs that are intended to be inputs of the Protected Engine, (ii) outputs that are generated by the Protected Engine; and based on the analysis, dynamically performs online fortification of the Protected Engine against attacks; by dynamically changing operational properties or operational parameters of the Protected Engine to reduce its vulnerability to attacks.
Owner:DEEPKEEP LTD

Electric power work order intelligent processing method with RPA fused with multi-mode large model

The invention relates to the technical field of intelligent operation and maintenance and artificial intelligence crossing of a power system, in particular to an intelligent power work order processing method of an RPA fused multi-modal large model, which analyzes multi-modal work order data such as texts, voices, images and the like through a domain adaptation large language model, and realizes fault key information extraction and conflict resolution in combination with a dynamic knowledge graph; performing work order priority scoring and resource allocation by using space-time constraint reinforcement learning; an analysis result is converted into an automatic execution script through an RPA engine, and a whole-process closed loop of order sending, processing and feedback is achieved; meanwhile, a feedback optimization and conflict resolution cooperation mechanism is constructed, and the knowledge graph and the model precision are continuously iterated. The method improves work order processing efficiency and analysis precision, enhances decision scientificity, and is suitable for an intelligent operation and maintenance scene of a power system.
Owner:FUJIAN ZEYUAN INFORMATION TECHNOLOGY CO LTD

Robot dynamic risk assessment and decision-making system and method based on multi-modal perception

The invention relates to the technical field of intelligent assessment and decision making, in particular to a robot dynamic risk assessment and decision making system and method based on multi-modal perception, and the system comprises a multi-modal sensor module which is used for collecting environment vision, acoustics, mechanics and position data in real time; the edge calculation unit is used for carrying out space-time alignment and feature fusion on the sensor data; the dynamic risk assessment model is used for integrating the environment uncertainty quantification module and the robot state prediction module based on a reinforcement learning framework; the decision execution interface is used for outputting a risk level and obstacle avoidance, speed reduction and shutdown instructions; by integrating visual, acoustic, mechanical and position multi-source sensor data and the like, the system can comprehensively capture various risk factors in a complex dynamic environment, so that the defect that a traditional single sensor system is insufficient in sensing dimension is overcome, and the system is particularly suitable for terrains and weather conditions with variable regions.
Owner:SICHUAN SANSIDE TECH CO LTD

Optical storage charging and discharging station aggregation control and optimization method based on virtual power plant

The invention provides an optical storage charging and discharging station aggregation control and optimization method based on a virtual power plant, and aims to solve the problems of multi-target collaborative optimization, dynamic resource response and uncertainty robustness. By introducing a Markov decision process and an adaptive clustering algorithm, the system can dynamically aggregate photovoltaic, energy storage and charging pile resources according to equipment characteristics, and power dispatching is optimized. A multi-objective optimization model is adopted, economical, technical and environmental objectives are combined, a dynamic weight factor is introduced, and optimal scheduling is generated in combination with a fuzzy decision theory. And real-time compensation is carried out by adopting a rolling time domain control framework and deep reinforcement learning, so that the scheduling precision and the response speed are improved. The edge computing and cloud collaboration mechanism reduces the communication load through a lightweight federated learning model, and improves the scheduling response efficiency. According to the invention, the scheduling efficiency of the optical storage charging station can be obviously improved, the operation cost is reduced, the system stability is improved, and the system has good adaptability and expandability.
Owner:NANJING INST OF MECHATRONIC TECH

Conference summary processing method and system using AI

The invention relates to the technical field of intelligent conference processing, and relates to a conference summary processing method and system using AI, and the method comprises the steps: carrying out the real-time noise suppression of a collected conference audio stream and associated text data through a noise suppression algorithm, and carrying out the cross-modal alignment of the denoised data through a cross-modal alignment algorithm; a domain-specific attention head is inserted into an attention layer of the pre-trained Transform model, a domain-enhanced speech recognition model is constructed, and audio is converted into a text sequence with a speaker tag; adopting a heterogeneous graph neural network to construct a structured topic evolution graph; key decision nodes in the structured topic evolution graph are extracted based on a reinforcement learning strategy, and a final conference summary document is generated. In the decoding stage, the fusion proportion of the acoustic model and the language model is dynamically adjusted based on the real-time acoustic confidence coefficient, the recognition rate of the vocabularies in the professional field is increased, and the problems of frequent term transcription errors and poor semantic coherence in the professional conference are effectively solved.
Owner:GUANGZHOU DAZZLE VIEW INTELLIGENT TECH CO LTD

Energy-saving intelligent street lamp automatic emergency response system and control method thereof

The invention discloses an energy-saving intelligent street lamp automatic emergency response system and a control method thereof, relates to the technical field of industrial Internet of Things control, and solves the problems that an existing intelligent street lamp system is poor in dynamic scene adaptability, single in emergency response strategy and insufficient in communication stability. According to the method, a dynamic priority scheduling matrix is generated through multi-source data fusion and an adaptive weighted decision tree, and an intelligent dimming strategy is trained in combination with improved fuzzy reinforcement learning; a multi-level fuzzy control and fuzzy reasoning system is used for generating emergency parameters driven by accident levels; dynamically selecting an optimal communication link transmission instruction based on a multiple access protocol and multi-scale channel sensing; an IEEE 1588PTP protocol and Bayesian clock drift correction are adopted to guarantee time sequence consistency, and energy consumption and safety balance are optimized through multi-target reinforcement learning; the dynamic adaptive capacity, the emergency response accuracy and the communication reliability of a complex scene are remarkably improved, and collaborative optimization of energy-saving efficiency and road safety is realized.
Owner:NANYANG GREAT OPTOELECTRONIC TECH CO LTD

Computer task scheduling method based on artificial intelligence

The invention discloses a computer task scheduling method based on artificial intelligence, and the method comprises the following steps: 1, data collection: employing a double-flow feature fusion mechanism, and generating global feature representation containing long-term dependence and an instantaneous state; step 2, generating a global optimization scheduling strategy: constructing a hierarchical federal reinforcement learning system, dividing a cluster into a plurality of super nodes through an enhanced spectral clustering algorithm, independently training a Dueling DQN network by each super node, performing global strategy cooperation by adopting Shapley value weighted aggregation and differential privacy protection, and generating a scheduling strategy of global optimization; distilling a global strategy into a lightweight decision tree through a strategy distillation technology, and deploying the lightweight decision tree to a physical node; 3, task priority control and elastic resource allocation are carried out, wherein elastic control over resource allocation is carried out through a dynamic time slice bank mechanism; and 4, self-adaptive evolution: establishing a closed-loop optimization system, and carrying out strategy self-evolution by adopting a double-layer optimization architecture.
Owner:CHANGSHU INSTITUTE OF TECHNOLOGY

Intelligent regulation and control method for three-stage constructed wetland recirculating aquaculture system

The invention provides an intelligent regulation and control method for a three-stage constructed wetland recirculating aquaculture system, and belongs to the technical field of machine learning. The method comprises the following steps: firstly, continuously collecting water quality data and operation control data of each control unit, and constructing a multi-source heterogeneous data set under a unified time scale; then, constructing a pollution evolution trend prediction model, and capturing a dynamic evolution trend of water quality along with time and control behavior changes; then, under the guidance of a prediction result, analyzing the similarity of historical states and the sensitivity of regulation and control response, automatically identifying key control parameters which influence the water quality change of the system at present, and reasoning the dynamic adjustable boundary of the key control parameters; and finally, constructing a reinforcement learning strategy network fusing state prediction, a parameter boundary and a control target, realizing multi-target tradeoff among pollutant removal efficiency, a water quality standard-reaching rate and operation energy consumption, and outputting an efficient and steady control strategy through continuous interactive training. According to the invention, efficient, accurate and robust operation of the wetland system can be realized.
Owner:YELLOW SEA FISHERIES RES INST CHINESE ACAD OF FISHERIES SCI

Reinforcement learning based satellite control

The disclosed technology is generally directed to a method for controlling a satellite system comprising at least one satellite. The method may include receiving and processing a set of control parameters associated with an orientation of the at least one satellite via a classic control model to generate a set of actions to control the orientation of the at least one satellite and storing the set of actions as data in a buffer. The processing and storing are iteratively repeated until the data stored in the buffer exceeds a threshold. When the data stored in the buffer exceeds the threshold, the method may further include iteratively implementing, based on each of the set of control parameters and the data stored in the buffer, the machine learning model to control the orientation of the at least one satellite to stabilize the at least one satellite.
Owner:WILDSTAR LLC

Unmanned aerial vehicle real-time path planning system and method based on dynamic weight distribution and multi-source data fusion

The invention relates to the technical field of unmanned aerial vehicle flight path planning, in particular to an unmanned aerial vehicle real-time path planning system and method based on dynamic weight distribution and multi-source data fusion. The system comprises a multi-source data fusion module, an integrated laser radar, a millimeter wave radar, a visual sensor and a Beidou positioning unit. The dynamic weight distribution module dynamically adjusts the weight coefficient of each sensor according to the environmental complexity, the threat level and the state of the unmanned aerial vehicle by adopting a mixed decision-making mechanism combining fuzzy logic and reinforcement learning; an improved RRT * algorithm and a Markov decision process are built in the real-time path planning module, and a global optimal path and a local obstacle avoidance track are generated by adopting a layered planning architecture; the unmanned aerial vehicle cooperative control module comprises a dual-redundancy flight control system and a dynamic obstacle avoidance unit; and the communication relay module supports 5G and low-orbit satellite dual-mode communication, updates an environment cognitive model of each unmanned aerial vehicle through federated learning, and realizes multi-source fusion real-time path planning based on dynamic weight distribution and the unmanned aerial vehicles.
Owner:四川电力设计咨询有限责任公司

Building electromechanical BIM model information rapid retrieval method and system

The invention discloses a building electromechanical BIM model information rapid retrieval method and system, and the method comprises the steps: generating composite retrieval parameters fusing semantic keywords and three-dimensional coordinate constraints according to a multi-mode retrieval instruction inputted by a user; on the basis of the composite retrieval parameters, constructing a dynamic search space by utilizing a hierarchical graph convolutional network, and generating a candidate model index structure of multi-dimensional feature coding; inputting the candidate model index into a multi-objective optimization engine, performing real-time optimization on a search path by adopting a dynamic pruning algorithm driven by reinforcement learning, and outputting a candidate model set of which the confidence coefficient is higher than a preset confidence threshold after pruning; and on the basis of the candidate model set, associated equipment nodes are expanded through a knowledge graph embedding and complementing technology, and an enhanced retrieval result set containing the hidden associated equipment is generated. By utilizing the embodiment of the invention, efficient, multi-dimensional and multi-modal information accurate positioning and quick retrieval can be realized in a large-scale complex BIM model.
Owner:杭州美屋美居数智科技有限公司

Network attack dynamic detection and security protection method and system based on artificial intelligence

The invention relates to the technical field of network attacks, in particular to a network attack dynamic detection and security protection method and system based on artificial intelligence, and the method comprises the following steps: S1, data collection: collecting a multi-protocol communication data flow of network equipment, and generating a multi-dimensional feature vector; s2, constructing a cross-protocol behavior graph: generating a dynamically updated network behavior graph; s3, anomaly detection: identifying an abnormal behavior mode through the deep residual sequential network, and outputting threat evaluation parameters; s4, protection strategy generation: generating a dynamic protection instruction set through a reinforcement learning decision algorithm; and S5, protection execution: executing the dynamic protection instruction set to complete safety protection operation. According to the method, the multi-protocol fusion behavior graph is constructed, and an abnormal detection mechanism of graph nerve and differential modeling and a dynamic response strategy driven by reinforcement learning are introduced, so that high-precision identification and efficient protection of network attacks are realized.
Owner:TIBET LANGJIE INFORMATION TECH CO LTD