Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

22619 results about "Reinforcement learning" patented technology

Reinforcement learning (RL) is an area of machine learning concerned with how software agents ought to take actions in an environment so as to maximize some notion of cumulative reward. Reinforcement learning is one of three basic machine learning paradigms, alongside supervised learning and unsupervised learning.

Convergent Intelligence Fabric for Multi-Domain Orchestration of Distributed Agents with Hierarchical Memory Architecture and Quantum-Resistant Trust Mechanisms

A system and method for implementing a convergent intelligence fabric (CIF) for distributed artificial intelligence operations. The CIF architecture integrates tensor-theoretic foundations, probabilistic cache management, precision-aware memory operations, quantum-resistant security, and neural-based optimization within a unified framework. The system orchestrates asynchronous, multi-hop data flow among computational resources while maintaining data security through per-block encryption and identity-based access control. Key components include a universal multi-model KV cache subsystem, agent-parallel disaggregation pipelines, reinforcement learning-based orchestration, and neuromorphic memory integration. Advanced implementations incorporate graphon-enhanced memory for sparse graph sequences, multi-modal cognitive persistent memory, and quantum-resistant asynchronous multi-domain trust protocols. The system enables efficient cross-agent collaboration, sophisticated knowledge sharing, and secure cross-domain operations while optimizing computational resources and maintaining strict privacy guarantees across distributed AI deployments.
Owner:QOMPLX INC

Method and system for analyzing defects in wafer manufacturing based on big data

The invention provides a method and system for analyzing defects in wafer manufacturing based on big data, and relates to the technical field of big data, and the method comprises the steps: collecting technological parameter information, defect scanning images and manufacturing process data information, and carrying out multi-scale feature pyramid network processing and fusion to obtain fusion features; the fusion features are analyzed through a deep learning network, the deep learning network adopts a multi-task learning framework to complete a defect classification task, a defect segmentation task and a defect evolution prediction task at the same time, consistency loss based on graph matching is introduced, and a defect type recognition result and a feature map of defect space distribution are obtained; based on the characteristic spectrum, when it is detected that the process parameters are abnormal, analyzing historical defect data by using a graph neural network containing a time sequence attention mechanism; technological parameter constraint conditions are set in combination with an expert knowledge base, and technological parameters are adaptively adjusted through a reinforcement learning method. According to the invention, the accuracy of defect detection and classification is improved.
Owner:BEIJING KEYANG TECH CO LTD

Petrochemical production process anomaly diagnosis and optimization method and system integrated with knowledge graph

The invention provides a petrochemical production process anomaly diagnosis and optimization method and system integrated with a knowledge graph, and relates to the technical field of petrochemical production, and the method comprises the steps: collecting technological parameters and equipment state data, carrying out the preprocessing and feature extraction through adaptive wavelet threshold denoising and depth variational mode decomposition, and carrying out the feature extraction; a heterogeneous graph neural network is constructed, a causal relationship graph is constructed in combination with a neural causal discovery network, the causal relationship graph is optimized through knowledge distillation, missing relationships are complemented to obtain a knowledge graph, real-time features are compared with normal feature distribution of a pre-trained contrast diffusion model, and after anomaly detection is triggered, the real-time features are extracted. A causal inference engine is combined with a knowledge graph to analyze an anomaly propagation path, an anomaly root and a prediction trend are determined based on multi-agent reinforcement learning, a multi-objective optimization problem is constructed according to the knowledge graph, an optimization strategy is generated and dynamically adjusted, and an optimization result is evaluated by combining a knowledge distillation hybrid model. And finally, progressive optimization is realized and the knowledge graph is updated.
Owner:CHINA UNIV OF PETROLEUM (BEIJING)

Automatic construction method of end-to-end agent based on graph structure semantic fusion

The invention relates to the technical field of artificial intelligence, in particular to an automatic construction method of an end-to-end agent based on graph structure semantic fusion. The method comprises the following steps: receiving business demand data input by a user; business target and demand constraint condition analysis is carried out on the business demand data, and a core workflow framework of the intelligent agent is generated; performing end-to-end execution path analysis on the core workflow framework of the intelligent agent to obtain an end-to-end workflow; constructing a dynamic evolution semantic map; and constructing an end-to-end call chain execution strategy based on the end-to-end workflow, and performing agent instance packaging and agent instance reinforcement learning enhancement processing according to the dynamic evolution semantic map, thereby automatically constructing an end-to-end agent. According to the invention, by fusing the graph structure knowledge and the generation capability of the large language model, an efficient, accurate and extensible agent automatic construction scheme is provided for various complex business scenes.
Owner:BEIJING ZHONGSHURUIZHI TECH CO LTD

Dynamic data pipeline construction method based on artificial intelligence and multi-modal data processing

The invention relates to a dynamic data pipeline construction method based on artificial intelligence and multi-modal data processing, and belongs to the technical field of data fusion treatment and artificial intelligence. According to the method, a multi-modal deep learning model is adopted, semantic analysis is performed on business documents, user requirements and function specification instructions, and key indexes, data requirements and logic constraints are extracted; constructing a multi-modal knowledge graph, performing unified representation and feature extraction on structured and unstructured data resources, and performing embedded learning by using a graph neural network; based on a deep semantic matching model and a hybrid recommendation system, realizing accurate matching of business requirements and data resources; modeling generation of a data processing flow into a Markov decision process by adopting a reinforcement learning strategy, and automatically generating an optimized data processing workflow; the adaptability of the model to new business requirements is improved by utilizing a meta-learning algorithm; and dynamic scheduling and execution of tasks are realized through a workflow engine. According to the invention, the data processing efficiency can be improved.
Owner:BEIJING INST OF COMP TECH & APPL

AI-based big data distributed computing task automatic optimization method and system

The invention provides an AI-based big data distributed computing task automatic optimization method and system, and relates to the technical field of AI. The method comprises the following steps: constructing a multi-modal spatial-temporal feature sensing network to extract spatial-temporal features of tasks and resources, and training a hierarchical hybrid decision network to perform global task scheduling and local resource allocation. The global strategy network adopts a layered deep reinforcement learning architecture, and generates a decision by combining Monte Carlo tree search and priority experience playback; and the local execution network optimizes local deployment based on the graph neural network and multi-agent collaborative learning. In addition, a distributed anomaly detection network is deployed to monitor the performance in real time, self-adaptive adjustment and optimization are achieved through enhanced transfer learning, and finally the perception network is updated through knowledge distillation to achieve model evolution. According to the method, the execution efficiency and the resource utilization rate of the big data distributed computing task can be effectively improved, and the system operation cost is reduced.
Owner:ZHEJIANG SHUXIN NETWORK CO LTD

Multi-machine collaborative industrial robot intelligent scheduling system and application method

The invention relates to the technical field of industrial automation control, and discloses a multi-machine collaborative industrial robot intelligent scheduling system and an application method.The system comprises a data acquisition module for acquiring real-time motion data through a multi-modal sensor; the feature fusion module is used for generating environment dynamic feature data based on graph neural network fusion data; the strategy generation module is used for generating collaborative strategy parameters by utilizing a collaborative reinforcement learning model; the trajectory optimization module is used for constructing a multi-target trajectory optimization model to plan an optimal synchronous trajectory; the motion control module is used for establishing a layered motion control model to realize cooperative motion control; a dynamic resource allocation module can also be included to optimize resource allocation. The application method sequentially executes corresponding steps according to the modules of the system. According to the method, the environment can be accurately sensed, the cooperation strategy can be optimized, the efficient track can be planned, accurate motion control and reasonable resource allocation can be realized, and the cooperative motion control capability and the production efficiency of the industrial robot in the complex environment can be effectively improved.
Owner:SHANGHAI WANTULIN ROBOT TECH CO LTD

Multi-modal dynamic optimization educational resource recommendation system and method

The invention relates to a multi-modal dynamic optimization educational resource recommendation system and method, and the system comprises the following modules: a multi-modal data collection module integrates video behaviors, answer tracks, physiological signals and other data through edge calculation, and constructs a learning feature map; the student portrait module adopts an LSTM-Attention network in combination with a graph neural network to dynamically model knowledge mastery and learning styles; the resource matching engine realizes multi-objective optimization of knowledge gain, cognitive load and interest matching based on reinforcement learning and knowledge graph analysis; the tag adaptive module dynamically adjusts resource weights through causal inference and comparative learning, the personalized recommendation module generates a dynamic learning path and pushes adaptive resources based on student portraits and real-time behavior data, and the learning progress tracking module monitors a learning state in real time and feeds back the learning state to the resource matching engine to optimize a recommendation strategy in a closed loop mode. The technical defects that resource recommendation of a traditional education platform is rigid and personalized adaptation is lacked are overcome.
Owner:WUHAN YOUYOU TECHNOLOGY CO LTD

Tunnel multi-source fusion dynamic twin surrounding rock intelligent prediction and control method and system

The invention discloses a tunnel multi-source fusion dynamic twin surrounding rock intelligent prediction and control method and system, and the method comprises the steps: collecting multi-source heterogeneous data in real time through intelligent drilling equipment, a distributed optical fiber sensing network and a mobile scanning device which are disposed on a tunnel construction surface; inputting the multi-source heterogeneous data into a space-time diagram convolutional network, constructing a space-time correlation model of geological features and construction disturbance parameters, and outputting a coupling feature matrix; based on the coupling characteristic matrix, simulating the dynamic response of the surrounding rock-support system through a streaming voxelization engine and a multi-physics coupling engine, and generating a risk evolution three-dimensional thermodynamic diagram; and inputting the risk evolution three-dimensional thermodynamic diagram into the deep reinforcement learning model, and dynamically optimizing to generate a construction parameter regulation and control instruction meeting a safety constraint condition. According to the technology, a full-link channel of'data perception-mechanical analysis-decision execution 'is opened in a closed-loop mode, and therefore the double risks of'data distortion misjudgment' and'response lag out-of-control 'of a traditional method are avoided.
Owner:CHINA TIESIJU CIVIL ENGINEERING GROUP CO LTD +1

Edge computing resource allocation optimization method and system based on reinforcement learning

ActiveCN119862029AResource allocationEnergy efficient computingEdge nodeState space matrices
The invention discloses an edge computing resource allocation optimization method and system based on reinforcement learning, and relates to the technical field of edge computing resource management.The method comprises the steps that computing load data and network state data are collected, a historical load sequence is formed, a state space matrix is constructed, the historical load sequence is mapped into a discrete state value, and the discrete state value is obtained; establishing a deep neural network model; inputting the state space matrix into a deep neural network model, and generating a resource allocation strategy set according to the priority and time delay requirements of the calculation tasks; iteratively training the resource allocation strategy set by adopting a double Q learning algorithm, setting a reward function based on task completion time and a resource utilization rate, and selecting an optimal resource allocation strategy; and adjusting computing resource allocation of the edge nodes according to the optimal resource allocation strategy, and meanwhile, feeding back an execution result to the deep neural network model for online learning updating. According to the method, intelligent optimization of edge computing resource allocation is realized by introducing a deep reinforcement learning method.
Owner:NANJING MAXON OE TECH CO LTD

Network security evaluation system and method based on dynamic attack and defense game model

ActiveCN119544307AImprove real-time performanceDynamically adjust defense strategiesSecuring communicationAttackSimulation
The invention belongs to the field of network security, and discloses a network security evaluation system and method based on a dynamic attack and defense game model, and the evaluation system comprises four functional modules of attack and defense game construction, risk prediction, dynamic defense optimization and security situation awareness. According to the method, the idea of dynamic attack and defense game is introduced, multi-level and multi-scene attack and defense simulation is carried out according to historical states, strategy data and real-time data, and the optimal attack path and attack strategy are calculated and analyzed through a game equilibrium solution; according to the method, network resources and network security resources are dynamically adjusted by relying on reinforcement learning and deep learning technologies and a defense rule base generated by pre-training, network configuration is optimized according to a real-time evaluation result, and waste of system resources is reduced. By implementing the system and the method provided by the invention, the security of the target network can be dynamically evaluated, the security defense strategy of the network can be adjusted in real time, and unknown attacks such as advanced persistent threat (APT) and zero-day attack can be effectively resisted.
Owner:CHINESE PEOPLES LIBERATION ARMY 92493 UNIT INFORMATION TECH CENT

Smart park full-life-cycle management system and method based on digital twinning and Internet of Things

The invention discloses a smart park full life cycle management system and method based on digital twinning and Internet of Things, and relates to the technical field of smart park management, and the system comprises a sensing edge module, a data governance module, an intelligent analysis module, a life cycle module and a twinning modeling module. According to the invention, multi-protocol access and edge computing capability are supported, and the data transmission efficiency and stability are greatly improved; the intelligent analysis module outputs an accurate analysis result by constructing a multi-class feature matrix and deep multi-task joint modeling mechanism, and provides data support and model guidance for dynamic management and intelligent decision making of the park; the life cycle module integrates a Kepler optimization algorithm and a multi-agent reinforcement learning and simulated annealing algorithm, establishes a collaborative optimization mechanism, realizes combination of global search and local fine tuning of resource scheduling, and effectively optimizes energy consumption, response time, space utilization and safety risks; and the twin modeling module constructs a park three-dimensional model, so that the interactivity and operability of the system are improved.
Owner:SUQIAN NANYOU DIGITAL ECONOMY IND RES INST +1

Computing resource scheduling method based on user demands and task priorities

The invention discloses a computing resource scheduling method based on user demands and task priorities, which relates to the technical field of resource scheduling, and comprises the following steps: receiving a computing task request submitted by a user, analyzing and verifying explicit demand parameters and implicit demand parameters, and generating a standardized demand description object; acquiring cluster state data and external environment parameters in real time, constructing a user-task-environment three-dimensional feature tensor, and outputting a standardized feature vector group; and collecting a performance data flow of the container instance group, triggering an elastic scaling decision based on a pre-trained LSTM prediction model, dynamically adjusting cluster resource configuration and executing abnormal task rescheduling. According to the method, a user-task-environment three-dimensional feature tensor is constructed, and a dynamic mixed weighted priority score is generated in combination with a reinforcement learning model, so that space alignment and time sequence cumulative effect fusion of multi-dimensional features is realized.
Owner:WUHAN SPARK ZHONGDA INFORMATION TECH CO LTD

Industrial robot walking control system based on obstacle recognition

The invention relates to the technical field of industrial robots, in particular to an industrial robot walking control system based on obstacle recognition. Comprising an environment sensing unit; the obstacle analysis and decision-making unit is used for processing the multi-dimensional data output by the environment sensing unit based on a deep reinforcement learning framework, accurately identifying static obstacle and dynamic obstacle types, motion trails and interaction influences, constructing a two-dimensional decision-making model of static obstacle avoidance and dynamic obstacle avoidance, and carrying out obstacle avoidance and obstacle avoidance on the basis of the two-dimensional decision-making model. A differential obstacle avoidance strategy is triggered; the path planning unit is based on a dynamic game path algorithm under space-time constraint; and an instruction transceiving unit. Through the multi-modal fusion sensing technology and the adaptive parameter adjustment module, space-time alignment and feature fusion of multi-source data such as three-dimensional point cloud, texture features and vibration spectrum are realized, a high-dimensional environment state model is constructed, and the problem of insufficient data fusion depth in the prior art is effectively solved.
Owner:JIANGSU ZHENG MAO MFG CO LTD

Dynamic sensitive data outbound risk assessment method and system based on multi-source risk information

The invention discloses a dynamic sensitive data outbound risk assessment method and system based on multi-source risk information in the technical field of data cross-border. The system is mainly composed of a multi-source risk information acquisition module, a dynamic security identifier generation module, a risk collaborative assessment engine, a dynamic weight adjustment module, a disposal range dynamic calculation module and a flexible emergency disposal module, and an acquisition-identifier-assessment-calculation-disposal full-process closed-loop architecture is formed. A full-process closed-loop processing framework of collection-identification-evaluation-calculation-disposal is innovatively proposed, and by combining a dynamic risk evaluation model, a reinforcement learning intelligent technology and a block chain evidence storage technology, the problems of insufficient dynamic nature, lack of collaboration and lack of closed-loop capability in the prior art are systematically solved; and high-precision evaluation, real-time response and traceable management and control of the cross-border data flow risk are realized.
Owner:积至(海南)信息技术有限公司

Intelligent programming auxiliary method and system based on multi-mode AI language model

The invention discloses an intelligent programming auxiliary method and system based on a multi-modal AI language model, and belongs to the technical field of programming auxiliary tools. The method comprises the following steps: a multi-modal input processing stage; a dynamic context modeling stage; a hierarchical semantic analysis stage; in the code generation stage, codes are generated in two stages by adopting a Codex-Plus large model; the reinforcement learning driven code optimization stage is used for carrying out multi-objective optimization and reward function design on the codes generated in the code generation stage; a multi-dimensional feedback stage; an interaction and visualization stage; code semantic deep analysis, dynamic context sensing, multi-target optimization generation and real-time interactive feedback are realized by fusing code texts, natural language description, developer behavior data and a domain knowledge graph, and programming efficiency and code quality can be remarkably improved.
Owner:积至(海南)信息技术有限公司

Method and system for establishing and planning intelligent path of car in scenic spot based on AI algorithm

The invention provides an AI algorithm-based scenic spot car intelligent path establishing and planning method and system, and relates to the technical field of path planning, and the method comprises the steps: collecting scenic spot road geographic information data, and constructing a weighted road network model; collecting real-time positioning of the trolley and sensor data; using the reinforcement learning model to generate a real-time optimal path planning strategy; calculating an initial recommendation path; road condition changes are monitored, and a path is dynamically adjusted; and outputting the updated optimal path scheme and carrying out navigation. According to the method, intelligent and real-time path planning of the vehicles in the scenic area can be realized.
Owner:BEIJING SUBCUBIC TECH CO LTD

Multi-modal sensing humanoid robot action self-adaptive control method and multi-modal sensing humanoid robot action self-adaptive control system

The invention discloses a multi-modal perception humanoid robot action adaptive control method and system, and belongs to the technical field of computers, and the method comprises the steps: obtaining first multi-modal data; the first multi-modal data comprises first image data, first point cloud data and first force sense data; performing data fusion on the first image data and the first point cloud data, and constructing a three-dimensional model of the scene in real time; generating an optimal path according to the real-time environment data of the three-dimensional model, converting the optimal path into a joint instruction of the humanoid robot, and generating an action control strategy; according to the action control strategy, arm movement of the robot is adjusted through visual servo control, and first operation data are obtained; the path and action of the robot are adjusted in a closed-loop control mode, and second operation data are obtained; and reinforcement learning and regular evaluation are carried out through a DDPG algorithm, and an action control strategy is continuously optimized. According to the invention, multi-modal sensing robot motion adaptive control with strong adaptive capability, high operation precision and good robustness can be realized.
Owner:广州里工实业有限公司

LLM-based client intention identification and response system, method and device, and medium

The invention discloses an LLM-based customer intention recognition and response system, method, device and medium, and relates to the technical field of intelligent dialogues, the system comprises a multi-modal input processing unit used for collecting and fusing multi-source interaction data of an intelligent voice outbound system to form multi-dimensional input representation; the dynamic context enhancement LLM unit is used for performing context understanding based on the multi-dimensional input representation and a preset knowledge base and generating a user feature portrait; the reinforcement learning dialogue strategy generation unit is used for dynamically generating a dialogue strategy according to the user feature portrait and generating response content based on the dialogue strategy; and the multi-modal output unit is used for converting the response content into multi-modal output information and performing adaptive adjustment on the multi-modal output information according to the real-time scene parameters. According to the invention, accurate identification and intelligent response to the intention of the user are realized, and the interaction experience and service quality of the intelligent dialogue system are remarkably improved.
Owner:GUANGZHOU JIUSI INTELLIGENT TECH CO LTD

Game behavior dynamic evolution and strategy deduction optimization method and system in space field

The invention provides a space field game behavior dynamic evolution and strategy deduction optimization method and system, and relates to the technical field of space field game behavior optimization, and the method comprises the steps: analyzing historical behavior data through a deep neural network, constructing a dynamic relation graph of participants, inputting a multi-agent reinforcement learning model, and outputting a game behavior model. Then, a multi-layer game scene evolution tree is constructed, the instant income and the long-term risk are calculated in combination with a dual neural network, dynamic updating is performed by using a search algorithm of a hierarchical attention mechanism, and candidate evolution paths are generated; and finally, evaluating the candidate paths by using a strategy evaluation model constructed by a space-time diagram neural network, selecting an optimal strategy path, and generating a strategy deployment scheme implemented by stages in combination with a knowledge inference engine. According to the method, the evolution trend of the game behavior in the space field can be effectively predicted, a feasible strategy deployment scheme is provided, and the scientificity and effectiveness of strategy decision are improved.
Owner:PLA PEOPLES LIBERATION ARMY OF CHINA STRATEGIC SUPPORT FORCE AEROSPACE ENG UNIV

Wind power plant booster station multi-source data fusion anti-misoperation locking intelligent decision and early warning method

The invention discloses a wind power plant booster station multi-source data fusion anti-misoperation locking intelligent decision-making and early warning method, and relates to the technical field of intelligent misoperation prevention of a power system, and the method comprises the following steps: collecting multi-source heterogeneous data, obtaining the data through a distributed sensor network, and carrying out the edge calculation preprocessing; performing data space-time alignment and fusion, performing equipment state evaluation, and constructing a deep belief network and Bayesian network hybrid model to calculate a health index; anti-misoperation rule modeling is carried out, and operation logic verification is carried out based on a Petri network and an expert knowledge base; risk early warning decision making: fusing multi-source early warning information to divide risk levels; intelligent locking control is carried out, and a locking strategy is optimized through reinforcement learning; and performing decision support and visualization, constructing a three-dimensional digital twinborn model, and displaying operation guidance and risk early warning in combination with an AR technology. Through multi-source data fusion and intelligent decision making, the anti-misoperation locking accuracy and efficiency are improved, and the safety and the operation and maintenance level of the booster station are remarkably enhanced by equipment fault early warning three months ahead of time.
Owner:BEIJING YANENG ELECTRIC EQUIP CO LTD

Knowledge graph construction method and system based on large language model

The invention relates to a knowledge graph construction method and system based on a large language model, and the method and system achieve the automatic construction and dynamic maintenance of a knowledge graph through multi-modal data fusion, reinforcement learning and comparative learning joint optimization, teacher-student model knowledge migration, time sequence dynamic analysis and an incremental updating mechanism. Constructing a reinforcement learning framework, and taking accuracy and integrity as reward indexes to train a large model to extract an entity relationship; a large-scale knowledge graph is used as a teacher model, and conflict resolution and semantic alignment of newly added knowledge and an existing graph are realized through a graph attention network; a verification rule is dynamically generated based on historical data and domain knowledge, and relation periodicity and mutation points are detected in combination with Fourier transform and a CUSUM algorithm; and finally, generating a traceable knowledge graph through incremental updating and version control. And the multi-modal data processing precision, the entity relationship extraction dynamic adaptability and the knowledge graph maintenance efficiency are improved.
Owner:SICHUAN UNIV JINCHENG INST

Personalized learning recommendation method based on personalized knowledge graph

The invention discloses a personalized learning recommendation method based on a personalized knowledge graph. The method comprises the steps that the knowledge graph is constructed, and a learner fills in learning style self-description and learning target expected content; the current learning condition of the learner is subjected to primary research evaluation through the enrollment test module; an initial learner portrait model is established, a learner enters a database for learning, and a learning evaluation module performs staged evaluation on the learning condition of the learner; updating a learner portrait model, and generating a learning path and learning resources adaptive to the learner by using a knowledge graph technology and a reinforcement learning DQN network; updating the learning path database; the new learning path is recommended to the learner; according to the method, the learning data of the students are analyzed to determine the personal basic conditions of the students, the learner portrait model is constructed, the knowledge graph technology and the learning recommendation algorithm are utilized to adapt the personalized learning features to the learning knowledge element sequence, and a personalized learning push path recommendation mode is constructed to assist the students in improving the learning effect.
Owner:SUZHOU YANTU EDUCATION TECH CO LTD

Multi-element sales planning agent system and method

The invention discloses a multi-element sales planning agent system and method, and aims to improve the intelligence and precision of sales planning. The system comprises a collection module, an analysis module, an optimization module, a creation module and a generation module. The collection module is used for receiving multi-modal data such as marketing targets and extracting key marketing elements. The analysis module is used for generating a target user portrait and extracting marketing strategy analysis data. And the optimization module is used for calculating a medium putting weight by utilizing reinforcement learning and generating a medium strategy scheme. And the creation module generates a propagation theme and marketing content by adopting a generative artificial intelligence technology. And the generation module predicts a delivery effect by using a machine learning model and dynamically optimizes a medium strategy and a content scheme. Through multi-modal data fusion, intelligent analysis and optimization, closed-loop processing from data acquisition to marketing execution is realized, the marketing decision-making efficiency is improved, and brand promotion accuracy and market adaptability are enhanced.
Owner:SUZHOU DUOYUAN DATA CO LTD

Multi-layer distributed micro-grid control system and method based on edge cloud collaborative lightweight reinforcement learning

The invention relates to the technical field of micro-grid control, in particular to a multi-layer distributed micro-grid control system and method based on edge cloud collaborative lightweight reinforcement learning. The method comprises the following steps: a cloud management unit trains a DQN model by using historical environment data, generates a lightweight DQN model through pruning and quantification, issues the lightweight DQN model to an edge node unit, and formulates day-level and weekly-level optimization scheduling strategies based on a function layering + layering cooperation strategy; the edge node unit monitors electrical quantity and environmental parameters in real time through a sensor, deploys a lightweight DQN model to monitor abnormal conditions and trigger local early warning and emergency strategies, and makes a fast decision by using the lightweight DQN model; the micro-grid subgroup units collect data of the edge node units. According to the invention, through close cooperation of the edge node layer, the micro-grid subgroup layer and the cloud management layer, a distributed cooperative control mode of edge node real-time decision, subgroup cooperative management and cloud global optimization is realized.
Owner:YANTAI DEV ZONE DELIAN SOFTWARE CO LTD

Intelligent agent autonomous decision control method based on multi-modal data fusion

The invention discloses an agent autonomous decision control method based on multi-modal data fusion. The method comprises the following steps: S1, synchronously collecting multi-source heterogeneous data; s2, dynamic weight adaptive fusion is carried out; s3, generating a task-driven decision; and S4, performing autonomous decision closed-loop optimization. According to the method, through dynamic weight distribution and space-time correlation modeling, the problems of heterogeneity and environment adaptation in multi-modal data fusion are solved; furthermore, a risk-sensitive reinforcement learning framework and a closed-loop feedback mechanism are combined, so that full-link cooperative control from data fusion, strategy generation to optimization execution is realized. In the mechanism level, the method breaks through the limitations of static fusion, single-target optimization and offline training, can adapt to a dynamic environment, ensures that the intelligent agent is in a complex scene such as noise interference, illumination abrupt change and task emergency switching, and meets the requirements of decision-making efficiency, safety and environment robustness at the same time.
Owner:NANJING CHOYEA INFOTECH CO LTD

Method for evaluating real-time performance of computing power network based on analytic hierarchy process

The invention relates to the technical field of computer networks, and discloses a computing power network real-time performance evaluation method based on an analytic hierarchy process, and the method comprises the steps: collecting a node operation state and task demand data through a sensor, and generating a local performance index in combination with an edge quantum algorithm; simulating a future network state by using digital twinning, and fusing to generate a multi-dimensional performance data set; the AHP weight is dynamically adjusted based on resource deviation and a geological classification model, high-frequency updating is started for high load / fault, and the weight range is expanded for low load; introducing a risk assessment algorithm to quantify a performance-cost-carbon effect conflict level, and triggering resource recovery, optimization prompt or single index suggestion; scheduling strategies are triggered in a grading mode according to evaluation results, and active intervention is started in combination with anomaly detection; the AHP weight is dynamically updated through reinforcement learning, and quantum-classical hybrid algorithm parameters and block chain verification weight are automatically optimized. The real-time response efficiency and the resource utilization rate of the computing power network can be improved.
Owner:GUANGZHOU ZHANGDONG INTELLIGENT TECH CO LTD

Electric vehicle battery state real-time monitoring system based on deep learning

The invention relates to the technical field of battery monitoring, in particular to an electric vehicle battery state real-time monitoring system based on deep learning. Comprising a battery data acquisition module, a feature extraction module, a battery state prediction module, a fault monitoring module and a safety regulation and control module. The battery data acquisition module acquires battery parameters in real time, the feature extraction module extracts key features through deep learning, and the battery state prediction module predicts battery capacity, health state and performance degradation based on a neural network and a differential equation. The fault monitoring module adopts integrated learning to detect abnormity and output an alarm signal, and the safety regulation and control module optimizes a charging and discharging strategy through reinforcement learning and fuzzy control to guarantee safe and stable operation of the battery. According to the invention, accurate prediction and intelligent monitoring of the battery state are realized through the deep learning technology, comprehensive state evaluation and fault early warning are provided, and the accuracy and stability of battery state monitoring are effectively improved, so that the operation safety of the electric vehicle is improved, and the service life of the battery is prolonged.
Owner:GUANGDONG GENUINE SMART TECH CO LTD

Intelligent inspection path planning method and system based on reinforcement learning

The invention provides an intelligent inspection path planning method and system based on reinforcement learning, and relates to the technical field of path planning, comprising the steps of constructing a scene understanding model and a dynamic interaction model, and forming a cognitive enhanced digital twin system. Metaheuristic search and social learning mechanisms are fused, and the inspection efficiency, energy consumption and risk are balanced through a multi-target conflict coordinator. The group behavior emergence prediction model achieves dynamic prediction of a collaborative mode, the federated learning framework achieves aggregation of experience knowledge, a group evolution strategy with high adaptability is generated, and closed-loop optimization from task execution to cognitive enhancement is achieved through a robustness evaluation mechanism fed back in real time and a task allocation optimizer based on an attention mechanism. And the inspection efficiency and adaptability are improved.
Owner:厦门新航世纪信息技术有限公司

Igniter robot production line control method and system based on deep reinforcement learning

The invention provides an igniter robot production line control method and system based on deep reinforcement learning, and relates to the technical field of robot production line control, and the method comprises the steps: collecting the real-time state data of a production line station, extracting features through a multi-scale residual neural network and a spatial pyramid pooling module, and carrying out the feature extraction; channel attention and space attention modules are combined to perform feature enhancement, a cross-modal encoder is used to perform time sequence modeling, task decomposition is performed based on hierarchical reinforcement learning, soft constraint trajectory optimization and adaptive impedance control are used to generate a station control instruction, and a multi-target Pareto evaluation and priority dual experience pool is used to perform sample screening. Network parameters are optimized and updated through a near-end strategy, and a production line optimization decision scheme is output, so that the production line control precision can be improved, the system robustness can be enhanced, and the optimization of the production efficiency is realized.
Owner:NANJING AILONG AUTOMATION EQUIP