Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

5435 results about "Reinforcement learning algorithm" patented technology

Reinforcement learning refers to goal-oriented algorithms, which learn how to attain a complex objective (goal) or maximize along a particular dimension over many steps; for example, maximize the points won in a game over many moves. They can start from a blank slate,...

Industrial environment monitoring and accident prediction method fusing multi-modal data

The invention provides an industrial environment monitoring and accident prediction method fusing multi-modal data, and relates to the technical field of data processing, and the method comprises the steps: carrying out the semantic collection and causal association preprocessing of multi-modal heterogeneous data collected in real time through constructing a dynamic industrial knowledge graph; a customized deep learning model is adopted to extract deep abstract features of each mode, and weak signals and potential risks are accurately represented and uncertainty is quantified; a high-fidelity digital twin model is utilized to drive a deep reinforcement learning algorithm, and dynamic optimization and verification are performed to generate a multi-level and multi-target preventive intervention strategy combination; an intervention strategy is executed through an edge-end-cloud three-layer collaborative intelligent architecture, and online learning and system sustainable evolution are realized by using a closed-loop data feedback mechanism. According to the method, the sensing and early warning capability of the early weak and complex abnormal state of the industrial environment can be remarkably improved, the accident evolution path is accurately predicted, and credible explanation is provided.
Owner:SHANGHAI YUNLIN COMM TECH CO LTD

Big data platform scheduling task and data collaborative smooth migration method and system

The invention provides a big data platform scheduling task and data collaborative smooth migration method and system, and relates to the technical field of big data, and the method comprises the steps: constructing a digital twin environment of a target system, collecting task operation state data of a source system, extracting task features through a deep neural network, and carrying out the clustering and grouping. And deploying the task group to a digital twin environment, analyzing a task association relationship and a resource competition relationship based on a graph neural network, and generating a task stability score in combination with a task operation index. And constructing a migration risk prediction model to perform quantitative evaluation on the migration risk, and determining a migration priority and an execution sequence according to the quantitative evaluation. And making corresponding resource configuration, data synchronization and fault recovery plans for each task group, carrying out migration drilling in a digital twinning environment, and optimizing a migration scheme by utilizing a reinforcement learning algorithm. The migration risk can be effectively reduced, the smoothness and stability of the migration process are guaranteed, and the migration efficiency is improved.
Owner:ZHEJIANG SHUXIN NETWORK CO LTD

Advanced model management platform for optimizing and securing ai systems including large language models

An advanced model management platform for optimizing and securing generative artificial intelligence systems such as large language models (LLMs) and diffusion models. The platform incorporates various techniques to address the limitations of current generative AI systems, such as hallucination, lack of validation, security vulnerabilities, and inadequate model management. The system employs reinforcement learning algorithms for model optimization, retrieval augmented generation (RAG) for hallucination mitigation, domain-specific validation against expert knowledge, model distillation and similarity scoring for security, adversarial training for robustness, and attention mechanism search and model blending for advanced management and neuro symbolic AI routine combinations. By integrating these techniques, the platform significantly improves the performance, reliability, and security of generative AI across a wide range of tasks and domains leveraging the best elements of symbolic and connectionist techniques alongside automated planning and modeling simulation.
Owner:QOMPLX INC

Looped network unit monitoring method and system based on Internet of Things

The invention discloses a ring main unit monitoring method and system based on the Internet of Things, and the method comprises the steps: building a multi-source data collection network of a ring main unit, extracting the multi-dimensional time-frequency domain features of a signal through an edge computing device, generating a multi-source feature data set, and constructing a dynamic digital twinborn model, real-time mapping of the running state of the ring main unit is achieved through a physical-virtual synchronization algorithm, and twin data volumes are output; according to the node influence coefficient of the twin data volume, analyzing a topological structure of a ring network system by adopting a graph neural network, identifying a key fault propagation path and generating a priority monitoring node list; based on the priority monitoring node list and the twin data volume, dynamically generating an adaptive monitoring strategy through a reinforcement learning algorithm, executing the adaptive monitoring strategy and collecting feedback data in real time, and completing closed-loop iteration of the monitoring strategy through an online learning algorithm; through closed-loop control of multi-source perception-digital twinning-intelligent decision, high efficiency, intelligence and reliability of ring main unit monitoring are realized.
Owner:SHENZHEN FRIENDCOM TECH DEV

Cross-domain network security policy automatic generation and protection policy collaboration method and system

The invention provides a cross-domain network security policy automatic generation and protection policy collaboration method and system, and relates to the technical field of network security, and the method comprises the steps: collecting multi-domain security event data; constructing a security threat map; generating a cross-domain security risk score by using a deep learning algorithm; determining an inter-domain access control rule set and an intra-domain protection strategy according to the score; forming a cross-domain collaborative protection strategy; deploying a strategy on the multi-domain security device; establishing an inter-domain information sharing channel; monitoring the strategy effect; optimizing the strategy by using a reinforcement learning algorithm; and updating to each domain security device. According to the method, the effectiveness of cross-domain network security protection is improved.
Owner:SUZHOU SAILOTE DIGITAL TECH CO LTD

Industrial park multi-target collaborative optimization scheduling system and method based on artificial intelligence

The invention provides an industrial park multi-target collaborative optimization scheduling method and system based on artificial intelligence, relates to the technical field of intelligent scheduling of industrial parks, and aims to establish a digital twinborn model and a dynamic topological graph, perform resource flow relationship modeling by using a graph neural network, and perform resource demand analysis in combination with a multi-model prediction framework. A multi-agent reinforcement learning algorithm is adopted to generate a scheduling strategy, migration from a global strategy to a local decision module is realized through a strategy distillation technology, robustness of the scheduling strategy is simulated and verified in a digital twin model, the strategy is adjusted according to a simulation result, and finally efficient scheduling of park resources is realized. The method effectively improves the intelligentization and collaboration level of the operation of the industrial park, reduces the energy consumption and carbon emission, enhances the ability of the park to cope with complex scenes, and is suitable for the efficient management of the modern industrial park.
Owner:GUANGDONG SANDING INTELLIGENT INFORMATION TECH CO LTD

Traffic supervision system applied to intelligent street lamp and intelligent supervision method thereof

The invention discloses a traffic supervision system applied to an intelligent street lamp and an intelligent supervision method thereof, relates to the technical field of intelligent traffic, and solves the problems that an existing intelligent street lamp system lacks a physical-digital mapping relation, edge computing resource allocation is low in efficiency and cloud computing delay is high. According to the scheme, on the basis of multi-sensor data fusion, space-time reference unification is carried out by adopting an atomic clock and a GNSS, and a dynamic causal graph is constructed through a graph neural network, so that abnormal event detection is optimized; an improved Jaccard space-time similarity algorithm is adopted to optimize calculation task allocation, an edge calculation cluster is constructed based on 5G-V2X, and high-risk region identification and traffic flow prediction are carried out; a LiFi or 5G-UWB communication medium is adaptively selected through a multi-modal fusion reinforcement learning algorithm, and efficient early warning information synchronization is realized; according to the method, the multi-source data fusion value and the early warning precision are remarkably improved, the computing power resource utilization rate is optimized, and the instruction real-time performance and the system self-adaptive capability in a complex environment are enhanced.
Owner:NANYANG GREAT OPTOELECTRONIC TECH CO LTD

Industrial robot real-time adaptive control method and system based on digital twinning

The invention discloses an industrial robot real-time adaptive control method and system based on digital twinning, and relates to the technical field of industrial robots. The digital twin engine module runs a high-fidelity dynamics simulation model and an environment interaction model, performs real-time state estimation, abnormal working condition recognition and twin parameter dynamic updating, is seamlessly integrated with the control execution module, and provides decision support with high robustness and high adaptability for an industrial scene; the adaptive control module performs online rolling optimization on a control strategy based on a deep reinforcement learning algorithm, generates joint space trajectory correction, tail end precision compensation and dynamic load adaptability optimal instructions, and realizes parameter adaptive setting through fuzzy logic or a neural network; and the fault diagnosis module performs multi-scale time sequence analysis by using an LSTM and convolutional neural network fusion model, detects position offset, moment sudden change or temperature overrun and other abnormalities, and triggers emergency shutdown, sound-light alarm and an adaptive recovery strategy.
Owner:XUZHOU NORMAL UNIVERSITY

Robot alarm processing method and system based on target detection algorithm and cloud platform

The invention provides a robot alarm processing method and system based on a target detection algorithm and a cloud platform, and relates to the technical field of robot alarm processing, and the method comprises the steps: carrying out the detection of an abnormal target based on a convolutional neural network target detection model of the cloud platform in combination with a residual structure, a channel attention mechanism and an improved anchor-frame-free target detection algorithm, performing feature fusion through a feature fusion network guided by depth information to obtain accurate three-dimensional representation data, constructing a dynamic anomaly association graph by using an improved time sequence graph neural network, and generating a multi-level decision sequence in combination with an improved hierarchical reinforcement learning algorithm, and finally, collaborative task planning is carried out through a task decomposition network to obtain a task allocation scheme, and the robot carries out exception handling according to the optimal motion track, obstacle avoidance track data, real-time pose data, key operation sequence data and contact force feedback data.
Owner:北京网藤科技有限公司

Communication engineering construction dynamic optimization method based on multi-dimensional perception

The invention discloses a communication engineering construction dynamic optimization method based on multi-dimensional perception, and the method comprises the steps: collecting the multi-dimensional perception data of a construction site in real time through a multi-source heterogeneous sensor network, including environment parameters, equipment operation states, construction progress and personnel behavior data; performing space-time alignment processing on the multi-dimensional sensing data, and constructing a space-time associated dynamic construction digital twinborn body; establishing a dynamic optimization model based on a reinforcement learning algorithm, taking construction efficiency maximization, resource loss minimization and safety risk minimization as target optimization functions, and embedding risk constraint conditions; inputting the dynamic construction digital twin into the dynamic optimization model, and outputting a multi-dimensional parameter optimization instruction set comprising equipment scheduling parameters, construction path parameters and resource configuration parameters; and performing real-time performance evaluation on the multi-dimensional parameter optimization instruction set through edge computing nodes, and dynamically adjusting weight parameters of the model to form closed-loop feedback control. The purpose of cooperatively improving the construction efficiency, the safety and the economical efficiency is achieved.
Owner:ZHUHAI PENGYUAN TECH CO LTD

BIM-based building energy consumption simulation analysis optimization method and system

The invention provides a BIM-based building energy consumption simulation analysis optimization method and system, and relates to the technical field of building energy consumption, and the method comprises the steps: building a building energy consumption digital twinborn model through integrating a building information model (BIM) and real-time operation data, such as indoor and outdoor temperature, equipment operation, electrical load and personnel density, collected by an Internet of Things sensor. An LSTM and GNN mixed deep learning algorithm is used to predict building energy consumption, and clustering analysis is used to identify an energy consumption abnormal mode and a peak period. And finally, based on a reinforcement learning algorithm, constructing an energy consumption optimization model taking total energy consumption minimization as a target and taking indoor thermal comfort and air quality as constraints, outputting equipment optimization operation parameters such as air conditioner temperature, fresh air volume, illumination brightness and the like, and realizing intelligent optimization control of building energy consumption, so that the building energy consumption is reduced, and the building operation efficiency is improved.
Owner:GUANGZHOU DABAI DIGITAL TECHNOLOGY CO LTD

Optical fiber data storage management system and method based on big data

The invention discloses an optical fiber data storage management system and method based on big data, and relates to the technical field of storage management. According to the optical fiber data storage management system and method based on big data, the spatial-temporal characteristics of the historical access records are extracted through the LSTM network, the data heat value is calculated in combination with the time decay function, and the thermal distribution diagram of the data blocks is generated. And based on the thermal distribution map, constructing a storage resource allocation model by using a deep reinforcement learning algorithm, and dynamically adjusting the optical path priority and copy distribution. A data prefetching strategy is optimized through the spatio-temporal joint index and the vector similarity index, and a high-frequency data cache index distribution diagram is generated. And comprehensively considering the data access delay, the index hit rate and the copy migration frequency, obtaining an optical fiber storage efficiency index, and adjusting a storage strategy according to the index. According to the method, the dynamic scheduling and utilization efficiency of data storage resources is effectively improved, the data access delay is reduced, the copy management is optimized, and the overall performance of a storage system is remarkably improved.
Owner:ICLOUDSHIELD SECURITY TECHNOLOGY CO LTD

Intelligent rehabilitation training method and system based on artificial intelligence and virtual reality

The invention provides an intelligent rehabilitation training method and system based on artificial intelligence and virtual reality, a user wears an intelligent wearable device to collect multi-modal data such as electroencephalogram, myoelectricity, physiological features and motion signals, the multi-modal data is preprocessed and then input into an artificial intelligence training model, and key features are extracted and fused by using a graph convolutional network and an attention mechanism algorithm. And constructing a digital twinborn model by using the fusion features, performing real-time dynamic mapping and predictive simulation, and generating a customized training scheme by means of a reinforcement learning algorithm in combination with a rehabilitation target and a physical state of the user. A user is trained in the virtual reality interaction model, the system monitors actions and physiological states in real time, the digital twin model synchronously acts, and the scene is dynamically adjusted. After training, the rehabilitation effect is evaluated according to the physiological indexes, the motion data and the twinning optimization analysis result, and an optimization training scheme and a digital twinning model are fed back. Precision, individuation and intelligentization of rehabilitation training are achieved, and the training effect and quality are improved.
Owner:TONGJI HOSPITAL ATTACHED TO TONGJI MEDICAL COLLEGE HUAZHONG SCI TECH

Distribution network auxiliary decision-making method and system considering source load fluctuation relevance, and medium

The invention relates to the technical field of power systems and automation thereof, in particular to a distribution network auxiliary decision-making method and system considering source load fluctuation relevance and a medium. The method comprises the following steps: firstly, collecting related information of a distribution network area, quantifying a synchronization and hysteresis association rule of multi-source heterogeneous data fluctuation, and constructing a composite feature vector and a standardized risk perception data set; defining a state space and an action space of a reinforcement learning algorithm based on the composite feature vector, and realizing auxiliary decision-making optimization of the distribution network; constructing a scene feature library, calculating the fluctuation relevance similarity between a new scene and a historical scene, and multiplexing a deep reinforcement learning model architecture and carrying out transfer learning; building a power grid digital twinborn simulation platform, designing evaluation indexes, generating candidate schemes, deducing the candidate schemes, selecting recommendation strategies and storing the recommendation strategies in a strategy knowledge base.
Owner:SUQIAN POWER SUPPLY COMPANY OF JIANGSU PROVINCE POWER +2

Predictive maintenance method for light storage and charging integrated power station based on deep learning

The invention discloses a predictive maintenance method for an optical storage and charging integrated power station based on deep learning, and the method comprises the steps: constructing an efficient equipment state evaluation and prediction model based on multi-source data fusion, an intelligent prediction algorithm and a closed-loop optimization feedback mechanism, collecting multi-source data, and carrying out the fusion processing, an improved Attention-LSTM model is utilized to evaluate and predict the state of equipment, a transfer learning method is adopted to improve generalization ability, Bayesian optimization and an adaptive sliding window technology are combined at the same time, dynamic threshold adjustment is performed, a deep reinforcement learning algorithm based on a Markov decision process is adopted to optimize a maintenance strategy, and the maintenance efficiency is improved. Weibull distribution is introduced for failure probability modeling, the maintenance cost and the fault risk are balanced, continuous optimization and dynamic adaptive adjustment of a predictive maintenance scheme are realized through a closed-loop feedback mechanism, the prediction accuracy and the intelligent level of maintenance decision are remarkably improved, planned maintenance and sudden fault maintenance are reduced, and the maintenance efficiency is improved. And the reliability of the charging station is improved.
Owner:NANJING INST OF MECHATRONIC TECH

Monitoring and early warning method and system for power equipment of transformer substation

The invention relates to the technical field of monitoring and early warning of power equipment, in particular to a monitoring and early warning method and system for substation power equipment. Comprising a data acquisition module, an intelligent diagnosis module, a risk assessment module, a collaborative early warning module and an interaction control module. The data acquisition module acquires equipment operation data including current, voltage, temperature and humidity and vibration signals. And the intelligent diagnosis module identifies equipment abnormity through the generative adversarial network and the graph neural network. The risk assessment module generates a risk assessment curve based on a fractional order differential model and a reinforcement learning algorithm. And the collaborative early warning module generates a graded early warning scheme by utilizing edge calculation. And the interaction control module displays a state and optimizes a control strategy through a human-computer interface. The intelligent monitoring and management level of the power equipment of the transformer substation is improved, the service life of the equipment is prolonged, and the operation and maintenance cost is reduced.
Owner:XINGMA INTELLIGENT ELECTRIC CO LTD

Smart city environmental sanitation unmanned vehicle path planning and real-time monitoring method

The invention relates to the technical field of unmanned vehicle control, and discloses a smart city environmental sanitation unmanned vehicle path planning and real-time monitoring method. The method comprises the following steps: firstly, acquiring a multi-source environment sensing data set such as laser radar point cloud data, a camera image sequence and real-time traffic flow information; local road network features are extracted based on laser radar point cloud data, a dynamic target motion prediction map is generated according to a camera image sequence, and real-time traffic flow information is processed to generate a regional traffic efficiency evolution curve. And inputting the data into a path optimization model to generate an initial path sequence, dividing cleaning task priorities, fusing related data and generating a final path planning scheme through a reinforcement learning algorithm. In addition, operation state data of the unmanned vehicle are collected in real time, and a path correction instruction set is generated through an anomaly detection model to update the strategy network. According to the method, the rationality and the operation efficiency of the path planning of the environmental sanitation unmanned vehicle can be improved, real-time monitoring is realized, and the operation safety and the management intelligence level are enhanced.
Owner:SHANGHAI BODLE ENVIRONMENTAL TECH GRP CO LTD

Artificial intelligence enhanced distributed denial of service attack defense method and system

The invention provides an artificial intelligence enhanced distributed denial of service attack defense method and system, and relates to the technical field of artificial intelligence, and the method comprises the steps: collecting a data packet through a network flow collection module, extracting basic feature information, and obtaining a behavior feature vector through a deep learning feature extraction model; inputting the behavior feature vector into a pre-trained multilayer attention mechanism neural network model, calculating an attack probability score and marking potential attack traffic; performing clustering analysis on the potential attack traffic to calculate a hazard level, and generating a defense strategy according to the hazard level; and executing the defense strategy through the defense equipment, and dynamically optimizing the defense strategy by using a reinforcement learning algorithm based on defense effect feedback. According to the method, the attack traffic can be accurately identified, the defense strategy is adaptively optimized, and the accuracy and efficiency of distributed denial of service attack defense are effectively improved.
Owner:SUZHOU SAILOTE DIGITAL TECH CO LTD

Labeling task assignment method and device based on artificial intelligence

The invention discloses a labeling task assignment method and device based on artificial intelligence, and the method comprises the steps: obtaining historical behavior data, and constructing a multi-dimensional user portrait; receiving a task description document, a data sample and a quality requirement document to obtain a multi-dimensional task feature vector; based on the multi-dimensional user portraits and the multi-dimensional task feature vectors, a matching degree score is calculated through a multi-objective optimization algorithm, and an optimal task allocation scheme is generated; optimizing the task structure through a fireworks algorithm based on student t distribution, and generating an optimized task unit structure; real-time monitoring is carried out through the anomaly detection model and the quality prediction model, and quality control measures are triggered; model parameters are updated through a reinforcement learning algorithm, and a personalized feedback and capability improvement strategy is generated. According to the method, accurate matching between the annotators and the tasks is realized, the processing efficiency of complex tasks is improved, the annotation quality is improved, the expansibility and the response speed of a platform are enhanced, and an effective solution is provided for large-scale and high-quality data annotation.
Owner:GUIZHOU YOUTEYUN TECH CO LTD

Automobile part spraying control method and system

The invention provides an automobile part spraying control method and system, and relates to the technical field of automobile manufacturing, and the method comprises the steps: collecting spraying environment parameters in real time, generating a comprehensive digital model containing the environment parameters and part characteristics, and carrying out the intelligent partitioning of the surface of an automobile part through a clustering partitioning algorithm, and dividing the surface into a plurality of sub-regions; on the basis of each sub-region, combining with the current environment parameters, generating an optimal spraying parameter for each sub-region by utilizing an intelligent agent trained by a reinforcement learning algorithm, and on the basis of the spatial relationship between the optimal spraying parameters and the sub-regions, optimizing a global spraying sequence by adopting an ant colony path planning algorithm, and generating an optimal spraying path; the spraying robot sprays, a real-time quality evaluation result of spraying is generated, a pre-constructed fuzzy logic controller is adopted, spraying parameters are adjusted, sprayed parts are obtained, a full-period comprehensive data set is integrated, and spraying control parameters are iteratively updated.
Owner:JIANGSU HUAKUI AUTO PARTS CO LTD

Multi-microgrid cooperative scheduling method and system based on game theory

The invention discloses a multi-microgrid cooperative scheduling method and system based on the game theory, and the method comprises the steps: generating a dynamic game initial strategy set through a multi-agent strategy network according to the charge state of user energy storage equipment, the charge and discharge efficiency and the real-time scheduling demands of a power grid; based on the dynamic game initial strategy set, adopting an asymmetric Nash bargaining model to carry out distributed negotiation, and generating a balanced benefit distribution scheme; according to the equilibrium benefit distribution scheme, iteratively correcting the energy storage priority index by using a time decay type reinforcement learning algorithm, and generating a dynamic bidding rule containing a supply and demand elastic coefficient and risk compensation; and based on a dynamic bidding rule, energy storage resources are allocated in real time through a decentralized gradient consensus mechanism, and a final collaborative scheduling instruction is generated and synchronized to each micro-grid terminal. According to the embodiment of the invention, the operation efficiency and the self-adaptive capability of the multi-microgrid system can be improved, and the requirements of a future intelligent power distribution network are met.
Owner:HANGZHOU KGOOER ELECTRONIC TECH CO LTD

Automatic control method and system for secondary granulation of high-voltage zinc oxide resistor disc

The invention discloses an automatic control method and system for secondary granulation of a high-voltage zinc oxide resistor disc, relates to the technical field of intelligent manufacturing of power equipment, and solves the problems of out-of-control particle morphology caused by dynamic coupling parameter identification lag and control instability caused by multi-physical field parameter coupling in an existing method. According to the invention, a dynamic physical property parameter matrix is generated in real time based on multi-band dielectric relaxation spectrum analysis and terahertz wave tomography; predicting a fluidized phase change threshold value and an energy gathering area through multi-physics field coupling modeling; a time sequence attention deep reinforcement learning algorithm is adopted to generate a multi-field cooperative adjustment instruction; positioning a parameter conflict source and triggering decoupling compensation by combining a high-frequency vibration and acoustic emission combined monitoring module; performing closed-loop correction on the control network weight based on the laser spectrum data and a partial least squares regression model; the real-time performance of fluidization parameter identification, the stability of multi-field coupling control and the recovery efficiency of abnormal working conditions are remarkably improved, and meanwhile the batch consistency of the electrical performance of the resistor discs is guaranteed.
Owner:NANYANG GOLDEN CROWN IND CO LTD

Smart park multi-source data fusion method and system based on AI

The invention discloses an AI-based smart park multi-source data fusion method and system, and the method comprises the steps: generating a time-space aligned standardized data flow according to environment parameters, energy consumption waveforms, security signals and personnel trajectory data collected by a heterogeneous sensor network; generating a multi-modal fusion feature matrix based on the standardized data stream; according to the multi-modal fusion feature matrix, generating a three-dimensional twinborn body including the equipment state, the people flow density and the energy consumption hot spot in real time; inputting the three-dimensional twin into a multi-target constrained reinforcement learning algorithm, and fusing real-time data and prediction data to generate a Pareto optimal solution set; and based on the Pareto optimal solution set, generating a final instruction set for driving park equipment regulation and control, and triggering collaborative response of a security and protection system and an energy consumption system at the same time. According to the embodiment of the invention, intelligent upgrading of park management can be realized through cross-modal feature extraction, dynamic digital twin modeling and reinforcement learning optimization.
Owner:ZHONGZHEXIN TECH CONSULTING CO LTD

Precise advertisement putting method and system based on artificial intelligence

The invention discloses an accurate advertisement putting method and system based on artificial intelligence, and relates to the technical field of information, and the method comprises the steps: collecting user behavior data and real-time situation data, and carrying out the preprocessing of the user behavior data; analyzing the preprocessed user behavior data to generate a user interest label; combining the real-time situation data with the user interest label, constructing a situation interest model by adopting a deep learning technology, and predicting a user interest change mode; using an interest-driven recommendation method to obtain an initialized advertisement putting strategy; generating feedback information based on the analysis of the initialized advertisement putting strategy; and optimizing the feedback information through a reinforcement learning algorithm to generate an optimized advertisement display strategy. By vectorizing the user interest and combining the advertisement strategy characteristics, the generator model can meet the user preference and follow the advertisement materials of the optimal display strategy, so that the visual experience and the emotion resonance of the user are improved, and finally the click rate and the conversion rate of the advertisement are improved.
Owner:CLOUD ATTACK NETWORK TECH HEBEI CO LTD

Park-level adjustable load-oriented resource regulation and control method, device and equipment and medium

The invention belongs to the technical field of power grid regulation and control, and particularly relates to a park-level adjustable load-oriented resource regulation and control method and system, and the method comprises the steps: formulating an initial energy scheduling scheme according to the predicted energy demand in combination with the output characteristics of distributed energy in a park and the load condition of a power grid; and training a load regulation and control strategy model by adopting a reinforcement learning algorithm based on the initial energy scheduling scheme, and generating a personalized load regulation and control instruction for each energy consumption unit. According to the scheme, the real-time energy consumption data of the plurality of energy consumption units in the park, the output characteristics of the distributed energy and the power grid load condition can be comprehensively considered, a scientific and reasonable energy scheduling and load regulation and control strategy is formulated, and efficient utilization and green low-carbon development of park energy are realized. Meanwhile, the method also needs to have the characteristics of data sharing, accurate prediction, intelligent scheduling, rapid response and the like so as to adapt to complex and changeable energy requirements and environmental protection requirements of the park.
Owner:STATE GRID BEIJING ELECTRIC POWER CO +1

Unmanned aerial vehicle intelligent charging control method and system based on multi-scene adaptation

The invention provides an unmanned aerial vehicle intelligent charging control method and system based on multi-scene adaptation, and relates to the technical field of unmanned aerial vehicles, and the method comprises the steps: collecting environment data through multiple types of sensors, carrying out the scene recognition and classification through a deep learning algorithm, and generating a scene feature vector and a parameter data set; a basic strategy is called from a preset charging strategy library according to the scene type, a reinforcement learning algorithm is adopted to optimize a charging strategy, a charging power adjustment curve is generated in combination with the environmental parameters, and a charging control instruction is output; and when the charging process is executed, monitoring battery state parameters in real time, performing safety threshold comparison and protection control, calculating a battery health index to evaluate a performance state, and feeding back an evaluation result to the charging optimization model to realize closed-loop control of the charging process.
Owner:ZHONGDIAN GUOKE TECH CO LTD +1

Well drilling key parameter automatic regulation and control method based on improved DDPG algorithm

The invention discloses a drilling key parameter automatic regulation and control method based on an improved DDPG algorithm. The method comprises the following steps: collecting and preprocessing drilling data, and constructing a complete data set for training; a drilling speed (ROP) time sequence prediction model is constructed and trained on the basis of a self-attention mechanism (self-attention); building a simulation environment by using the trained ROP prediction model, and defining a state space, an action space and a multi-target reward function of a reinforcement learning DDPG algorithm model; a deep deterministic strategy gradient algorithm (DDPG) is adopted to train a reinforcement learning model, through an Actor-Critic network structure, an intelligent agent learns an optimal bit pressure (WOB) and rotating speed (RPM) regulation strategy in a simulation environment, and dynamic optimization of the drilling speed (ROP) is achieved. According to the method, through automatic and intelligent parameter regulation and control, the efficiency and stability of the drilling process are improved, the drill bit wear rate and the operation cost are reduced, and the method has good adaptability and multi-target optimization capacity and is suitable for drilling operation under the complex stratum condition.
Owner:XI'AN PETROLEUM UNIVERSITY

Heterogeneous encrypted multi-modal multimedia message real-time fragmentation transmission method for 5G network

The invention discloses a heterogeneous encrypted multi-mode multimedia message real-time fragmentation transmission method for a 5G network, and relates to the technical field of multimedia transmission optimization. According to the heterogeneous encryption multi-mode multimedia message real-time fragmentation transmission method for the 5G network, the fragmentation granularity and priority are optimized through a reinforcement learning algorithm by obtaining the sensitive label and the value density of multimedia data and combining the 5G slice resource state. And dynamically selecting an encryption algorithm cluster according to a fragmentation rule, and realizing cross-slice key distribution and updating by using an alliance chain. On the basis of space-time relevance of multi-modal data, a fountain code driven redundant coding strategy is constructed, and a fragment transmission path is optimized in combination with a game theory model. And finally, analyzing a transmission flow characteristic and a key distribution log, and dynamically adjusting an encryption strength threshold value and a fragment retransmission strategy. According to the method, the security, the reliability and the transmission efficiency of the multimedia data in the 5G network are improved, and the method is suitable for a multimedia communication scene with low time delay and high reliability.
Owner:北京微呼科技有限公司

Supply chain full-process traceability system based on digital twinning and block chain

The invention discloses a supply chain full-process traceability system based on digital twinning and block chains, and belongs to the technical field of digital twinning and block chains, and the system comprises a data collection layer which obtains original data from each link in real time, and carries out the preprocessing of the original data through an edge computing device; the twinborn model building layer is used for building digital twinborn models corresponding to all links of the supply chain respectively and generating link-level optimization parameters through simulation analysis; the block chain network layer is used for verifying and storing shared data and key traceability information among the digital twin models; the collaborative optimization module is used for dynamically adjusting a cross-link collaborative strategy based on a multi-agent reinforcement learning algorithm; and the data traceability layer responds to an external traceability query request and generates a full-link visual traceability map. By means of the collaborative algorithm based on multi-agent reinforcement learning, automation and intellectualization of information interaction among all link models are guaranteed, and personalized and multi-terminal traceability service can be provided for users.
Owner:HANGZHOU YIZHI MICRO TECH CO LTD

Computer network information security monitoring method, system, equipment and medium

The invention relates to the technical field of network security, in particular to a computer network information security monitoring method, system and device and a medium, and the method comprises the steps: obtaining encrypted traffic data and application log data in a network environment, and constructing a space-time associated original data set based on the encrypted traffic data and the application log data; performing protocol analysis on the original data set with the time-space association to generate a protocol fingerprint feature vector; inputting the protocol fingerprint feature vector and the application log data into a preset heterogeneous multi-modal analysis model, and obtaining a multi-dimensional security situation assessment result containing a threat level and an attack path; and based on the multi-dimensional security situation assessment result, generating a dynamic defense strategy instruction set through a reinforcement learning algorithm, and issuing a strategy instruction to a network execution node in real time. The method and the device have the effects of realizing real-time accurate detection of encryption threats and constructing a dynamic defense system with balanced security and efficiency.
Owner:李俊磊 +1