42390 results about "Neural network nn" patented technology

The present invention relates to the field of industrial intelligent predictive maintenance, and in particular to an interpretable deep feature fusion network-based industrial intelligent predictive maintenance method, comprising: acquiring gearbox vibration data comprising noise; performing preliminary extraction and noise suppression on features of the acquired data by establishing an interpretable feature extraction module having a physical information constraint; integrating multi-scale features comprising long-distance and local dependencies by means of a dual-branch feature fusion module having global and local feature fusion capabilities; performing dimensionality reduction on a high-dimensional feature and generating an output by means of a classifier to obtain a final fault identification result; and performing interpretability analysis on a diagnosis process of a model. In the present invention, by embedding the signal processing technology having a well-defined physical theory support into a deep neural network, the interpretability and reliability of model inference results are effectively improved while the fault identification accuracy of the model is improved.

A method is provided for enhanced data routing in neural networks using Self-Organizing Maps (SOM) integrated with Autoencoder-GAN. The method comprises training an autoencoder to encode input data into a latent space representation; applying a Self-Organizing Map (SOM) to organize the latent space representation into a topological map; refining the latent space representation using a Generative Adversarial Network (GAN), wherein the generator generates enhanced latent space representations and the discriminator evaluates their quality; using the refined latent space representations to update the SOM topology dynamically; generating routing coefficients based on the updated SOM topology to guide data routing in a capsule network; and dynamically adjusting routing within the capsule network using the generated routing coefficients to enhance performance based on the refined latent representations.

The invention relates to the technical field of computing power scheduling, and discloses a heterogeneous resource computing power intelligent scheduling method and system. According to the method, real-time state monitoring is conducted on heterogeneous computing resources, and resource state parameters such as the computing unit utilization rate and the memory occupancy rate are obtained; task attributes and user request parameters of the task queue are collected, historical task data are processed based on the genetic algorithm optimization model to execute task demand prediction, and predicted demand parameters are generated. A dependency graph containing resource unit nodes and communication link roadsides is constructed through a resource topology analysis tool, predicted demand parameters are input into a scheduling priority classifier trained by a graph neural network, and an actual scheduling priority is identified. And executing resource conflict prediction based on the priority, inputting task feature vectors into a conflict resolution module of a fuzzy logic decision maker, outputting actual conflict resolution parameters, and finally integrating to generate a scheduling scheme containing a resource allocation sequence and an execution time table.

A real-time system for the multimodal generation of virtual reality scenes based on artificial intelligence for the creation of immersive three-dimensional environments from natural language narratives, consisting of: a speech capture module configured to continuously record a user's spoken narrative via one or more directional microphones, preprocesses the captured signal by noise reduction and temporal alignment, and outputs a digital speech stream; A speech-to-text processing unit that is operationally coupled to the speech capture module and configured for real-time speech recognition using a continuous neural transformer model. The unit is trained to transcribe natural language utterances into structured text data while maintaining contextual continuity throughout the evolving narrative. a semantic interpretation processing unit that is communicatively linked to the speech recognition unit and configured to perform natural language understanding techniques to extract contextual entities, spatial references, temporal relationships, and object attributes from the transcribed narrative; the engine includes a large language model that is fine-tuned for spatial reasoning tasks; a scene graph generation module configured to transform the interpreted semantic data into a structured, hierarchical representation that defines nodes for identified entities and edges for corresponding relationships, with each node associated with metadata describing geometry, position, orientation, texture, and linking attributes between objects; a multimodal image-language model processor coupled with the scene graph generation module, wherein the processor is configured to retrieve, adapt, or synthesize appropriate three-dimensional elements from a pre-trained visual-lexical embedding space and align these elements with their semantic and spatial definitions derived from the scene graph; a scene assembly and rendering controller configured to create a cohesive virtual scene from the aligned assets, perform real-time rendering using a GPU-accelerated ray tracing pipeline, and produce a stereoscopic visual output that corresponds to the evolving narrative; A head-mounted virtual reality visualization device connected to the rendering engine and configured to display the generated immersive environment to the user in real time. The device features motion sensors and inside-out tracking cameras to detect head and body movements, dynamically updating viewing angles and perspective within the rendered scene; and a bidirectional feedback module integrated into the head-mounted device and connected to the semantic interpretation processing unit; the module is configured to interpret corrective commands, gestures, or supplementary comments from the user to refine or modify specific scene elements without interrupting the real-time visualization; The system continuously updates the virtual scene as the narrative develops, ensuring temporal synchronization between speech input and rendered output below a defined latency threshold, thus enabling a natural, dialogic construction of complex three-dimensional virtual environments.

The invention relates to a disaster multi-source situation intelligent sensing management and control method and system. According to the method, hydrometeorological and topographic data are collected, and a standardized data set is generated through space-time alignment and anomaly cleaning; constructing a directed topological graph containing node and edge attributes based on the extracted river network topological relation; designing a neural network model, and training through a physical constraint loss function embedded in a water balance principle to obtain a flood dynamic routing prediction model; inputting real-time hydrological data into the model for graph convolution operation, and predicting water level, flow and split ratio changes of each node in a future time period; and finally, carrying out submerging simulation analysis in combination with a digital elevation model, and generating a flood control scheduling scheme and risk early warning information. The deep fusion of a physical mechanism and data driving is realized, the flood propagation rule under the river network topology constraint is effectively captured by using the graph neural network, the calculation efficiency is remarkably improved while the prediction precision is ensured, and real-time and reliable decision support is provided for flood disaster prevention and control in a complex river network region.

An intelligent analysis method based on medical document structure perception and multi-modal fusion comprises the following steps: carrying out structure topology modeling on a medical document, extracting visual layout, text meta-information, space coordinates and semantic keyword features, constructing a semantic topological graph and dynamically shielding irrelevant contents; selecting an extraction path according to a document type, performing deep semantic analysis and entity recognition on a text-type document, and performing visual enhancement OCR recognition on a scanning-type document; the features are injected into a medical knowledge graph, and feature fusion, semantic verification, relation reasoning and information completion are achieved through a graph neural network; a three-stage strategy optimization model of basic pre-training, domain adaptation and online reinforcement learning is adopted; and large-scale processing is realized through a dynamically aggregated distributed architecture. The method is used for intelligent analysis and structured conversion of documents of hospitals, medical insurance and medical scientific research. The problems that heterogeneous medical document analysis adaptability is poor, multi-modal fusion is difficult, medical knowledge utilization is insufficient, and large-scale processing efficiency is low are solved.

The invention belongs to the technical field of bridge monitoring, and relates to a system and a method for fusing multi-source data of a bridge structure. Comprising a heterogeneous topological graph construction and manifold embedding technology module, a multi-scale space-time cognitive convolutional neural network module, a continuous manifold space-time alignment and Bayesian fusion module and a structure health index calculation and state evaluation module. The heterogeneous topological graph construction and manifold embedding technology module is used for obtaining a heterogeneous topological graph, a node embedding vector and a manifold model parameter; the multi-scale space-time cognitive convolutional neural network module is used for performing deep feature extraction on the heterogeneous topological graph to obtain multi-scale fusion features; the continuous manifold space-time alignment and Bayesian fusion module is used for obtaining space-time alignment parameters and fusion state vectors; the structure health index calculation and state evaluation module is used for carrying out structure health monitoring and state evaluation on the bridge to obtain a final health evaluation result; therefore, the intelligence, automation and reliability levels of the structure monitoring system are improved.

The present invention discloses an artificial intelligence-based adaptive big data storage and retrieval optimization system and method designed to intelligently manage and optimize large-scale distributed data environments. The system integrates data acquisition, distributed storage, metadata processing, adaptive learning, and retrieval optimization units configured to work collaboratively for continuous self-optimization. The invention employs deep reinforcement learning and predictive neural network techniques to dynamically analyze system telemetry, workload behavior, and data access patterns in real time, enabling proactive adjustment of data placement, caching, replication, and compression parameters across distributed nodes. The metadata processing framework utilizes graph-based dependency modeling to maintain semantic and contextual relationships among datasets, facilitating intelligent and context-aware data retrieval. The retrieval optimization unit interprets user queries semantically and computes the optimal retrieval route using latency prediction models and dynamic routing techniques.

The invention provides a road bridge crack detection method and system, and the method comprises the steps: collecting a bridge surface multi-view image, and constructing a training data set containing crack feature labeling through quality screening and standardized labeling; preprocessing the image by using a multi-scale feature fused deep convolutional neural network and carrying out semantic segmentation, initially identifying a suspected crack region and generating a segmentation mask; and constructing a BeNNS proxy model based on the mask, and establishing a mapping relationship between the detection result and the bridge structure topology, the stress flow field and the service function chain so as to evaluate the result reliability. And inputting an evaluation result into a hybrid evaluation mechanism, performing online real-time detection and offline batch verification to optimize precision, and outputting a verified crack region. Finally, morphological analysis is conducted on the area, geometric parameters and danger levels of cracks are extracted and integrated to a bridge health monitoring system, a crack evolution tracking algorithm and an early warning mechanism are established, and dynamic tracking early warning is achieved. The problem of low detection precision in a complex environment can be solved.

The invention relates to the technical field of safety monitoring and intelligent early warning, discloses a construction safety risk monitoring method and system, and aims to solve the problems that a traditional construction safety monitoring means is isolated, static and lagged. The method comprises the following steps: deploying a multi-modal sensing network to collect environment, personnel, equipment and structural data; constructing a risk factor time sequence matrix through space-time alignment and feature normalization; constructing a dynamic association graph in combination with the risk conduction rule base and historical cases; predicting risk propagation potential energy of each node by using a graph neural network; triggering early warning according to the multi-level threshold value and outputting a conduction path and a blocking suggestion; the field devices are linked to perform hierarchical suppression actions. The system comprises a sensing deployment module, a data fusion module, a map construction module, a potential energy prediction module and an early warning decision and execution linkage module. Through space-time modeling and intelligent deduction, active identification and second-level intervention of a risk link are realized, the transformation of construction safety from passive response to active prevention is promoted, and the accident probability and the loss scale are reduced.

Disclosed in the present invention is an improved deep learning model-based refrigeration unit fault detection method. The method uses an LOF algorithm to remove outliers from a fault dataset, and then uses ADASYN technology to solve the problem of data imbalance. In addition, in respect of the problems that existing refrigeration unit fault diagnosis deep learning models are prone to network degradation, and refrigeration unit fault diagnosis models generally lack weighting critical features, the present invention first alleviate, on the basis of ResNet, the problem of network performance degradation which is prone to occur in deep neural network training processes, and then integrates a CBAM for capturing critical features in fault data, so as to improve the feature extraction capability of a network. Experimental results show that the LOF-ADASYN-ResNet-CBAM method provided by the present invention effectively diagnoses refrigeration unit faults.

The invention belongs to the technical field of coal mine risk early warning, and particularly relates to a coal mine goaf multi-risk comprehensive early warning method and system based on machine learning, and the method comprises the steps: collecting mine pressure, gas and hydrological real-time data in real time through a multi-temporal-spatial-scale sensor, and obtaining a dynamic coupling relation basic data set based on the real-time data; preprocessing noise and missing values according to the dynamic coupling relationship basic data set, and modeling node connection between a geological structure and mine pressure change by adopting a graph neural network to obtain space-time heterogeneous feature representation; non-linear features are analyzed through spatial-temporal heterogeneous feature representation, and a multi-scale dynamic mode is determined; acquiring a risk conduction path in the multi-scale dynamic mode, and acquiring an early recognition signal of a potential disaster chain; based on the early recognition signal, a long-short-term memory network is used for processing a sequential sequence, and the probability of the compound disaster is judged; a high-risk area is extracted from the composite disaster probability, and real-time early warning model parameters are obtained; and generating alarm output according to the real-time early warning model parameters.

The invention discloses an intelligent cable fault diagnosis and positioning method and system, and relates to the technical field of intelligent operation and maintenance of a power system. The method is used for accurately identifying and positioning high-resistance faults and external damage. According to the method, electric field, current, temperature and vibration signals are synchronously collected, a multi-source fusion enhanced signal flow is constructed, and multi-physical field features are extracted; based on a coupling mechanism of an electromagnetic-thermal field and a mechanical-electric field, generating a fault type label and a space coordinate; executing targeted impedance correction for different fault types, establishing a dynamic topology network, and inputting a time-space diagram neural network to output a preliminary positioning result; and multi-source verification is carried out by further fusing salinity dielectric, a harmonic thermal field, a vibration electric field and stress topological information, a high-confidence-coefficient fault positioning result is finally output, a closed-loop diagnosis mechanism is formed, and the fault recognition accuracy and the system adaptability under complex working conditions are improved.

The embodiment of the invention provides an unhooking robot control method based on multi-source visual fusion, which is applied to the technical field of robot control and comprises the following steps: acquiring an RGB image, a depth image, an infrared image and IMU data through a multi-source sensing system mounted at the tail end of a robot; carrying out feature fusion identification by adopting a double-branch neural network, and outputting the boundary contour of the lifting hook and the three-dimensional coordinates of the optimal grabbing point; the visual coordinates are unified to a robot base coordinate system through a registration correction mechanism; a Transform prediction model is constructed based on the visual and inertial signals, and future pose changes of the lifting hook are estimated; a feedforward control track is generated to counteract swing of the lifting hook, and track correction is carried out in combination with visual servo feedback; and a joint instruction is generated through path planning and inverse kinematics solution, and the mechanical arm is driven to complete precise unhooking operation. According to the method, the recognition precision, the anti-interference capability and the operation success rate of unhooking operation in complex illumination and dynamic environments are effectively improved.

The invention provides an engineering construction defect automatic detection and classification method based on deep learning, and the method comprises the steps: obtaining a welding seam surface image through the shooting of an unmanned plane, and carrying out the denoising and illumination normalization processing of the welding seam surface image, and obtaining a standardized image; welding seam surface texture features are extracted from the standardized image, a convolutional neural network is adopted to analyze the spatial distribution characteristics of textures, and vectorization processing is carried out to obtain texture feature vectors; segmenting a weld surface corresponding to abnormal region distribution by adopting a region growing algorithm, and analyzing pore and weld discontinuity in combination with the texture feature vector to obtain a defect candidate region; performing threshold division on the sizes and the numbers of the defects according to the defect types and the feature vectors of the candidate regions to obtain a severity grading result of each type of defects; and severity features are extracted from a grading result, and a Bayesian network is adopted to fuse texture feature vectors and defect type labels to obtain a welding quality evaluation score.

The invention relates to the technical field of exception prediction, in particular to a storage cabinet exception trend prediction system based on time series data analysis, which comprises a state monitoring module, an interval sensing module, a path reconstruction module, a symptom activation module and an evolution prediction module. According to the method, the state vectors including the temperature, the voltage, the current and the door lock state are constructed and combined with the timestamp information to form the time sequence data sequence, and the dynamic expression mode of state change is established; a jump characteristic is analyzed by using a ratio of a time interval to a state change amplitude, a short-time disturbance path and a trend evolution path are distinguished by combining a jump rate statistical index, and an evolution activation signal is identified based on trend maintenance and non-fallback characteristics. On the basis, a neural network structure with long-time dependent learning ability is introduced to capture an aperiodic thermal anomaly trend in a state sequence, and the accuracy and timeliness of anomaly recognition are improved through multi-dimensional parameter cooperative processing and path construction logic.

A neural network system is provided. The system includes an autoencoder configured to encode input data into a latent space representation; a generator neural network configured to receive a noise vector and the latent space representation and output a set of routing coefficients; a discriminator neural network configured to evaluate the effectiveness of the routing coefficients by measuring the performance of a capsule network utilizing said routing coefficients; and a capsule network comprising a first capsule layer and a second capsule layer, wherein the routing coefficients are used to dynamically route outputs from the first capsule layer to the second capsule layer.

The invention relates to the technical field of drainage basin water scheduling, and discloses a drainage basin water regulation and control optimization method based on ecological element changes. The method comprises the following steps: deploying a drainage basin monitoring system, and collecting ecological element real-time data such as a hydrological parameter sequence and a remote sensing image; after the data is cleaned and converted, hydrological trend features and spatial distribution features are extracted by adopting a feature learning model, and the hydrological trend features and the spatial distribution features are fused into unified ecological representation through a cross-modal alignment mechanism; inputting the unified ecological representation into a physically constrained neural network prediction model, and outputting a water regimen dynamic prediction value; and finally, based on the predicted value, a water resource regulation and control instruction is generated and executed by using a multi-objective decision algorithm so as to optimize the watershed water circulation process. According to the method, feature extraction comprehensiveness is improved through multi-source data fusion and cross-modal analysis, prediction reliability is enhanced in combination with physical constraints, reasonable allocation of water resources is achieved by means of multi-target decision, the ecological condition of a drainage basin can be improved, and the water utilization efficiency is improved.

The invention is suitable for the technical field of data analysis, and provides a transformer substation fault handling method combining causal reasoning knowledge graph modeling, comprising: acquiring multi-source heterogeneous data and performing data cleaning processing to obtain a space-time alignment data set, the space-time alignment data set comprising one or more quaternary data sets, the quaternary data set comprises a device identifier, a timestamp, a feature vector and an event tag; causal modeling processing is carried out on the time-space alignment data set to obtain a causal graph, and the causal graph comprises node information of nodes and relation information between the nodes; constructing a space-time diagram neural network model according to the causal diagram and the equipment connection relation diagram, wherein the space-time diagram neural network model realizes dynamic evolution of the graph based on an incremental updating strategy; and outputting fault root cause positioning information according to the time-space diagram neural network model.

The invention relates to the technical field of mining industry, and discloses an intelligent prediction method for gold ore beneficiation process parameters based on cloud and edge fusion, which realizes space-time correlation modeling of beneficiation process parameters and accurately depicts dynamic interaction influence among equipment. The cloud edge collaborative architecture considers global optimization and real-time response requirements, and the prediction stability under complex working conditions is effectively improved. The introduction of physical constraints enhances the applicability of the model in an actual production environment, a bidirectional feedback mechanism ensures the adaptive ability of the system in a dynamic change environment, and through the joint reasoning of a knowledge graph and a neural network, the consistency of a prediction result and a process principle is enhanced, and the risk of misjudgment under an abnormal working condition is reduced; the man-machine cooperation mechanism significantly improves the labeling efficiency of high-value samples, shortens the model iteration period, and ensures the continuous optimization capability of the prediction system in the actual production environment.

The invention relates to a groundwater safety assessment method under an extreme climate event, which comprises the following steps: collecting multi-source heterogeneous data such as meteorological data, geological data, hydrological data and remote sensing data, and constructing a unified groundwater safety knowledge graph through standardized cleaning, semantic alignment and deletion completion; monitoring an extreme climate event in real time, and updating a node relation weight and sparsifying a transmission path based on knowledge graph dynamic evolution and a time sequence attention mechanism; performing risk propagation path reasoning on the dynamic knowledge graph in combination with an improved graph neural network, identifying key pollution nodes, and outputting a structured risk level and a coping suggestion; the system continuously optimizes atlas and model parameters based on evolution feedback, and high adaptability and reasoning precision of emergency response are achieved. According to the method, the intelligence, the real-time performance and the accuracy of underground water risk assessment are improved. The problems that the underground water pollution propagation path is difficult to dynamically identify and the decision adaptability is insufficient under extreme climate events are solved.

The invention provides a dam safety perception fusion association method based on a multi-modal space-time diagram neural network. The method comprises the following steps: dividing a dam into a plurality of structural units, and mapping various data into a three-dimensional coordinate system; a heterogeneous graph structure is defined, and a dynamic adjacency matrix is calculated based on the real-time stress gradient so as to reflect physical connection, mechanical conduction and geological association relationships among nodes; carrying out fusion modeling on multi-source data in the heterogeneous graph structure by utilizing a multi-modal space-time diagram neural network, constructing a causal inference engine based on an output result of the multi-modal space-time diagram neural network, and updating a three-level modeling system through structural equation modeling, anti-factual inference and dynamic weight to obtain the heterogeneous graph structure. According to the method, the dynamic coupling rule among the dam structure, geology and material states is excavated, cross-modal space-time fusion of manual inspection and sensor monitoring data can be realized, the early recognition capability and early warning accuracy of dam potential safety hazards are improved, and the problems of data islands and insufficient relevance in a traditional monitoring method are effectively solved.

The invention discloses a modeling method based on shield tunneling data feature analysis and parameter relevance, and relates to the field of tunnel engineering data processing. The method comprises the steps that shield tunneling time sequence parameters are obtained, and a non-uniform time sequence is resampled into a space-aligned standardized footage domain sequence through state cleaning and coordinate domain transformation; by means of mixed variable rejection and lagging correlation analysis, environment common cause interference is stripped, physical response delay among parameters is recognized, and a time-delay directed correlation graph model is constructed; and inputting the footage domain sequence and the graph model into a graph neural network, performing feature learning by using a time delay compensation aggregation mechanism, and outputting a key parameter influence degree set with symbols based on a prediction gradient. According to the method, the problem of data space-time dislocation caused by propelling speed fluctuation and the problem of parameter relevance misjudgment caused by physical response lag are solved, and accurate identification and explanation of shield tunneling key parameters are achieved.

A method, system, and device for wind speed prediction and layout optimization in wind power generation are provided. The method includes: obtaining a basic wind resource dataset of a target region; constructing a physics-informed neural network model based on the basic wind resource dataset; obtaining wind speeds data at a specific location in a velocity field based on the physics-informed neural networks and constructing a training dataset; training the physics-informed neural network model based on the training dataset; reconstructing a wind speed distribution within the velocity field and predicting wind speeds for a next time period with a wind farm using the trained physics-informed neural network model; and optimizing a layout of a wind turbine cluster based on a reconstructed wind speed distribution within the velocity field. The present application reconstructs a two-dimensional velocity field of the wind farm by training the PINN and enables accurate ultra-short-term wind speed prediction.

The invention relates to the technical field of aircraft structure detection, and discloses an aircraft structure crack intelligent identification method based on deep learning. The method comprises the following steps: acquiring original vibration response signals and electromagnetic field distribution data on the surface and inside of an aircraft structure in parallel through a multi-source sensor network; synchronously processing the data by using a multi-scale convolutional neural network, and extracting time-frequency domain abnormal fluctuation features and space magnetic field distortion features; constructing a cross-modal correlation model, analyzing a topological dependency relationship of the two types of features through a graph attention mechanism, and generating a fused damage sensitive feature vector; inputting the vector into a pre-trained deep belief network to obtain a probability distribution mapping relation for different crack types; and according to the mapping relation, carrying out adaptive weighted fusion on original multi-sensor data, inhibiting environmental noise and structural background interference, and separating and reconstructing an accurate three-dimensional morphology map of the target crack. According to the method, multi-source data information can be effectively fused to improve the accuracy of aircraft structure crack identification.

The invention provides a water conservancy project safety monitoring method and system based on data processing, and relates to the technical field of monitoring, and the method comprises the steps: obtaining and carrying out the multi-dimensional preprocessing of water conservancy project multi-source heterogeneous monitoring data through the deployment of a sensor network, and extracting multi-scale space-time fusion features from the data; performing structural state modeling, anomaly prediction, risk assessment and early warning by using a long-short-term memory neural network model integrated with a multi-head attention mechanism; and intelligent suggestions oriented to maintenance decisions are generated, so that comprehensive, accurate and prospective evaluation and early warning of the structural state of the water conservancy project are finally realized, the exception identification and risk prediction capabilities are effectively improved, the false alarm rate is reduced, refined and initiative intelligent maintenance decisions are provided, resource allocation is optimized, and the service life of the project is prolonged.

Deep learning tools such as convolutional neural networks (CNNs) and transformers have spurred great advancements in computational biology. However, existing methods are constrained architecturally in context length, computational complexity, and model size. This application introduces a sub-quadratic architecture for modeling, which combines projected gated convolutions and structured state spaces to achieve local and global context with, for example, single-nucleotide resolution. These models outperform CNN-, GPT-, BERT-, and long convolution-based models in many tested genomics tasks without pre-training and with 4×-781× fewer parameters. In the proteomics domain, these models similarly outperform pretrained attention-based models, including ESM-1B and TAPE-BERT, on remote homology prediction without pre-training and while using 3,308×-23,636× fewer parameters.

The invention discloses a light guide plate defect detection method and system based on a neural network, and particularly relates to the technical field of machine vision detection, and the method comprises the following steps: aiming at the problem of image instability of a light guide plate in a dynamic transmission or rotation process, continuously collecting an image sequence and extracting time domain features; and performing interference judgment in combination with the inter-frame consistency prediction coefficient and a first threshold to realize accurate identification of the abnormal image frame. For an abnormal image frame, further correcting the recognition credibility of the abnormal image frame by adopting a confidence adjustment and fusion mode, and meanwhile, introducing a frequency domain transformation and image enhancement strategy to compensate detail loss caused by motion blur; according to the method, inter-frame consistency analysis, confidence fusion regulation and control and frequency domain fuzzy recognition and compensation mechanisms are introduced, abnormal judgment and image quality restoration of the light guide plate image in the dynamic scene are realized, the recognition accuracy and stability of the neural network model on the defect type, position and confidence are improved, and the false detection and omission ratio is effectively reduced.

The invention discloses an intelligent operation and maintenance management system and method based on a charging pile, and belongs to the technical field of fault early warning, and the method comprises the steps: building a unified time sequence operation data matrix through collecting multi-source state data generated in the operation process of the charging pile; key features are extracted to construct feature vectors, and a multi-classification neural network model is utilized to evaluate a health state; a micro-degradation evolution path model is constructed in combination with the health trend in the continuous observation period, and a fault prediction curve is generated; performing similarity matching on a prediction result and a fault prior curve library, calculating a risk weight coefficient, identifying potential fault nodes and outputting an early warning list; constructing a regional task scheduling graph based on the high-risk pile position, fusing geographic position, power level and residual life information, and optimizing to generate an operation and maintenance path and a resource configuration scheme; according to the method, the fault prediction accuracy and operation and maintenance efficiency of the charging pile can be remarkably improved, and intelligent operation and maintenance and response optimization are realized.

The invention discloses a visual language navigation method for cross-modal alignment in a dynamic shielding environment, and the method comprises the steps: collecting multi-modal data through a visual sensor, an inertial measurement unit, a laser radar and the like, and carrying out the preprocessing and time synchronization; sensing the dynamic shielding object through a model composed of a convolutional neural network and a long-short-term memory network, and estimating the future change of the dynamic shielding object in combination with a space-time sequence prediction algorithm; a double-branch convolutional neural network and a Transform based on a dynamic attention mechanism are adopted to respectively extract visual and semantic features and fuse the visual and semantic features; on the basis of occlusion prediction, potential occlusion region features are extracted in advance from a time dimension, an occluded image is repaired by using a generative adversarial network and geometric constraints in a space dimension, and cross-modal feature alignment is optimized through an attention mechanism; planning a path by using a hybrid reinforcement learning algorithm based on a deep Q network-space and a fast exploration random tree, and dynamically adjusting according to real-time shielding; according to the method, the accuracy, adaptability and reliability of visual language navigation in a dynamic shielding environment are improved.