4766 results about "Infrared image" patented technology

The invention discloses a visible light and infrared image fusion method based on cross-modal dynamic collaboration. The method comprises the following steps: respectively extracting texture detail features of a visible light image and thermal radiation features of an infrared image through a visible light encoder and an infrared encoder; spatial alignment and channel complementarity optimization of cross-modal features are realized by using a heterogeneous attention collaboration module; and performing layered fusion on deep semantics and shallow detail features through a dynamic gating multi-scale decoder to generate a high-resolution fusion image. According to the method, the problems of feature dislocation, detail loss and unreasonable fusion weight distribution caused by modal difference in the prior art are solved, the detail fidelity, the thermal target saliency and the complex scene adaptability of the fusion image can be remarkably improved, and a high-robustness fusion result is provided for low-illumination environment perception and multi-modal target recognition.

The invention relates to the technical field of computer programming languages, and particularly discloses a coal-fired power plant safety monitoring system and method. The system comprises a multi-modal data fusion platform, a federal learning agent network and a digital twinborn simulation engine. The edge computing node carries out unified acquisition and feature extraction on multi-source heterogeneous data through multi-protocol conversion, quantum noise suppression and a preprocessing chipset; the multi-modal data fusion platform realizes semantic mapping based on a knowledge graph, and fuses time-space correlation characteristics of data such as an infrared image and gas concentration by adopting a time-space encoder and a cross-modal attention mechanism. According to the method, the problems of early warning delay and high false alarm rate caused by low multi-source data decentralized processing efficiency and insufficient nonlinear correlation analysis in a traditional scheme are solved, efficient data fusion, complex risk accurate prediction and automatic safety response are realized, and the real-time performance and reliability of a coal-fired power plant monitoring system are remarkably improved.

The invention relates to a high-voltage equipment defect detection method based on deep learning and multispectral image fusion, and relates to the technical field of electric power high-voltage equipment state detection. The method comprises the following steps: acquiring an ultraviolet image, an infrared image and a visible light image of the surface of the high-voltage equipment; carrying out image pixel feature-based fusion processing on the ultraviolet image, the infrared image and the visible light image through an image fusion method; establishing a high-voltage equipment defect detection model, and training the high-voltage equipment defect detection model by using the fused image data to obtain a high-voltage equipment defect identification model based on the YOLO-STrans multispectral fusion network; and inputting the ultraviolet image, the infrared image and the visible light image of the outer surface of the power high-voltage equipment into a high-voltage equipment defect identification model to obtain a fault identification result of the to-be-detected power high-voltage equipment. The method can improve the recognition precision of the extremely early insulation degradation and temperature anomaly defects of the surface of the high-voltage power equipment.

The invention discloses an unmanned aerial vehicle electric power inspection image intelligent analysis method and system based on deep learning and multi-modal fusion and a medium thereof, and relates to the technical field of electric power equipment detection. The method comprises the following steps: planning an optimal inspection path by adopting an A * algorithm to realize multi-sensor synchronous data acquisition; adaptive histogram equalization and defogging processing are carried out on the visible light image, non-uniformity correction and temperature calibration are carried out on the infrared image, and filtering and registration are carried out on point cloud data; constructing a multi-scale feature fusion network based on improved VGGNet-16, and introducing deformable convolution and a cross-modal attention mechanism to realize multi-source data fusion; defect detection is carried out based on a three-level template library and a feature map cross-correlation algorithm, and the precision is improved in combination with non-maximum suppression and sub-pixel positioning; and finally generating a detection report containing defect types, positions and maintenance suggestions. According to the invention, the automation level and the detection precision of power inspection are obviously improved.

The invention belongs to the technical field of structure monitoring systems, and discloses a structure monitoring system and method for civil engineering, and the method comprises the steps that a data collection module collects structure data; the cruise monitoring mechanism collects a high-definition image, an infrared image and laser point cloud data; the environment data acquisition module acquires environment data; the image analysis module identifies abnormal conditions; the infrared data analysis module detects internal defects; the laser data analysis module accurately measures the deformation of the structure; the comprehensive analysis module performs comprehensive evaluation; the risk prediction module fuses multi-source data and predicts potential problems and risks; when an abnormal condition or a potential problem risk is monitored, the alarm module gives an alarm in time. According to the invention, through combination of sensor monitoring and unmanned aerial vehicle cruise monitoring, the structure of civil engineering is monitored in an omnibearing manner; the comprehensive analysis module is used for integrating the multi-source monitoring data to carry out comprehensive evaluation and abnormity judgment; and the risk prediction module fuses monitoring results of multiple modules and predicts potential problems and risks.

The invention discloses a multi-source information collaborative power equipment three-dimensional temperature field construction method. Firstly, an infrared camera, an IMU and a laser radar are utilized to obtain an accurate external parameter relation through joint calibration, point cloud distortion is eliminated, angular points and plane points are extracted, a re-projection residual error, a distance sampling residual error and an IMU pre-integration residual error are constructed, an error state iteration Kalman filter is adopted to optimize a global pose, and positioning is achieved. Providing a self-supervised depth completion network, combining an infrared temperature image and a sparse depth map generated by a laser radar as input, adopting a depth completion strategy guided by an infrared image, estimating relative motion of adjacent frames by using pose information, introducing a feature alignment module to reduce alignment errors, and combining the depth map, the infrared image and IMU data to obtain a self-supervised depth completion algorithm; and efficient construction of the three-dimensional temperature field of the power equipment is realized. According to the invention, the three-dimensional temperature field of the power equipment is constructed more accurately, and the capability of the substation inspection robot for state monitoring and fault diagnosis of the power equipment is improved.

The invention relates to a human shape posture recognition method and system based on image analysis, and the method comprises the steps: inputting the reference human shape data of a monitored object, and collecting the multi-modal data of an RGB image, an infrared image and inertial measurement data in a target scene in real time; space-time alignment processing is carried out, and corresponding features are fused; image space features are extracted, time sequence modeling is carried out on inertial data, and dynamic weighted fusion of two paths of network outputs is realized through a gating mechanism; human body basic joint points are positioned, and refined posture vectors including joint angles and limb relative positions are generated; according to attitude data and environment information collected in real time, adaptively adjusting an attitude classification threshold value and a similarity measurement standard, and predicting abnormal behaviors in a future time period; and when the abnormal behavior is predicted, triggering to execute a preset safety measure. Multi-modal data can be efficiently fused, attitude features can be accurately extracted, an identification strategy can be adaptively adjusted, and human shape attitude identification with behavior trend prediction capability can be realized.

The invention provides a photovoltaic module fault detection system, method and device based on infrared image hot spot detection, and a storage medium, and belongs to the field of photovoltaic module fault detection. The system comprises a temperature difference boundary extraction module, an image sequence registration module, a hot spot track identification module, an abnormal dynamic screening module and a fault hot spot confirmation module. Pixel difference screening is carried out by setting a temperature difference threshold value, a boundary communication structure is established, frame-level displacement calculation between time sequence images is introduced to realize coordinate alignment, hot spot center points in continuous frames are extracted to form a motion path, abnormal point screening and time node labeling are carried out in combination with path displacement characteristics, and the time sequence image is obtained. According to the method, the boundary area growth rate and temperature change double factors are fused to screen fault areas, dynamic tracking and accurate detection of abnormal hot spots are achieved, the logic relevance between abnormal behavior recognition and fault judgment is enhanced, and the integrity of photovoltaic module fault information extraction and the accuracy of hot spot recognition are guaranteed.

The invention provides a water area safety patrol method and system based on multi-modal feature analysis, and relates to the technical field of image recognition. The method comprises the steps of collecting a visible light image, an infrared image and laser radar data corresponding to a target water area, and performing time synchronization and space alignment to obtain visible light alignment data, infrared alignment data and laser radar alignment data; in response to the condition that the definition of the visible light image is higher than a quality reference value, carrying out edge detection and region segmentation processing on the visible light alignment data, and generating a candidate region set containing a target contour; for the infrared alignment data corresponding to the candidate region set, screening out a thermal anomaly region from the candidate region set; and carrying out three-dimensional space feature extraction and motion state feature extraction on the laser radar alignment data corresponding to the thermal anomaly region, and carrying out anomaly identification on the thermal anomaly region. According to the scheme, high-precision safety patrol of the target water area in various environments can be realized.

The invention discloses a space-time consistent multi-modal feature fusion-based aerial target detection method. The method comprises the steps of 1, obtaining a visible light and infrared image pair sequence of an aerial target; 2, constructing a space-time consistent air target detection network, wherein the space-time consistent air target detection network comprises a time domain enhanced backbone network, a space domain fusion module, a bidirectional feature pyramid and a Head module; 3, constructing a total loss function; and 4, training to obtain an optimal target detection network model, carrying out multi-scale detection on the space-time consistency characteristics, finally outputting the position and the category of the target, and returning a result with a detection frame. According to the invention, through space-time consistency modeling and cross-modal attention fusion, the detection precision and robustness of the aerial target in a complex scene are effectively improved, and meanwhile, a lightweight design is adopted to meet the real-time requirement, and the method is suitable for the fields of unmanned aerial vehicle supervision, low-altitude security and protection and the like.

The invention discloses a heterogeneous perceptual attention fusion network-based multi-modal image target detection method, which aims at the target detection problem in a complex scene, utilizes a double-backbone network to respectively perform multi-scale feature extraction on visible light and infrared images, generates a feature pyramid containing different levels of details and semantic information, and performs feature extraction on the visible light and infrared images. Through a heterogeneous perception enhancement module, a channel-space bidirectional attention mechanism is constructed, cross-modal heterogeneous enhancement is carried out on features of different levels, key region information is highlighted, by means of a refined channel attention fusion module, discriminative features are effectively amplified, modal specific noise is suppressed at the same time, and in a target detection link, an elliptical dynamic CIoU loss function is adopted, so that the target detection accuracy is improved. According to the method, the external connection ellipse or the inconnection ellipse is dynamically selected according to the proportion of the target to calculate the intersection-to-union ratio, geometric alignment of the anchor frame and the target is optimized, the detection precision and robustness of the multi-modal image target are effectively improved, and the method has wide application prospects in the fields of automatic driving, anomaly detection and the like.

The invention relates to the technical field of knowledge graph construction, and discloses a transformer substation knowledge graph construction and optimization method based on multi-view learning, which comprises the following steps of: processing transformer substation multi-source data through a heterogeneous model; multi-source heterogeneous data of operation and maintenance texts, monitoring data, regulations and rules and infrared images of substation equipment are mapped to a unified feature space through linear projection, a multi-mode positive and negative sample pair of the same equipment is constructed, the distance of related equipment features is shortened by adopting comparative learning, projection matrixes of various data are dynamically optimized, and the multi-mode heterogeneous data of the substation equipment is obtained. And jointly detecting the power transformation equipment entity boundary in the operation and maintenance text and the equipment monitoring data, fusing the multi-modal equipment characteristics through an attention mechanism, and reasoning the relationship type between the equipment. According to the method, the multi-source heterogeneous data of the transformer substation and expert experience are deeply fused, so that the fragmentation and staticization problems of a traditional knowledge management system are effectively solved, and the accuracy of state perception and fault diagnosis of the power equipment is remarkably improved.

The invention discloses a multi-modal target detection method based on feature enhancement and alignment fusion. The method mainly comprises the following steps: (1) extracting features of a visible light image and an infrared image by using a backbone network, and better guiding the backbone network to extract related features from two modes and enhance feature representation by using an FEM in multiple stages of extracting the image features by the backbone network; (2) performing global-to-local alignment on the feature maps of the two modalities after feature enhancement by using FAM (Frequency Administration and Maintenance); (3) utilizing FFM to fuse the aligned feature maps from the two modalities; (4) using SFFM to further fuse the deeper feature map after cross-modal fusion in the step (3); and (5) inputting the fused feature maps under different scales into a detection head to obtain a target detection result. The method is mainly applied to the technical field of target detection in computer vision, and has wide application prospects in the fields of video monitoring, automatic driving and the like.

The invention relates to an infrared and visible light image fusion method based on a cross-domain Transform, and belongs to the field of computer image processing. The method comprises the following steps: respectively carrying out preprocessing operation on an infrared image and a visible light image to obtain a training data set; an end-to-end image generator network is designed, an encoder module is used for extracting deep semantic features of an infrared image and a visible light image, a fusion module introduces an axial attention mechanism to enhance the global modeling capability of the features, and feature fusion is carried out in combination with information of a spatial domain and a frequency domain; the fused features are gradually recovered to an image space through a decoder module, and a fused image is generated; constructing a fusion loss function module, and guiding the network to focus a significant feature difference between the source image and the fusion image based on a comparative learning idea; and finally, inputting the infrared and visible light image Y channel into the network model, generating a fusion image, completing a training process, and realizing unified optimization of fusion performance and visual quality.

The invention discloses an infrared small target detection method fusing local prior and a multi-scale global background, and the method comprises the steps: firstly obtaining image data containing an infrared image and a mask label corresponding to the infrared image, and carrying out the preprocessing; secondly, a target detection model of an encoder-decoder architecture is constructed, an encoder comprises a local detail prior mining branch and a multi-scale global background perception branch which are parallel, step-by-step feature extraction is performed on the preprocessed image data, and a decoder comprises a progressive feature fusion decoding branch; and inputting the features of each level of the encoder double branches into decoder branches for decoding step by step to obtain a detection result. And finally, a weighted depth supervision mechanism is introduced in training, auxiliary prediction output is set in a plurality of decoding layers, and weighting loss is calculated. According to the method, the problems of insufficient local detail modeling, insufficient multi-scale global background perception of Mamba, difficulty in global and local feature fusion and the like in the existing method are solved, and the detection precision of the infrared small target is improved.

The invention discloses a power transmission image defect detection and defect duplicate removal method and system based on a deep learning image segmentation algorithm, and belongs to the technical field of intelligent inspection of power equipment. According to the method, real-time tower identification and adaptive shooting are realized through a lightweight YOLO model deployed at the edge end of an unmanned aerial vehicle; pixel-level segmentation is carried out on the infrared image by using an MSAN-Net network, the network integrates a ResNet encoder, a cross-scale attention mechanism and a multi-level feature pyramid, and boundary learning is enhanced by using a composite loss function; based on a multi-view three-dimensional reconstruction technology, two-dimensional defects are mapped into space rays through feature point matching and pose estimation, and defect de-weighting is achieved through ray intersection judgment. Through the MSAN-Net network, the segmentation precision of the infrared component under a complex background is remarkably improved through an attention mechanism and multi-scale feature fusion, and the problem of repeated defect detection in multi-view inspection is effectively solved in combination with a three-dimensional space mapping method.

The invention provides a pseudo-infrared generation and cross-modal fusion defogging method based on single-mode visible light, and belongs to the field of computer vision, and the method comprises the following steps: (1) inputting a single-mode visible light foggy image, firstly carrying out the normalization of the input image, carrying out the dynamic cutting of the normalized image, and enhancing the adaptability of a model to the local fog density; (2) taking the visible light foggy image as input, and generating a pseudo-infrared image by using a cross-modal generation network from visible light to pseudo-infrared; (3) taking the visible light foggy image and the generated pseudo-infrared image as input, and performing feature extraction and fusion in the visible light and infrared defogging fusion network; and (4) adopting an end-to-end joint training strategy. According to the method, the pseudo-infrared image is generated through single-mode visible light input, and the fog penetration characteristic of an infrared mode is effectively simulated under the condition of not depending on a real infrared sensor in combination with a cross-mode fusion mechanism.

The invention discloses a feature integration method for interactive convolution and dynamic focusing of infrared images. The feature integration method comprises the steps that infrared image pairs with different resolutions in various real scenes are obtained through an infrared camera; performing degradation preprocessing on a part of original high-resolution images to obtain low-quality high-resolution images to form a mixed low-resolution data set, and dividing the processed data set into a training set and a test set; constructing a double-layer feature extraction module for feature modeling; training a network by using the processed training set, and optimizing a loss function; and inputting a low-resolution infrared image into the trained network, and outputting a high-resolution reconstruction result. According to the method, local and global features are fused, so that the super-resolution reconstruction quality of the infrared image in complex scenes such as low contrast and fuzzy edges is remarkably improved, and meanwhile, relatively high calculation efficiency is kept.

The invention provides a method for multi-domain division and conquering of super-resolution of an infrared image of an unmanned aerial vehicle based on Mamba. The progressive optimization of the super-resolution result is realized by fusing the feature interpretation of the spatial domain and the frequency domain. The method comprises the following steps: firstly, capturing a long-range spatial dependency relationship through a vision-oriented state space module; then capturing the local feature and texture information of the image through the synergistic effect of a wavelet transform branch, a global branch and a local branch of a feature mapping module based on wavelet transform; finally, for challenges of modal difference and semantic alignment, complementary interaction and fusion of the features are achieved through a cross attention mechanism of a multi-domain attention fusion module, the characterization capacity of global and local features is enhanced, and therefore the robustness of the model is improved.

The invention discloses a visible light-infrared dual-mode image registration method based on deep learning. The method comprises the following steps: acquiring a visible light image and an infrared image in the same scene; preprocessing the image; performing feature extraction on the preprocessed visible light image and the preprocessed infrared image, and performing feature enhancement on a feature extraction result by using a double attention mechanism; performing multi-scale feature fusion on the enhanced visible light image features and the enhanced infrared image features to generate cross-modal fusion features; inputting the cross-modal fusion features into a deformation field estimation network to generate an estimation result of a deformation field; and applying the estimation result of the deformation field to the infrared image to register the corresponding visible light image. According to the method, the problem of cross-modal registration between the visible light image and the infrared thermal imaging of the live pig body temperature non-contact prediction scene is effectively solved, high-precision pixel-level alignment is realized, and a technical basis is provided for non-contact pig body temperature monitoring.

The invention discloses an on-bridge pedestrian abnormal behavior identification and early warning method based on intelligent monitoring, and relates to the technical field of bridge engineering, and the method comprises the steps: carrying out the registration of a current visible light image and a current infrared image, and obtaining a registration dual-mode image based on a current image coordinate system; considering current bridge deformation to establish a current coordinate mapping conversion model for mapping pixel coordinate points in the current image coordinate system to physical coordinate points of a current bridge physical space coordinate system; obtaining the current three-dimensional actual coordinates of the pedestrian; recognizing abnormal behaviors of the pedestrians on the bridge based on the current three-dimensional actual coordinates of the pedestrians and acquiring current dynamic risk score values of the pedestrians; and determining the current risk level of the pedestrian according to the current dynamic risk score value of the pedestrian and a preset risk threshold value to realize multi-level linkage protection response. The method provided by the invention solves the technical problem in the prior art that the current actual coordinate of the pedestrian is difficult to accurately obtain due to environmental interference, and the abnormal recognition of the pedestrian on the bridge is inaccurate.

The invention relates to the technical field of image detection, in particular to a visible light and infrared image combined photovoltaic defect detection method based on an unmanned aerial vehicle, which comprises the following steps of: determining a photovoltaic power station detection area, carrying out synchronous aerial photography by using a visible light camera carried by the unmanned aerial vehicle and an infrared thermal imager, and carrying out local division to extract texture and temperature characteristics; the screening area performs fitting affine parameter generation on an extraction center point, corrects an infrared image to extract contour lines and texture change features, and screens a defect area to extract a positioning coordinate set; according to the method, through synchronously screening generated visible light and infrared image pairs, the resolution of an abnormal region is enhanced, a complex background and an abnormal target are accurately separated, fine-grained adaptive registration is realized through central point extraction and affine parameter derivation, and defect region characteristics are verified bidirectionally through a temperature contour closing proportion and a texture density variable quantity; thermal features and texture features are fused in the defect screening process, the recognition capability of weak anomalies is enhanced, and the defect positioning accuracy is improved.

The invention discloses a concrete crack depth detection method and system based on multi-modal data fusion. The method comprises the following steps: synchronously obtaining a visible light image sequence and a thermal imaging image sequence of a concrete crack; the thermal imaging image sequence is obtained based on adjustable thermal excitation; and through a preset multi-modal data registration algorithm, according to the visible light image, predicting a registration displacement vector field to generate a pseudo-infrared image corresponding to the enhanced visible light image, and migrating a temperature field of the thermal imaging image at the same moment and under the same picture to the pseudo-infrared image to generate a fusion modal image, obtaining a fusion modal image sequence; and through a preset heat conduction inversion model and a temperature attenuation characteristic curve generated based on the fusion modal image sequence, obtaining crack depth data and generating a three-dimensional crack map so as to visually present concrete crack depth detection data. According to the invention, the universality and accuracy of concrete crack depth detection can be improved.

The invention provides a defect identification method and device for substation equipment and electronic equipment, and relates to the field of image identification. According to the method, an infrared image, an electric field leakage map and a visible light image are obtained through a multi-channel imaging system deployed in a substation site, and a multi-channel image tensor is generated and input into a multi-channel recognition model to extract fusion features. And fusing the features, inputting the fused features into a YOLOv8 backbone network, constructing a joint attention domain in combination with an equipment prior structure, generating a high-confidence candidate box, and performing non-maximum suppression to obtain a detection result. And constructing an inter-frame residual tensor for a detection result to perform time sequence modeling, thereby improving the detection effect. And for equipment with complex shielding, complementing a structure contour through an edge prediction path, and finally outputting target boundary and defect positioning information. By implementing the technical scheme provided by the invention, defect identification of the substation equipment is facilitated.

The invention discloses an intelligent detection method for fault detection of an outdoor power line, and the method comprises the following steps: 1, carrying out the collection and preprocessing of multi-modal data, and carrying out the collection and preprocessing of the multi-modal data through an unmanned plane cluster, a distributed optical fiber sensor, a laser radar and meteorological monitoring equipment; visible light image data, infrared image data, laser point cloud data, vibration waveforms, temperature distribution and environmental parameters of the power line are synchronously obtained, and multi-source image data are processed, namely the visible light image data, the infrared image data and the laser point cloud data are processed; and 2, intelligent fault diagnosis: inputting the data acquired in the step 1 into a multi-task neural network model, and outputting a fault positioning and type identification result. According to the novel detection method based on multi-modal data fusion, an intelligent algorithm and closed-loop optimization, the fault identification precision, the dynamic decision-making capability and the comprehensive protection efficiency are improved, and the intelligent operation and maintenance requirements of a modern power grid are met.

The invention discloses an AI-based prefabricated member multi-modal visual quality intelligent detection system and method, and the system comprises a multi-modal visual data collection unit which is used for obtaining the multi-modal visual data of a prefabricated member detection region, calibrating the multi-modal visual data, and constructing a multi-modal data set. And the feature fusion and candidate region extraction unit is used for inputting the multi-modal data set into a multi-modal feature fusion network to extract multi-modal features, fusing the multi-modal features and generating a defect candidate region. And the defect type identification and quantitative analysis unit is used for calling a deep learning detection and segmentation model to carry out defect type classification and defect boundary segmentation on the defect candidate region, and calculating a quantitative index of the defect region in the segmentation boundary by using the three-dimensional point cloud and the infrared image. And the defect grade judgment and component quality evaluation unit is used for carrying out dynamic threshold judgment on the defect area according to the defect type and the quantitative index of the defect area, and outputting the defect severity grade and the quality evaluation result of the prefabricated component.

The invention provides a sea surface target tracking method and system based on infrared and visible light image fusion, and relates to the technical field of ocean monitoring, and the method comprises the steps: collecting visible light and infrared image data of a sea surface target; performing feature extraction and fusion through wavelet transform fusion to generate a comprehensive feature map, and performing target recognition on the comprehensive feature map by using a deep learning target detection model; after target recognition, the system calculates the position of a target based on image data and radar data, performs multi-target matching and association through a Hungary algorithm combined with multi-modal features, predicts the position of the target and updates trajectory information in combination with a Kalman filtering or particle filtering algorithm. The infrared camera and the visible light camera carry out dynamic angle adjustment according to the position and the movement track of the target; whether light information correction is carried out or not is judged based on the light correction threshold value, when light information correction is carried out, light information correction features are constructed based on the visible light compensation model and the infrared compensation model through the image data, and information errors caused by the illumination angle are eliminated.

The invention provides a photovoltaic power station energy efficiency evaluation method. A data acquisition layer module, a dynamic energy efficiency model module, an energy efficiency evaluation module and a fault positioning module are included. Wherein the dynamic energy efficiency model module establishes a theoretical power generation model based on an AI prediction technology, and the model dynamically updates model parameters according to real-time environment parameters and equipment states; the energy efficiency evaluation module calculates the actual energy efficiency according to the theoretical generating capacity predicted by the dynamic energy efficiency model and the actually collected inverter output power data, and performs energy efficiency loss grading; the fault positioning module discriminates an abnormal group string through a group string current dispersion rate and determines a hot spot position by means of an infrared image, relates to the technical field of photovoltaic power generation, and achieves precise and real-time power station energy efficiency management through fusion of dynamic environment correction, equipment health degree diagnosis and energy efficiency loss classification, thereby improving the efficiency of power station energy efficiency management. The problems that the evaluation deviation is large and the accuracy is reduced along with time in the existing evaluation technology are effectively solved.

The invention discloses a machine tool thermal error prediction method based on multi-modal deep learning and domain adaptation, and the method comprises the steps: constructing an infrared image feature extraction module, and extracting the low-dimensional thermal features of infrared image data; constructing a spatio-temporal feature extraction module, and extracting spatio-temporal features in the current and power data; constructing a multi-modal feature fusion module, and fusing the low-dimensional thermal features and the spatial-temporal features to obtain fused features; a thermal error predictor is constructed, thermal error prediction is carried out according to the fusion features, and prediction loss is calculated; machine tool operation data under different working conditions are collected as a source domain and a target domain; through processing of the steps, fusion features of the source domain and the target domain and prediction loss of the source domain are obtained. Inputting the fusion features of the source domain and the target domain into a deep transfer learning module, calculating domain alignment loss, constructing a total loss function in combination with the prediction loss of the source domain, and performing joint optimization on the model; and predicting the thermal error of the target domain after optimization is completed. According to the invention, the prediction accuracy can be improved.

The invention relates to the technical field of image processing, in particular to a low-light and infrared image fused night vision imaging method and system. According to the method, multi-source data collaboration is realized by constructing a dual-band polarization feature cube, a degradation rule of fog scattering on low-light texture is accurately quantified, and a scattering invariance enhanced image is generated; based on fog concentration gradient dynamic partitioning, low-light details and infrared contours are fused in a low-concentration area, polarization state penetrating dense fog is recombined in a high-concentration area, finally, a night vision image with high definition, high scattering resistance and scene adaptability is output, and the identification capacity and monitoring reliability of fog night road targets are improved.