4432 results about "Information fusion" patented technology

The invention discloses a distribution line fault intelligent diagnosis method based on multi-source information fusion, and belongs to the technical field of power system fault detection and diagnosis, and the method comprises the steps: obtaining distribution line data and meteorological data; superposing the distribution line data with the meteorological data to generate a space-time fusion feature matrix based on the wire space displacement; dynamically adjusting a preset initial threshold value by using the space-time fusion feature matrix; and performing multi-round verification on the abnormal fluctuation of the electrical parameters of the line according to the fault judgment threshold, generating a fault positioning instruction, performing real-time matching with the topological structure of the line, correcting the priority queue of the fault section based on the switching action feedback data of the feeder terminal, and triggering the fault removal action matched with the priority. According to the method, spatial-temporal feature fusion of current, voltage, weather and spatial displacement data and a dynamic threshold adjustment mechanism are adopted, the fault type can be accurately identified, the fault section can be positioned in real time, and the diagnosis precision and the response speed in a complex environment are remarkably improved.

The invention discloses a cross-modal information fusion and retrieval method and system driven by semantic comprehension, and the method comprises the steps: obtaining text, image and audio original data, and extracting an initial feature set of each modal through a deep neural network; dynamically distributing each modal weight coefficient based on an attention mechanism, and performing weighted fusion on the initial feature set to obtain cross-modal fusion feature representation; through a cross-modal semantic association analysis model, high-dimensional semantic association features are extracted from the fusion feature representation, and semantic enhancement feature vectors are generated; constructing a cross-modal semantic graph network based on the vector, complementing missing modal features, and generating an optimized multi-modal feature set; and inputting the optimized feature set and the query sample into a contrast learning model, calculating a semantic similarity score, and generating a cross-modal retrieval result sorting list according to the score.

The invention provides an unmanned aerial vehicle multi-dimensional information fusion method and system based on acousto-optic-electric composite detection. According to the method, acoustic frequency band signals, visible light image sequences and electromagnetic field intensity change data are collected, acoustic characteristic flow, optical characteristic flow and electrical characteristic flow are generated, and based on the time deviation between a low-frequency vibration mode and transient electromagnetic pulses, multi-channel dynamic calibration is carried out on an image distortion area in the optical characteristic flow. The method comprises the following steps: acquiring an acoustic feature flow, an optical feature flow and an electrical feature flow, correcting space-time coordinate parameters of the acoustic feature flow, the optical feature flow and the electrical feature flow, generating a calibration feature flow, carrying out anti-interference fusion processing on the calibration feature flow, extracting multi-dimensional coupling features, inputting the multi-dimensional coupling features into an unmanned aerial vehicle flight path planning model, and generating a three-dimensional space situation model; according to the invention, the physical space-time consistency alignment and noise suppression of the multi-modal data are realized, and the obstacle positioning precision and the dynamic trajectory prediction real-time performance are significantly improved.

The invention discloses a remote sensing image building extraction method fusing double-space attention features, and belongs to the technical field of image processing. The method comprises the following steps: firstly, inputting a training set of an Inria aviation data set into a ConvNeXt backbone network to extract shallow feature information; then, carrying out feature information enhancement processing on the feature information through a double-space attention feature fusion module (DAFF); and finally, a multi-modal dynamic enhancement module (FAM) is used in the last time of feature information up-sampling operation to carry out channel alignment operation of different levels of features, and feature information fusion errors are reduced. According to the method, the accuracy of building extraction in the remote sensing image is remarkably improved.

The invention relates to the technical field of industrial automatic monitoring, in particular to a weftless tape machine intelligent monitoring system and method based on real-time data acquisition. The system comprises a data acquisition module used for acquiring real-time data of a multi-heterogeneous sensor; the data processing module is used for preprocessing the real-time data; the intelligent analysis module covers a feature extraction unit, an anomaly detection unit, a fault diagnosis unit, a service life prediction unit and a data fusion unit and can extract data features, detect anomaly, diagnose faults, predict the service life of a part and fuse multi-unit output to make a decision; and the early warning response module triggers corresponding levels of alarms according to the analysis result and generates a diagnosis report. According to the invention, comprehensive real-time monitoring, early fault early warning, accurate fault diagnosis, residual life prediction, multi-source information fusion and the like of the operation state of the weftless tape machine are realized, the production efficiency and the product quality are effectively improved, and intelligent management of production of the weftless tape machine is assisted.

The invention relates to the technical field of data center intelligent management, in particular to a data center construction and intelligent operation and maintenance management system, which comprises a dynamic environment sensing module, a heterogeneous equipment protocol adaptation module, a multi-dimensional resource dynamic scheduling module, a hidden fault prediction module and an energy efficiency optimization execution module. Physical environment data such as temperature gradient, current harmonic component and optical fiber strain rate are acquired by deploying a multi-mode sensor, and an environment characteristic matrix is constructed; standard semantic mapping of the heterogeneous protocol is realized by using a semantic slot migration algorithm; establishing a resource topological graph based on the hypergraph neural network and dynamically updating the resource topological graph; a dual-channel space-time convolutional network is adopted to realize fault prediction; and combining the fault probability matrix to generate a dynamic tuning strategy of dimensions such as cooling, electric power, network and the like, and forming closed-loop optimization control. According to the invention, integrated collaboration of multi-source information fusion, equipment intelligent control and energy efficiency adaptive optimization is realized, and the intelligence, reliability and energy efficiency level of data center operation and maintenance are improved.

The embodiment of the invention provides an unmanned aerial vehicle data anomaly detection method based on multi-modal time sequence modeling, and the method comprises the steps: carrying out the multi-stage data preprocessing of original data obtained in the working process of an unmanned aerial vehicle, and generating a standardized input data flow; extracting time sequence features of the standardized input data stream through continuous LSTM blocks in the multi-level feature extraction network, and generating a shallow time sequence feature set; performing depth time sequence modeling on the shallow time sequence feature set to generate a deep time sequence feature set; performing multi-stage information fusion and mask screening on the shallow time sequence feature set and the deep time sequence feature set to generate a fusion time-space correlation feature set; and generating an attitude parameter prediction result of the unmanned aerial vehicle according to the fusion time-space correlation feature set, and obtaining an anomaly detection decision result of the unmanned aerial vehicle by using a deviation comparison and multi-level anomaly judgment mechanism based on an adaptive threshold obtained based on the attitude parameter prediction result and prediction error statistical distribution. Therefore, the anomaly detection accuracy of the unmanned aerial vehicle data is improved.

The invention discloses an end-to-end monocular visual odometer method fusing space-time semantic information. According to the method, continuous image sequence frames are collected through a color monocular camera, and a multi-information fusion end-to-end deep learning framework is constructed; a heterogeneous training domain is adopted to set various data set course sharing parameter fusion training, continuous image sequences are input, and the end-to-end deep learning framework is dynamically coupled with hidden state feature vectors output historically, so that a feature mapping relation of time sequence perception is formed; and interpretable feature decoupling of the static background elements and the dynamic entity objects in the scene is realized. After iterative feature fusion, the system outputs sparse depth and camera motion poses which conform to scene geometric constraints, so that a camera trajectory estimation model with high robustness and strong generalization ability in a complex environment is constructed. According to the method, the positioning precision and stability of the monocular vision odometer are remarkably improved.

The invention relates to the technical field of intelligent vending, solves the problem that in the prior art, commodity identification cannot be accurately carried out in a multi-target scene, and provides a multi-target commodity identification method, device and system based on multi-modal data processing. The method comprises the following steps: acquiring multiple frames of real-time images in a commodity transaction scene; performing preprocessing and label information extraction on the real-time image, and determining character information corresponding to the target image and the commodity label; performing instance segmentation on the target image, and determining commodity position information; performing feature extraction on the target image, and determining commodity image feature information; according to pre-collected multi-source privatized data in an intelligent vending scene, performing fine adjustment and optimization processing on the open-source multi-modal visual language model to obtain a multi-modal large model; and inputting the commodity image feature information and the text information into the multi-modal large model for information fusion, and determining a commodity target identification result. According to the invention, commodity identification can be accurately carried out in a multi-target scene.

The invention belongs to the technical field of bearing residual service life detection, and discloses a rolling bearing residual service life prediction method and system based on a convolution white box. According to the method, time domain and frequency domain feature extraction, noise reduction processing and health state and degradation state division are carried out on an original vibration signal, and deep neural network training is carried out in combination with a Weibull-MSE loss function, so that prediction of RUL conforms to the actual degradation process of a bearing; and synchronous extraction of long-time dependence information and local degradation characteristics of the bearing signal is completed through a convolution CRATE network architecture fusing an expansion causal convolution attention mechanism DCA and a multi-scale convolution MSC. According to the method, the accuracy of RUL prediction is improved in combination with health state evaluation, the local feature extraction capability is enhanced, the local modeling capability of the model is improved through multi-scale information fusion, and the interpretability and the prediction credibility are improved through a CRATE structure.

The invention provides a network security protection method and system based on information fusion, and the method comprises the steps: firstly obtaining a multi-source heterogeneous data set, which comprises a traffic interaction data unit, an equipment log data unit and a protocol analysis data unit, of a target network, then carrying out the time sequence correlation analysis of the traffic interaction data unit, and generating a traffic behavior feature set; and executing state mode analysis on the equipment log data unit to generate an equipment operation feature set, and executing semantic recognition on the protocol analysis data unit to generate a protocol analysis feature set. Then, on the basis of a multi-dimensional feature fusion rule, cross-dimensional feature fusion processing is carried out on the feature set, and a network situation feature set is generated; and calling a threat identification model to carry out threat identification on the set, generating a threat identification result set containing threat type identifiers and influence range parameters, and finally generating a security response strategy set according to the threat identification result and issuing the security response strategy set to a security control node to execute protection operation, thereby effectively improving the network security protection capability.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a decision-making method, device, equipment and medium based on multi-modal semantic alignment. Executing cross-modal alignment by taking the voice semantic map as a reference to generate associated information, fusing the voice features, the visual features, the action features and the associated information to generate a fusion feature vector, inputting a decision network to generate a decision feature vector and generate a task execution instruction, obtaining execution feedback information of the task execution instruction, and updating the decision network. According to the method, input is dominated by voice instructions, visual features, action features and semantic map depth alignment and fusion are combined, input naturalness and multi-modal data analysis and decision-making efficiency are improved, and interaction adaptability and decision-making accuracy of the model in a complex scene are improved.

The invention provides a multi-source information fusion data spatial analysis method and system based on a knowledge graph, and relates to the technical field of data analysis, and the method comprises the steps: carrying out the quality calibration and fusion of multi-source heterogeneous data, and obtaining standardized fusion data; a city system knowledge graph is constructed, the city system knowledge graph comprises city element nodes with category and hierarchical relations and association strength of the city element nodes, and city function communities are constructed and optimized through a modularity optimization method; an urban element diffusion wave equation model is constructed based on an urban system knowledge graph, an urban element state propagation rule is analyzed, urban function division is performed, an urban system coupling differential equation set model is established to predict urban element state change, an urban system vulnerability index is constructed, and urban system toughness analysis is performed. According to the method, multi-source city data can be effectively fused, the city system knowledge graph is constructed, and decision support is provided for city space planning and management.

The invention provides an underwater vehicle multi-source information fusion accurate navigation method and system. The method comprises the following steps: firstly, acquiring inertial navigation data, DVL data and ocean current information of an underwater vehicle and observation information of a distance between the underwater vehicle and a beacon, and preprocessing the inertial navigation data, the DVL data and the ocean current information; then, establishing a state model according to the kinematics principle of the underwater vehicle, and establishing an observation model by combining various types of information; carrying out fusion processing on the state model and the observation model by adopting a self-adaptive Kalman filtering algorithm; and finally, estimating the current position of the underwater vehicle according to the fused state vector, comparing the current position with a preset target position to calculate a deviation, and correcting the deviation by adjusting a rudder angle and the rotating speed of a propeller. According to the method, multi-source information is integrated, innovation is carried out on construction of a state model and an observation model and position estimation and deviation correction, adaptive Kalman filtering is adopted, and the method has the advantages that the navigation precision is improved, the ocean current influence is considered, adaptive adjustment is realized, and real-time navigation is realized.

The invention relates to the technical field of image processing, and discloses an industrial part alignment method and system based on visual analysis and a storage medium. The method comprises the steps that a three-view camera collects an industrial part image, and preprocessing is carried out through gradient magnitude local contrast enhancement to obtain an enhanced image; performing hierarchical feature extraction to identify edge contours and key control points to form a multi-dimensional feature set; and establishing a dynamic reference coordinate system based on the feature set to obtain a part space attitude matrix. And the attitude deviation is compensated through Z-axis offset and rotation coupling error analysis. Posture adjustment is decomposed into a plurality of sub-stages, an alignment track is optimized by adopting a variable speed planning strategy, and accurate alignment of the parts is achieved. The problems that multi-view visual information fusion is insufficient, a special recognition algorithm for geometrical characteristics of the industrial parts is lacked, and Z-axis offset and rotation coupling error compensation is inaccurate in the posture adjustment process are solved, and the precision and stability of alignment of the industrial parts are improved.

The invention relates to the technical field of unmanned aerial vehicle positioning, in particular to an unmanned aerial vehicle flight path positioning method and system based on multi-source information fusion. The method comprises the following steps: acquiring an original observation data stream of an unmanned aerial vehicle in real time through a sensor array, and preprocessing to output a multi-source data sample set; calculating relative motion increment between adjacent key frames through an IMU pre-integration model, and extracting local pose estimation through a visual geometric calculation method; evaluating the confidence of each sensor in real time to dynamically generate an adaptive weight coefficient; and constructing a tight coupling fusion filter taking position, speed and attitude errors as core state quantities, and outputting a global optimal trajectory of the unmanned aerial vehicle. According to the invention, the weight is dynamically distributed through the real-time confidence of the sensor, the multi-source data association is fully mined, and the flight path positioning precision and environmental adaptability of the unmanned aerial vehicle are improved.

The invention relates to the field of image processing, and discloses an intelligent drawing checking method and system based on a multi-modal large language model, and the method comprises the steps: obtaining a to-be-checked target engineering design drawing and a to-be-checked task description; generating a global overview drawing based on the target engineering design drawing; performing global semantic analysis according to the global overview map and the review task description through a multi-modal large language model, and generating a global semantic analysis result and to-be-reviewed local area proposal information; cutting a local image from the design drawing; performing element identification analysis on the local image through a multi-modal large language model to obtain local structured information; and performing information fusion processing on the local structured information and the global semantic analysis result, generating complete drawing information, performing compliance verification and defect positioning on the complete drawing information and the structured specification knowledge base, and generating a review report. According to the method, intelligent review of the power grid engineering design drawing can be realized, the review efficiency and accuracy are improved, and meanwhile, the resource consumption is reduced.

The invention belongs to the technical field of emergency management, and discloses a natural disaster emergency rescue system based on multi-source sensing information fusion. The system is composed of a multi-source sensing data acquisition module, a data preprocessing and space-time registration module, a cross-modal feature extraction module, a multi-modal information fusion and conflict resolution module, a disaster type identification and grade discrimination module, a disaster influence range prediction and diffusion modeling module, and a dynamic emergency path planning and response plan generation module. A rescue scheduling and command control module; and an emergency feedback and closed loop dynamic correction module. Through multi-source sensing data fusion, cross-modal feature extraction and deep information fusion technologies, a full-space-time and full-process natural disaster emergency rescue system is constructed, comprehensive sensing, accurate recognition and dynamic plan generation of a disaster site are realized, the rescue response speed and decision scientificity are remarkably improved, and the intelligent level of emergency rescue is comprehensively improved.

The invention relates to the technical field of data processing and information fusion, and provides a multi-source heterogeneous data fusion method and system, and the method comprises the steps: carrying out the multi-dimensional quality evaluation of at least three heterogeneous data sources; on the basis of a quality evaluation result, feature decoupling and cross-modal correlation analysis of the heterogeneous data source are executed, and an intermediate feature set with a space-time alignment characteristic is generated; constructing a nonlinear dynamic weight distribution model, and calculating a multi-dimensional credibility weight of each data source; performing fusion calculation on the intermediate feature set through a three-level joint optimization architecture; and dynamically correcting the fusion result by adopting a feedback type self-adaptive calibration mechanism, and outputting an optimized fusion data cube. According to the invention, the accuracy, consistency and reliability of fused data can be improved.

The invention relates to the technical field of rock mechanics, and discloses a rock three-dimensional reconstruction method and system based on multi-source information fusion, and the method comprises the steps: obtaining and preprocessing data, carrying out the spatial feature learning of a fusion feature vector through a 3D-CNN network, and constructing a three-dimensional voxel model of rock microscopic damage; converting the fused image data into a point cloud model of the underground cavern surrounding rock structure by adopting a three-dimensional reconstruction algorithm based on point cloud, and constructing a digital twin framework of the underground cavern surrounding rock structure based on an implicit surface reconstruction algorithm; feature parameters output by the three-dimensional voxel model and the digital twinning framework are used as input, and the optimal supporting opportunity and supporting parameters are output through an LSTM-CNN fusion model; in the underground engineering construction process, surrounding rock deformation data are collected in real time, and a supporting scheme is adjusted in real time through a depth deterministic strategy gradient algorithm; according to the method, the scientificity and timeliness of support design under complex geological conditions can be improved.

The invention discloses a multi-modal fusion rumor detection method and system based on a dynamic graph convolutional neural network. According to the method, a dynamic feature graph of a language propagation path is constructed, and potential features in the language propagation process are extracted and analyzed by utilizing time sequence changes and key node relations between nodes in a propagation graph. A neural network is adopted to extract and enhance image data, text semantic features are extracted in combination with a text feature modeling network, text feature vectorization expression is achieved based on a BERT model, and rich semantic information is obtained. And a gating mechanism is introduced to dynamically adjust fusion weights of different modal features, and an information fusion strategy is optimized. A collaborative attention mechanism is further adopted for deep fusion, interactive learning of text, image and propagation path features is enhanced, and the relevance of cross-modal and time series data is improved. And finally, inputting the fused feature vectors into a classifier for accurate classification, thereby realizing accurate detection of the social media rumors. According to the method, the multi-modal features are effectively integrated, and the false information identification efficiency is remarkably improved.

The invention provides an intelligent drilling speed prediction method based on physical feature guidance and multi-source information fusion, and relates to the technical field of intelligent drilling speed prediction, and the method specifically comprises the following steps: collecting multi-source heterogeneous data from a drilling real-time database, a logging system, a logging system and a geological database; constructing a dual-channel deep learning prediction model, wherein the dual-channel deep learning prediction model comprises a dual-channel convolution feature extraction module, a feature fusion module, a time sequence fusion module, a time sequence modeling module and a full connection layer which are connected in sequence; obtaining a predicted drilling speed by using a dual-channel deep learning prediction model; a joint loss function is constructed by considering a data driving error and a physical constraint error, an error is calculated according to the joint loss function, and network parameters are updated through back propagation; carrying out loop iteration training until convergence; and the trained dual-channel deep learning prediction model is used for drilling speed prediction. According to the technical scheme, the problems that in the prior art, a mechanism model is insufficient in precision, and a data driving model is poor in reliability are solved.

The invention discloses a partial discharge signal identification method and system based on deep learning and a storage medium, and relates to the field of computer systems based on a specific calculation model, and the method comprises the steps: dividing multi-source monitoring data into a high-frequency signal group and a low-frequency signal group; respectively inputting corresponding feature information to the first deep neural network and the second deep neural network to obtain a high-frequency feature vector and a low-frequency feature vector; generating a signal attenuation compensation factor based on the low-frequency feature vector, and performing distortion compensation on the high-frequency feature vector to obtain a high-frequency correction vector; calculating the feature correlation degree of the high-frequency correction vector and the low-frequency feature vector, and when the feature correlation degree is lower than a preset correlation threshold value, extracting transient feature information of the high-frequency correction vector, and fusing the low-frequency feature vector to obtain a low-frequency correction vector; and inputting the high-frequency correction vector and the low-frequency correction vector to a partial discharge identification model to obtain a partial discharge type and identification confidence. According to the invention, the identification accuracy of the partial discharge signal can be improved.

The invention discloses a coal rock fracture intelligent extraction method based on improved U-Net. The method comprises the following steps: S1, constructing a coal rock fracture CT image data set; s2, constructing an improved U-Net segmentation model, specifically comprising the following steps: S2.1, taking VGG16 as a backbone network, and introducing a depth separable convolution module; s2.2, a PPA attention module is added after each layer of depth separable convolution of the decoder, the PPA attention module is introduced after each up-sampling stage of the decoder, and the output of the PPA attention module is subjected to batch normalization and Dropout layer processing; s2.3, defining a composite loss function; s3, training and optimizing a segmentation model, wherein the specific steps comprise: S3.1, setting hyper-parameters; and S3.2, training the model by using the training set, adjusting hyper-parameters by using the verification set, and evaluating the performance by using the test set, wherein the evaluation indexes comprise MIoU, MAcc and FWIoU. According to the method, the problems of difficult identification of small fractures, large model calculation amount, poor multi-scale information fusion and class imbalance in the coal rock fracture image can be solved, and the robustness, segmentation precision and practicability of the model are improved.

The invention belongs to the technical field of microwave measurement, and discloses an outer wall hollowing microwave reflection detection method based on multi-modal fusion, which comprises the following steps: carrying out multi-modal scanning on a building outer wall to be detected, obtaining visible light image data and infrared temperature distribution data of the outer wall surface, and carrying out space registration and coordinate mapping; a unified multi-modal fusion data set is formed; performing anomaly screening on the multi-modal fusion data set, and identifying a thermal anomaly region by analyzing infrared temperature distribution data; detecting a bump or crack area in combination with texture and morphology anomaly features of the visible light image data; performing information fusion on the thermal anomaly region and the bump or crack region, and extracting candidate detection regions of suspected hollowing; high-precision recognition and quantitative evaluation of the outer wall hollowing are achieved, and the precision and stability of outer wall hollowing detection are improved.

The invention relates to the technical field of vehicle monitoring, in particular to a multi-dimensional information fusion vehicle monitoring and abnormal behavior early warning method, which comprises the following steps: acquiring real-time vehicle operation data, environment perception data and driver behavior data; performing time-space synchronization and feature fusion on the vehicle operation data, the environment perception data and the driver behavior data to generate a multi-dimensional fusion feature vector; inputting the multi-dimensional fusion feature vector into a preset abnormal behavior detection model, and outputting an abnormal probability value of the current driving scene; and if the abnormal probability value exceeds a preset threshold value, generating a graded early warning signal and carrying out early warning prompt through a vehicle-mounted interaction interface and a cloud platform. The problems that an existing vehicle monitoring and abnormal behavior early warning method is single in data source, low in monitoring accuracy and incapable of achieving real-time monitoring are solved.

According to the multi-modal automatic knowledge graph construction method based on the large language model, a multi-modal data stream is preprocessed, features are extracted, and the multi-modal data stream is mapped to a unified semantic space through a cross-modal alignment network after being processed through the large language model, a visual converter and a time sequence neural network. In the space, entities and categories are recognized based on a large language model, a triple is generated by combining a multi-modal feature judgment entity relationship, mapping fusion is performed through an ontology alignment algorithm driven by a graph neural network and a predefined domain ontology, finally knowledge is stored in a graph database, and dynamic updating is performed by means of incremental learning and online reasoning. Standardized APIs and visualization components are provided. According to the method, the construction efficiency and the automation degree of the knowledge graph are remarkably improved, the cross-modal information fusion and knowledge maintenance capability is enhanced, and the application requirements of intelligent retrieval, recommendation, decision support and the like are met.

The invention belongs to the field of multi-modal data processing, and provides a multi-modal mixed expert psychological health assessment system, method, medium and equipment in order to solve the problem of low feature fusion efficiency caused by insufficient dynamic interaction between modals of an existing mixed expert model in a multi-modal scene. The multi-modal mixed expert psychological health assessment system comprises a multi-modal data acquisition module, and an adaptive grouping module. The cross attention fusion module is used for extracting features of corresponding modal data in the basic group and the auxiliary group, performing intra-group cross attention fusion on the features of each group, and generating intra-group features; performing global information fusion on all the intra-group features through a cross-group cross attention mechanism to obtain cross-group features; and after the cross-group features, the intra-group features and the original features of the multi-modal data are spliced, a dynamic gating weight is obtained through a gating network. The method can provide more accurate guidance for psychologists.

The invention discloses a multi-source information fusion equipment health diagnosis management system, and relates to the technical field of equipment management. Comprising an information acquisition module, a feature perception module, a processing fusion module, an equipment modeling module, an evolution prediction module, a root cause diagnosis module, a cross-domain inspection module, a learning sharing module, a state evaluation module, a collaborative decision-making module, a chain account book module and a visual decision-making module. According to the method, the perspectiveness and the sensitivity of anomaly detection are remarkably improved, noise interference and sampling deviation are reduced, fused data are more stable and have higher physical consistency, differential diagnosis and individual-level prediction are supported, the interpretability of diagnosis and the decision reliability are improved, false alarm and missing alarm are avoided, the early warning reliability is improved, and the method is suitable for popularization and application. And scientific, transparent and traceable health management is realized.

The invention discloses a computer vision structure deformation monitoring system combined with laser scanning. The system comprises a laser scanning module, a computer vision module, an image processing module, a data fusion module, a data analysis and processing module, a communication module and a power supply module. The laser scanning module adopts a pulse type laser scanner to scan the surface of the rock-soil structure; the computer vision module adopts a wide-angle lens to obtain a two-dimensional image sequence of the rock-soil structure; the image processing module processes the two-dimensional image sequence to obtain two-dimensional displacement information of the feature points; the data fusion module fuses the point cloud data and the image feature point displacement information; and the data analysis and processing module analyzes the fused model, models historical deformation data, and predicts a future deformation trend. The system has the advantages of high precision, real-time performance, intelligence and strong anti-interference capability, can effectively guarantee the safe and stable operation of the power tunnel, and is of great significance to the construction, operation and maintenance of geotechnical engineering of the power tunnel.