Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

14043 results about "Feature fusion" patented technology

Feature fusion is the process of combining two feature vectors to obtain a single feature vector, which is more discriminative than any of the input feature vectors.

Interpretable deep feature fusion network-based industrial intelligent predictive maintenance method

PCT designated stageWO2026021130A1Biological modelsEngineeringPredictive maintenance
The present invention relates to the field of industrial intelligent predictive maintenance, and in particular to an interpretable deep feature fusion network-based industrial intelligent predictive maintenance method, comprising: acquiring gearbox vibration data comprising noise; performing preliminary extraction and noise suppression on features of the acquired data by establishing an interpretable feature extraction module having a physical information constraint; integrating multi-scale features comprising long-distance and local dependencies by means of a dual-branch feature fusion module having global and local feature fusion capabilities; performing dimensionality reduction on a high-dimensional feature and generating an output by means of a classifier to obtain a final fault identification result; and performing interpretability analysis on a diagnosis process of a model. In the present invention, by embedding the signal processing technology having a well-defined physical theory support into a deep neural network, the interpretability and reliability of model inference results are effectively improved while the fault identification accuracy of the model is improved.
Owner:INST OF IND INTERNET CHONGQING UNIV OF POSTS & TELECOMM

Intelligent analysis method based on medical document structure perception and multi-modal fusion

An intelligent analysis method based on medical document structure perception and multi-modal fusion comprises the following steps: carrying out structure topology modeling on a medical document, extracting visual layout, text meta-information, space coordinates and semantic keyword features, constructing a semantic topological graph and dynamically shielding irrelevant contents; selecting an extraction path according to a document type, performing deep semantic analysis and entity recognition on a text-type document, and performing visual enhancement OCR recognition on a scanning-type document; the features are injected into a medical knowledge graph, and feature fusion, semantic verification, relation reasoning and information completion are achieved through a graph neural network; a three-stage strategy optimization model of basic pre-training, domain adaptation and online reinforcement learning is adopted; and large-scale processing is realized through a dynamically aggregated distributed architecture. The method is used for intelligent analysis and structured conversion of documents of hospitals, medical insurance and medical scientific research. The problems that heterogeneous medical document analysis adaptability is poor, multi-modal fusion is difficult, medical knowledge utilization is insufficient, and large-scale processing efficiency is low are solved.
Owner:NORTHWEST UNIV

Road and bridge crack detection method and system

The invention provides a road bridge crack detection method and system, and the method comprises the steps: collecting a bridge surface multi-view image, and constructing a training data set containing crack feature labeling through quality screening and standardized labeling; preprocessing the image by using a multi-scale feature fused deep convolutional neural network and carrying out semantic segmentation, initially identifying a suspected crack region and generating a segmentation mask; and constructing a BeNNS proxy model based on the mask, and establishing a mapping relationship between the detection result and the bridge structure topology, the stress flow field and the service function chain so as to evaluate the result reliability. And inputting an evaluation result into a hybrid evaluation mechanism, performing online real-time detection and offline batch verification to optimize precision, and outputting a verified crack region. Finally, morphological analysis is conducted on the area, geometric parameters and danger levels of cracks are extracted and integrated to a bridge health monitoring system, a crack evolution tracking algorithm and an early warning mechanism are established, and dynamic tracking early warning is achieved. The problem of low detection precision in a complex environment can be solved.
Owner:SICHUAN YUANHAO LUDA ENGINEERING CONSTRUCTION CO LTD

Uncoupling robot control system and method based on multi-source visual fusion

The embodiment of the invention provides an unhooking robot control method based on multi-source visual fusion, which is applied to the technical field of robot control and comprises the following steps: acquiring an RGB image, a depth image, an infrared image and IMU data through a multi-source sensing system mounted at the tail end of a robot; carrying out feature fusion identification by adopting a double-branch neural network, and outputting the boundary contour of the lifting hook and the three-dimensional coordinates of the optimal grabbing point; the visual coordinates are unified to a robot base coordinate system through a registration correction mechanism; a Transform prediction model is constructed based on the visual and inertial signals, and future pose changes of the lifting hook are estimated; a feedforward control track is generated to counteract swing of the lifting hook, and track correction is carried out in combination with visual servo feedback; and a joint instruction is generated through path planning and inverse kinematics solution, and the mechanical arm is driven to complete precise unhooking operation. According to the method, the recognition precision, the anti-interference capability and the operation success rate of unhooking operation in complex illumination and dynamic environments are effectively improved.
Owner:ANHUI HUADIAN SUZHOU POWER GENERATION

Multi-modal fusion tunnel structure apparent disease identification and risk assessment system

PendingCN121256709AData synchronizationDisease
The invention relates to the technical field of civil engineering tunnel structure safety monitoring and intelligent detection, in particular to a multi-modal fusion tunnel structure apparent disease identification and risk assessment system, which comprises an image acquisition module used for acquiring continuous images of the inner wall of a tunnel lining; a laser point cloud acquisition module; a structure sensor acquisition module; a data synchronization and preprocessing module; the multi-modal feature extraction module is used for performing depth feature extraction on the image, the point cloud and the sensor data; the heterogeneous feature fusion and disease identification module is used for fusing each modal feature and outputting a disease type identification result; and the risk assessment module is used for carrying out size estimation and parameterized expression on the identified diseases. The problems that in an existing tunnel inspection technology, the detection means is single, appearance and internal information cannot be considered, and the disease size is difficult to quantify automatically are solved.
Owner:HUAZHONG UNIV OF SCI & TECH

Multivariate time-series long-term forecasting based on multi-scale temporal feature enhancements

A method for multivariate time-series long-term forecasting based on multi-scale temporal feature enhancements, includes a time-series forcasting model TFEformer. The model utilizes a multi-branch structure and a patch-series attention mechanism to extract global and local time-series features at multiple temporal scales, and designs an adaptive feature fusion mechanism to achieve adaptive fusion of multi-scale temporal features. It employs an variate-wise attention mechanism and a redesigned gated feedforward network to perform feature fusion among multivariate variables and within the time-series, respectively. The time-series forcasting model TFEformer proposed by the present invention significantly improves the prediction of long-term trends in time-series and enhances the fitting ability for short-term local fluctuations, comprehensively increasing prediction accuracy across different prediction time lengths in multivariate time-series forcasting tasks.
Owner:ZHEJIANG UNIV

Multi-modal dynamic fusion and incremental learning fault diagnosis method for deep vertical shaft equipment

The invention discloses a multi-modal dynamic fusion and incremental learning fault diagnosis method for deep vertical shaft equipment, which belongs to the technical field of industrial equipment fault diagnosis, and comprises the following four steps of: constructing a pre-training large model to perform feature extraction, and relying on a multi-layer Transformer encoder and a dual loss function, establishing a multi-modal dynamic fusion and incremental learning fault diagnosis model; mining cross-modal universal fault features from vibration, temperature and current multi-modal time sequence data; according to the method, multi-modal features are fused, multi-modal association is constructed, modal weights are dynamically adjusted through a modal gating unit and a time delay compensation attention mechanism to adapt to signal quality changes, and meanwhile time sequence deviation is corrected to achieve accurate association; incremental learning is realized by using a decoupling projection layer, and a lightweight projection module is designed for a newly added fault task to suppress disastrous forgetting; network training is optimized, pre-training loss, incremental learning loss and attention regularization loss are integrated through a multi-objective loss function, and model stability and diagnosis precision are improved. The method has the advantage that the model stability and the diagnosis precision are improved.
Owner:CHINA COAL NO 5 CONSTR +1

Intelligent drilling speed prediction method based on physical feature guidance and multi-source information fusion

The invention provides an intelligent drilling speed prediction method based on physical feature guidance and multi-source information fusion, and relates to the technical field of intelligent drilling speed prediction, and the method specifically comprises the following steps: collecting multi-source heterogeneous data from a drilling real-time database, a logging system, a logging system and a geological database; constructing a dual-channel deep learning prediction model, wherein the dual-channel deep learning prediction model comprises a dual-channel convolution feature extraction module, a feature fusion module, a time sequence fusion module, a time sequence modeling module and a full connection layer which are connected in sequence; obtaining a predicted drilling speed by using a dual-channel deep learning prediction model; a joint loss function is constructed by considering a data driving error and a physical constraint error, an error is calculated according to the joint loss function, and network parameters are updated through back propagation; carrying out loop iteration training until convergence; and the trained dual-channel deep learning prediction model is used for drilling speed prediction. According to the technical scheme, the problems that in the prior art, a mechanism model is insufficient in precision, and a data driving model is poor in reliability are solved.
Owner:CHINA UNIV OF PETROLEUM (EAST CHINA)

Intelligent event identification method and system based on high-speed camera

The invention provides an intelligent event identification method and system based on a high-speed camera, and the method comprises the steps: setting the collection parameters of the high-speed camera, and triggering the camera to collect a target scene video stream. And hardware acceleration decoding processing is carried out on the collected original video data stream, real-time environment illumination information of the environment illumination sensor is obtained, and dynamic brightness equalization processing is executed. And performing motion adaptive denoising processing on the video sequence. Geometric distortion correction is carried out on the image sequence through camera calibration parameters, sub-pixel-level displacement vectors and dense optical flow field data of a moving object are extracted, and multi-scale morphological features are extracted. And the features are fused to generate motion feature data, the data are processed through a spatio-temporal joint event classification model, an event identification result is output, the result is bound with a high-precision timestamp, and event identification information is output to an industrial control system display device in real time. According to the invention, the accuracy and real-time performance of event identification can be improved.
Owner:广州思林杰科技股份有限公司

Large-scene monitoring video abnormal event early warning method based on multi-modal large model

The invention relates to the technical field of abnormal event early warning, and provides a large-scene monitoring video abnormal event early warning method based on a multi-mode large model. According to the invention, the problems of delay, low accuracy and limited coverage range of abnormal event early warning of large-scene monitoring videos in the prior art are solved. According to the main scheme, multiple paths of high-resolution monitoring videos are spliced and preprocessed to generate a panoramic video; synchronously acquiring and preprocessing audio and sensor data to construct a multi-modal data set; video key frames are extracted by adopting a traditional small model, and the video key frames and multi-modal data are jointly input into a multi-modal large model based on a Transform architecture for deep feature fusion; abnormal events such as tumble, congestion and fight are identified based on the fusion features; triggering an early warning mechanism to send event type and position information in real time; and storing the full-dimensional data of the abnormal event for tracing analysis. The real-time processing performance is optimized through edge calculation, the complex scene understanding ability is enhanced in combination with a multi-modal large model, and the detection precision and the response speed are remarkably improved.
Owner:PEKING UNIV (TIANJIN BINHAI) NEW GENERATION INFORMATION TECH RES INST +1

Road crack detection method and system based on improved RT-DETR, computer equipment and storage medium

The road crack detection method based on the improved RT-DETR comprises the following steps: shooting a road at a preset flight height by using an unmanned aerial vehicle to obtain an original road image containing a crack; a pre-trained crack detection model is utilized to carry out crack detection based on an original road image to obtain crack parameters, and the crack detection model is obtained through improvement and training based on an RT-DETR (Real-Time Detecting Transformer) model; the method for improving the RT-DETR model to obtain the crack detection model comprises the following steps: replacing a basic residual block at the tail end of a ResNet18 backbone network in the RT-DETR model with a dynamic snakelike convolution residual block (DSCRBlock); a cross-scale feature fusion module (CCFM) in a hybrid encoder in an RT-DETR model is replaced by a bidirectional diffusion focusing pyramid network (BDFPN), and the bidirectional diffusion focusing pyramid network comprises a primary focusing sub-network and a secondary focusing sub-network. The method can efficiently and accurately identify the road crack, can be applied to the unmanned aerial vehicle, and is easier to implement.
Owner:HENAN UNIVERSITY OF TECHNOLOGY

Multi-modal remote sensing semantic segmentation method and system for learning frequency domain fusion

The invention discloses a multi-modal remote sensing semantic segmentation method and system for learning frequency domain fusion. The method comprises the following steps: respectively extracting multi-scale features of two modal input images by adopting a double-branch encoder; sequentially executing frequency domain decoupling and fusion, mutual information constraint-based feature optimization and low-frequency guided cross-modal fusion processing on each scale feature to generate a fused semantic feature; and performing up-sampling and feature refining on the fused features through a decoder, and outputting a full-resolution segmentation prediction map. According to the multi-modal remote sensing image semantic segmentation method, modal sharing information and specific details are effectively separated through frequency domain decoupling, feature representation is optimized through mutual information constraint, adaptive feature fusion is achieved in combination with an attention mechanism, and the accuracy and robustness of multi-modal remote sensing image semantic segmentation are remarkably improved.
Owner:NORTHEAST FORESTRY UNIV

Multi-mode ultrasonic fusion pressure vessel welding seam defect nondestructive testing method and multi-mode ultrasonic fusion pressure vessel welding seam defect nondestructive testing system

The invention provides a multi-mode ultrasonic fusion pressure vessel weld defect nondestructive testing method and system, and relates to the technical field of nondestructive testing. According to the method, geometric parameters of a welding seam are obtained through three-dimensional laser scanning, and an optimal scanning parameter set is generated; driving ultrasonic phased array equipment to scan for one time and synchronously acquire shear wave full-matrix capture and longitudinal wave linear scanning data; performing energy flow angular spectrum analysis and envelope analysis on the bimodal data, extracting defect feature parameters and constructing a three-dimensional feature tensor; carrying out multi-dimensional feature fusion by adopting Tucker decomposition, and enhancing a core tensor through physical modeling; generating three types of defect indication diagrams including a defect existence possibility diagram, a defect relative scale diagram and a defect space orientation diagram from the enhanced feature tensor; and the three types of indication diagrams are visually presented for comprehensive interpretation of detection personnel. Through multi-modal data fusion and physical modeling enhancement, the defect identification accuracy and detection efficiency are remarkably improved, the false alarm rate is reduced, and reliable technical support is provided for pressure vessel welding seam safety detection.
Owner:YUNNAN SPECIAL EQUIP SAFETY TESTING RES INST

Medical image segmentation method and system based on residual Mama and multi-scale boundary enhancement

The invention relates to a medical image segmentation method and system based on residual Mama and multi-scale boundary enhancement. The method comprises the following steps: acquiring and preprocessing a medical image; inputting the image into a segmentation model based on an encoder-decoder architecture; the encoder synchronously extracts local texture features and models long-range spatial dependence through residual error convolution blocks and residual error Mama blocks which are alternately connected; fusing and enhancing the jump connection features between the encoder and the decoder through a boundary enhancement module to optimize boundary characterization; integrating a multi-scale gating attention module in a decoding path, and adaptively selecting and fusing multi-scale context features; and finally outputting the high-precision segmentation mask. The method effectively solves the problems that in the prior art, long-range dependence and local details are difficult to consider, the multi-scale feature fusion capability is insufficient, boundary segmentation is fuzzy and the like, and the segmentation accuracy, the boundary continuity and the clinical practicability are remarkably improved.
Owner:NINGBO MEDICAL CENT LIHUILI HOSPITACL

Cable fault positioning method based on deep learning clustering analysis test waveform characteristics

The invention relates to the technical field of cable asset management and fault prediction, and discloses a cable fault positioning method based on deep learning clustering analysis test waveform characteristics, and the method comprises the steps: collecting waveform and environment data in a cable operation period, and constructing a historical feature library comprising waveform, environment and position features; a self-adaptive detection model is adopted, and parameters are dynamically adjusted to adapt to different working conditions; multi-dimensional feature fusion and matching analysis are combined; a fault point distance is calculated through a signal propagation model and a time difference positioning algorithm, precise positioning is realized by fusing environment compensation and multi-point cross validation, and a three-dimensional geographic coordinate is generated by combining a laying path; and after multiple verifications, a structured report containing a fault type, a risk level, a prediction position, confidence and operation and maintenance suggestions is generated. According to the system, intelligent monitoring, fault risk prediction, asset optimization management and operation and maintenance decision support of a cable operation state are realized, and scientificity and economy of cable management in a complex environment are improved.
Owner:SHANXI ZHONGSHI ELECTRICITY TECH CO LTD +2

Brain tumor multi-modal large model construction method and device, equipment and storage medium

The invention discloses a brain tumor multi-mode large model construction method, device and equipment and a storage medium, and is applied to the technical field of brain tumor imagines.The method comprises the steps that pixel-concept level alignment is conducted on a multi-mode MRI image and a pathological text; constructing a multi-modal feature fusion network for fusing image features and text features by adopting an attention mechanism of pathology perception and combining medical semantic information; training the multi-modal feature fusion network to generate an analysis report and a segmentation result; according to the technical scheme of multi-task cooperation, cross-modal pathological semantic accurate alignment, pathological knowledge graph injection and lightweight and continuous optimization parallelization, full-process coverage of brain tumor accurate segmentation, analysis report generation and prognosis prediction is achieved, the problems that a traditional model lacks pathological semantic support and is insufficient in clinical adaptability are solved, and the clinical adaptability of the traditional model is improved. And the deployment feasibility and the dynamic optimization capability are also considered.
Owner:SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI

Automatic welding robot based on artificial intelligence and welding system thereof

The invention relates to the technical field of artificial intelligence welding, and discloses an automatic welding robot based on artificial intelligence and a welding system thereof. The system comprises a welding feature acquisition module, a process parameter generation module, a real-time regulation and control module and a motion planning module. The welding characteristic acquisition module is used for acquiring three-dimensional contour data, material component information and welding seam geometric parameters of a workpiece to be welded, and generating a welding characteristic spectrum through characteristic fusion; a process parameter generation module retrieves a matching template from a welding knowledge base according to the parameters, and outputs a reference welding process parameter combination in combination with an environment temperature and humidity compensation coefficient; the real-time regulation and control module dynamically corrects the reference parameters to generate an optimization instruction according to the molten pool form, thermal radiation distribution and electric arc voiceprint characteristics in the welding process; and the motion planning module calculates a motion track, attitude parameters and a speed curve of the welding execution mechanism according to the optimization instruction to form a robot control instruction set. The system can improve the intelligent level of welding, guarantees stable welding quality, and is suitable for welding scenes of multiple manufacturing industries.
Owner:湖北金石炼化建设有限公司

Defect identification method and device for substation equipment and electronic equipment

The invention provides a defect identification method and device for substation equipment and electronic equipment, and relates to the field of image identification. According to the method, an infrared image, an electric field leakage map and a visible light image are obtained through a multi-channel imaging system deployed in a substation site, and a multi-channel image tensor is generated and input into a multi-channel recognition model to extract fusion features. And fusing the features, inputting the fused features into a YOLOv8 backbone network, constructing a joint attention domain in combination with an equipment prior structure, generating a high-confidence candidate box, and performing non-maximum suppression to obtain a detection result. And constructing an inter-frame residual tensor for a detection result to perform time sequence modeling, thereby improving the detection effect. And for equipment with complex shielding, complementing a structure contour through an edge prediction path, and finally outputting target boundary and defect positioning information. By implementing the technical scheme provided by the invention, defect identification of the substation equipment is facilitated.
Owner:HUBEI CENT CHINA TECH DEV OF ELECTRIC POWER

Defect detection method and system based on honeycomb catalyst stacking

The invention belongs to the technical field of industrial detection, and discloses a defect detection method and system based on honeycomb catalyst stacking. Omnibearing image data of honeycomb catalyst stacking are obtained through a multi-angle polarization imaging technology, pixel-level polarization degree parameters are calculated to construct a global polarization feature map, and accurate distinguishing between an intrinsic porous structure and suspected defects is achieved. A blind area identification and virtual view angle reconstruction mechanism is introduced, so that the problem of a stacked edge detection blind area is solved; and a layered reflectivity compensation function is adopted, so that the optical interference of an interlayer overlapping region is eliminated. Texture features are extracted through multi-scale morphological filtering, multi-dimensional feature fusion is carried out in combination with polarization features, edge continuity indexes and correction reflection intensity, and a high-precision defect discrimination model is established. And for a low-confidence region, dynamically adjusting detection parameters and performing iterative optimization to form an adaptive detection closed loop. According to the invention, the detection precision and reliability are improved, and the defect position, type and severity can be accurately output.
Owner:TIANHE BAODING ENVIRONMENTAL ENG

Disease tracking management system and method based on lingual face diagnosis instrument

The invention discloses an illness state tracking management system and method based on a lingual face diagnosis instrument, and belongs to the technical field of traditional Chinese medicine tongue diagnosis and modern information technology fusion. The system comprises a multi-modal data acquisition module, a data processing and analysis module and an augmented reality visualization module; according to the method, illness state tracking is achieved through the steps of multi-modal data acquisition, data preprocessing and feature fusion, personalized digital twinborn model establishment, augmented reality visualization presentation and the like, multi-dimensional data such as tongue picture macroscopic features and tongue surface microorganism distribution can be integrated, dynamic association between the data is revealed, the health state and the intervention effect are visually displayed, and the method is suitable for being popularized and applied. The method is suitable for the fields of traditional Chinese medicine health management and chronic disease monitoring.
Owner:NANJING DAJING TCM INFORMATION TECH CO LTD

Battery health state dynamic evaluation method based on multi-modal feature fusion

The invention provides a battery health state dynamic evaluation method based on multi-modal feature fusion, and relates to the technical field of battery health state dynamic evaluation. The method comprises the steps of collecting multi-modal operation data of a battery, constructing a standardized cross-scale data set, performing hierarchical feature extraction, obtaining a multi-dimensional feature vector, generating a dynamic fusion feature matrix, constructing an SOH dynamic prediction model based on the fusion feature matrix, outputting an SOH prediction value, and establishing a dynamic threshold early warning mechanism based on digital twinning. And the attenuation source is backtracked and analyzed. According to the method, full-dimensional monitoring is realized by introducing microscopic data, and the data quality is guaranteed through cross-scale preprocessing; the feature expression and fusion precision is improved by means of a hybrid model and an AMKAF algorithm; data precision and physical rationality are both considered by using a hybrid prediction model; the threshold value is dynamically adjusted and traced through digital twinborn early warning, accurate evaluation of the whole life cycle of the SOH is achieved, safety is guaranteed, the service life is prolonged, and the operation and maintenance cost is reduced.
Owner:ZHUHAI GONGFENG NEW ENERGY DEV CO LTD

Fault tracing and positioning method in FTU (Feeder Terminal Unit) section

The invention discloses a fault tracing and positioning method in an FTU section, and belongs to the technical field of distribution automation fault positioning. The method comprises the following steps: synchronously acquiring current abrupt change signals of multiple FTU sections, reconstructing a transient waveform through EMD decomposition and cubic spline interpolation, extracting wavelet packet energy characteristics, and generating multi-dimensional transient characteristics in combination with wave head polarity and timestamps; fusing the power distribution network topology and traveling wave time delay to construct a space-time correlation graph, introducing virtual nodes to compensate communication interruption, dynamically assigning node attributes and marking a reflection path; based on graph neural network cooperative training, iteratively aggregating neighborhood information and dynamically optimizing edge weights, and generating candidate section fault probability distribution; and judging a conflict level by using information entropy, carrying out multi-level digestion in combination with polarity matching and time delay consistency, and outputting a high-confidence positioning result. According to the method, the problems of difficulty in multi-FTU cooperative positioning, poor communication interruption adaptability, inaccurate feature fusion and the like are solved, and the accuracy and robustness of power distribution network fault tracing are remarkably improved.
Owner:HONGHE POWER SUPPLY BUREAU OF YUNNAN POWER GRID

Wind driven generator fault diagnosis method and system based on Mamba-ResNet

The invention relates to the technical field of fault diagnosis, in particular to a wind driven generator fault diagnosis method and system based on Mamba-ResNet. The method comprises the following steps: carrying out feature extraction and feature fusion by utilizing preprocessed data, namely constructing adaptive window short-time Fourier transform (AW-STFT) to carry out dynamic time-frequency resolution analysis, carrying out parallel feature extraction and constructing a multi-dimensional heterogeneous feature vector, and carrying out a cross-modal adaptive gating fusion mechanism based on a bidirectional cross gating unit; the method comprises the following steps: constructing a Mamba-ResNet hybrid deep network model architecture; performing model training on the constructed network model architecture; and performing fault diagnosis on the wind driven generator by using the trained model architecture. A tedious manual feature design process in a traditional method is avoided, and the automation level and adaptability of a diagnosis system are remarkably improved.
Owner:YANTAI UNIV

Water quality prediction method and system based on gating residual enhancement and feature fusion

The invention relates to a water quality prediction method and system based on gating residual enhancement and feature fusion, and belongs to the technical field of water environment intelligent analysis and deep learning. Taking each water quality index as a node of the graph, and constructing two complementary variable relation graph structures by utilizing a Pearson's correlation coefficient and mutual information; respectively inputting the two graph structures into a graph convolutional network, extracting deep dependency features among indexes, and splicing and fusing the deep dependency features. A multi-head attention mechanism is used as a trunk to extract global time dependence, a GRU network is introduced to extract local time sequence features, GRU output is used as an adjustable residual term to be injected into the attention trunk through a residual gating mechanism, self-adaptive enhancement of local dynamic features is achieved, and finally a self-adaptive fusion mechanism is introduced to generate comprehensive representation. According to the method, the complex dependency relationship between the water quality indexes and the time dynamic evolution process can be modeled in a collaborative manner, the response capability to key local change and sudden change events is remarkably enhanced, and the accuracy and robustness of water quality prediction are improved.
Owner:SHANDONG FENGSHI INFORMATION TECH CO LTD

Ton bag hoisting unmanned control system based on binocular vision camera and laser radar

The invention relates to the technical field of machine vision and perception, in particular to a ton bag lifting unmanned control system based on a binocular vision camera and a laser radar, which comprises an intelligent control unit, a lifting appliance executing mechanism, a sensing unit and a special ton bag, the sensing unit comprises a binocular vision camera and a laser radar and is used for collecting depth vision and three-dimensional point cloud information of an operation area; the intelligent control unit fuses multi-source data, locates a lifting lug by improving a weighted multi-feature fusion algorithm, plans a safety path and generates a staged instruction; the lifting appliance executing mechanism lifts and pulls a collapsed lifting lug through an electromagnetic adsorption module, a mechanical gripper module clamps the lifting lug, and reliable operation is achieved in cooperation with a verification mechanism; the special ton bag is matched with a sensing and executing module through a high-contrast color and a pre-embedded metal piece. The full-process unmanned operation is achieved, the robustness and operation safety of the complex environment are improved, and the ton bag hoisting requirements of multiple industries are met.
Owner:ZIJIN ZHIXIN (XIAMEN) TECH CO LTD

Intelligent hardware dynamic interaction system based on voice semantic fusion and multi-mode perception

The invention relates to the field of intelligent interaction, and discloses an intelligent hardware dynamic interaction system based on voice semantic fusion and multi-modal perception, which comprises the following steps of: constructing a context model of continuous operation by collecting continuous voice instructions, gesture actions and expression information of a user; semantic analysis and feature fusion are carried out on currently collected voice, gesture and expression features, meanwhile, credibility indexes of all modes are calculated through a weighting or deep learning model, weighting correction is carried out on a fusion result, a real-time feedback algorithm is adopted for weight adjustment for continuous optimization, the next operation intention of a user is predicted through deep learning, and the user experience is improved. And in combination with historical interaction data, online feedback and prediction errors, context management, modal weight and intention prediction strategies are adaptively optimized, and the updated strategies are used for next-round context acquisition and multi-modal fusion. The method has the advantage of improving the recognition accuracy in the continuous interaction scene.
Owner:华欧同惠(苏州)科技有限公司

Power equipment defect identification and alarm method and system based on deep learning

The invention discloses an electrical equipment defect identification and alarm method and system based on deep learning. The method comprises the following steps: synchronously collecting and registering visible light and infrared thermal imaging images on the surface of power equipment, and constructing an instance segmentation network comprising a lightweight feature extraction network, a multi-scale feature fusion network and a frequency domain mask prediction branch; enhancing the diversity of training samples by adopting a generative adversarial strategy; based on the graph neural network, analyzing the incidence relation between the defects and the equipment topology and historical records, and deducing the defect causal relation and the risk level; generating interpretable alarm information including the thermodynamic diagram, the natural language report and the maintenance suggestion; real-time detection and deep analysis are realized by adopting an end-side cloud collaborative architecture; and the system performance is continuously improved through a closed-loop optimization mechanism. According to the method, high-precision defect detection under multi-modal data fusion is realized, the robustness and interpretability are high, and the operation and maintenance intelligence level of power equipment is remarkably improved.
Owner:JIANGSU POWER TRANSMISSION & DISTRIBUTION CO LTD

Image recognition method based on edge calculation

The invention relates to the technical field of computer vision and image recognition, in particular to an image recognition method based on edge computing, which comprises the following steps: dynamically capturing an original image through a plurality of edge nodes, rejecting redundant regions through a multi-modal perception triggering mechanism, and establishing a cooperative processing group. Illumination equalization, noise filtering and resolution self-adaptive compression tasks are distributed according to dynamic role election, a standardized preprocessed image is generated, a lightweight convolutional neural network is operated in parallel to extract a dual-channel feature vector, and after entropy coding lossless compression and equipment identity tag and time sequence stamp attachment, the dual-channel feature vector is transmitted to a cloud end by adopting a lightweight encryption protocol. The cloud end analyzes the data packet, reconstructs a feature topological graph based on space-time relevance, loads a depth residual error recognition model to execute feature fusion and classification decision, feeds back and updates the weight of an edge node model, solves the problems of low collaborative efficiency and feature distortion, and improves the efficiency and precision of image recognition.
Owner:TUSU AUTOMATION TECH (SHANGHAI) CO LTD

Stainless steel tube surface defect detection method and system

The invention discloses a stainless steel tube surface defect detection method and system. The method comprises the following steps: S1, collecting stainless steel tube scanning images under dark field and bright field illumination; s2, splicing the line scanning images into dark field and bright field cylindrical expanded images, and executing brightness equalization and reflection suppression processing; s3, carrying out pixel-level fusion on the dark field and bright field cylindrical expansion images according to a set weight; s4, inputting the fusion cylinder expansion image into a YOLO network trunk of an integrated Swin Transform module, and extracting a multi-scale feature map; s5, performing feature fusion and bounding box prediction, and outputting a bounding box, confidence and a category label of the defect; s6, performing semantic segmentation, gray segmentation and weighted fusion in the detection frame area to generate a final defect mask; and S7, calculating the area, length, width and centroid coordinates of the defect, and converting the actual size and the spatial position. The stainless steel tube surface defect recognition accuracy and stability are improved.
Owner:NINGBO MINGYANG STAINLESS STEEL PIPE

Power distribution network data intelligent analysis method based on data consanguinity and multi-modal fusion learning

The invention relates to a power distribution network data intelligent analysis method based on data consanguinity and multi-modal fusion learning. The method comprises the following steps: S1, constructing a dynamically evolved data consanguinity topological graph; s2, designing a label-guided graph neural network architecture, embedding historical abnormal knowledge into a graph learning process, and outputting a deep semantic feature vector; s3, constructing a multi-modal fusion analysis framework, performing multi-dimensional feature fusion and data quality analysis, and identifying abnormal nodes; s4, designing a semi-supervised and incremental learning combined mixed training normal form, and performing model training and strategy optimization; and S5, based on the dynamic consanguinity topology constructed in the step S1 and the identified abnormal nodes, constructing a probabilistic reasoning framework, and fusing the model parameters obtained by optimization in the step S4 to realize quality abnormality root positioning and full-link visualization so as to form a complete data intelligent analysis scheme. According to the invention, efficient and accurate management of the topological data quality of the power distribution network is realized.
Owner:STATE GRID TIANJIN ELECTRIC POWER COMPANY +1