Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

5370 results about "Information fusion" patented technology

Distribution line fault intelligent diagnosis method based on multi-source information fusion

The invention discloses a distribution line fault intelligent diagnosis method based on multi-source information fusion, and belongs to the technical field of power system fault detection and diagnosis, and the method comprises the steps: obtaining distribution line data and meteorological data; superposing the distribution line data with the meteorological data to generate a space-time fusion feature matrix based on the wire space displacement; dynamically adjusting a preset initial threshold value by using the space-time fusion feature matrix; and performing multi-round verification on the abnormal fluctuation of the electrical parameters of the line according to the fault judgment threshold, generating a fault positioning instruction, performing real-time matching with the topological structure of the line, correcting the priority queue of the fault section based on the switching action feedback data of the feeder terminal, and triggering the fault removal action matched with the priority. According to the method, spatial-temporal feature fusion of current, voltage, weather and spatial displacement data and a dynamic threshold adjustment mechanism are adopted, the fault type can be accurately identified, the fault section can be positioned in real time, and the diagnosis precision and the response speed in a complex environment are remarkably improved.
Owner:SICHUAN JIYUE INTERNET OF THINGS TECH CO LTD

Semantic comprehension driven cross-modal information fusion and retrieval method and system

The invention discloses a cross-modal information fusion and retrieval method and system driven by semantic comprehension, and the method comprises the steps: obtaining text, image and audio original data, and extracting an initial feature set of each modal through a deep neural network; dynamically distributing each modal weight coefficient based on an attention mechanism, and performing weighted fusion on the initial feature set to obtain cross-modal fusion feature representation; through a cross-modal semantic association analysis model, high-dimensional semantic association features are extracted from the fusion feature representation, and semantic enhancement feature vectors are generated; constructing a cross-modal semantic graph network based on the vector, complementing missing modal features, and generating an optimized multi-modal feature set; and inputting the optimized feature set and the query sample into a contrast learning model, calculating a semantic similarity score, and generating a cross-modal retrieval result sorting list according to the score.
Owner:SHANGHAI CIVIL AVIATION VOCATIONAL & TECH COLLEGE

Method and system for collecting decision data by multi-modal large model driven intelligent agent

The invention discloses a method and a system for collecting decision data by an intelligent agent driven by a multi-modal large model. The method comprises the following steps: collecting original data of a predetermined sensor, calculating information entropy and a normalized mass score, and generating a fusion feature vector through self-adaptive multi-modal information fusion; time sequence sensitive multi-mode alignment processing is carried out on the image, and time sequence alignment features are obtained by combining timestamp embedding and a self-attention mechanism; based on this, decision distribution is generated by using a Bayesian neural network, uncertainty is evaluated, and a final decision and index set is generated; evaluating a task score in combination with task description, and making an execution plan according to a resource state; initializing the model, generating synthetic data, optimizing the model and storing experience. According to the invention, the efficient decision-making process of the intelligent trolley is realized, and the execution capability and task completion precision of the intelligent trolley are improved.
Owner:NANJING ARTIFICIAL INTELLIGENCE CHIPS RES INST OF AUTOMATION CHINESE ACAD OF SCI +1

Industrial article appearance detection method and system based on machine vision

The invention relates to the technical field of image processing, and discloses an industrial article appearance detection method and system based on machine vision. The method comprises the steps that a workpiece image is collected, and a standardized image is obtained through Gaussian filtering, histogram equalization and Otsu algorithm preprocessing; feature vectors are extracted through edge detection, Hough transform and a gray-level co-occurrence matrix; training a defect identification model by adopting a CNN of an attention mechanism; inputting an image for real-time detection; fusing the detection data and the environmental parameters by using a D-S theory; and establishing a database based on a distributed architecture to generate a quality report. According to the method, the detection accuracy is improved through multi-source information fusion, and efficient management and analysis of mass detection data are realized by adopting a distributed architecture.
Owner:SHENZJEM SOFTWELL TECH DEV CO LTD

Unmanned aerial vehicle multi-dimensional information fusion method and system based on acousto-optic-electric composite detection

The invention provides an unmanned aerial vehicle multi-dimensional information fusion method and system based on acousto-optic-electric composite detection. According to the method, acoustic frequency band signals, visible light image sequences and electromagnetic field intensity change data are collected, acoustic characteristic flow, optical characteristic flow and electrical characteristic flow are generated, and based on the time deviation between a low-frequency vibration mode and transient electromagnetic pulses, multi-channel dynamic calibration is carried out on an image distortion area in the optical characteristic flow. The method comprises the following steps: acquiring an acoustic feature flow, an optical feature flow and an electrical feature flow, correcting space-time coordinate parameters of the acoustic feature flow, the optical feature flow and the electrical feature flow, generating a calibration feature flow, carrying out anti-interference fusion processing on the calibration feature flow, extracting multi-dimensional coupling features, inputting the multi-dimensional coupling features into an unmanned aerial vehicle flight path planning model, and generating a three-dimensional space situation model; according to the invention, the physical space-time consistency alignment and noise suppression of the multi-modal data are realized, and the obstacle positioning precision and the dynamic trajectory prediction real-time performance are significantly improved.
Owner:ZHONGLIAN GOLDEN CROWN INFORMATION TECH (BEIJING) CO LTD

Remote sensing image building extraction method fusing double-space attention features

The invention discloses a remote sensing image building extraction method fusing double-space attention features, and belongs to the technical field of image processing. The method comprises the following steps: firstly, inputting a training set of an Inria aviation data set into a ConvNeXt backbone network to extract shallow feature information; then, carrying out feature information enhancement processing on the feature information through a double-space attention feature fusion module (DAFF); and finally, a multi-modal dynamic enhancement module (FAM) is used in the last time of feature information up-sampling operation to carry out channel alignment operation of different levels of features, and feature information fusion errors are reduced. According to the method, the accuracy of building extraction in the remote sensing image is remarkably improved.
Owner:SOUTHWEAT UNIV OF SCI & TECH

Vision-text collaborative abstract generation method and system based on multi-modal learning

The invention belongs to the field of natural language processing crossing, and particularly relates to a visual-text collaborative abstract generation method and system based on multi-modal learning, and the system comprises a multi-modal data receiving module which is used for receiving multi-modal input data in parallel, and the multi-modal input data comprises text data and visual data; the visual semantic understanding module is used for extracting high-level semantic features of the image by adopting a visual semantic understanding model and generating text description; the semantic fusion module is used for carrying out semantic fusion on the original text and the generated image description by adopting a vision-text semantic fusion method based on direction consistency and self-adaptive semantic completion; and the abstract optimization module is used for carrying out semantic reconstruction on the fusion features by adopting a multilayer deep fusion hybrid neural network architecture, and generating an abstract text conforming to context semantics and accurate expression. The method has the advantages that visual and text information is accurately aligned, high-quality abstracts are generated, and the method is particularly suitable for news reports, conference records, video content analysis and other scenes needing cross-modal information fusion.
Owner:SHANDONG UNIV +1

Real-time data acquisition-based weftless tape machine intelligent monitoring system and method

The invention relates to the technical field of industrial automatic monitoring, in particular to a weftless tape machine intelligent monitoring system and method based on real-time data acquisition. The system comprises a data acquisition module used for acquiring real-time data of a multi-heterogeneous sensor; the data processing module is used for preprocessing the real-time data; the intelligent analysis module covers a feature extraction unit, an anomaly detection unit, a fault diagnosis unit, a service life prediction unit and a data fusion unit and can extract data features, detect anomaly, diagnose faults, predict the service life of a part and fuse multi-unit output to make a decision; and the early warning response module triggers corresponding levels of alarms according to the analysis result and generates a diagnosis report. According to the invention, comprehensive real-time monitoring, early fault early warning, accurate fault diagnosis, residual life prediction, multi-source information fusion and the like of the operation state of the weftless tape machine are realized, the production efficiency and the product quality are effectively improved, and intelligent management of production of the weftless tape machine is assisted.
Owner:SHANGHAI TONGLI ELECTRICAL MATERIALS CO LTD

Data center construction and intelligent operation and maintenance management system

The invention relates to the technical field of data center intelligent management, in particular to a data center construction and intelligent operation and maintenance management system, which comprises a dynamic environment sensing module, a heterogeneous equipment protocol adaptation module, a multi-dimensional resource dynamic scheduling module, a hidden fault prediction module and an energy efficiency optimization execution module. Physical environment data such as temperature gradient, current harmonic component and optical fiber strain rate are acquired by deploying a multi-mode sensor, and an environment characteristic matrix is constructed; standard semantic mapping of the heterogeneous protocol is realized by using a semantic slot migration algorithm; establishing a resource topological graph based on the hypergraph neural network and dynamically updating the resource topological graph; a dual-channel space-time convolutional network is adopted to realize fault prediction; and combining the fault probability matrix to generate a dynamic tuning strategy of dimensions such as cooling, electric power, network and the like, and forming closed-loop optimization control. According to the invention, integrated collaboration of multi-source information fusion, equipment intelligent control and energy efficiency adaptive optimization is realized, and the intelligence, reliability and energy efficiency level of data center operation and maintenance are improved.
Owner:SHANDONG ENERGY SHENGLUNENG CHEM ALXA LEAGUE NEW ENERGY CO LTD +1

Foundation radar landslide monitoring and early warning method and system

The invention provides a ground-based radar landslide monitoring and early warning method and system, and relates to the technical field of landslide monitoring, and the method comprises the steps: collecting a monitoring signal, and carrying out the filtering processing; extracting an instantaneous phase and performing wavelet packet decomposition; enhanced features are obtained through morphological filtering; constructing a monitoring feature vector; carrying out nonlinear dimension reduction on the characteristic time sequence matrix; obtaining an evolution trajectory by using a fractional order adaptive neural network; constructing a hierarchical risk reasoning framework; a risk metric value is obtained through multi-source information fusion; and carrying out dynamic evaluation by adopting a fuzzy evolution algorithm and determining an early warning level. The method can improve the accuracy and real-time performance of landslide monitoring and early warning.
Owner:BEIJING SOBOLA AUTOMATION TECH CO LTD

Unmanned aerial vehicle data anomaly detection method based on multi-modal time sequence modeling

The embodiment of the invention provides an unmanned aerial vehicle data anomaly detection method based on multi-modal time sequence modeling, and the method comprises the steps: carrying out the multi-stage data preprocessing of original data obtained in the working process of an unmanned aerial vehicle, and generating a standardized input data flow; extracting time sequence features of the standardized input data stream through continuous LSTM blocks in the multi-level feature extraction network, and generating a shallow time sequence feature set; performing depth time sequence modeling on the shallow time sequence feature set to generate a deep time sequence feature set; performing multi-stage information fusion and mask screening on the shallow time sequence feature set and the deep time sequence feature set to generate a fusion time-space correlation feature set; and generating an attitude parameter prediction result of the unmanned aerial vehicle according to the fusion time-space correlation feature set, and obtaining an anomaly detection decision result of the unmanned aerial vehicle by using a deviation comparison and multi-level anomaly judgment mechanism based on an adaptive threshold obtained based on the attitude parameter prediction result and prediction error statistical distribution. Therefore, the anomaly detection accuracy of the unmanned aerial vehicle data is improved.
Owner:SICHUAN UNIV

End-to-end monocular visual odometer method fusing space-time semantic information

The invention discloses an end-to-end monocular visual odometer method fusing space-time semantic information. According to the method, continuous image sequence frames are collected through a color monocular camera, and a multi-information fusion end-to-end deep learning framework is constructed; a heterogeneous training domain is adopted to set various data set course sharing parameter fusion training, continuous image sequences are input, and the end-to-end deep learning framework is dynamically coupled with hidden state feature vectors output historically, so that a feature mapping relation of time sequence perception is formed; and interpretable feature decoupling of the static background elements and the dynamic entity objects in the scene is realized. After iterative feature fusion, the system outputs sparse depth and camera motion poses which conform to scene geometric constraints, so that a camera trajectory estimation model with high robustness and strong generalization ability in a complex environment is constructed. According to the method, the positioning precision and stability of the monocular vision odometer are remarkably improved.
Owner:ZHEJIANG UNIV

Multi-target commodity identification method, device and system based on multi-modal data processing

The invention relates to the technical field of intelligent vending, solves the problem that in the prior art, commodity identification cannot be accurately carried out in a multi-target scene, and provides a multi-target commodity identification method, device and system based on multi-modal data processing. The method comprises the following steps: acquiring multiple frames of real-time images in a commodity transaction scene; performing preprocessing and label information extraction on the real-time image, and determining character information corresponding to the target image and the commodity label; performing instance segmentation on the target image, and determining commodity position information; performing feature extraction on the target image, and determining commodity image feature information; according to pre-collected multi-source privatized data in an intelligent vending scene, performing fine adjustment and optimization processing on the open-source multi-modal visual language model to obtain a multi-modal large model; and inputting the commodity image feature information and the text information into the multi-modal large model for information fusion, and determining a commodity target identification result. According to the invention, commodity identification can be accurately carried out in a multi-target scene.
Owner:YOPOINT SMART RETAIL TECH LTD

Rolling bearing residual life prediction method and system based on convolution white box

The invention belongs to the technical field of bearing residual service life detection, and discloses a rolling bearing residual service life prediction method and system based on a convolution white box. According to the method, time domain and frequency domain feature extraction, noise reduction processing and health state and degradation state division are carried out on an original vibration signal, and deep neural network training is carried out in combination with a Weibull-MSE loss function, so that prediction of RUL conforms to the actual degradation process of a bearing; and synchronous extraction of long-time dependence information and local degradation characteristics of the bearing signal is completed through a convolution CRATE network architecture fusing an expansion causal convolution attention mechanism DCA and a multi-scale convolution MSC. According to the method, the accuracy of RUL prediction is improved in combination with health state evaluation, the local feature extraction capability is enhanced, the local modeling capability of the model is improved through multi-scale information fusion, and the interpretability and the prediction credibility are improved through a CRATE structure.
Owner:SHANDONG UNIV OF SCI & TECH

Network security protection method and system based on information fusion

The invention provides a network security protection method and system based on information fusion, and the method comprises the steps: firstly obtaining a multi-source heterogeneous data set, which comprises a traffic interaction data unit, an equipment log data unit and a protocol analysis data unit, of a target network, then carrying out the time sequence correlation analysis of the traffic interaction data unit, and generating a traffic behavior feature set; and executing state mode analysis on the equipment log data unit to generate an equipment operation feature set, and executing semantic recognition on the protocol analysis data unit to generate a protocol analysis feature set. Then, on the basis of a multi-dimensional feature fusion rule, cross-dimensional feature fusion processing is carried out on the feature set, and a network situation feature set is generated; and calling a threat identification model to carry out threat identification on the set, generating a threat identification result set containing threat type identifiers and influence range parameters, and finally generating a security response strategy set according to the threat identification result and issuing the security response strategy set to a security control node to execute protection operation, thereby effectively improving the network security protection capability.
Owner:GUANGXI POWER GRID CORP

Decision-making method and device based on multi-modal semantic alignment, equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a decision-making method, device, equipment and medium based on multi-modal semantic alignment. Executing cross-modal alignment by taking the voice semantic map as a reference to generate associated information, fusing the voice features, the visual features, the action features and the associated information to generate a fusion feature vector, inputting a decision network to generate a decision feature vector and generate a task execution instruction, obtaining execution feedback information of the task execution instruction, and updating the decision network. According to the method, input is dominated by voice instructions, visual features, action features and semantic map depth alignment and fusion are combined, input naturalness and multi-modal data analysis and decision-making efficiency are improved, and interaction adaptability and decision-making accuracy of the model in a complex scene are improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Multi-source information fusion data space analysis method and system based on knowledge graph

The invention provides a multi-source information fusion data spatial analysis method and system based on a knowledge graph, and relates to the technical field of data analysis, and the method comprises the steps: carrying out the quality calibration and fusion of multi-source heterogeneous data, and obtaining standardized fusion data; a city system knowledge graph is constructed, the city system knowledge graph comprises city element nodes with category and hierarchical relations and association strength of the city element nodes, and city function communities are constructed and optimized through a modularity optimization method; an urban element diffusion wave equation model is constructed based on an urban system knowledge graph, an urban element state propagation rule is analyzed, urban function division is performed, an urban system coupling differential equation set model is established to predict urban element state change, an urban system vulnerability index is constructed, and urban system toughness analysis is performed. According to the method, multi-source city data can be effectively fused, the city system knowledge graph is constructed, and decision support is provided for city space planning and management.
Owner:WUXI ORACLE BONE JINSHENG DIGITAL TECHNOLOGY CO LTD

Group behavior analysis method for multi-modal information fusion and dynamic updating

The invention discloses a multi-modal information fusion and dynamic updating group behavior analysis method. The method comprises the steps of information integration and dynamic updating, multi-modal information obtaining and information preprocessing, feature extraction, feature representation conversion, alignment and fusion, and multi-modal information real-time processing and dynamic updating through a stream processing framework. A self-learning mechanism and a self-optimization mechanism are introduced; group portrait generation: extracting population statistical characteristics, geographic position distribution, behavior and emotional psychological characteristics, social relationships, social media and economic characteristics from the multi-modal data to generate a group portrait; analyzing group behaviors; and outputting visualization, and outputting group behavior prediction results in a visualized manner, including a behavior trend graph, a group clustering graph, an association rule graph and an abnormal behavior detection graph. According to the method, multi-modal data from various sources and forms are effectively integrated and analyzed, self-learning and self-optimization mechanisms are introduced, and finally group behavior analysis is performed.
Owner:GUANGZHOU UNIVERSITY

Robot motion planning method and device based on multi-modal information fusion

The invention relates to the field of robot motion, in particular to a multi-modal information fusion robot motion planning method, which comprises the following steps: information acquisition: acquiring multi-modal data of a robot through various sensors; preprocessing: carrying out normalization, denoising and synchronization processing on the multi-modal data; fusion: coding and fusing the preprocessed data by adopting a feature level fusion method, and generating an environment model based on an information fusion algorithm; motion planning: combining an environment modeling and path planning algorithm, and generating a motion path according to the fused multi-modal information; and feedback adjustment: dynamically adjusting the motion track by adopting a feedback control mechanism based on the environment change sensed in real time. The invention provides a multi-modal information fused robot motion planning method and equipment, which are used for improving the perception capability of a robot to a complex environment, enhancing motion planning and precision and improving task execution efficiency and safety by fusing multi-modal information.
Owner:WUHAN POLYTECHNIC UNIVERSITY

Multi-source information fusion accurate navigation method and system for underwater vehicle

The invention provides an underwater vehicle multi-source information fusion accurate navigation method and system. The method comprises the following steps: firstly, acquiring inertial navigation data, DVL data and ocean current information of an underwater vehicle and observation information of a distance between the underwater vehicle and a beacon, and preprocessing the inertial navigation data, the DVL data and the ocean current information; then, establishing a state model according to the kinematics principle of the underwater vehicle, and establishing an observation model by combining various types of information; carrying out fusion processing on the state model and the observation model by adopting a self-adaptive Kalman filtering algorithm; and finally, estimating the current position of the underwater vehicle according to the fused state vector, comparing the current position with a preset target position to calculate a deviation, and correcting the deviation by adjusting a rudder angle and the rotating speed of a propeller. According to the method, multi-source information is integrated, innovation is carried out on construction of a state model and an observation model and position estimation and deviation correction, adaptive Kalman filtering is adopted, and the method has the advantages that the navigation precision is improved, the ocean current influence is considered, adaptive adjustment is realized, and real-time navigation is realized.
Owner:JIMEI UNIV

Semantic alignment method for infrared image and microwave non-image information fusion

The invention discloses a semantic alignment method for infrared image and microwave non-image information fusion. The method comprises the steps that infrared image and microwave non-image information fragments in the same scene are collected; carrying out preprocessing operation on the acquired infrared image and microwave non-image information; extracting spatial and semantic features of the infrared image, and extracting frequency domain features of microwave non-image information; embedding the infrared image features and the microwave non-image features into the same high-dimensional semantic space; calculating the similarity in semantic representation; and carrying out global optimal matching by adopting a Hungary algorithm. Respectively performing wavelet decomposition on the infrared image and the microwave features by adopting a wavelet transform fusion algorithm, and extracting low-frequency and high-frequency coefficients under different resolutions; by constructing a unified semantic representation space and an efficient feature fusion mechanism, the difference between the infrared image and the microwave data in the feature expression form and the semantic level is effectively solved, complementary information of two modes is fully mined, and the target recognition and environment perception ability in a complex environment is improved.
Owner:CHINA UNIV OF MINING & TECH +1

Dynamic self-adaptive multi-view three-dimensional reconstruction method and model based on double-domain information fusion

The invention relates to a three-dimensional reconstruction method and model, in particular to a dynamic self-adaptive multi-view three-dimensional reconstruction method and model based on double-domain information fusion, and aims to solve the problems that in the prior art, the space relation between pixels is explored by utilizing attention along a channel dimension, the self-adaptive long-range information association capability is lacked, and the space relation between pixels is not explored. According to the dynamic adaptive multi-view three-dimensional reconstruction method based on double-domain information fusion, spatial domain detail enhancement and frequency domain dynamic aggregation and enhancement are realized through a multi-scale spatial domain and frequency domain information fusion network, so that multi-scale enhancement characteristics of an input image are obtained; a multi-scale depth prediction network is constructed by adopting a coarse-to-fine framework, depth hypotheses of all scales are obtained, a cost body is generated through adaptive aggregation, finally regularization is carried out to obtain prediction depth, and the prediction depth is converted to obtain a three-dimensional point cloud file of a corresponding scene. Meanwhile, the invention provides a model capable of realizing the method.
Owner:XIAN INST OF OPTICS & PRECISION MECHANICS CHINESE ACAD OF SCI

Industrial part alignment method and system based on visual analysis and storage medium

The invention relates to the technical field of image processing, and discloses an industrial part alignment method and system based on visual analysis and a storage medium. The method comprises the steps that a three-view camera collects an industrial part image, and preprocessing is carried out through gradient magnitude local contrast enhancement to obtain an enhanced image; performing hierarchical feature extraction to identify edge contours and key control points to form a multi-dimensional feature set; and establishing a dynamic reference coordinate system based on the feature set to obtain a part space attitude matrix. And the attitude deviation is compensated through Z-axis offset and rotation coupling error analysis. Posture adjustment is decomposed into a plurality of sub-stages, an alignment track is optimized by adopting a variable speed planning strategy, and accurate alignment of the parts is achieved. The problems that multi-view visual information fusion is insufficient, a special recognition algorithm for geometrical characteristics of the industrial parts is lacked, and Z-axis offset and rotation coupling error compensation is inaccurate in the posture adjustment process are solved, and the precision and stability of alignment of the industrial parts are improved.
Owner:BEIJING TIANYUAN 3D TECH CO LTD

Unmanned aerial vehicle flight path positioning method and system based on multi-source information fusion

The invention relates to the technical field of unmanned aerial vehicle positioning, in particular to an unmanned aerial vehicle flight path positioning method and system based on multi-source information fusion. The method comprises the following steps: acquiring an original observation data stream of an unmanned aerial vehicle in real time through a sensor array, and preprocessing to output a multi-source data sample set; calculating relative motion increment between adjacent key frames through an IMU pre-integration model, and extracting local pose estimation through a visual geometric calculation method; evaluating the confidence of each sensor in real time to dynamically generate an adaptive weight coefficient; and constructing a tight coupling fusion filter taking position, speed and attitude errors as core state quantities, and outputting a global optimal trajectory of the unmanned aerial vehicle. According to the invention, the weight is dynamically distributed through the real-time confidence of the sensor, the multi-source data association is fully mined, and the flight path positioning precision and environmental adaptability of the unmanned aerial vehicle are improved.
Owner:YANTAI XINFEI INTELLIGENT SYST CO LTD

Multi-modal small sample image classification method and system based on multi-scale dynamic feature fusion

The invention relates to the technical field of small sample image classification, in particular to a multi-modal small sample image classification method and system based on multi-scale dynamic feature fusion. The method comprises the following steps: acquiring a small sample image data set, and dividing the small sample image data set into a support set and a query set; and inputting the two features into a feature extraction network to extract global features, and inputting the features into a regional proposal network (RPN) to obtain corresponding local features. Extracting semantic information according to the category label of the support set data, and inputting the semantic information into a text encoder to obtain text features; inputting the global feature, the local feature and the text feature of the input image into an adaptive weight network, and performing dynamic feature fusion to effectively integrate multi-modal information; and inputting the fused multi-modal features into a classification model which takes a prototype network as a learning device and takes an MAML algorithm as a meta-learning device for classification prediction, finally training a network model by using a composite loss function, and performing image classification by using the trained classifier.
Owner:CHANGCHUN UNIV OF SCI & TECH

Method for constructing structural semantic map under underground weak-light and low-texture environment

A method for constructing a structural semantic map under an underground weak-light and low-texture environment is provided. The method includes: fusing traditional methods with a parameter line detection and verification model of structural semantics of a Transformer; and establishing a geometric primitive half-plane search method guided by the direction of structural information. The method also includes establishing a neighborhood greedy expansion algorithm based on a geometric primitive model; and optimizing geometric primitive poses and boundaries one by one. The method further includes fusing a point cloud map with structural information, and establishing a semantic map with geometric structure primitives.
Owner:TONGJI UNIV

Electric vehicle parking lot fire prevention and control system based on multi-source information fusion

The invention discloses an electric vehicle parking lot fire prevention and control system based on multi-source information fusion. A sensing layer captures the environment state of an electric vehicle parking lot and the operation parameters of a vehicle battery in real time through a multi-mode sensor network; the network layer adopts an intelligent fusion network architecture to realize communication between the sensing layer and the data processing layer; the data processing layer is used for performing fusion analysis on the environment state and the operation parameters, judging a fire risk level and generating a dynamic control instruction; the data processing layer is composed of a multi-dimensional analysis engine, and a hierarchical progressive intelligent analysis architecture is adopted to realize multi-level research and judgment of fire risks; and the application layer receives the dynamic control instruction generated by the data processing layer, and realizes full-process closed-loop management of fire prevention and control through a multi-mode terminal device. The method not only improves the fire prevention and control precision of the electric vehicle parking lot, but also has good interpretability, and can be directly applied to a fire prevention and control system of the electric vehicle parking lot.
Owner:SHENYANG FIRE RES INST OF MEM

Aviation converter fault detection method based on information fusion algorithm

The invention discloses an aviation converter fault detection method based on an information fusion algorithm, and the method comprises the steps: collecting the operation data of an aviation converter, and constructing a data set; performing time information extraction and space information extraction on the data in the data set, and performing feature fusion on time features and space features based on a variational auto-encoder to obtain spatio-temporal data; constructing a Bayesian deep learning model, and training and optimizing the Bayesian deep learning model; inputting the spatio-temporal data into the trained and optimized Bayesian deep learning model for processing, outputting a numerical value representing a fault occurrence probability, and taking a variance based on the probability numerical value as uncertainty estimation; presetting a probability threshold, and when the output probability is greater than the threshold, determining that the converter has a fault; otherwise, judging that the operation state is normal; a more accurate and reliable diagnosis result is provided for fault detection, and the method has high adaptability and robustness in practical application.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Intelligent drawing auditing method and system based on multi-modal large language model

The invention relates to the field of image processing, and discloses an intelligent drawing checking method and system based on a multi-modal large language model, and the method comprises the steps: obtaining a to-be-checked target engineering design drawing and a to-be-checked task description; generating a global overview drawing based on the target engineering design drawing; performing global semantic analysis according to the global overview map and the review task description through a multi-modal large language model, and generating a global semantic analysis result and to-be-reviewed local area proposal information; cutting a local image from the design drawing; performing element identification analysis on the local image through a multi-modal large language model to obtain local structured information; and performing information fusion processing on the local structured information and the global semantic analysis result, generating complete drawing information, performing compliance verification and defect positioning on the complete drawing information and the structured specification knowledge base, and generating a review report. According to the method, intelligent review of the power grid engineering design drawing can be realized, the review efficiency and accuracy are improved, and meanwhile, the resource consumption is reduced.
Owner:YANGJIANG POWER SUPPLY BUREAU OF GUANGDONG POWER GRID

Natural disaster emergency rescue system based on multi-source perception information fusion

The invention belongs to the technical field of emergency management, and discloses a natural disaster emergency rescue system based on multi-source sensing information fusion. The system is composed of a multi-source sensing data acquisition module, a data preprocessing and space-time registration module, a cross-modal feature extraction module, a multi-modal information fusion and conflict resolution module, a disaster type identification and grade discrimination module, a disaster influence range prediction and diffusion modeling module, and a dynamic emergency path planning and response plan generation module. A rescue scheduling and command control module; and an emergency feedback and closed loop dynamic correction module. Through multi-source sensing data fusion, cross-modal feature extraction and deep information fusion technologies, a full-space-time and full-process natural disaster emergency rescue system is constructed, comprehensive sensing, accurate recognition and dynamic plan generation of a disaster site are realized, the rescue response speed and decision scientificity are remarkably improved, and the intelligent level of emergency rescue is comprehensively improved.
Owner:YUNNAN TUOMEI DECORATION ENGINEERING CO LTD