Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

26189 results about "Feature fusion" patented technology

Feature fusion is the process of combining two feature vectors to obtain a single feature vector, which is more discriminative than any of the input feature vectors.

Equipment anomaly detection method and system based on multi-source heterogeneous data

ActiveCN120145206AData streamFeature set
The invention discloses an equipment anomaly detection method and system based on multi-source heterogeneous data, and the method comprises the steps: obtaining a real-time multi-source monitoring data flow of production equipment in a smart park, carrying out the cross-modal data alignment processing of the real-time multi-source monitoring data flow, and generating a target monitoring data set, and executing a dynamic feature extraction operation in each edge computing node, generating a multi-dimensional equipment state feature set based on the target monitoring data set, inputting the multi-dimensional equipment state feature set into the trained anomaly detection integrated model, generating equipment anomaly probability distribution through a multi-level feature fusion strategy, and outputting the equipment anomaly probability distribution. Determining the abnormity type and abnormity confidence of the target equipment according to the equipment abnormity probability distribution, generating an equipment maintenance instruction set based on the abnormity type and the abnormity confidence, and sending the equipment maintenance instruction set to an equipment management terminal of the smart park to trigger abnormity processing operation; therefore, the automation degree and decision reliability of the equipment maintenance response of the smart park are improved.
Owner:GUIZHOU UNIVERSITY OF FINANCE AND ECONOMICS +1

Multi-machine collaborative industrial robot intelligent scheduling system and application method

The invention relates to the technical field of industrial automation control, and discloses a multi-machine collaborative industrial robot intelligent scheduling system and an application method.The system comprises a data acquisition module for acquiring real-time motion data through a multi-modal sensor; the feature fusion module is used for generating environment dynamic feature data based on graph neural network fusion data; the strategy generation module is used for generating collaborative strategy parameters by utilizing a collaborative reinforcement learning model; the trajectory optimization module is used for constructing a multi-target trajectory optimization model to plan an optimal synchronous trajectory; the motion control module is used for establishing a layered motion control model to realize cooperative motion control; a dynamic resource allocation module can also be included to optimize resource allocation. The application method sequentially executes corresponding steps according to the modules of the system. According to the method, the environment can be accurately sensed, the cooperation strategy can be optimized, the efficient track can be planned, accurate motion control and reasonable resource allocation can be realized, and the cooperative motion control capability and the production efficiency of the industrial robot in the complex environment can be effectively improved.
Owner:SHANGHAI WANTULIN ROBOT TECH CO LTD

Task planning system and method for intelligent robot with body based on multi-dimensional situation awareness

The invention discloses a system and a method for task planning of an intelligent robot with a body based on multi-dimensional situation awareness, and particularly relates to the technical field of task planning of the intelligent robot with the body, space-time alignment is carried out on asynchronous heterogeneous data generated by a multi-modal sensor channel, and cross-modal space-time features are extracted through a cross-modal feature fusion network; a fusion situation matrix is generated, dynamic causal modeling is used to update association strength among the multi-modal data, an anti-factual reasoning engine is used to identify and trace abnormities, and an abnormities traceability result is output; dynamically adjusting the reliability weight of each sensing channel through a multi-modal credibility evaluation model by using the fusion situation matrix and an abnormal traceability result; and on the basis of the reliability weight, inputting the fusion situation matrix into a real robot dynamic model and a digital twin virtual model, executing collaborative predictive control, and starting an adaptive rule evolution mechanism when a safety score is lower than a threshold value, thereby solving the problem of fusion matrix distortion in dynamic obstacle avoidance and precise grabbing tasks.
Owner:ZHIMOU (ZHEJIANG) TECHNOLOGY DEVELOPMENT CO LTD

Construction site safety risk intelligent assessment method and system

The invention discloses a construction site safety risk intelligent assessment method and system, and belongs to the technical field of engineering supervision. The method comprises the following steps: S100, collecting multi-source data including an equipment state, an image video, a personnel state, an equipment distance, an environment parameter and an engineering text in real time; s200, performing space-time alignment, preprocessing and cross-modal feature fusion on the multi-source data; s300, outputting a risk score and a risk level label based on the dynamic risk knowledge graph and a multi-model fusion algorithm; s400, generating a hierarchical disposal strategy according to the risk scoring hierarchy, and realizing risk closed-loop management and control through rectification verification and cooperation of multiple parties; and S500, outputting a three-dimensional visual risk distribution map and a compliance report. Through technologies of multi-source data fusion, dynamic risk mapping knowledge, intelligent closed-loop management and the like, comprehensive perception, accurate evaluation, efficient management and control and compliance landing of engineering supervision safety risks are realized, the occurrence rate of safety accidents is remarkably reduced, and reliable technical support is provided for intelligent construction site construction.
Owner:HENAN XIAO KELP DATA TECH CO LTD +1

Complex device fault diagnosis method and system based on multi-dimensional features

Disclosed are a complex device fault diagnosis method and system based on multi-dimensional features, and the method comprises the following steps of: acquiring fault data of a target complex device, and carrying out input coding mapping and position coding; utilizing a multi-head attention mechanism and multi-head dilated convolution series connection, and acquiring fault features covering global and local deep information in combination with a feedforward neural network; fusing the extracted fault features to acquire a multi-dimensional feature vector; and acquiring a fault type probability score matrix by a classifier, and outputting a fault diagnosis result of the target complex device. The global modeling advantage of multi-head self-attention and the local multi-scale feature perception advantage of multi-head dilated convolution are fused, and a device fault diagnosis model in which a Transform model and the multi-head dilated convolution are mutually fused is established.
Owner:GUANGDONG UNIV OF TECH

Camera linkage alarm method and system for intelligent environment monitoring

The invention relates to the technical field of camera linkage alarm, and discloses a camera linkage alarm method and system for intelligent environment monitoring, and the method comprises the steps: synchronously collecting the video stream data of a plurality of cameras and the multi-parameter monitoring data of an environment sensor; executing multi-path feature analysis and cross-modal feature fusion to obtain environment-vision joint features; environment scene self-adaptive classification is executed, and environment-vision joint features are analyzed through an anomaly judgment model to obtain an abnormal event judgment result; executing multi-camera collaborative verification and vision-environment data association analysis to obtain multi-dimensional abnormal event description information; and selecting a multi-camera linkage response strategy and coordinating the plurality of cameras to carry out three-dimensional monitoring on the abnormal area to obtain a linkage response execution result, so that a false alarm mode can be identified and an abnormal judgment rule can be dynamically adjusted, continuous optimization of the performance of the plurality of cameras is realized, and the false alarm rate and the missing report rate of the plurality of cameras in long-term operation are reduced.
Owner:SHENZHEN NEW SAIBO TECHNOLOGY CO LTD

Power equipment fault cross-domain collaborative analysis system and method

The invention discloses a power equipment fault cross-domain collaborative analysis system and method, and relates to the technical field of power grid dispatching, and the method comprises the steps: obtaining preprocessed multi-source heterogeneous data of power equipment, constructing a cross-domain knowledge graph based on the topological relation of the preprocessed data and historical fault data, and marking a fault propagation path. And a graph neural network is adopted to carry out embedded representation. Designing a space-time multi-branch network, respectively extracting space, time sequence and modal interaction features by using the space-time multi-branch network, and performing fusion in a feature fusion layer to obtain fusion features and branch weights; according to the method, mapping knowledge domain embedded representation is combined, a collaborative reasoning model is constructed by utilizing a Bayesian network, reasoning decision is performed on fusion features, finally, a cross-domain collaborative analysis result of the power equipment fault is obtained, and fusion and efficient reasoning of multi-source heterogeneous data are realized through combination of the mapping knowledge domain and a space-time multi-branch network. And the accuracy and efficiency of fault diagnosis are improved.
Owner:GUANGZHOU ZONGNENG TECHNOLOGY CO LTD

Industrial robot walking control system based on obstacle recognition

The invention relates to the technical field of industrial robots, in particular to an industrial robot walking control system based on obstacle recognition. Comprising an environment sensing unit; the obstacle analysis and decision-making unit is used for processing the multi-dimensional data output by the environment sensing unit based on a deep reinforcement learning framework, accurately identifying static obstacle and dynamic obstacle types, motion trails and interaction influences, constructing a two-dimensional decision-making model of static obstacle avoidance and dynamic obstacle avoidance, and carrying out obstacle avoidance and obstacle avoidance on the basis of the two-dimensional decision-making model. A differential obstacle avoidance strategy is triggered; the path planning unit is based on a dynamic game path algorithm under space-time constraint; and an instruction transceiving unit. Through the multi-modal fusion sensing technology and the adaptive parameter adjustment module, space-time alignment and feature fusion of multi-source data such as three-dimensional point cloud, texture features and vibration spectrum are realized, a high-dimensional environment state model is constructed, and the problem of insufficient data fusion depth in the prior art is effectively solved.
Owner:JIANGSU ZHENG MAO MFG CO LTD

Multi-modal fusion AGV dynamic path planning and cluster scheduling system

The invention discloses a multi-modal fusion AGV dynamic path planning and cluster scheduling system, and relates to the technical field of multi-modal perception and data fusion, and the system comprises a multi-modal perception module which generates a dynamic obstacle confidence map through multi-source data fusion in combination with a hardware-level time synchronization and Transform feature fusion network; the dynamic path planning module adopts an improved rolling window algorithm, integrates an LSTM space-time conflict prediction model and an adaptive weight cost function, and realizes dynamic obstacle trajectory prediction and non-oscillation global path generation; the cluster scheduling control module is used for optimizing multi-AGV task allocation and conflict resolution in combination with a dynamic priority preemption mechanism and digital twinborn simulation rehearsal based on a distributed contract network protocol of edge computing; and the data conflict resolution module is used for triggering a multi-modal re-calibration process through confidence weighting and sliding window time sequence verification. According to the system, in logistics storage and intelligent manufacturing scenes, the dynamic obstacle avoidance success rate and the robustness and operation efficiency of an AGV cluster are improved.
Owner:EAST CHINA JIAOTONG UNIVERSITY

Thermal power equipment real-time monitoring method and system based on edge calculation

The invention provides a thermal power equipment real-time monitoring method and system based on edge computing, and relates to the technical field of thermal power equipment real-time monitoring, and the method comprises the steps: deploying an edge computing node array to collect multi-source heterogeneous data of thermal power equipment, and carrying out the preprocessing through data screening, multi-scale adaptive filtering and wavelet packet decomposition, a conditional variation auto-encoder is used to extract features, a hierarchical attention mechanism and a deep feature fusion network are combined to generate mixed feature representation, refined distribution estimation and abnormal mode recognition are performed on equipment states, cooperative monitoring modeling is performed based on a multi-scale spatial-temporal feature fusion network and a hierarchical depth deterministic policy gradient network, and a multi-scale spatial-temporal feature fusion network is established. The real-time monitoring accuracy and efficiency of the thermal power equipment can be effectively improved, the equipment failure rate is reduced, and safe and stable operation of a thermal power plant is guaranteed.
Owner:GUODIAN KARAMAY POWER GENERATION CO LTD

Glass lens surface scratch detection method and system

The invention discloses a glass lens surface scratch detection method and system, relates to the technical field of precision optical detection, and aims to solve the problems of scratch false detection, leak detection and poor algorithm adaptability caused by interference fringes, noise coupling and poor form adaptability in a high-reflection / complex coating process scene in the prior art. According to the scheme, an orthogonal polarization state composite light field is generated based on a multi-angle polarization light source array and a near-infrared compensation light source, and candidate regions are extracted through dynamic threshold segmentation and a direction gradient tensor matrix; gaussian pyramid multi-scale feature fusion and refraction angle consistency verification are utilized to eliminate artifact interference; constructing a direction constraint convolution kernel group to decompose scratches and background textures, and dynamically allocating computing resources in combination with a cascade network; feeding back closed-loop calibration light source wavelength and convolution kernel parameters in real time through coating parameters; according to the method, the precision and robustness of high-reflectivity surface scratch detection are remarkably improved, and meanwhile, the requirements for high-resolution image processing and real-time performance in a high-speed production line are balanced.
Owner:NANYANG CITY JINGLIANG OPTICAL TECH CO LTD

Knowledge graph construction method and system based on large language model technology

The invention relates to the technical field of knowledge graph construction, and discloses a knowledge graph construction method and system based on a large language model technology. The method comprises the following steps: receiving a multi-source heterogeneous data stream, and completing semantic space mapping and cross-modal feature fusion to generate a unified semantic representation vector set; constructing an initial knowledge graph skeleton; performing incremental optimization on the skeleton, and performing entity relationship disambiguation and conflict detection; and iteratively updating the knowledge representation, and outputting a target knowledge graph meeting semantic consistency. The system comprises a data receiving module, a semantic fusion module, a skeleton construction module, an optimization module and a knowledge updating module. According to the method, multi-source heterogeneous data is effectively processed, the accuracy, the dynamic updating capability and the semantic consistency of the knowledge graph are improved, and the method has wide application prospects in the fields of intelligent question answering, information retrieval and the like.
Owner:NAVAL AVIATION UNIV

Automatic test script dynamic generation method and system based on multi-modal AI identification

The invention relates to the technical field of computers, provides an automatic test script dynamic generation method and system based on multi-modal AI recognition, and is used for remarkably improving the coverage dimension and execution robustness of test cases while reducing the manual maintenance cost. The method comprises the following steps: acquiring target test interface data, extracting dynamic interaction characteristics in the test interface data, calling a trained target detection network to carry out element positioning processing on the test interface data, generating an interface element coordinate set, and generating a target test interface based on the interface element coordinate set. Calling a character recognition network to carry out multi-modal feature analysis on the interface element distribution information, and generating a feature fusion result containing character semantic features and icon classification features; the feature fusion result is input into a script generation model for dynamic path planning processing, automatic test script elements are output, and the automatic test script elements comprise logic control instructions generated based on the element operation sequence and coordinate self-correction parameters.
Owner:CHINA RONGXIN CLOUD TECH CO LTD

Cross-modal retrieval method for semantic and vector fusion in data space

The invention provides a cross-modal retrieval method for semantic and vector fusion in a data space, which belongs to the field of cross-modal information retrieval, and comprises the following steps: firstly, collecting and preprocessing multi-modal data; generating modal embedding and storing by utilizing the pre-training model; a shared semantic space is constructed, cross-modal vector alignment is optimized through comparative learning, and a modal mapping network is designed to enhance the embedding projection effect; storing the aligned embedding by using a Milvus database, and constructing an HNSW index; user text or image query is processed, text query analyzes limiting conditions to generate enhanced embedding, and image query extracts characters through OCR and fuses the characters with image features to generate embedding; in a database, through condition screening and semantic similarity calculation, a Top-K candidate item is retrieved; performing multi-modal correlation sorting on the candidate results and returning the results; according to the method, the shared semantic space is constructed, the alignment effect of different modal embedding is optimized, efficient storage and index management of multi-modal embedding are carried out, and real-time retrieval of large-scale cross-modal data is achieved.
Owner:HARBIN ENG UNIV

PCFarm resource scheduling method and system based on dynamic load prediction

The invention discloses a PCFarm resource scheduling method and system based on dynamic load prediction, and relates to the technical field of resource scheduling, and the method comprises the steps: constructing a feature extractor based on multi-modal feature fusion, mapping original data into a high-dimensional feature vector, and obtaining a dependency relationship between tasks; modeling a cluster topology, predicting a load propagation effect between nodes, constructing a spatio-temporal joint prediction framework, and fusing a time sequence and spatial topology information; proposing a multi-objective optimization function; training a scheduling strategy generator, and generating an optimal scheduling scheme based on the current cluster state; designing the elastic expansion and contraction of the prediction drive; constructing a migration cost model, and quantifying the influence of task migration on the performance; the overall load balance degree of the cluster is calculated through the global controller, and a coarse-grained migration instruction is generated. By arranging the load prediction module and the resource scheduling module, resource allocation is dynamically adjusted according to the real-time state and task requirements of the cluster, and a better resource scheduling effect is achieved.
Owner:SHENZHEN ZHIAO TECH CO LTD

Hydraulic engineering dam safety monitoring and early warning method and system

The invention relates to the technical field of hydraulic engineering safety monitoring, and particularly discloses a hydraulic engineering dam safety monitoring and early warning method and system, which realize comprehensive perception and accurate early warning of the health state of a dam structure through a composite sensing technology and an intelligent analysis algorithm. A micro-mechanical resonance sensor and a distributed optical fiber sensor are cooperatively deployed, and an interface and structure integrated three-dimensional monitoring network is constructed; a three-dimensional interface stripping characteristic spectrum is constructed based on a time-frequency conjoint analysis technology, and the bonding degradation state between the sensor and the dam body is accurately identified; a strain field anomaly distribution matrix is established through spatial correlation modeling, precise positioning of internal damage is realized, a dual-channel feature fusion network and a deep neural network evaluator based on an attention mechanism are designed, and multi-dimensional correlation analysis is performed on an interface state and structural damage features; and finally, realizing progressive response from data verification and multi-source verification to emergency linkage through a three-level linkage early warning decision tree.
Owner:JIANGXI ACAD OF WATER RESOURCES (JIANGXI PROVINCE DAM SAFETY MANAGEMENT CENT JIANGXI PROVINCE WATER RESOURCES MANAGEMENT CENT)

Industrial robot autonomous collaborative decision-making method and system based on multi-modal perception and medium

The invention provides an industrial robot autonomous collaborative decision-making method and system based on multi-modal sensing and a medium, and belongs to the technical field of industrial robot intelligent control. The method comprises the steps of performing cross-modal space-time alignment to eliminate data space-time differences by collecting visual, tactile and auditory information, realizing multi-modal feature fusion in combination with a dynamic weight adjustment mechanism and an attention calculation model, and generating a joint decision strategy through a deep learning optimization model. The system dynamically allocates sensor weights according to task types, introduces a multi-objective optimization mechanism of energy consumption, precision and safety, and sets a fault-tolerant rule to automatically recover the weights or recalibrate the sensors. According to the method, the problems of rigid data fusion and single optimization dimension in traditional multi-modal decision making are solved, and the precision, the response speed and the environmental adaptability of collaborative operation of the industrial robot are remarkably improved.
Owner:SHENZHEN HUAZHONG NUMERICAL CONTROL

Steam turbine vibration fault diagnosis system fused with deep learning

The invention relates to the field of power equipment data processing, in particular to a steam turbine vibration fault diagnosis system fused with deep learning. Comprising a dynamic knowledge base construction module, a working condition adaptive data synchronization module, a knowledge-guided heterogeneous feature fusion module, a dynamic structure neural network module, an online self-optimization weight distribution module and a knowledge-enhanced coupling fault reasoning module. The dynamic knowledge base construction module updates the multi-modal knowledge graph through an incremental knowledge distillation mechanism, and generates an interpolation strategy template and a frequency band sensitivity matrix; the working condition self-adaptive data synchronization module dynamically calls an interpolation algorithm based on a rotating speed fluctuation mode to realize time sequence alignment optimization of multi-source sensor data; the system effectively solves the problems of time scale asynchronism and feature heterogeneity in multi-source heterogeneous data fusion through a knowledge-driven and data-driven closed-loop interaction mechanism, and realizes accurate diagnosis and early warning of steam turbine vibration faults under complex working conditions.
Owner:HUANENG XINDIAN POWER GENERATION CO LTD

Interpretable deep feature fusion network-based industrial intelligent predictive maintenance method

PCT designated stageWO2026021130A1Biological modelsEngineeringPredictive maintenance
The present invention relates to the field of industrial intelligent predictive maintenance, and in particular to an interpretable deep feature fusion network-based industrial intelligent predictive maintenance method, comprising: acquiring gearbox vibration data comprising noise; performing preliminary extraction and noise suppression on features of the acquired data by establishing an interpretable feature extraction module having a physical information constraint; integrating multi-scale features comprising long-distance and local dependencies by means of a dual-branch feature fusion module having global and local feature fusion capabilities; performing dimensionality reduction on a high-dimensional feature and generating an output by means of a classifier to obtain a final fault identification result; and performing interpretability analysis on a diagnosis process of a model. In the present invention, by embedding the signal processing technology having a well-defined physical theory support into a deep neural network, the interpretability and reliability of model inference results are effectively improved while the fault identification accuracy of the model is improved.
Owner:INST OF IND INTERNET CHONGQING UNIV OF POSTS & TELECOMM

Chicken flock state inspection monitoring system and method

The invention relates to the technical field of poultry breeding monitoring, and discloses a chicken flock state inspection monitoring system and method. The method comprises the following steps: firstly, collecting chicken flock visual images, sound signals, environment temperature and humidity and individual activity track data, and constructing a multi-modal data set through labeling and preprocessing; different modal data features are extracted and fused; training a self-supervised contrast learning model to generate a discrimination model, and optimizing hyper-parameters in combination with a genetic algorithm; collecting data in real time, calculating a health state probability, generating an abnormal score, and dynamically updating an early warning threshold value; and if the abnormal score exceeds a threshold value, grading early warning and abnormal positioning are carried out. The system comprises a data acquisition and preprocessing module, a feature extraction module, a feature fusion module and the like. According to the method, the health of the chicken flocks is accurately monitored by using multi-modal data, dynamic early warning and model adaptive optimization are realized, the breeding benefits are improved, and the disease risk is reduced.
Owner:CP EGG IND (SHANDONG) CO LTD

Reconstruction method of three-dimensional reconstruction model based on two-dimensional Gaussian splashing

The invention provides a reconstruction method of a three-dimensional reconstruction model based on two-dimensional Gaussian splashing, which comprises the following steps: S1, carrying out sparse reconstruction on an input image sequence through a multi-view stereoscopic vision algorithm to generate an initial sparse three-dimensional point cloud and a corresponding camera pose parameter; s2, inputting an improved two-dimensional Gaussian radiation field by using the sparse three-dimensional point cloud and the camera pose as information; s3, dynamically screening a visible anchor point subset based on the current view angle parameter, and generating a rendered image through a differentiable rendering pipeline; s4, calculating a loss function of the rendering image of the training track and the input image to optimize a reconstruction scene; and S5, starting a special visualization tool, and inputting a rendering result. According to the method, by introducing a trimmable anchor point parameterization framework and a multi-scale feature fusion mechanism, light-weight and high-precision three-dimensional scene modeling is achieved, and the problems that traditional 2D Gaussian sputtering is insufficient in multi-view geometric consistency, storage overhead and weak texture region reconstruction and an existing 2D Gaussian splashing method is insufficient in self-adaptive mechanism are solved.
Owner:GUANGDONG BOHUA UHD INNOVATION CENT CO LTD

Resistor disc defect online detection system and grading method based on machine vision

The invention discloses a machine vision-based resistor disc defect online detection system and a grading method, relates to the technical field of industrial machine vision detection, and solves the defect problems in the aspects of multi-scale defect dynamic perception, cross-level feature interaction and process adaptive optimization in the prior art. According to the scheme, metal reflection interference is inhibited through Retinex illumination correction and a combined denoising model; adopting a deformable convolution kernel and cavity space pyramid pooling to realize gradient entropy driving dynamic sensing of the multi-scale defect; constructing a bidirectional cross-layer attention network to realize early fusion of high-resolution details and high-level semantics; modeling local-global feature physical association based on a graph attention network and a self-supervised message passing mechanism; integrating reinforcement learning and a memristor random calculation unit to form a closed-loop parameter optimization system; according to the method, the multi-scale defect detection precision, the cross-modal feature fusion efficiency and the system adaptive capacity under complex working conditions are remarkably improved.
Owner:NANYANG GOLDEN CROWN IND CO LTD

Intelligent anomaly recognition and intervention processing method, device and equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses an intelligent anomaly recognition and intervention processing method, device, equipment and medium. The method comprises the following steps: carrying out feature fusion by using a gating fusion network and generating a preliminary abnormal score, determining a reconstruction error through an auto-encoder and triggering abnormal early warning, calculating a causal effect value of key features in combination with a causal graph model and anti-factual reasoning, and calibrating the abnormal score to generate a final abnormal score and an intervention instruction. And executing an intervention action and recording a result. According to the method, the multi-dimensional feature information and the causal reasoning mechanism are fused, the self-encoder reconstruction error is combined to carry out anomaly judgment, the intervention instruction is generated and executed, closed-loop control of anomaly detection, reasoning analysis and intervention execution is achieved, and the recognition accuracy of complex events and the system response capacity are improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Multi-source heterogeneous corpus fusion method and system based on government affair service data

The invention provides a multi-source heterogeneous corpus fusion method and system based on government affair service data, and the method comprises the steps: obtaining an original corpus set of a plurality of data sources in government affair service, carrying out the cross-modal semantic alignment processing of each corpus unit in the original corpus set, generating a normalized data block corresponding to each corpus unit, and carrying out the fusion of the data blocks; carrying out multi-modal semantic coding on the standardized data blocks to obtain semantic feature vectors of all corpus units, carrying out topological structure coding on association attribute sets among the standardized data blocks to generate a global structure relation graph, and carrying out dynamic weight distribution on the semantic feature vectors based on node connection weights in the global structure relation graph to obtain semantic feature vectors of all corpus units; and generating a fusion weight matrix, performing cross-modal feature fusion on the semantic feature vector to obtain a target semantic embedding representation, and generating a standardized corpus associated with the government affair service. According to the method, the semantic aggregation problem of the non-uniformly distributed corpus units is solved, and the government affair data governance efficiency and the cross-department cooperation capability are greatly improved.
Owner:GUANGDONG YIQI DATA IND CO LTD

Abnormal short message behavior detection method and system based on multi-dimensional feature fusion

The invention discloses an abnormal short message behavior detection method and system based on multi-dimensional feature fusion, and relates to the related technical field of short message security detection.The method comprises the steps that spatial and temporal distribution features, semantic association maps and equipment behavior fingerprints of short message interaction are collected, a dynamic feature pool is configured, and a cross-modal feature sequence is extracted; cascade identification is carried out; the feature fusion weight matrix is dynamically adjusted, an abnormal probability score is generated, and when the abnormal probability score exceeds a dynamic abnormal probability threshold, a multi-stage verification mechanism is triggered; and matching a time sequence mode at an edge computing node, dynamically generating a verification code triggering threshold value, performing interactive risk verification, and determining an abnormal short message behavior mark. The technical problems of insufficient detection timeliness and adaptability and high false alarm and missing report rate caused by single detection dimension and difficulty in identifying novel complex abnormal short message behaviors in the prior art are solved, and the technical effects of reducing the false alarm and missing report rate of short message anomaly detection and improving the detection timeliness and adaptability are achieved.
Owner:SHENZHEN YINGJIETONG INFORMATION TECHNOLOGY CO LTD

Intelligent multi-mode virtual digital human interaction system based on AI language large model, interaction method and application

The invention discloses an intelligent multi-modal virtual digital human interaction system based on an AI language large model. The system comprises a high-authenticity face generation module; the high-authenticity face generation module uses an AdaAN network, based on adaptive feature fusion and voice driving and time sequence modeling of voice features, feature information related to voice is extracted, the extracted voice features are processed through a deep neural network, it is ensured that the voice and facial expressions are highly aligned in time and space, and the face recognition accuracy is improved. Collecting a bio-electricity signal, mapping the signal to facial muscle movement, generating a final facial expression, and interacting with a user; the system further comprises an intelligent interaction module, a training optimization and efficient generation module, an efficient integration module, a multi-modal data acquisition module, an AI large model core processing module, a digital human image generation and driving module, an interaction scene adaptation module and a feedback optimization module. The invention further discloses a multi-mode digital human interaction method which has wide application value.
Owner:EAST CHINA NORMAL UNIV

Self-adaptive software vulnerability repairing system based on deep learning

ActiveCN120086865APlatform integrity maintainanceNeural learning methodsSelf adaptive softwareSyntax
The invention discloses a self-adaptive software vulnerability repair system based on deep learning. The self-adaptive software vulnerability repair system comprises a multi-modal feature fusion engine, a spatio-temporal joint modeling module, a vulnerability repair strategy generator and a cross-language representation model. The multi-modal feature fusion engine generates a mixed feature vector of a code, inputs the mixed feature vector into the spatio-temporal joint modeling module, captures code structure and time sequence dependence, and identifies risk features; the vulnerability repair strategy generator generates a repair scheme based on the risk features and optimizes the repair scheme through static verification; and the cross-language representation module performs feedback training by using the newly added sample and outputs a final detection result and a repair scheme. According to the method, the vulnerability trigger points can be accurately positioned, all the associated code snippets are extracted, a solid foundation is provided for subsequent vulnerability analysis, and the repaired codes conform to grammatical rules and keep original semantic consistency.
Owner:ANHUI PERCEPTION FUTURE ELECTRONIC TECH CO LTD

Small-size vehicle detection deep learning model based on feature fusion of multi-scale modules

A small-size vehicle detection deep learning model based on feature fusion of multi-scale modules is provided, which solves the problem of small-size vehicle image detection. The model includes a Backbone network, a Neck layer and a Head network, wherein a C2f_DCNv3 module based on the combination of deformable convolution v3 (DCNv3) and a cross stage feature fusion (C2f) module and an SPPF_LSKA module based on the combination of a spatial pyramid pooling fast (SPPF) layer and a large separable kernel attention (LSKA) module are introduced into the Backbone network; a C2f_SCConv module based on the combination of spatial and channel reconstruction convolution (SCConv) and a C2f module is introduced into the Neck layer; and a multi-scale kernel detection (MSK_Detect) module is introduced into the Head network.
Owner:NANHU LAB

Network traffic anomaly detection model training method and device and readable storage medium

The invention provides a network traffic anomaly detection model training method and device and a readable storage medium, and the method comprises the steps: extracting a traffic statistical feature vector according to original network traffic data, and generating an initial mixed data set; generating a confrontation disturbance sample output enhanced feature matrix based on the initial mixed data set; constructing a self-adaptive feature fusion rule based on the enhanced feature matrix, embedding asset association degree parameters into an attention calculation layer of a feature encoder, and outputting encoding features fusing threat intelligence; inputting the coding features fused with the threat intelligence into a pre-constructed initial detection model, generating false report and missing report correction labels based on the suspicious traffic fragments, and outputting an adversarial sample correction data set; and performing adversarial training on the initial detection model through the adversarial sample correction data set to obtain an incremental detection model for network traffic anomaly detection. According to the invention, the detection precision, the anti-interference capability and the real-time defense response capability of the detection model to novel attacks can be improved.
Owner:CHINA UNITED NETWORK COMM GRP CO LTD