90 results about "Canonical correlation" patented technology

The invention provides an access control system based on face recognition and a recognition method, and the system comprises a multi-modal image collection subsystem which integrates a visible light camera, a depth camera and an infrared thermal imaging camera and is used for synchronously collecting a visible light image, a depth image and an infrared thermal imaging image of a face; the image preprocessing unit is used for carrying out corresponding preprocessing on the image; the feature extraction network module is used for extracting image features; the multi-modal feature fusion and alignment module is used for calculating a mutual information matrix by adopting a feature fusion strategy based on mutual information maximization and adaptive weighting, determining an adaptive weight and performing weighted summation, and performing feature alignment by applying a method based on canonical correlation analysis; and the face recognition classification and verification module verifies the image by adopting a multi-level fusion strategy. According to the method, the false recognition rate and the rejection rate are effectively reduced, the strong anti-cheating capability is achieved, and cheating attacks of various fake face means can be accurately recognized and resisted.

Systems, methods, and software can be used to determine risks of software files. In some aspects, a method includes: obtaining an input, wherein the input comprises a binary file; determining a second set of feature vectors of the input; performing a canonical correlation analysis (CCA) on the second set of feature vectors and a first set of feature vectors to obtain a first vector and a second vector; calculating a correlation coefficient value of the first vector and the second vector; obtaining a third set of feature vectors based on the correlation coefficient value; and providing, based on the third set of feature vectors, information indicating a level of a security risk of the input and information indicating features associated with the security risk of the input.

The invention relates to a power construction deviation degree diagnosis method based on multi-modal time series data fusion, and the method comprises the steps: collecting voltage, current and frequency data through a multi-channel synchronous sampling technology, filling missing data through cubic spline interpolation, and constructing an initial data matrix; based on a hierarchical feature extraction technology, mapping the voltage frequency domain features and the current time domain statistical features to a unified feature space through canonical correlation analysis, and generating a multi-modal feature vector with a time sequence tag in combination with a sliding window; analyzing the dynamic trend of the electrical variable under multiple time scales by adopting a long short-term memory network, and capturing a key time point through an attention mechanism; a sudden change point and a stationary section are defined, an isolated forest algorithm is combined to detect an abnormal point location deviating from a trajectory, anomaly is classified as transient disturbance or continuous deviation through a multi-layer perceptron, the evolution trend of regional continuous deviation is predicted, and the key problem of the power deviation degree diagnosis capability is improved.

The invention relates to the technical field of wireless communication, and discloses an information source number detection method and system based on a non-circular signal. The method comprises the following steps: calculating a compensation sample covariance matrix of a received signal, and obtaining a sample canonical correlation coefficient through Takagi decomposition of the compensation sample covariance matrix; constructing a marginal likelihood function of the maternal typical correlation coefficient; taking a sample canonical correlation coefficient as an estimated value of a corresponding matrix, and establishing an estimated statistic by applying a minimum description length criterion; and obtaining the number of the parent typical correlation coefficients when the estimation statistic is minimized, and taking the number as an estimation value of the actual number of the non-circular signals. According to the method, the characteristic that the non-circular signal compensation covariance is not zero is fully utilized, the marginal likelihood function with the minimum redundancy parameters is adopted to construct the statistics, high-precision estimation of the number of the non-circular signals can be achieved, and necessary guarantee is provided for practical application scenes such as direction of arrival estimation and wave velocity formation.

A method for robust identification of a vehicle occupant. Simultaneously acquired data pairs from interior sensors and sensing elements are used as a training data set for global learning of a Deep Canonical Correlation Analysis architecture with two neural networks, wherein an authentication of the respective vehicle occupants from the group of vehicle users is carried out in a first step as an initialization. In a second step or a subsequent use, only one of the two sensing elements is then needed to identify the respective vehicle occupant. Also described is a system, via which the robust identification is provided by way of the method.

The invention provides a construction method of a macular degeneration classification system and the macular degeneration classification system, and the method comprises the steps: carrying out the same AMD degeneration label pairing of an obtained multi-modal image through employing a loose pairing technology, and expanding a multi-modal AMD image data set; performing feature extraction on the OCT-CFP training sample pair by using a feature extraction module fused with a low-rank adaptive technology to obtain a multi-modal feature vector; based on a deep canonical correlation analysis module of the neural network, correlation maximization of the multi-modal features in the shared space is realized; fusing the multi-modal features based on a feature fusion module, outputting target fusion features for classifier training, and training to obtain a target classifier with a minimum loss function; and integrating a loose pairing technology, a feature extraction module, a deep canonical correlation analysis module, a feature fusion module and a target classifier to obtain the macular degeneration classification system. According to the invention, computing resources are saved, and the denaturation classification efficiency and accuracy are greatly improved.

The invention relates to the technical field of marine ecological informatics, and discloses a habitat suitability prediction method and system for marine ecological management.The habitat suitability prediction method for marine ecological management.The habitat suitability prediction method for marine ecological management.The habitat suitability prediction method for marine ecological managementincludes the steps that traditional knowledge data of fishermen is obtained, and audio data is transcribed into a text format through a natural language processing technology; generating a traditional knowledge graph containing the corresponding relationship between the observation characteristics and the fishing results; carrying out canonical correlation analysis on surface observation characteristics and vortex physical parameters in the traditional knowledge graph, and converting traditional knowledge into quantitative expression of a vortex parameter space based on a mapping matrix; and adopting a random forest to integrate multi-source prediction results, taking a traditional knowledge prediction rule and a physical model calculation result as input features, and outputting a middle-layer fish habitat probability distribution diagram. The technical problem that traditional knowledge and a vortex physical model are difficult to effectively integrate for middle-layer fish habitat prediction is solved.

The invention discloses a financial market emotional fluctuation early warning system, and relates to the field of security, according to the scheme, modal features of three texts, voices and social public opinions are input into a multi-layer perceptron to calculate modal weights, and canonical correlation analysis alignment is adopted after weighted fusion, so that high-quality fused emotional features of a unified measurement space are realized. A weighted directed investor relation network is constructed through interaction frequency and Pearson correlation based on a fusion vector, a group emotion evolution mode is captured by applying sequence diagram convolution, a high-correlation emotion community is divided through modularity maximization iteration, community abnormal emotions are jointly detected by means of an auto-encoder and a first-class support vector machine, and an early warning signal is triggered. And finally, soft update adjustment is performed on an early warning threshold value by using a depth deterministic strategy gradient algorithm, so that the system has early response capability and low false alarm rate in a complex and changeable transaction environment, and reliable and accurate decision support is provided for market risk management and control.

The invention discloses an equipment health monitoring method based on multi-modal data fusion, and the method comprises the following steps: carrying out the preprocessing and feature extraction of collected multi-modal monitoring data, and constructing a cross-modal pairing feature sample; a deep canonical correlation analysis model is adopted to model correlativity among different monitoring data, and multi-modal features are mapped to a unified potential health representation space; and further combining with a hidden variable Gaussian process model, carrying out probability modeling and posterior inference on the potential health representation to obtain a continuous estimation result of the equipment health state changing along with time, and generating a health degradation track. The method is suitable for various equipment operation scenes with noise, missing or asynchronization of monitoring data.

The invention discloses a continuous dynamic emotion recognition method, system and device, a medium and a product, and relates to the field of emotion recognizing.The method comprises the steps that electroencephalogram signal data and eye movement signal data of a target subject are obtained; determining electroencephalogram features and eye movement features according to the electroencephalogram signal data and the eye movement signal data; based on a deep learning model, the electroencephalogram features and the eye movement features are fused to obtain multi-modal fusion features, and the continuous dynamic emotion category of the target subject is determined according to the multi-modal fusion features; the deep learning model comprises a cross-modal attention mechanism layer, a deep typicality correlation analysis layer, a convolutional neural network, a Transform network and a full connection layer. According to the invention, the accuracy and real-time performance of continuous dynamic emotion recognition are improved.

The invention discloses a multi-modal data processing method and system based on an attention mechanism, and relates to the technical field of deep learning, and the method comprises the steps: collecting a multi-modal data set, carrying out the multi-scale time sequence calibration through dynamic time warping, and obtaining a time sequence alignment data stream; performing cross-modal semantic association on the time sequence alignment data stream to form a multi-modal feature vector; performing sparse processing on the multi-modal feature vector by using a multi-head self-attention mechanism to generate potential sparse representation; and carrying out coarse graining analysis and fluctuation mode capture on the potential sparse representation, generating a feature sequence length and a variance descriptor, and carrying out spectral entropy calculation to obtain a data complexity score. According to the method, cross-modal semantic association is performed by using canonical correlation analysis, and meanwhile, differential processing is performed on samples with different complexities through the hierarchical adaptive processing model, so that dynamic matching of computing resources is realized, and the resource utilization rate of multi-modal data processing is remarkably improved.

The invention provides a multi-modal fusion obstructive sleep apnea (OSA) identification method based on deep canonical correlation analysis (DCCA). For multi-modal characteristics, a whole process from data preprocessing, feature extraction and screening to feature fusion and classification is designed. Firstly, AHI indexes, voice data and craniofacial image data of a subject are collected and preprocessed, and DeepSpectrum voice features and geometric morphology image features based on MediaPipe are extracted. Then, feature screening is carried out by adopting a competitive group optimizer (CSO) and a ReliefF algorithm respectively; for a class imbalance problem, an oversampling (AMDO) method based on an adaptive mahalanobis distance is introduced to balance data. Non-linear mapping and deep fusion are carried out on high-dimensional features of the two modals through DCCA, low-dimensional high-correlation features are generated, and information complementarity between the modals is improved. And finally, inputting the fused features into a classifier and evaluating the performance by using five-fold cross validation. According to the invention, effective fusion between modals is realized by using DCCA, and a new method is provided for early screening and auxiliary diagnosis of OSA.

The invention provides a brain network construction and analysis method based on multivariable analysis. The method is mainly used for multi-view analysis of a brain structure and a functional network. The technical problem to be solved is that information loss is caused by neglecting necessary multivariate relationships among brain region nodes when univariate analysis is carried out on a brain function network and a brain structure network. According to the method, the canonical correlation analysis method based on data driving is used for constructing the single-mode brain network, the problem that a traditional univariate analysis method neglects necessary multivariate relations is avoided, the complex relation between the brain structure and functions can be reflected more accurately, and a more reliable basis is provided for deep research of a brain working mechanism.

The invention discloses a space coding and decoding method for steady-state visual evoked potential, which realizes mapping and identification of a target and a space characteristic by combining a multi-frequency characteristic with a canonical correlation analysis method and utilizing a space coding characteristic of a stimulation target. By monitoring and analyzing SSVEP response distribution of surrounding targets, different central targets can be effectively distinguished, so that spatial coding is realized. In the decoding process, the target frequency corresponding to the most relevant frequency of the electroencephalogram signal is identified through the maximum correlation coefficient. Then, in combination with the frequency of the surrounding target, an inclusion index is calculated to further confirm the validity of the identification. And when the inclusion degree is greater than a set threshold value, considering that the current center target is identified as an effective center target. According to the method, the recognition precision can be improved, the electroencephalogram channel requirement is reduced, the information transmission rate and the real-time performance of the system are improved through the optimized space coding scheme, and the method is particularly suitable for low-delay and multi-target recognition brain-computer interaction tasks.

The invention relates to the technical field of mechanical engineering and automatic control, discloses a fault diagnosis method and system based on electro-hydraulic linkage, and aims to solve the problems that diagnosis models are mismatched, early weak faults are difficult to extract and fault root positioning is fuzzy due to electrical and hydraulic data modal isomerism and deep fault feature coupling in the prior art. The method comprises the following steps: synchronously acquiring electro-hydraulic multi-source signals; constructing an electro-hydraulic coupling dynamic state space model based on the health data; generating a multi-dimensional residual sequence through a Kalman filter; performing multi-scale wavelet time-frequency decomposition on the residual error and extracting features; analyzing and fusing cross-domain features by using standard correlation; and finally, realizing accurate fault identification through a support vector machine. The system comprises a synchronous acquisition module, a modeling module, a residual error generation module, a feature fusion module and a fault identification module. Through mechanism modeling and data driving fusion, the early fault sensitivity and the coupling fault distinction degree are remarkably improved.

The application relates to the field of alloy defect detection, and specifically discloses a praseodymium-neodymium alloy nondestructive detection method and system based on acoustic feature analysis, which comprehensively captures defect information contained in an original probe signal from two complementary physical perspectives of instantaneous dynamic characteristics and frequency band energy distribution by simultaneously adopting Hilbert-Huang transform and wavelet packet transform. Further, the scheme discards simple feature splicing, and instead utilizes canonical correlation analysis as an information decoupling tool to online decompose two groups of original feature vectors into a shared part describing defect commonality and unique information parts respectively representing the unique resolution capabilities of HHT and wavelet packet. Finally, the three decoupled components are structurally recombined to form a fusion feature vector which can effectively eliminate redundancy, amplify differences and has higher information density, thereby providing a clear structure and highly refined input for a subsequent classification model.

The invention relates to a point labeling remote sensing target directional detection method and device, and the method comprises the steps: obtaining a point labeling image, inputting the point labeling image into an improved ResNet50 model, and obtaining a class probability graph; the improved model comprises the following steps: sequentially connecting a cavity convolution layer, a canonical correlation analysis-based feature extraction network and a mixed channel attention mechanism to an output layer of a ResNet50 model to obtain a class probability graph; in the model training process, according to the original class probability graph, obtaining target height and width pseudo labels, adjusting a dynamic radius adjustment mechanism of a positive label distribution radius for the target pseudo labels, and performing positive and negative label distribution in combination with point labeling information; and carrying out dimension reduction on the class probability graph, distributing a weight to each data point after dimension reduction, constructing a covariance matrix, decomposing a characteristic value of the covariance matrix, determining width and height directions of the target according to a direction of a decomposition result, moving outwards along the width and height directions, obtaining a target boundary, and further generating a rotation frame.

This invention discloses a fire-fighting pipe fitting leakage risk early warning system based on big data analysis, comprising the following steps: collecting multi-dimensional time-series data such as pressure, flow rate, temperature, and humidity; constructing a data processing and modeling workflow; employing kernel canonical correlation analysis to extract nonlinear correlation features between different monitoring parameters to identify weak correlation changes before leakage; and constructing an anomaly measurement mechanism based on the maximum correlation entropy criterion to quantify the degree of feature shift. By fusing the above correlation features and entropy information, a dynamic risk index is generated and compared with a dynamic threshold to achieve real-time early warning of leakage risk, effectively supporting early fault detection and intelligent assessment of fire-fighting pipe fittings. This invention achieves dynamic perception and intelligent judgment of fire-fighting pipe fitting leakage risk, possessing data-driven early warning capabilities.

The invention relates to the field of computer vision, artificial intelligence and medical image analysis, in particular to a disease prediction method for supervising multi-omics tensor fusion, and the method comprises the steps: obtaining a tensor covariance among multi-omics data according to the processed multi-omics data, and defining a target function of tensor canonical correlation analysis; according to the tensor covariance and the target function, introducing structured sparse constraint and disease supervision information, and constructing a multi-modal image correlation analysis model based on tensor; solving the multi-modal image correlation analysis model by using an alternating iteration method to obtain a typical weight of each omics data; and predicting the disease according to the typical weight of each piece of omics data. According to the supervised multi-omics data fusion method based on the tensor, high-order related information can be effectively mined, the classification accuracy of chronic diseases is improved, and powerful technical support is provided for clinical diagnosis.

The invention discloses a multi-target control system for brain control interaction, which adopts non-invasive EEG (electroencephalogram) acquisition equipment, electroencephalogram signals are transmitted to a data processing computer in a wireless communication mode, and the computer processes the signals in real time and transmits control instructions to external equipment. And accurate selection and control of the target by the user are realized. The multi-target control device is constructed based on the SSVEP, efficient and accurate recognition of multiple targets is achieved through the non-invasive brain-computer interface technology, the limitation of a traditional remote control or manual input mode is overcome, and the naturalness and real-time performance of interaction are improved. According to the method, a training mode is not introduced, so that a user can quickly use the system without pre-training, the use threshold of a new user is reduced, and meanwhile, the accuracy of signal classification is improved and the stability and generalization ability of the system are ensured through optimized canonical correlation analysis (CCA) and multi-band CCA (FBCCA algorithms.

The application relates to a point labeling remote sensing target directional detection method and device, which comprises the following steps: acquiring a point labeling image, inputting the point labeling image into an improved ResNet50 model, and acquiring a class probability graph; the improved model comprises the following steps: connecting a hollow convolution layer, a feature extraction network based on canonical correlation analysis and a mixed channel attention mechanism in sequence at an output layer of the ResNet50 model to acquire the class probability graph; in the process of training the model, pseudo labels of the height and width of a target are acquired according to an original class probability graph, a dynamic radius adjustment mechanism of adjusting a positive label distribution radius is adjusted according to the target pseudo labels, and positive and negative label distribution is combined with point labeling information; the class probability graph is dimensionally reduced, each data point after the dimensional reduction is assigned a weight, a covariance matrix is constructed, eigenvalues of the covariance matrix are decomposed, the width and height directions of the target are determined according to the direction of the decomposition result, the target boundary is acquired by moving outward along the two directions, and a rotating frame is further generated.

This invention discloses a face recognition method based on semi-supervised dual-source face feature fusion, addressing the semi-supervised, multi-view, and cost-sensitive learning problems existing in real-world face recognition applications. The method includes: acquiring multiple face image data under preset dual views; inputting the face image data into a trained semi-supervised cost-sensitive canonical correlation analysis model; performing dual-source feature fusion using the cost-sensitive feature extraction matrix in the semi-supervised cost-sensitive canonical correlation analysis model to obtain the feature representation of the face image data; and classifying the face image data using a classification model based on the feature representation to obtain the face recognition result. This invention can obtain accurate and reliable face recognition results using only a small number of supervised dual-source face images, effectively improving the classification performance of the face recognition model.

The invention provides a personalized comprehensive old-age care service recommendation method and system based on artificial intelligence big data, and relates to the technical field of computer data processing and artificial intelligence. Travel data of a plurality of target users and browsing data of a community service APP are collected, the travel data comprise travel timestamps and in-out directions, and the travel timestamps and the in-out directions of the target users are acquired; the browsing data comprises a plurality of browsing records, browsing frequency and staying duration; constructing a behavior feature vector according to the record quantity of the travel data in the in-out direction in the preset time period, and constructing an interest feature vector according to the browsing data; respectively inputting the behavior feature vector and the interest feature vector into a neural network based on deep canonical correlation analysis to generate a fusion feature vector of each target user; dividing all the target users into a plurality of social groups based on the fused feature vectors; and based on the low-dimensional manifold space, the community activity information is sent to the edge node objects in the same social group, so that precise social recommendation for the solitary old people is realized.

Systems, methods, and software can be used to determine risks of software files. In some aspects, a method includes: obtaining an input, wherein the input comprises a binary file; determining a second set of feature vectors of the input; performing a canonical correlation analysis (CCA) on the second set of feature vectors and a first set of feature vectors to obtain a first vector and a second vector; calculating a correlation coefficient value of the first vector and the second vector; obtaining a third set of feature vectors based on the correlation coefficient value; and providing, based on the third set of feature vectors, information indicating a level of a security risk of the input and information indicating features associated with the security risk of the input.

The invention discloses a multi-modal network fusion analysis method based on a multi-layer network. The method comprises the following steps: 1, constructing a single-modal brain network based on canonical correlation analysis; 2, brain network structure-function coupling is extracted; and step 3, constructing and analyzing a high-order multi-mode brain network. The method has the advantages that the constructed high-order multi-mode brain network integrates brain structure and function information and structure-function coupling information, information loss caused by independent analysis of a structure network and a function network is overcome, multi-scale understanding of a brain mechanism and an abnormal mode is achieved, and a neural mechanism can be revealed more comprehensively; and 2, a core-peripheral tissue analysis method is introduced, the degeneration phenomenon of the core brain region of the brain is found from a multi-mode perspective, a new perspective is provided for analyzing the brain information processing process, and the understanding of the key brain region of the brain mechanism is further deepened.

To enable real-time seizure warnings, systems and methods of the present disclosure include a wearable sensor device in communication with processors that are configured to receive from the wearable sensor device data streams associated with a user that include biomarker data parameters. The processors utilize a seizure forecasting machine learning model that combines a deep canonical correlation analysis with a long short-term memory neural network to predict a seizure likelihood in a prediction period.

The present invention relates to the technical field of industrial process monitoring. More specifically, it relates to a distributed process monitoring method and device for collaborative modeling within and between blocks. This method includes: The offline modeling stage includes the following steps: decomposing the process data to obtain each sub-block; performing slow feature analysis method modeling within each sub-block; performing canonical correlation analysis modeling between sub-blocks; The online monitoring stage includes the following steps: partitioning the new sampled data; substituting the partitioned sampled data into the slow feature analysis method model within the sub-block and the canonical correlation analysis model between sub-blocks respectively to obtain the corresponding feature components; using Bayesian inference fusion to obtain a comprehensive index as the final monitoring statistic and comparing it with the corresponding control limit to detect the state of the current sub-block. The present invention can detect faults from different characteristic perspectives of the data, provide a preliminary range for fault location, so as to improve the detection performance of the process and the fault detection rate.

The application belongs to the field of social network analysis, and particularly relates to a dynamic social network alignment method based on longitudinal federation and canonical correlation analysis, comprising the following steps: simulating the spatio-temporal relationship of users through a dynamic spatio-temporal graph self-encoding memory model and an attention mechanism to obtain a user relationship matrix; constructing a user attribute matrix and fusing the user relationship matrix to obtain a user matrix; inputting the user feature matrices of platforms X and Y into a model for training through a training model based on federated learning to obtain a prediction result of cross-domain user alignment; and updating and modeling the dynamic relationship representation in combination with the time sequence characteristics of user relationship and fusing other non-time sequence characteristics for cross-platform user alignment prediction. Through the method, the problems of cross-domain data privacy leakage and social network dynamics can be effectively solved, and finally precise cross-platform network user alignment is realized.

The invention belongs to the technical field of medical image processing, provides a medical image-based computer-aided diagnosis method and system, and solves the problem of insufficient computer-aided diagnosis. The method comprises the following steps: collecting a brain diffusion tensor image of a target object and a surface electromyogram signal of an associated muscle group; converting the image into Riemannian manifold data through tensor resolving and symmetric positive definite matrix mapping; extracting a Hurst index of the electromyographic signal based on remarking range analysis, and generating a motion feature vector; using Riemannian logarithm mapping and canonical correlation analysis to project manifold data and motion features to a correlation space, and extracting a maximum correlation component to generate a coupling feature vector; determining a reconstruction site through Riemannian index mapping, and calculating a geodesic line length between the reconstruction site and the reference state point to obtain a deviation value; and quantitatively judging the nerve remodeling degree and the motor function level of the stroke patient according to the deviation value. According to the application, accurate quantitative evaluation of the stroke nerve remodeling and motion recovery state is realized.

The invention relates to the technical field of environment detection, and discloses a soil organic carbon detection hyperspectral band optimization method based on deep learning, which comprises the following steps: filtering and denoising original hyperspectral data by adopting an improved filtering mode; calculating the determination importance of the hyperspectral band to the determined organic carbon content, and dynamically selecting the hyperspectral band with the highest information gain as a candidate hyperspectral band; calculating correlation weights between the candidate hyperspectral data and the soil environment factors by adopting a canonical correlation analysis mode; and performing multi-factor fusion optimal hyperspectral band prediction by using the optimal hyperspectral band prediction model, and detecting the organic carbon content of the soil based on an optimal hyperspectral band prediction result. According to the method, the content of the organic carbon in the soil is efficiently predicted by collecting the hyperspectral data and the measured content of the organic carbon, screening the candidate hyperspectral wave band with high information gain, constructing the hyperspectral wave band prediction model and screening the optimal hyperspectral wave band in combination with environmental factors.