Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1072results about "Multiple biometrics use" patented technology

Intelligent glasses image adjusting system based on eye movement tracking and gesture fusion

The invention discloses an intelligent glasses image adjusting system based on eye movement tracking and gesture fusion, and relates to the technical field of intelligent equipment. A multi-modal sensing module is arranged to construct a multi-modal sensing layer to capture eyeball movement tracks and gesture actions; a fixation point prediction module is set to process a dynamic scene through a space-time attention mechanism to obtain a fixation point prediction area, a gesture semantic understanding module is set to process gesture actions based on a Transform architecture, and the gesture actions of a user are converted into image adjustment instructions. An image enhancement strategy setting module designs a multi-stage image enhancement strategy according to the fixation point prediction area and the image adjustment instruction, and sets a dynamic adjustment intensity control module to perform adaptive adjustment to obtain a dynamic adjustment intensity control result; an eye movement-gesture cooperative control module is arranged to provide an eye movement-gesture cooperative control mechanism to realize image area selection and parameter adjustment, and accurate image area selection and parameter adjustment are realized.
Owner:MINAMI ACOUSTICS LTD

Emotion recognition and intervention system based on facial micro-expression and physiological signal fusion

The invention belongs to the technical field of artificial intelligence and health monitoring, and particularly relates to an emotion recognition and intervention system based on facial micro-expression and physiological signal fusion. The emotion recognition precision is improved through space-time alignment analysis of facial micro-expressions and physiological signals, adaptive feedback is achieved in combination with cognitive load correlation modeling and a wearable multi-channel regulation and control terminal, cross-period emotion evolution prediction and group situation awareness are supported, a'awareness-decision-intervention 'complete closed loop is constructed, and the emotion recognition efficiency is improved. And the accuracy and initiative of emotion management in a complex environment are enhanced.
Owner:JIANGSU ZHUODUN INFORMATION TECH CO LTD

Automatic fare collection method and system based on multi-mode identity recognition

The invention discloses an automatic fare collection method and system based on multi-modal identity recognition, and relates to the technical field of rail transit automatic fare collection systems and multi-modal biological recognition fusion, and the method comprises the following steps: 1, enabling a user to approach a recognition area, carrying out the multi-modal data collection, and carrying out the quality detection and preprocessing; 2, feature extraction and credibility preliminary calculation are carried out; 3, environment data are collected and subjected to standardization processing; step 4, adaptively predicting a weight through machine learning, and constructing weight smoothing and time domain constraints; step 5, carrying out D-S evidence step-by-step fusion, and calculating comprehensive credibility; and step 6, comparing the comprehensive credibility with a preset threshold value, if the comprehensive credibility is greater than or equal to the preset threshold value, determining that the identification is successful and the gate is opened for passing, otherwise, determining that the credibility is insufficient, and performing alternative / manual processing. The system comprises a front-end identification terminal, a read-write industrial control all-in-one machine and a cloud management platform.
Owner:NINGBO YIKATONG TECHNOLOGY CO LTD +2

Driver fatigue state monitoring system and method based on multi-modal biological feature fusion

PendingCN121341210AMultiple biometrics useDriver/operatorBiometric fusion
The invention relates to the technical field of artificial intelligence, in particular to a driver fatigue state monitoring system and method based on multi-modal biological feature fusion, and the system comprises a sensing module, a data processing and analysis module, an environment risk assessment module, a personalized model module, a self-adaptive decision fusion module, and a vehicle interaction and vehicle control module. Compared with the prior art in which fatigue judgment is performed by adopting a fixed threshold value, the fatigue judgment cannot adapt to a complicated and changeable driving environment and may cause excessive alarm or missing alarm under a monotonous road condition in a dangerous road section, an environment perception and dynamic threshold value adjustment algorithm is introduced, so that the system can intelligently evaluate the environmental risk and monotonicity, and the fatigue judgment accuracy is improved. The alarm sensitivity is automatically adjusted, and the early warning accuracy and the scene adaptability are both improved.
Owner:SICHUAN VOCATIONAL COLLEGE OF CHEM TECH

AI digital human interactive response method based on large language model

The invention discloses an AI digital human interactive response method based on a large language model, and relates to the technical field of digital human interaction, and the method comprises the steps: analyzing collected user voice data and visual data through a natural language processing method, generating a cross-modal feature vector, carrying out the cross-modal association analysis of the cross-modal feature vector, and carrying out the cross-modal association analysis of the cross-modal feature vector. Generating a semantic association topological graph; calculating a vertex coordinate and a joint activity threshold value of the semantic association topological graph through high-digital human correlation, inputting the vertex coordinate and the joint activity threshold value into a constructed coordinate index database to execute attention weight calibration, and outputting a multi-dimensional association graph; and performing information density analysis based on the multi-dimensional association map, generating an information density gradient vector field, and dividing a high-density core region and a low-density edge region, the high-density core region generating a semantic core coding tensor, and the low-density edge region generating an edge feature package. According to the method, the cross-modal fusion vector is converted into the cross-modal feature vector, so that the modeling of the cross-modal association relationship is realized.
Owner:BEI JING XIN ZHI YUAN LANG WANG LUO KE JI YOU XIAN GONG SI

Fatigue driving behavior feature extraction and analysis method based on image recognition

The invention relates to the field of fatigue driving behavior analysis based on image recognition, in particular to a fatigue driving behavior feature extraction and analysis method based on image recognition, which comprises the following steps of: acquiring an initial state set of a driver in real time through an IMU (Inertial Measurement Unit), an RGB (Red, Green and Blue) camera and an MEMS (Micro Electro Mechanical System) vibration sensor, converting the initial state set into four images such as a head attitude angular velocity oscillogram, extracting image features and inputting the image features into corresponding preset models to obtain fused feature data, dynamically adjusting weights through scene context features, calculating cognitive load indexes and dividing processing modes; according to the method, multi-modal data fusion and dynamic weight adjustment are realized, the cognitive load of the driver can be accurately evaluated and graded intervention can be performed, and the driving safety is improved.
Owner:ZHONGWUYUN INFORMATION TECH (WUXI) CO LTD

Access control equipment data management method and system based on multi-source fusion

The invention discloses an access control equipment data management method and system based on multi-source fusion. The method comprises the following steps: collecting a multi-source access control data stream in real time; based on a preset feature extraction rule set, extracting a multi-modal biological feature vector, a voucher legality identifier, an abnormal behavior probability value and an equipment health degree index, and inputting the multi-modal biological feature vector, the voucher legality identifier, the abnormal behavior probability value and the equipment health degree index into a dynamic security assessment matrix generation model to generate a real-time security assessment matrix; matching the dimension safety score of the real-time safety evaluation matrix with a preset threshold strategy library, and dynamically generating an access control strategy instruction set; and issuing the access control strategy instruction set to the target access control equipment execution terminal. The method has the following advantages and effects: the fault tolerance bottleneck of a single-dimensional decision chain is broken through, and the system misjudgment rate is reduced by at least one order of magnitude on the premise of ensuring the security by establishing a dynamic coupling mechanism of the multi-source data stream.
Owner:SHENZHEN ISURPASS TECH CO LTD

Multi-dimensional personality assessment method for dynamic emotion change

The invention discloses a multi-dimensional personality evaluation method for dynamic emotion changes, and relates to the technical field of personality evaluation, the system is composed of a plurality of functional modules, and the method comprises the following steps: step 1, recording physiological data in real time through a wearable device, capturing micro-reactions by using a computer vision technology, and determining whether the micro-reactions exist or not; the micro-reactions comprise facial micro-expressions, limb actions and voice and intonation changes; based on a preset dynamic simulation social scene, observing an emotion regulation strategy of the subject in pressure; step 2, using an LSTM model to carry out time sequence modeling on the multi-modal acquisition data, capturing dynamic evolution of emotions, and combining an attention mechanism to dynamically adjust the weight of each modal; based on six basic emotions and nine mental disorder tendencies, establishing a classification model, and capturing association between emotions and personalities; reinforcement learning is introduced, and model parameters are dynamically optimized according to feedback of a subject; and predicting the emotion trend of the subject in a period of time in the future through an autoregressive integral moving average model.
Owner:HANGZHOU PIGEON NEST TECH CO LTD

Non-contact multi-mode decoupling emotion recognition method and device in dialogue scene

The invention discloses a non-contact multi-modal decoupling emotion recognition method and device in a dialogue scene. The method comprises the following steps: acquiring original data of multiple modals in the dialogue scene; encoding the original data into original features by using a mode-dedicated encoder; projecting the original features by using a shared feature projector to obtain projection features, and performing weighted fusion to obtain shared features; extracting exclusive features from the original features by using a modal-specific expert network, and carrying out weighted fusion on the exclusive features to obtain private features; fusing the shared features and the private features through a cross attention fusion module to obtain multi-modal fusion features; and classifying the multi-modal fusion features by using a first classifier to obtain an emotion recognition result. According to the method, the key problems of high modal feature heterogeneity, inconsistent modal information, unbalanced modal, missing and the like in the field of multi-modal emotion recognition are solved, and the performance and robustness of emotion recognition in a dialogue scene are improved.
Owner:XIDIAN UNIV

Multi-task emotion recognition method for embedding fine-grained image blocks

The invention belongs to the technical field of computer vision and image recognition, and particularly relates to a fine-grained image block embedded multi-task emotion recognition method, which comprises the following steps of: constructing a golden snub monkey multi-modal emotion data set for wild primate animals, and covering emotion, individual and gender multi-dimensional labels; the method comprises the following steps: preprocessing an input wild primate image, dividing the input wild primate image into non-overlapping local image blocks with fixed sizes through blocking and feature extraction, and mapping the non-overlapping local image blocks to a high-dimensional feature space through linear projection to form a series of image block embedding vectors; performing local feature modeling on the image block embedded vector based on a fine-grained local scanning module to enhance fine-grained perception of local features such as facial expression and hair texture of the golden snub monkey, and performing global feature modeling on the image block feature vector by a global scanning module to enhance global semantic representation; according to the invention, the performance and generalization ability of multi-task identification of golden snub monkeys are improved.
Owner:NORTHWEST UNIV

Personnel behavior safety early warning system based on multi-source data fusion

The invention relates to the technical field of safety monitoring, and discloses a multi-source data fusion-based personnel behavior safety early warning system, which comprises a data acquisition module, a fusion decision module, a dynamic adjustment module, a cross validation and correction module, an accumulated score management module, an early warning comparison module, an early warning response module and an equipment linkage module, the data acquisition module acquires identity permission, dynamic position, environmental perception and video stream data in real time, and encrypts and transmits the data to the fusion decision module, the fusion decision module performs modeling by using an improved D-S evidence theory, identifies illegal behaviors and gives initial scores, the dynamic adjustment module performs weighting according to time and position coefficients to obtain dynamic scores, and the dynamic adjustment module performs decision making according to the dynamic scores. The cross validation module calculates correction scores such as conflict coefficients, the score accumulation module performs rolling accumulation according to 24 hours, attenuation and reset rules exist, the early warning comparison module marks three-level threshold values to determine risk levels, the early warning response module triggers corresponding strategies according to the levels, and the equipment linkage module controls hardware to realize closed-loop control so as to guarantee regional safety.
Owner:HUNAN HUANAN OPTO ELECTRO SCI TECH CO LTD

Providing private answers to non-vocal questions

Systems, methods, and non-transitory computer readable media including instructions for providing private answers to silent questions are described. Providing private answers to silent questions includes receiving signals indicative of particular facial micromovements in an absence of perceptible vocalization; accessing a data structure correlating facial micromovements with words; using the received signals to perform a lookup in the data structure of particular words associated with the particular facial micromovements; determining a query from the particular words; accessing at least one data structure to perform a look up for an answer to the query; and generating a discreet output that includes the answer to the query.
Owner:APPLE INC

Multi-channel dynamic hypergraph sentiment analysis method and analysis network fusing time sequence consistency

The invention discloses a multi-channel dynamic hypergraph sentiment analysis method and a multi-channel dynamic hypergraph sentiment analysis network fusing time sequence consistency, belongs to the field of artificial intelligence and multi-modal sentiment calculation, and aims to solve the problems existing in the existing sentiment analysis technology. The method comprises the following steps: S1, a multi-channel feature extraction step: extracting multi-channel features of a text mode and an audio mode through a heterogeneous pre-training model; s2, a local time sequence context fusion step based on a video number: fusing short-term emotional fluctuation based on a local context mechanism of the video number, and capturing long-range dependence across time dimensions through Transform; s3, a single-modal-multi-modal hypergraph collaborative prediction step: dynamically constructing a single-modal hypergraph and a multi-modal hypergraph in a training batch, and modeling a high-order relationship by adopting spectral domain-spatial domain hybrid convolution; and S4, a multi-level multi-branch supervision step: outputting a final emotion prediction result through joint optimization of an early MLP branch and a late hypergraph branch.
Owner:HARBIN INST OF TECH

Space-time sequence data processing method and system for pet abnormal behavior recognition

ActiveCN121071757ABiological modelsAlarmsModel parametersNormal behaviour
The invention relates to the technical field of pet behavior data processing, and discloses a time-space sequence data processing method and system for pet abnormal behavior recognition, and the method comprises the steps: 1, obtaining multi-modal data, carrying out the time alignment, building a multi-scale scene semantic graph, and generating a grid occupancy frequency and a region transfer matrix; 2, constructing a normal behavior template library, and generating window-level spatio-temporal features; 3, establishing group normal behavior distribution by using a generative density model, calculating a residual error in combination with a time sequence prediction model, and obtaining individual model parameters; 4, performing statistics on historical rhythm distribution and calculating differences of the day to obtain rhythm deviations; 5, fusing multi-component anomalies to obtain a comprehensive anomaly score; step 6, introducing an Internet of Things event to generate a gating coefficient and adjusting an abnormal score; and 7, comparing the abnormal score after gating with a threshold value, and outputting an abnormal alarm. According to the invention, accurate identification and stable alarm of the abnormal behavior of the pet are realized.
Owner:NINGBO CREATOR ANIMAL PHARM CO LTD +1

Course analysis management system based on deep learning

The invention relates to the technical field of course analysis management, in particular to a course analysis management system based on deep learning. The method has the advantages that multi-modal data deep analysis realizes full-dimensional analysis of unstructured data by integrating a 3D-CNN model, a Transform architecture and a BERT model and synchronously extracting an attention hot area, a voice emotional state and a text knowledge point association network of a classroom video; nonlinear behavior modeling adopts an LSTM network and time convolutional network fusion model, a knowledge internalization path and forgetting curve prediction are dynamically generated, parameters are optimized in combination with incremental learning, and a transition rule across knowledge points is captured; a teaching scene-evaluation threshold mapping table is constructed based on a reinforcement learning algorithm through dynamic decision and resource collaboration, collaborative optimization under multi-campus data privacy protection is achieved in combination with a federated learning framework, GPU computing nodes are dynamically allocated through a heterogeneous resource scheduling engine, and the analysis efficiency is improved.
Owner:ZHUHAI QIYAO IND CO LTD

Dynamic context-based behavior recognition method and device, equipment and storage medium

The invention discloses a behavior recognition method and device based on dynamic context, equipment and a medium, and the method comprises the steps: obtaining a dynamic context graph through cross-modal modeling among multi-modal data, fusing long / short-term events in a monitoring video through dynamic upper and lower graphs, carrying out the cross-modal semantic connection, carrying out the multi-modal feature fusion, and carrying out the multi-modal feature fusion. Determining a gating strategy vector and a gating weight matrix according to a splicing result; and performing multi-modal fusion according to the gating strategy vector, the gating weight matrix and the multi-modal sequence feature to obtain a multi-modal fusion feature, and performing abnormal behavior identification on the monitoring video based on the multi-modal fusion feature. Richer information support is provided for decision making through feature fusion, so that the decision making accuracy in a complex scene is improved. The method can be applied to security and protection monitoring scenes in the financial field or the medical field, so that the abnormal behavior recognition accuracy in the security and protection monitoring scenes is improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Cross-modal biological feature generation type enhancement method and system

The embodiment of the invention discloses a cross-modal biological feature generation type enhancement method and system. The method comprises the following steps of: constructing a cross-modal biological feature recognition model, respectively acquiring long-distance modal data and short-distance modal data of a user, extracting feature vectors, pre-recognizing the user based on the long-distance feature vectors, finely recognizing the user based on the short-distance feature vectors, and carrying out mutual complementation and fusion on various modal features, so as to improve the recognition accuracy of the user. According to the method, the limitation that a single mode is low in recognition accuracy and prone to being interfered under different distance scenes is overcome, the identity recognition safety is improved, and through a secondary recognition mechanism combining pre-recognition and fine recognition, the efficiency and precision of identity recognition are improved while the system load is reduced.
Owner:HANGZHOU MINGGUANG MICROELECTRONICS TECH CO LTD

Cabin active dialogue method and system

The invention belongs to the field of vehicles, and discloses a cabin active conversation method and system, and the method comprises the steps: obtaining user information and vehicle information, and determining a user portrait; matching a corresponding active dialogue type in a preset database based on the user portrait; and determining a trigger score of the active dialogue type based on the user portrait, and triggering a corresponding active dialogue when the trigger score meets a preset condition. According to the method and the system, user demands and preferences can be accurately grasped, and personalization and scene adaptability of dialogue contents can be ensured. Meanwhile, the triggering score of the active dialogue type is determined according to the user portrait, the dialogue can be triggered at a proper time, dialogue triggering does not depend on a preset fixed logic or scene any more, dynamic decision making is carried out based on real-time and personalized data, the method can adapt to complex and changeable driving scenes and user requirements, and the user experience is improved. The intelligence and initiative of the vehicle-mounted voice interaction system are effectively improved, and the user experience is enhanced.
Owner:SAIC GM WULING AUTOMOBILE CO LTD

Multi-modal sentiment analysis method based on task association perception learning

The invention relates to the field of multi-modal sentiment analysis, in particular to a multi-modal sentiment analysis method based on task association perception learning. According to the scheme, the method comprises the steps that multi-modal data including text, audio and visual modal data are obtained, feature extraction is conducted on the multi-modal data, a double-branch comparison module is constructed for each kind of modal data, each double-branch comparison module comprises a fusion branch and a comparison branch, and the fusion branch is connected with the comparison branch; input of a fusion branch and a comparison branch of each double-branch comparison module is an extracted text modal feature, an extracted audio modal feature and an extracted visual modal feature; and finally, feature fusion and prediction output are carried out, so that the accuracy and robustness of multi-modal sentiment analysis are improved. The method is suitable for multi-modal sentiment analysis.
Owner:SOUTHWEST JIAOTONG UNIV

Driving authority management method and device based on biological characteristic verification and medium

The invention provides a driving authority management method and device based on biological feature verification and a medium, and belongs to the technical field of vehicles. The method comprises the steps of collecting facial features, voiceprint data and driving behavior data by detecting a starting operation of a current driver; the identity of the current driver is recognized by using a multi-modal biological recognition algorithm, and the accuracy and anti-counterfeiting capability of identity verification are improved by adopting a bimodal fusion scheme of face recognition and voiceprint recognition; when it is determined that identity recognition of the current driver succeeds, a driving account is determined to judge whether the driver has the use permission or not, a binding relation of driver identity-account-function permission is established, and accurate matching of the intelligent driving permission and the driver qualification is achieved; the open state of the intelligent driving function is dynamically controlled based on a permission verification result, if the permission exists, the intelligent driving function is automatically prepared, if the permission does not exist, the function is locked, a clear prompt is given, and the safety risk that the intelligent driving function is used before being learned is avoided from the source.
Owner:CHINA FAW CO LTD

Internet enterprise multi-mode identity verification method and system

The invention discloses an Internet enterprise multi-mode identity verification method and system, and belongs to the technical field of Internet enterprise security, and the method comprises the steps: obtaining user historical behavior data, current transaction request data, equipment environment parameters and initial biological signal data, carrying out the risk assessment, and generating a verification path; obtaining a personalized verification sequence instruction, collecting a user face dynamic video stream, a real-time voice stream and response action time sequence data, carrying out cross-modal association comparison with a user reference biological feature template, outputting a biological feature confidence matrix, carrying out association analysis in combination with the obtained structured identity feature vector and risk assessment, and obtaining a personalized verification result; and generating a verification decision feature vector to judge a verification result state, and obtaining a pass instruction, a rejection instruction or a manual auditing request instruction. According to the method, dynamic risk-driven multi-modal verification path generation, cross-modal biological feature association decision and incremental learning mechanisms are adopted, so that the optimal balance between security and user experience can be realized in a complex network environment.
Owner:NAN JING OU YI TAI XIN XI KE JI YOU XIAN GONG SI

Man-machine interaction method for electronic screen control

The invention belongs to the field of man-machine interaction, and particularly discloses a man-machine interaction method for electronic screen control, which comprises the following steps: acquiring touch track data of a user according to a touch sensor, and performing feature extraction on the touch track data to obtain a touch feature vector; the method comprises the following steps: acquiring gesture action data of a user according to image acquisition equipment, and performing key point detection on the gesture action data to obtain a gesture feature vector; the method comprises the following steps: acquiring voice instruction data of a user according to an audio acquisition device, and performing acoustic feature extraction on the voice instruction data to obtain a voice feature vector; acquiring current environment parameters in real time through an environment detection module, wherein the environment parameters comprise illumination intensity, environment noise level and distance between a user and a screen; the objective of the invention is to solve the problem of insufficient reliability of a man-machine interaction mode in a complex environment in the prior art.
Owner:SHENZHEN SAIBO YUHUA ELECTRONIC TECH CO LTD

Deep forged video detection method based on multi-dimensional feature collaborative modeling

The invention discloses a deep counterfeit video detection method based on multi-dimensional feature collaborative modeling, which belongs to the field of computer vision and comprises the following steps of: preprocessing a complete face image by using a face recognition technology to obtain an image of a face local area; respectively extracting frequency domain features and spatial domain features of the face local region; carrying out adaptive weight modulation and nonlinear fusion on the extracted spatial domain features and frequency domain features by adopting a position sensing double-domain fusion module; the contribution degree of the local region in the local-global feature fusion process is adjusted, and a final global fusion feature is obtained; and the loss of each task is automatically weighted and balanced, and the prediction classification of the forged video is realized. According to the method, a multi-dimensional feature fusion framework of local and global and spatial and frequency domains is adopted, so that the detection precision of the deeply-forged video is effectively improved.
Owner:SHANDONG UNIV OF SCI & TECH

Identity authentication method, device, equipment, medium and program product

The invention provides an identity authentication method which can be applied to the technical field of biological recognition. The identity authentication method comprises the following steps: after agreement or authorization of a user is obtained, collecting biological characteristic data of multiple modes of the user; preprocessing the collected biological characteristic data of various modes to generate corresponding biological characteristic vectors; performing quality evaluation on each biological feature vector to generate a corresponding quality score; dynamically calculating a weight coefficient of each biological feature vector in a feature fusion process by using a nonlinear weighting function based on the quality score; based on the weight coefficient, performing feature level fusion on each biological feature vector to generate a primary fusion feature; and performing cross-modal correlation analysis on the primary fusion features by using a multi-branch convolutional neural network based on an attention mechanism, and outputting an identity authentication result. The invention also provides an identity authentication device, equipment, a medium and a program product.
Owner:INDUSTRIAL AND COMMERCIAL BANK OF CHINA +1

Vehicle control method, vehicle and electronic equipment

The invention relates to the technical field of vehicle control, in particular to a vehicle control method, a vehicle and electronic equipment. The control method comprises the following steps: acquiring a voice instruction of a person in a vehicle, converting the voice instruction into a text instruction, analyzing a user intention in the text instruction, and extracting a function object, the function intention and an associated main body in the user intention; determining a personnel node corresponding to the associated subject in the cabin personnel relation graph, when the personnel node corresponding to the associated subject is not unique, determining the personnel node referred by the associated subject based on a preset multi-priority decision model, and extracting position features corresponding to the personnel node in the cabin personnel relation graph, and generating a control instruction based on the position feature, the function object and the function intention. According to the invention, specific passenger identities involved in complex semantics can be accurately understood, and directional control is executed according to the specific passenger identities, so that the intelligent degree of voice interaction and the user experience are greatly improved.
Owner:GREAT WALL MOTOR CO LTD

Methods and systems for enhancing detection of morphed biometric modality data

A method for enhancing detection of morphed biometric modality data is provided that includes receiving, by an electronic device, biometric modality data of a person, extracting feature vectors from the biometric modality data, normalizing the feature vectors, encoding the normalized feature vectors into qubits, and expanding, using at least one quantum algorithm, the normalized feature vectors into a high-dimensional space. Moreover, the method includes generating a distribution from the high-dimensional space based on the qubits, calculating a deviation between the generated distribution and a corresponding record high-dimensionality feature vector distribution of the person, and comparing the calculated deviation against a threshold deviation value. In response to determining the deviation satisfies the threshold deviation value, the method determines the received biometric modality data was morphed.
Owner:DAON TECH

Face recognition method based on multi-modal fusion

The invention discloses a face recognition method based on multi-modal fusion, and belongs to the technical field of face recognition, in the face recognition method, when visual information is lost due to face partial shielding or strong light irradiation, emotion features in voice signals can automatically compensate for the deficiency of visual information. For example, in a video call scene, when a user shields a chin area with a hand, the system can still accurately recognize anxiety emotion by analyzing intonation trembling characteristics in voice and combining muscle movement of an unshielded eyebrow and eye area, and misjudgment caused by local information loss is avoided. Meanwhile, under the condition that noisy background sound interferes voice, the model can effectively filter interference of voice noise and maintain accuracy of emotion judgment by capturing continuous duration and intensity changes of facial micro-expressions, such as slight twitching of mouth corners lasting for more than 3 seconds.
Owner:HEFEI LINGYAN TECH CO LTD

Digital human contradictory dispute mediation method based on intelligent perception and emotion regulation

The invention discloses a digital human contradictory dispute mediation method based on intelligent perception and emotion regulation. The method comprises the following steps: firstly, acquiring voice information and visual information of two contradictory parties; calculating a voice emotion score by using the voice information, calculating a visual emotion score by using the visual information, and carrying out weighted calculation to obtain a comprehensive emotion score; then generating an initial speech speed, an initial expression and an initial gesture of the digital human; matching a proper response strategy from the knowledge base and transmitting the response strategy to the digital person; and finally, mapping voice information in the voice emotion score to a voice synthesis parameter, generating emotional voice signals consistent with both parties of a contradictory dispute in language by combining a response strategy, and outputting the emotional voice signals by a digital person for contradictory dispute mediation. In the mediation process, the digital person monitors the comprehensive emotion score and the contradictory scene in real time for dynamic adjustment. The real emotional state of the user is accurately captured based on intelligent perception, emotion mediation is carried out based on emotion perception, and the reality sense of digital human interaction and the user trust degree are improved.
Owner:GUANGDONG UNIV OF EDUCATION

Digital blackboard lightweight acquisition method and system based on multi-modal data

The invention relates to the technical field of digital blackboard lightweight acquisition, and particularly discloses a digital blackboard lightweight acquisition method and system based on multi-modal data. Comprising the steps of multi-modal data acquisition, behavior recognition result generation, teaching scene mode judgment, adaptive acquisition strategy generation, key multi-modal data acquisition, core semantic feature generation and core semantic feature transmission. Through infrared, audio and video data fusion, a behavior identification model and an attention mechanism, intelligent understanding of a teaching process and adaptive focusing of data acquisition are realized, lightweight processing is executed at an acquisition end, original data are converted into core semantic features, and storage, processing and transmission loads are reduced; it is guaranteed that the system can still operate efficiently in an unstable network environment or on edge equipment, the recognition accuracy and robustness of a complex teaching scene are remarkably improved, and meanwhile the intelligent level and decision quality of the whole system are ensured.
Owner:HUNAN JUYE NETWORK TECH CO LTD

Living fingerprint detection method based on multispectral and micro pulse feature fusion

The invention relates to the technical field of living body fingerprint detection, and particularly discloses a living body fingerprint detection method based on multispectral and micro pulse feature fusion, which comprises the steps of signal synchronous generation, time domain alignment processing, feature matrix generation, weight dynamic adjustment, cross validation analysis, abnormal region sampling, living body model verification and living body authentication output. According to the method, the verification result is generated by synchronously collecting the multi-spectral reflection intensity and the skin displacement fluctuation sequence of the fingerprint area, dynamically adjusting the spectral absorption and pulsation track feature weight, performing cross validation to output the local abnormal area and obtain the supplementary feature data, and performing physiological coupling rule matching by using the preset living body judgment model. When three consecutive results do not conform to a living body rule, activating an anti-counterfeiting attack alarm protocol; according to the method, multispectral and micro pulse features are fused, and an environment adaptive weight mechanism is combined, so that the accuracy of living body detection is effectively improved, and the environment adaptability of a detection algorithm is enhanced.
Owner:SHENZHEN NEWABEL ELECTRONICS