1593results about "Multiple biometrics use" patented technology

The invention provides a method and system for preventing identity spoofing during digital authentication processes using artificial intelligence (AI)-driven pattern recognition. The system receives an input data stream from a user attempting to authenticate, which may include biometric data, device behavior data, or user interaction data. An AI-based pattern recognition model processes this data to analyze user behavior patterns and detect any anomalies that may indicate potential spoofing attempts. The system compares the processed data against a pre-established user profile to generate an authentication decision. If anomalies are detected, the system can flag the authentication for further review or trigger additional verification steps, such as multi-factor authentication (MFA) or one-time password (OTP) prompts. The system continuously learns from user interaction data and dynamically updates the user profile to improve the accuracy of identity verification.

The invention provides an intelligent classroom teaching optimization method and system combining behavior recognition and the Internet of Things, and relates to the technical field of smart classs.The method comprises the steps that student behavior data, audio and video data and environment data are acquired through a distributed Internet of Things data acquisition system deployed at a student terminal; processing the data by adopting a multi-modal feature fusion network to obtain student interaction state features; and constructing a remote teaching interaction evaluation model based on the features, calculating the attention level and the classroom participation degree of the students in real time, and generating a personalized teaching guidance strategy. According to the method, intelligent sensing of student states and dynamic optimization of teaching strategies in the remote teaching process are realized.

The invention provides a lightweight digital human lesson preparation system based on an intelligent agent, and belongs to the field of intelligent teaching. Through collaborative operation of four core modules of knowledge graph construction and reasoning, multi-modal cognitive agent, lightweight digital human generation and intelligent teaching plan assistance, the problems of low efficiency of resource integration, teaching content homogenization, insufficient digital human interaction experience and the like in traditional lesson preparation are solved. The knowledge graph construction and reasoning module is used for constructing a structured knowledge graph and realizing knowledge point association mining and teaching logic reasoning; the multi-modal cognitive agent module is used for generating personalized explanation content according with a teaching target by fusing multi-modal courseware analysis, semantic understanding and lecture style dynamic adaptation functions; the lightweight digital human generation module is combined with model pruning and emotion modeling technologies to synchronously output natural voice and a high-simulation digital human image; the intelligent teaching plan auxiliary module helps the teacher to intelligently generate a teaching plan and a teaching outline according to the courseware content based on the knowledge graph.

The invention relates to the technical field of computer security, and discloses a computer remote login identification device based on artificial intelligence, which comprises a user side device module used for collecting biological identification data and input behavior data of a user; the authentication and verification module is used for executing multi-mode identity authentication and dynamically adjusting an authentication strategy; the behavior analysis and risk assessment module is used for analyzing a behavior mode and a login environment of the user; the database and storage module is used for storing user identity information, behavior characteristic data and authentication logs; and the security monitoring and alarming module is used for monitoring the login activity of the user in real time and detecting potential security threats. According to the invention, the design based on multi-modal authentication greatly improves the security of remote login. By combining a plurality of authentication means such as face recognition, fingerprint recognition and voice recognition, the system can effectively prevent security vulnerabilities such as password stealing, fingerprint counterfeiting or facial image attack.

The invention relates to the technical field of AI interaction, and discloses an AI multi-modal emotion interaction memory terminal, which realizes microsecond-level synchronization of voice, facial expression and text data through a multi-thread acquisition engine, dynamically allocates each modal weight by adopting a multi-head cross attention mechanism, and adaptively adjusts modal importance based on a conversation context hidden state; when the cross-modal confidence difference exceeds a threshold value, a gating LSTM conflict resolution module is activated, and the multi-source data collaboration problem is solved; the emotional memory modeling constructs an emotional state transition topology based on a graph convolutional network, protects user privacy in combination with a differential privacy mechanism, and realizes associated event storage of millisecond backtracking of short-term memory and long-term memory. The technology integrates multi-modal dynamic perception, privacy security calculation and adaptive learning ability, significantly improves the real-time performance and personification degree of emotion interaction, and can be applied to the fields of intelligent customer service, emotion accompanying, health monitoring and the like.

The invention discloses a pig individual identification and health monitoring system based on biological characteristics, and relates to the technical field of medical treatment, and the system comprises a multi-mode biological characteristic collection module which is used for obtaining pig 3D facial characteristics, ear blood vessel distribution characteristics, gait dynamic characteristics and physiological data; the biological feature fusion recognition module is used for fusing multi-modal features based on a Transform architecture and realizing individual unique identification and feature template dynamic updating; and the digital twinborn health monitoring module is used for constructing a pig full-life-cycle digital twinborn model and realizing health state evaluation and disease early warning in combination with an LSTM neural network. According to the pig individual recognition and health monitoring system based on the biological characteristics, 1024-dimensional standardized feature vectors are constructed through cooperation of multiple devices such as an RGB-D camera, a near-infrared camera and a binocular vision sensor, modal weights are dynamically distributed in combination with a Transform network, and high-precision recognition in a complex scene is achieved.

The invention discloses a power transmission line constructor identity verification method based on face recognition, and relates to the technical field of electric power engineering safety management, and the method comprises the steps: collecting multispectral face data, and generating a spectral stereo feature matrix; micro blood flow pulsation characteristics, skin texture characteristics and thermal imaging temperature distribution characteristics are extracted from the spectrum stereo characteristic matrix, a three-layer cascade anti-counterfeiting verification mechanism is constructed, and comprehensive living body judgment is carried out; establishing a distributed feature matching network, and matching the spectrum stereo feature matrix with a pre-stored feature library; collecting a geographic position track and an operation behavior mode of a constructor, and carrying out multi-dimensional cross validation on the geographic position track and the operation behavior mode and an identity matching result to generate a multi-level safety evaluation index; and writing the identity verification process and the multi-level security evaluation index into a distributed account book, and generating a verification voucher. According to the invention, cross analysis is carried out on the identity matching result of the constructor and the behavior characteristics, so that the problem that a traditional face recognition system is easily falsely used by the identity is effectively solved.

The invention relates to the technical field of audio and video identity recognition, in particular to an audio and video identity recognition system based on multimode clue driving. The audio and video identity recognition system comprises an audio feature extraction module, a video feature extraction module, a multimode clue fusion module, a living body detection module and an identity recognition and verification module. The audio feature extraction module is used for capturing a voice signal of a user and extracting key voiceprint features, the video feature extraction module is used for acquiring facial features or limb features of the user and extracting related features, and the multi-mode clue fusion module is used for performing intelligent weighted fusion on the features of audio and video modes. The method comprises the following steps: firstly, using a living body detection module to comprehensively analyze the dynamic characteristics of audio and video, judging whether a user is a real individual, and finally, completing the final verification of the identity of the user through an identity recognition and verification module. The problem of feature extraction and modal fusion in the prior art is effectively solved.

The invention discloses a laboratory automatic process management and multi-source data fusion system based on the Internet of Things, and belongs to the technical field of laboratory management. The system comprises a sensing layer, an analysis layer, an intelligent management layer and an application layer. The sensing layer carries out global data acquisition and real-time analysis; the analysis layer integrates data, mines an association relationship and optimizes task matching; the intelligent management layer performs full-process automatic management and control on a laboratory, and comprises an equipment cooperation module, a dynamic detection module, a dynamic configuration module, a real-time simulation module, a preset trigger module and an intelligent auditing module; and the application layer performs multi-terminal collaborative interaction and intelligent assistant assistance processing. According to the system, intelligent collaboration of laboratory equipment, automatic detection of samples, dynamic optimization of equipment parameters and automatic early warning and processing of abnormal conditions are realized through technical means such as knowledge graph construction, a digital twinborn technology and multi-mode biological recognition, and the laboratory management efficiency and the data processing accuracy are effectively improved.

The invention relates to a multi-modal fusion real-time digital human driving method based on unified behavior vector mapping, and belongs to the technical field of human-computer interaction. The method comprises the following steps of: 1) extracting multi-modal features of voice, action and vision, and generating input features by adopting language feature-emotion decoupling, staged action modeling and macroscopic-micro expression flow analysis; (2) cross-modal collaborative alignment and conflict correction are carried out, and high-precision fusion is realized through knowledge graph constraint time sequence decomposition, particle-by-particle interactive fusion and a situation-driven modal dominant strategy; and 3) constructing a three-dimensional behavior vector space, mapping the multi-modal features to a unified coordinate by utilizing honeycomb grid projection, and driving the digital human to output in combination with a coordinate-action mapping table. According to the method, the problems of difficulty in multi-modal time sequence alignment, feature isomerism and out-of-control conflict are solved, real-time interaction of naturalization, emotional and scenarized is realized, and the expressive force and adaptability of the digital human are remarkably improved.

The invention discloses an emotion detection system based on facial recognition, and relates to the technical field of computer vision and emotion calculation. A video stream time sequence analysis module is used for extracting a facial micro-expression image sequence of continuous frames, a time sequence feature vector containing a micro-expression intensity gradient, an illumination robustness coefficient and a facial action unit cooperation feature is generated, and a multi-mode dynamic sensing module is combined to carry out real-time analysis on an emotion classification probability, voice emotion parameters and physiological signals. And the fusion decision module performs dynamic weighted fusion on the multi-modal data based on the scene adaptive weight, and finally generates a comprehensive emotion score. Through multi-modal time sequence modeling and a dynamic weight optimization mechanism, the accuracy and environmental adaptability of emotion recognition are remarkably improved, and real-time perception and accurate decision making of customer emotion are realized in a target scene.

The embodiment of the invention provides an emotion recognition method and device based on artificial intelligence, and identity verification is realized through voiceprint features by creatively integrating multi-modal data of facial images, voices and body actions. And a multi-level attention fusion network is designed, and intelligent fusion of modal interior and cross-modal features is realized by using a feature attention layer and a modal attention layer. An emotion change time sequence model is constructed in combination with medical record data, the physiological indexes are fused for evaluation and correction, and dynamic evaluation and accurate monitoring of the emotional state are achieved. According to the method, the defects of the traditional technology in the aspects of multi-modal fusion, time sequence modeling, medical monitoring and the like are effectively overcome, and the accuracy and the practical value of emotion recognition in the medical scene are remarkably improved.

The invention provides a driver fatigue monitoring technology using eye movement tracking, and relates to the field of auxiliary driving, and the technology comprises the steps: collecting a face image frame through a front-end camera, carrying out Medipe (Media Pipeline) detection, recording a head posture, and recognizing an iris center region; extracting continuous eye closing time and mouth state information of the driver through the face information; a PNP algorithm is used; a world coordinate system and a camera coordinate system are established, and the sight line vector and the external environment are located in the same space; modeling is carried out on the human eyes and the fixation area; coordinates of a fixation point in a three-dimensional space are obtained through calculation of the geometric model; real-time attention analysis is carried out through the fixation point, and an analysis result is determined; the attention change condition and the fatigue state of the driver are effectively recognized through a BP neural network in combination with a fixation point analysis result. And early warning measures are taken in time to remind a driver. The system is crucial for improving the driving safety, and necessary warning and intervention can be provided when the driver is distracted or fatigued.

The invention belongs to the technical field of intelligent education, and particularly relates to a classroom attention detection method and system based on multi-modal data fusion. Aiming at the problems of high equipment cost, low multi-source data fusion efficiency, insufficient privacy protection and the like in the prior art, the invention provides the following solutions: collecting face, eye movement, posture, voice signals and heart rate variability data of a student through a sensor; multi-modal data synchronization is realized by adopting a time sequence alignment algorithm; respectively extracting a visual attention feature, a voiceprint matching feature and a physiological wake-up feature by using a lightweight deep learning model; constructing a multi-modal data fusion network, and dynamically adjusting a feature weight in combination with a classroom scene; attention anomaly detection is realized by adopting a hybrid model, and real-time early warning is output through edge computing equipment. The method has the beneficial effects that the hardware cost is greatly reduced while the detection precision is ensured, and the privacy of students is effectively protected; a dynamic weight distribution mechanism improves the adaptability of different teaching scenes.

The invention provides a network advertisement effect evaluation method based on eye movement tracking, and aims to improve the advertisement putting accuracy and the effect evaluation accuracy through integrating eye movement data and emotion data, and the method comprises the steps of capturing an eye movement track by using an infrared camera, extracting eye movement feature points, and calculating a fixation point and time. Meanwhile, emotion data are collected through a facial expression recognition technology and a physiological sensor, a visual attention model and an emotion analysis model are constructed through a deep neural network, the reverse emotion and cognitive avoidance state of the user is analyzed, and advertisement content display is dynamically adjusted; according to the method, the user position and time data are combined, personalized advertisement putting is achieved, the advertisement effect is optimized through multi-dimensional data analysis, the user experience is improved, and a scientific basis is provided for advertisement decision making.

The invention discloses a palm vein and palm print feature fusion intelligent identity verification method and system, and relates to the technical field of biological recognition, and the method comprises the steps: collecting a palm image and identity data of a to-be-authenticated user, and carrying out the identity coding of the palm image based on the identity data, and obtaining a palm identity coding image set; then, through region marking and feature extraction, multi-dimensional features of palm veins and palm prints are obtained; then, performing spatial alignment fusion on the features of the two to generate a palm code fusion feature data set; and then, through encryption processing and network training, a self-adaptive palm identity recognition network is obtained. And finally, acquiring a palm image of a target user, and performing identity verification by using the network. The technical problems of insufficient safety, low accuracy and poor anti-interference capability caused by dependence on a single biological characteristic in an existing identity authentication method are solved, and the technical effect of improving the safety, the accuracy and the anti-interference capability of identity authentication is achieved.

The invention discloses an emotion pressure recognition method and system based on an action form fusion graph neural network, and belongs to the field of image processing and machine learning. A double-graph data structure is constructed, wherein graph data with human body key points as nodes and graph data with image frames as nodes are processed through T-GCN and PCSN respectively. The T-GCN model fuses a GCN layer and a Mama encoder, the cohesion and coupling ability of emotion category characterization is enhanced through a graph partitioning strategy, and the spatial-temporal characteristic relation of human body actions is effectively captured. The PCSN adopts a three-branch parallel structure including one-dimensional global average pooling, 3 * 3 convolution and 5 * 5 convolution, efficient extraction of non-homogeneous features of the human body, the face and the hand is achieved, and the long and short distance dependence and local cross-channel interaction relation of the global features is established. According to the system, through combination of transfer learning and small sample learning, a public data set is utilized to initialize a network, and secondary training is performed on a small sample data set of campus emotion pressure, so that the recognition precision is remarkably improved.

The invention discloses an intelligent glasses image adjusting system based on eye movement tracking and gesture fusion, and relates to the technical field of intelligent equipment. A multi-modal sensing module is arranged to construct a multi-modal sensing layer to capture eyeball movement tracks and gesture actions; a fixation point prediction module is set to process a dynamic scene through a space-time attention mechanism to obtain a fixation point prediction area, a gesture semantic understanding module is set to process gesture actions based on a Transform architecture, and the gesture actions of a user are converted into image adjustment instructions. An image enhancement strategy setting module designs a multi-stage image enhancement strategy according to the fixation point prediction area and the image adjustment instruction, and sets a dynamic adjustment intensity control module to perform adaptive adjustment to obtain a dynamic adjustment intensity control result; an eye movement-gesture cooperative control module is arranged to provide an eye movement-gesture cooperative control mechanism to realize image area selection and parameter adjustment, and accurate image area selection and parameter adjustment are realized.

The present disclosure generally relates to methods and user interfaces for authentication, including providing authentication at a computer system in accordance with some embodiments.

The invention belongs to the technical field of artificial intelligence and health monitoring, and particularly relates to an emotion recognition and intervention system based on facial micro-expression and physiological signal fusion. The emotion recognition precision is improved through space-time alignment analysis of facial micro-expressions and physiological signals, adaptive feedback is achieved in combination with cognitive load correlation modeling and a wearable multi-channel regulation and control terminal, cross-period emotion evolution prediction and group situation awareness are supported, a'awareness-decision-intervention 'complete closed loop is constructed, and the emotion recognition efficiency is improved. And the accuracy and initiative of emotion management in a complex environment are enhanced.

The invention discloses an automatic fare collection method and system based on multi-modal identity recognition, and relates to the technical field of rail transit automatic fare collection systems and multi-modal biological recognition fusion, and the method comprises the following steps: 1, enabling a user to approach a recognition area, carrying out the multi-modal data collection, and carrying out the quality detection and preprocessing; 2, feature extraction and credibility preliminary calculation are carried out; 3, environment data are collected and subjected to standardization processing; step 4, adaptively predicting a weight through machine learning, and constructing weight smoothing and time domain constraints; step 5, carrying out D-S evidence step-by-step fusion, and calculating comprehensive credibility; and step 6, comparing the comprehensive credibility with a preset threshold value, if the comprehensive credibility is greater than or equal to the preset threshold value, determining that the identification is successful and the gate is opened for passing, otherwise, determining that the credibility is insufficient, and performing alternative / manual processing. The system comprises a front-end identification terminal, a read-write industrial control all-in-one machine and a cloud management platform.

The invention provides a palm vein feature extraction and depth adaptive matching method, which relates to the technical field of biological recognition, and is characterized in that a three-dimensional space-time convolutional neural network and a graph neural network are combined to extract space depth features, time blood flow dynamic features and blood vessel topological features of palm veins, and information bottleneck is utilized to optimize and screen a feature subset with the most distinguishing property; the method breaks through the limitation of traditional two-dimensional texture feature extraction, obtains abundant palm vein information through multi-source data acquisition (such as near-infrared imaging, a light field camera and a spectrum sensor), overcomes the interference of environmental factors such as illumination, angle and noise, achieves the high-precision modeling and stable extraction effects of palm vein features, and can achieve the real-time extraction of the palm vein features in a complex scene. A high recognition rate is kept under different illumination conditions or user hand posture changes, the robustness of the palm vein recognition system is remarkably improved, and the method is suitable for scenes with high safety requirements.

The invention relates to the technical field of biological agriculture, and discloses a live chicken state automatic identification system and method based on chicken face image analysis, and the system comprises a unique identity identification module which is used for generating the identity identification of a chicken through a chicken face image; the health monitoring module is used for setting a chicken classification health detection mechanism and creating a chicken body temperature monitoring unit of the coop; the egg quality detection module is used for identifying eggshell characteristics corresponding to the first type of eggs and the second type of eggs; the behavior tracking module is used for collecting ingestion records of the chickens and identifying abnormal behaviors of the chickens; the disease early warning module is used for outputting health indexes of the chickens according to the abnormal behaviors, the eggshell characteristics, the ingestion records and the real-time body temperature; and the live chicken automatic identification module is used for executing live chicken state automatic identification processing of the chicken coop in combination with the chicken face image, a classification health detection mechanism, a behavior tracking network and a disease early warning mechanism. The survival rate and the breeding efficiency of the chickens are improved.

The invention relates to the technical field of artificial intelligence, in particular to a driver fatigue state monitoring system and method based on multi-modal biological feature fusion, and the system comprises a sensing module, a data processing and analysis module, an environment risk assessment module, a personalized model module, a self-adaptive decision fusion module, and a vehicle interaction and vehicle control module. Compared with the prior art in which fatigue judgment is performed by adopting a fixed threshold value, the fatigue judgment cannot adapt to a complicated and changeable driving environment and may cause excessive alarm or missing alarm under a monotonous road condition in a dangerous road section, an environment perception and dynamic threshold value adjustment algorithm is introduced, so that the system can intelligently evaluate the environmental risk and monotonicity, and the fatigue judgment accuracy is improved. The alarm sensitivity is automatically adjusted, and the early warning accuracy and the scene adaptability are both improved.

A system for serving personalized advertisements based on biometric and identifying data captured by sensors. The system employs pre-processing, feature extraction, and recognition modules to identify individuals. A context-aware processing module adapts recognition strategies based on environmental data and analyzes personal information to confirm the identity of the targeted individual and send targeted advertisements. The system includes display and speaker modules for visual and audio advertisements, a predictive interaction modeling module for generating personalized advertisements, and a cross-platform behavior analysis module for analyzing user behavior across offline and online platforms.

The invention discloses an AI digital human interactive response method based on a large language model, and relates to the technical field of digital human interaction, and the method comprises the steps: analyzing collected user voice data and visual data through a natural language processing method, generating a cross-modal feature vector, carrying out the cross-modal association analysis of the cross-modal feature vector, and carrying out the cross-modal association analysis of the cross-modal feature vector. Generating a semantic association topological graph; calculating a vertex coordinate and a joint activity threshold value of the semantic association topological graph through high-digital human correlation, inputting the vertex coordinate and the joint activity threshold value into a constructed coordinate index database to execute attention weight calibration, and outputting a multi-dimensional association graph; and performing information density analysis based on the multi-dimensional association map, generating an information density gradient vector field, and dividing a high-density core region and a low-density edge region, the high-density core region generating a semantic core coding tensor, and the low-density edge region generating an edge feature package. According to the method, the cross-modal fusion vector is converted into the cross-modal feature vector, so that the modeling of the cross-modal association relationship is realized.

The invention relates to the technical field of fusion management, in particular to an urban rail train multi-subsystem intelligent fusion management method and system, and the method comprises the steps: obtaining operation data through multiple types of sensing terminals inside and outside each carriage of a train; constructing a situation awareness model of a passenger and environment interaction relationship, and predicting passenger interaction data in a future time period; adopting an anomaly detection model to identify emergencies and classifying emergencies; the method comprises the following steps: constructing a hierarchical fusion management architecture comprising a compartment-level local management unit and a train-level global coordination unit, wherein the local management unit dynamically adjusts the configuration of an operation subsystem in each compartment; and the global coordination unit constructs a global coordination model, and sets a priority regulation and control weight for a compartment area corresponding to an emergency by taking the passenger comfort and the system energy consumption as targets. According to the invention, the operation state of each subsystem can be sensed in real time and intelligently adjusted according to passenger flow and demand changes, so that the passenger experience is optimized, the energy consumption is reduced, and the overall system efficiency is improved.

The invention discloses a multi-modal interactive fusion virtual reality emotion computing system, which comprises a multi-modal interactive fusion virtual reality emotion computing device, a multi-modal interactive fusion virtual reality emotion computing device and a multi-modal interactive fusion virtual reality emotion computing device, the virtual reality emotion computing device based on multi-modal interaction fusion further comprises a distributed multi-modal sensing device, a user adaptation interaction module, an interaction feedback module, an emotion extraction module, a multi-modal fusion module and a self-adaptation emotion computing model. The multi-modal fusion module is used for carrying out full-dimensional monitoring and intelligent decision making on a complex scene, the user adaptive interaction module can realize accurate identification and response to user requirements, and the multi-modal fusion module is used for making up for information limitation of a single modal, so that effective interaction and accurate identification can be realized on the whole.

The invention relates to the technical field of identity authentication, and discloses an identity authentication method and system based on a large-model multi-mode venue, and the method comprises the steps: obtaining a fingerprint image, a face image and behavior interaction data of a user; performing fingerprint feature extraction according to the fingerprint image to obtain a fingerprint feature vector; performing facial feature extraction according to the facial image to obtain a facial feature vector; performing feature fusion on the fingerprint feature vector and the face feature vector, and generating a fusion feature vector after data dimension reduction; performing behavior feature extraction according to the behavior interaction data to obtain a behavior feature vector; and after cross-modal mapping is carried out according to the fusion feature vector and the behavior feature vector, matching degree analysis is carried out in a preset unified semantic space, and an identity authentication result is obtained. The method has the following effect that the identification security of identity authentication can be improved.

The invention relates to the field of fatigue driving behavior analysis based on image recognition, in particular to a fatigue driving behavior feature extraction and analysis method based on image recognition, which comprises the following steps of: acquiring an initial state set of a driver in real time through an IMU (Inertial Measurement Unit), an RGB (Red, Green and Blue) camera and an MEMS (Micro Electro Mechanical System) vibration sensor, converting the initial state set into four images such as a head attitude angular velocity oscillogram, extracting image features and inputting the image features into corresponding preset models to obtain fused feature data, dynamically adjusting weights through scene context features, calculating cognitive load indexes and dividing processing modes; according to the method, multi-modal data fusion and dynamic weight adjustment are realized, the cognitive load of the driver can be accurately evaluated and graded intervention can be performed, and the driving safety is improved.