41 results about "Face analysis" patented technology

The invention discloses a cognitive impairment screening method and system based on face analysis. The cognitive impairment screening method comprises the following steps: selecting a video clip with a preset duration for a user to watch, wherein the video clip comprises a plurality of smile points; setting a corresponding time window according to the appearing time of each laughing point; based on spontaneous facial expressions after the user watches the video, facial motion features of the user in each time window are collected, and the facial motion features comprise values of a plurality of facial motion units of the user; inputting the facial motion features of the user in each time window into a preset model to output a cognitive impairment screening result; wherein the preset model carries out model training based on historical big data, so as to form a mapping relation from the facial movement features to the cognitive impairment screening result. Therefore, by utilizing the method, the cognitive impairment can be screened in a diversified scene, the dependence on professionals is reduced, a user does not need to be wounded, and the method is particularly suitable for early screening of the cognitive impairment.

The invention discloses an intelligent interaction method and system for a meta-universe scene, and relates to the technical field of meta-universe scene interaction. The method comprises the following steps: acquiring scene interaction information and performing information analysis to obtain a voice analysis result, an action analysis result and a face analysis result; performing multi-modal sentiment analysis based on an analysis result to obtain a sentiment intention of the user; interacting with the user according to the emotional intention to obtain first interaction feedback information; acquiring a scene interaction log and performing log analysis to obtain an interaction recommendation result; interacting with the user according to the interaction recommendation result to obtain second interaction feedback information; and comprehensively analyzing the interaction feedback information and updating and optimizing the interaction process. According to the method, from two perspectives of scene interaction information and scene interaction logs, emotional intentions of users are obtained by adopting multiple technologies such as deep learning and neural networks, so that the accuracy of results, the usability and selectivity of interaction and the experience effect of the users are improved to a great extent.

The invention discloses a counterfeited face video detection method based on a regionalized space-time Transform. The method comprises the following steps: constructing a counterfeited face video data set containing real and counterfeited samples; the method comprises the following steps: constructing a fake face video detection network comprising a face analysis and region division module, a region adaptive feature extraction module, a regionalization space-time Transform module, an intra-region feature fusion module and an inter-region feature fusion module; training the detection network using a data set; and utilizing the trained network model to predict true and false labels of the input video sequence. According to the method, spatial-temporal feature differences generated in different areas of a face in a counterfeiting process are utilized, and key links such as feature extraction (adopting area adaptive convolution), spatial-temporal modeling (adopting spatial-temporal Transform with intra-area / inter-area attention) and feature fusion (adopting an intra-area / inter-area fusion mechanism) are penetrated through a regionalized processing strategy; the method aims to overcome the limitation of global analysis, and can detect the fake face video more accurately and robustly.

The present application relates to a kind of face analysis method and system based on self-supervised representation learning, the method includes: 1) obtaining face image from data set, and the face image is preprocessed;2) construct self-supervised local-to-global mask distillation network model to extract general face representation;Wherein, extract visible local feature Token sequence by online local encoder, extract target global feature Token sequence by target global encoder, and predict global feature Token sequence by local-to-global decoder;During model training, the weighted sum of mask loss and distillation loss is calculated, and the parameters of online local encoder are optimized by gradient back propagation, to realize the iterative training of model;3) the trained online local encoder is applied to face analysis, face key point detection, face attribute recognition or face expression recognition task by transfer learning.The method and system are beneficial to more robust, accurate, generalization to obtain the result of face analysis task.

The invention belongs to the technical field of face recognition, and particularly relates to a batch face analysis and comparison method and system. The method comprises the following steps: extracting key features in face data, namely a two-eye pupil distance, and performing batch calculation by utilizing a Hamming distance algorithm according to the two-eye pupil distance in the face data to obtain a plurality of pieces of face data with the highest similarity, and then, on the basis of a plurality of pieces of acquired face data with the highest similarity, performing similarity comparison on all features in the face data by adopting a cosine algorithm, and acquiring the same face data according to a similarity comparison result. The system comprises a face data snapshot module, a key feature extraction module, a face similarity extraction module and a face confirmation module which are connected in sequence. Compared with original batch comparison, the method and the system are faster, more efficient and more intensive.

The invention discloses an image processing method, electronic equipment and a computer readable storage medium, and belongs to the technical field of image processing. The method comprises the steps that a first face analysis graph of a to-be-enhanced image and a second face analysis graph of a reference image are acquired, the definition of the reference image meets a preset image definition condition, and the to-be-enhanced image and the reference image both comprise a first shooting object; determining a first affine transformation matrix for converting the second face analysis graph into the first face analysis graph; acquiring a first contour feature of the reference image; performing affine transformation on the first contour feature according to the first affine transformation matrix to obtain a second contour feature; and obtaining an enhanced image according to the second contour feature, the to-be-enhanced image and the face enhancement model, the definition of the face region in the enhanced image being greater than the definition of the to-be-enhanced image. The second contour feature carries the feature of the image with high definition in the reference image, so that the trueness and definition of the enhanced image can be improved, and the quality of the image is improved.

The present application relates to the technical field of advanced geological prediction, in particular to a kind of advanced geological prediction system based on information fusion of multiple detection methods, comprising comprehensive analysis subsystem, advanced prediction module and notification and statistics module.The comprehensive analysis subsystem includes face analysis module, advanced drilling analysis module and geological radar analysis module.The present application combines stress-strain monitoring, geological radar detection, advanced drilling and other detection methods, improves the adaptability to complex construction environment, improves the intelligent level, realizes the rapid transmission and sharing of geological information;Through logical judgment program, data centralized analysis is carried out, geological abnormal conditions such as rock burst, discontinuous geological structure are found in time during drilling process, so as to output corresponding early warning signal, which provides more definite decision basis for construction personnel.

The present invention discloses an Internet-based face recognition police information tracking platform, which includes a face analysis module, an identity formulation module, a police officer center module and a real-time monitoring module; the face analysis module includes a face information extraction unit, which is used to identify facial feature information of a face and extract and analyze the facial feature information; the identity formulation module is used to formulate an individual's identity based on the facial feature information of the face analysis module; the police officer center module includes an alarm information receiving unit and a police officer dispatch plan formulation unit, which is used for the police officer to predict the processing method and the police force to be dispatched after receiving the alarm information; the real-time monitoring module includes a real-time monitoring unit for movement trajectory and a real-time monitoring unit for the scene of the alarm, and the real-time monitoring module is used to monitor the movement trajectory of the person after face recognition and the scene picture when the alarm occurs.

The invention discloses an intelligent switching method and system for face component structured mask learning, and the method comprises the steps: extracting a portrait mask with an edge perception capability, and reconstructing a high-fidelity background region with spatial continuity through combining a background reconstruction network; generating a standardized face image with geometric consistency by adopting a face detection and posture correction network; generating an optical head portrait with vision and texture consistency; performing structured mask learning on the standardized face image and the optical head image by using a semantic segmentation network to realize pixel-level face analysis; obtaining a multi-component region mask through mask calculation based on morphological operation; generating an optical head portrait with a natural transition effect by using an optical head portrait synthesis module based on Poisson fusion; and generating a hair changing portrait with physical authenticity by using a hair changing portrait synthesis module. According to the method, the visual fidelity, the detail consistency and the identity retentivity of the face image after hair changing are remarkably improved.

A face image local area restoration method based on priori knowledge distillation comprises the following steps: extracting a corresponding face analysis graph from a public data set as priori information, preprocessing the face analysis graph, generating a free occlusion training set, and training a constructed teacher network containing a double-gating convolution coordination attention module, freezing parameters of the trained teacher network, and performing instructive training on the constructed student network; and finally, performing restoration processing on the face image received in real time through the trained student network. According to the method, on the basis of the face prior information, the error accumulation dilemma caused by prediction prior information deviation is ingeniously avoided, the repair accuracy is improved from the source, the long-distance dependency relationship between effective pixels is deeply mined and fully utilized, and under the condition of free shielding, the repair accuracy is improved. The repaired face image is more excellent in structural integrity and semantic coherence, and the gap between the repaired image and the original real image is remarkably reduced.

The present application relates to the technical field of intelligent control of light-emitting mirrors, and discloses a control system of a rotating light-emitting mirror with face recognition, comprising an induction recognition module, a data analysis module, a mirror surface control module and a light-emitting mirror. The system collects data sets through the induction recognition module, and a face analysis unit calculates and generates a rotating data set Xzsj. The system automatically matches by default with the image center point of the nose as the target height, a brightness analysis unit calculates and generates a brightness data set Ldsj, and the system automatically adjusts by default with the standard value as the final light intensity. The system intelligently matches the user's line of sight focus, an instruction analysis unit generates an execution data set Zxsj according to the corresponding voice data set, the mirror surface control module controls the opening of the rotating motor and the light adjustment module, and generates corresponding voice prompts. The voice control is more intelligent, has a wide range of flexible applications, and provides a better user experience.

The utility model discloses a high-definition video camera with a face recognition function, which relates to the technical field of video cameras and comprises a video camera unit. The camera unit is electrically connected with the data acquisition module, the data acquisition module is electrically connected with the data transmission module, and the data transmission module is electrically connected with the portrait acquisition unit; the portrait acquisition unit is electrically connected with the face recognition unit, and the face recognition unit is electrically connected with the data analysis center; according to the utility model, the camera shooting unit shoots the influence generated in real time, the data acquisition module acquires the influence, the data transmission module transmits data to the portrait acquisition unit for face correction and acquisition, the face recognition unit performs face comparison, the data is transmitted to the analysis center for face analysis, and a copy is copied to the storage module. And finally, the data of the analysis center is sent to the central control module for processing.

The invention belongs to the technical field of face recognition and verification, and particularly relates to a park and meeting room entrance and exit face recognition and verification system, which comprises an image acquisition module, a face recognition module, a face recognition module, a face recognition module and a face recognition module, the image adjusting module is used for adjusting the face image acquired by the image acquisition module so as to ensure the definition of the acquired face image; and the face analysis module is used for analyzing the face of the person according to the image adjusted by the image adjustment module so as to verify the face of the person and grading verification results. According to the invention, by arranging the face analysis module and the expression analysis module, when the face recognition is carried out on the personnel participating in the conference, the grade of the face image can be firstly determined, and then the expression analysis module is executed according to the judgment grade, so that when the face of the personnel participating in the conference changes, dual verification can be carried out, and the face recognition efficiency is improved. And the accuracy of face recognition is further ensured.

The invention relates to the technical field of face recognition, and discloses a multi-modal voice interaction method based on face recognition, which comprises the following steps of: 1, acquiring face features, and recording and numbering a plurality of face features; step 2, face analysis is carried out in combination with the face features, and a face score is calculated; 3, judging the face recognition accuracy according to the face scoring result; 4, extracting voice features of the crowd with low face recognition accuracy; step 5, combining the voice features to form a final voice feature, and matching the final voice feature with a pre-stored voice instruction; and step 6, sending a final instruction. According to the face recognition method, the face score is calculated through the face features, the face score is compared with the standard threshold value, the face information can be captured more comprehensively through the face recognition technology, and therefore the recognition accuracy is improved, and under the condition that the face recognition accuracy is low, judgment is carried out through the voice features, an instruction is sent out, and the recognition accuracy is improved.

Embodiments of the present disclosure provide a face image repairing method and device, electronic equipment and storage medium. The method comprises: obtaining a face image to be repaired; cropping a first face image from the face image to be repaired by a face detection algorithm; analyzing the first face image by a face analysis model to generate a binary face mask image; performing face repairing processing on the first face image by a face repairing model to obtain a second face image; synthesizing a third face image according to the first face image, the second face image and the binary face mask image; and replacing the first face image in the face image to be repaired with the third face image to form a repaired face image. The method analyzes and performs face repairing processing on the face image by the face analysis model and the face repairing model respectively to obtain the binary face mask image and the second face image. Different regions of the face image are selectively repaired according to the binary face mask image, so that the repaired face image is more natural.

The invention discloses a face analysis method based on multi-task learning and transformer, and the method comprises the following steps: dividing an input image into a plurality of non-overlapping windows, and carrying out the feature transformation through a multi-layer perceptron; tasks are classified according to output types, each prediction head has an independent and unique feature fusion module and a decoding module and can learn a plurality of sub-tasks at the same time, finally, corresponding losses are calculated, and a gradient normalization strategy is adopted to ensure that a model does not tend to each task. The invention provides a face analysis architecture based on multi-task learning and transformer, a plurality of related or unrelated tasks are allowed to be processed in a unified model at the same time, and feature representation is shared among different tasks, so that redundancy of feature extraction is reduced, and the resource utilization efficiency is improved. By dynamically calculating the learning weight for different tasks, the multi-task learning framework can synchronize the learning speed of each sub-task to the greatest extent, and an effective convergence effect is achieved.

The present invention provides a face recognition method, device, storage medium and electronic device, comprising obtaining a face video to be recognized, extracting face features and micro-expressions on the face video, and obtaining a first posture feature when the face video has micro-expressions; bringing the face features into a preset three-dimensional face model to construct a three-dimensional face model to be recognized; bringing the micro-expressions into the three-dimensional face model to obtain a second posture feature of a normal face producing micro-expressions; substituting the first posture feature and the second posture feature into a preset big data face analysis model to determine face change information; bringing the face three-dimensional model into change according to the face change information to generate a pre-comparison face set; bringing the face pre-comparison set into a big data face recognition database for matching to determine the face information on the face video.

This invention provides an intelligent interactive media display method and system. The method includes: offline construction of a visitor image library; capturing faces of people standing in front of the media wall using a camera installed on the media wall, and extracting qualified facial images using face detection technology; then, using face analysis technology to perform attribute analysis on the extracted qualified facial images to determine the gender, age, and identity attributes of the faces in front of the media wall; combining the constructed visitor image library with the results of face detection and analysis to intelligently display the media wall; and using gesture recognition technology to allow users to interact with the media wall without contact, including pausing, starting, scrolling forward, scrolling backward, and deleting. This invention innovatively applies face recognition and gesture recognition technologies to building walls, intelligently displaying media wall content and providing a contactless interactive method, giving users not only a sense of presence and surprise, but also a sense of interaction and friendliness.

The invention relates to the technical field of driving behavior safety recognition, in particular to a two-dimensional holder face positioning and fatigue driving detection device which comprises a data collection and storage module, an image information recognition and processing module, a face analysis and fatigue driving evaluation module and an intelligent alarm module. A two-dimensional image lossless storage mechanism is established in the data collection and storage module, the face image information is compressed and stored, and a two-dimensional image storage information base is obtained; a two-dimensional image feature recognition model and a two-dimensional image processing model are arranged in the image information recognition and processing module, a two-dimensional image information base is recognized and processed based on the models, and face monitoring information is obtained; a face analysis model and a fatigue driving evaluation system are established in the face analysis and fatigue driving evaluation module, and the module receives and processes the face monitoring information and outputs a fatigue driving evaluation result; and the intelligent alarm module sends a warning signal according to the evaluation result, so that the fatigue driving state is monitored and alarmed.

The invention is suitable for the technical field of man-machine interaction, and provides an auxiliary makeup method and system based on a user face analysis algorithm, and the method comprises the steps: firstly obtaining the intentional makeup information and multiple pieces of makeup feature information of a target user, and then obtaining the basic face information and real-time face information of the target user, and generating target makeup information based on the basic face information and the makeup feature information, generating expected makeup information based on the real-time face information and the makeup feature information, and finally sending the target makeup information and the expected makeup information to a display screen. According to the method, the user can conveniently know the final effect of the current makeup operation in real time, the user is assisted in forming a clearer expectation for the final makeup, the user can easily compare the current effect with the ideal target makeup, the user is helped to make more appropriate adjustment in the makeup process, the more satisfactory makeup effect is achieved, and the user experience is improved. And the user experience is obviously improved.

The present invention relates to the field of computer vision, and in particular to a lightweight face analysis method and device that takes into account global and local feature relationships. The method comprises the following steps: receiving an RGB image of a face, performing a convolution batch embedding operation on it to obtain an original feature map; performing a Transformer operation combined with convolution on the original feature map to obtain feature maps of different sizes; sending the feature maps of different sizes to FFN for feature fusion; and using the fused features to estimate the region category to which a single pixel belongs. The method of the present invention ensures that both long-distance pixel relationships and short-distance pixel relationships are taken into account by introducing a Transformer architecture and combining CNN, thereby greatly reducing the computational complexity.

The invention provides a dual-branch face image super-resolution reconstruction network based on prior information, and relates to the technical field of computer vision and image processing. The prior information-based double-branch face image super-resolution reconstruction network comprises the following contents: 1) firstly, a low-resolution image ILR passes through a convolutional layer and a PFB module, and the PFB module comprises two PAFB modules; (2) the PAFB module is responsible for fusing prior information (a human face analysis graph is adopted) and a low-resolution original feature F0 to obtain a feature F1, and the fusion mode is a cross-attention mode; according to the method, the prior information is fused with the local features and the global features respectively, and the local features and the global features fused with the prior information are fused again, so that the prior information is fully utilized; features of different depth layers are fused in a fusion mode that the features are added firstly and then pass through a CRC sequence, so that the understanding ability of the model to semantic features is improved.

The invention relates to an unconditional face image generation method and system based on end-to-end self-distillation, and the method comprises the steps: obtaining a face image, inputting the face image into a variational auto-encoder and a face analysis network, and obtaining potential features and a face region analysis result; constructing an end-to-end self-distillation unconditional generation network, and adding current and previous time step noise to the potential features to obtain temporary strong and weak random Gaussian noise; constructing face region noise based on a face region analysis result, and combining the face region noise with the noise to obtain strong and weak noise; weak noise is input into a target SiT to extract deep representation, strong noise is input into online SiT to extract shallow representation, and loss optimization parameters are aligned through representation; performing face high-order structure clustering on the deep representation to obtain a hypergraph, and calculating a Laplacian matrix as attention structure bias of online SiT; and on-line SiT, strong noise is input to predict noise, and parameters are optimized through diffusion loss. According to the invention, diversified face images can be efficiently generated with high quality, and the structure consistency and detail expression are improved.

The invention relates to the field of face capture, in particular to a VR virtual character interaction system and method based on user-defined expression and mouth shape synchronization, and the system comprises a data collection unit which is used for collecting face data of a target user; the face analysis unit is used for determining a paragraph division mode according to the face analysis state; the paragraph division unit is used for executing a paragraph division The point location processing unit is used for judging whether the sub-region is a target sub-region or not according to the motion trend median value, determining a range setting mode according to the influence coefficient difference degree of the first key point and determining a second key point setting strategy according to the motion state of the first key point; according to the invention, the virtual character interaction effect is improved.

The application provides an occlusion face recognition method based on an occlusion-feature mapping relationship, and the method comprises the following steps: establishing a face analysis and face key point detection module, obtaining a face semantic region division picture through the face analysis module; performing sub-region division on the face semantic region through the face key point detection module; inputting a pair of original face images and sub-region occlusion face images into a differential twin network to learn the mapping relationship between the occlusion and the deep feature, thereby establishing a mask dictionary of different sub-regions of the face; segmenting a binary image of the occlusion region through a segmentation network FCN-8s; merging the corresponding occlusion sub-region mask dictionary through the binary image query; multiplying the face picture to be recognized with the corresponding mask dictionary in the face recognition network to eliminate the damaged feature elements caused by the occlusion, so that the recognition rate of the occlusion face is improved; and the feasibility of the method is verified through experiments on a public data set.

The application discloses a method and device for tracing a fake face based on region classification, a medium and equipment. The method comprises the following steps: acquiring a face picture, wherein the face picture comprises a regionally fake picture, a globally fake picture and a real picture; performing face analysis on the face picture to obtain a face region picture, a background region picture and a connection region picture; performing trace feature extraction on the face picture to obtain a global feature and a global feature decision vector, and performing trace feature extraction on the face region picture, the background region picture and the connection region picture to obtain a face region feature, a background region feature, a connection region feature, a face region feature decision vector, a background region feature decision vector and a connection region feature decision vector; performing feature-level fusion and decision-level fusion on the features and the feature decision vectors to obtain a coarse-grained trace decision vector; and inputting the coarse-grained trace decision vector into a classifier to predict a trace result. The application can improve the accuracy of face tracing.

The invention relates to a face analysis method and system based on self-supervised representation learning, and the method comprises the steps: 1) obtaining a face image from a data set, and carrying out the preprocessing of the face image; 2) constructing a self-supervised local-to-global mask distillation network model to extract universal face representation; wherein a visible local feature Token sequence is extracted through an online local encoder, a target global feature Token sequence is extracted through a target global encoder, and a global feature Token sequence is predicted through a local-to-global decoder; in the model training process, the weighted sum of mask loss and distillation loss is calculated, and parameters of an online local encoder are optimized through gradient back propagation, so that iterative training of the model is realized; and 3) applying the trained online local encoder to face analysis, face key point detection, face attribute recognition or face expression recognition tasks through transfer learning. The method and the system are beneficial to obtaining the result of the face analysis task more robustly, accurately and generalizedly.

An object of a system according to an embodiment is to propose optimal makeup to a user and explain a procedure thereof.SOLUTION: A system according to an embodiment includes a face analysis unit, a makeup suggestion unit, a makeup simulation unit, and a makeup procedure explanation unit. The face analysis unit analyzes features of the face of the user. The makeup suggestion unit suggests optimal makeup based on the feature analyzed by the face analysis unit. The makeup simulator applies the makeup proposed by the makeup proposal unit to the face of the user. The makeup procedure explanation unit explains a makeup procedure applied by the makeup simulation unit.SELECTED DRAWING: Figure 1

A face analysis method based on multi-expert features and task prompts comprises the following steps: extracting aggregated multi-expert features from an input image by adopting a unified student network under the supervision of a multi-expert teacher network, generating task features according to task prompts and the aggregated multi-expert features through a feature fusion network, and analyzing the task features according to the task prompts and the aggregated multi-expert features. And finally, a face analysis result is obtained by the task head according to task feature classification. According to the invention, task features are aggregated from a plurality of teachers which are not limited to specific face downstream tasks by using a unified network, and expert features required by each downstream specific task are adaptively selected by using a unified feature fusion network with task prompts. Therefore, face recognition (metric learning), face attribute recognition (classification task) and age estimation (regression task) can be carried out at the same time, and complex and heavy specific task sub-network design is not needed.

The present invention relates to the field of image processing technology, solves the problem in the prior art that when capturing and enhancing infant facial images in infant facial recognition scenarios, multiple types of low-quality images appear, and provides an infant facial image capture and enhancement method, device, equipment and storage medium. The method comprises: acquiring multiple frames of real-time images in the scene where the infant is located; performing motion field analysis on each frame of real-time image, extracting multiple frames of first target images in which the horizontal average optical flow velocity in each of the images meets the preset requirements; performing image enhancement on each frame of the first target image, and outputting each frame of the second target image; performing facial analysis on each frame of the second target image, and outputting an image in which the infant's face is located in a preset area in the second target image. The present invention avoids the occurrence of multiple types of low-quality images when capturing and enhancing infant facial images, and improves the accuracy of infant facial recognition.