397 results about "Expression Feature" patented technology

The invention discloses a human face emotion recognition method in a mobile embedded complex environment. In the method, a human face is divided into main areas of a forehead, eyebrows and eyes, cheeks, a noise, a month and a chain, and 68 feature points are further divided. In view of the above feature points, in order to realize the human face emotion recognition rate, the accuracy and the reliability in various environments, a human face and expression feature classification method is used in a normal condition, a Faster R-CNN face area convolution neural network-based method is used in conditions of light, reflection and shadow, a method of combining a Bayes Network, a Markoff chain and variational reasoning is used in complex conditions of motion, jitter, shaking, and movement, and a method of combining a deep convolution neural network, a super-resolution generative adversarial network (SRGANs), reinforcement learning, a backpropagation algorithm and a dropout algorithm is used in conditions of incomplete human face display, a multi-human face environment and noisy background. Thus, the human face expression recognition effects, the accuracy and the reliability can be promoted effectively.

The embodiment of the invention discloses a model training method for synthesizing speaking expressions. Expression characteristics, acoustic characteristics and text characteristics are obtained according to videos containing face action expressions of speakers and corresponding voices. Because the acoustic feature and the text feature are obtained according to the same video, the time interval and the duration of the pronunciation element identified by the text feature are determined according to the acoustic feature. A first corresponding relation is determined according to the time interval and duration of the pronunciation element identified by the text feature and the expression feature, and an expression model is trained according to the first corresponding relation. The expressionmodel can determine different sub-expression characteristics for the same pronunciation element with different durations in the text characteristics; the change patterns of the speaking expressions are added, the speaking expressions generated according to the target expression characteristics is determined by the expression model. The speaking expressions have different change patterns for the same pronunciation element, and therefore the situation that the speaking expressions are excessively unnatural in change is improved to a certain degree.

A facial expression recognition system includes a facial database, an image capture unit, an expression recognition data generation unit and an expression recognition unit. The facial database includes a plurality of expression information and expression features of optical flow field, wherein each of the expression features of optical flow field corresponds to one of the expression information. The image capture unit captures a plurality of facial images. The expression recognition data generation unit is coupled to the image capture unit and the facial database for receiving a first facial image and a second facial image from the image capture unit and calculating an expression feature of optical flow field between the first facial image and the second facial image corresponding to each of the expression information. The expression recognition unit is coupled to the expression recognition data generation unit for determining a facial expression corresponding to the first and second facial images according to the calculated expression feature of optical flow field for each of the expression information and the variation features in optical flow in the facial database.

An authentication and authorization method comprises the following steps: acquiring images, identifying the human face information of images, extracting the expression features of the human face information, matching the expression features with expression templates; and confirming the matched authorized information. According to the invention, based on the image identification, some kind of image features, such as human expression, serve as authentication information/password, so not only is the communication manner between the user and the equipment increased, but also new user experience is brought and the safety of the equipment is improved. The invention also discloses a processor, equipment and a mobile terminal.

The invention discloses a multi-kernel-learning-based multi-mode emotion identification method. According to the method, extraction of emotion features like an expression feature, a voice feature and a physiological feature is carried out on sample data of each mode in a multi-mode emotion database; several different kernel matrixes are constructed for each mode respectively; the kernel matrix groups corresponding to different modes are fused to obtain a fused multi-mode emotion feature; and a multi-kernel support vector machine is used as a classifier to carry out training and identification. Therefore, basic emotions like angering, disgusting, fearing, delighting, upsetting, and surprising and the like can be identified effectively.

The invention provides a three-dimensional face mesh model processing method and three-dimensional face mesh model processing equipment. The method comprises the following steps of: obtaining an original three-dimensional face mesh model corresponding to an original two-dimensional face image, wherein the original three-dimensional face mesh model contains a second expression feature point corresponding to a first expression feature point of the original two-dimensional face image; calculating a camera parameter matrix of the original three-dimensional face mesh model according to a formula (1); and mapping the second expression feature point onto the original two-dimensional face image according to the camera parameter matrix for judging the matching degree of the second expression feature point and the first expression feature point, and adjusting the original three-dimensional mesh model according to the judging result. The original three-dimensional face mesh model and the original two-dimensional face image are subjected to matching degree judgment according to the camera parameters, and the original three-dimensional face mesh model is adjusted under the condition of low matching degree, so that the regulated three-dimensional face mesh model can be enabled to achieve a better matching degree with the original two-dimensional face image.

The invention relates to a newborn painful expression recognition method based on a deep neural network. According to the method, a deep learning method based on a convolutional neural network (CNN) and a long and short term memory (LSTM) network is introduced and applied to newborn painful expression recognition work, and therefore expressions such as a slight pain and an acute pain caused when a newborn is in a silent or crying state and during pain inducing operation can be effectively recognized. The deep neural network is introduced to extract time domain features and spatial domain features of a video clip, therefore, the technical bottleneck in traditional manual design and extraction of explicit expression features is broken through, and the recognition rate and robustness under complicated conditions such as face sheltering, posture tilting and illumination changing are improved.

The invention is applicable to the communication technical field and provides a method for generating a user expression head portrait. The method comprises a step of obtaining a user image comprising a current facial expression and a step of extracting the main expression feature of the user image and generating a user expression head portrait. Correspondingly, the invention also provides a communication terminal. In this way, the user facial expression as a real-time expression head portrait is sent to a friend, the mood of the user at that time can be visually and vividly expressed, and the interest of use is raised at the same time.

The invention discloses a facial expression recognition method based on an ELM. The method comprises the steps that a facial expression image is processed to obtain a facial region, image segmentation is conducted on an expression region containing expression features to obtain an eye expression region body, a nose expression region body and a lip expression region body, then Gabor filters are used for conducting expression feature extraction on the expression region bodies to obtain a total feature vector of each expression, the obtained expression feature vectors are used for training ELM models, the ELM models for all the expressions are combined to form an ELM expression classifier, and at last, the ELM classifier is tested to achieve the purpose of expression classified recognition. The facial expression recognition method based on the ELM increases the expression recognition rate on the condition that illumination influences are avoided.

The invention discloses a robot system and method for detecting a human face and recognizing emotion. The system comprises a human face expression library collecting module, an original expression library building module, a feature library rebuilding module, a field expression feature extracting module and an expression recognizing module. The human face expression library collecting module is used for collecting a large number of human face expression color image frames through a video collecting device and processing the human face expression color image frames to form a human face expression library. The original expression library building module is used for extracting expression features after removing image redundant information of training images in the human face expression library to form an original expression feature library. The feature library rebuilding module is used for rebuilding the original expression feature library as a structuralized hash table through the distance hash method. The field expression feature extracting module is used for collecting field human face expression color image frames through the video collecting device and extracting field expression features. The expression recognizing module is used for recognizing the human face expression through the k neighbor sorting algorithm in the feature library in which the field expression features extracted by field expression feature extracting module are rebuilt.

The embodiment of the invention provides a virtual image generation method and device, electronic equipment and a storage medium. The method comprises the following steps: performing feature recognition on a frame image comprising a target object to obtain skeleton features and expression features of the target object; obtaining a basic virtual image model; based on the skeleton features of the target object, adjusting the skeleton features of the basic virtual image model to obtain a virtual image model matched with the skeleton features of the target object; based on the expression featuresof the target object, adjusting the expression features of the virtual image model to obtain a target virtual image model matched with the expression features of the target object; wherein the targetvirtual image model is used for rendering to obtain a virtual image of the target object. According to the method and the device, the personalized virtual image can be created.

The invention discloses a recording and lamplight control system and method based on face recognition and facial expression recognition. The system comprises a face image collection unit, a storage, an operation processing unit, a wireless transmission module and a lamplight theme controller. The face image collection unit is used for collecting face images and converting the collected face images into feature data to be stored; the storage is used for facial storing expression features which are offline trained and a face registering template collected primarily; the operation processing unit achieves face recognition and facial expression recognition, and sends out corresponding wireless control signals through the wireless transmission module according to a recognition analysis result; the lamplight theme controller stores lamplight themes suitable for different moods and receives controls signals sent by the wireless transmission module, and lamplight theme control signals conforming to the corresponding moods are generated and transmitted to the lamplight system. Mood recording and household control based on face recognition and facial expression recognition are achieved, the good experience can be brought to a user, and entertainment life of a home is enriched.

The invention provides a tristimania diagnosis system and method based on attention and emotion information fusion. The system comprises an emotion stimulating module, an image collecting module, a data transmission module, a data pre-processing module, a data processing module, a feature extraction module and an identification feedback module, wherein the emotion stimulating module is used for setting a plurality of emotion stimulating tasks and providing the emotion stimulating tasks to a subject; the image collecting module is used for collecting eye images and face images of the subject in the emotion stimulating task performing process; the data transmission module is used for obtaining and sending the eye images and the face images; the data pre-processing module is used for pre-processing the eye images and the face images; the data processing module is used for calculating the attention point position and the pupil diameter of the subject; the feature extraction module is used for extracting attention type features and emotion type features; and the identification feedback module is used for performing tristimania diagnosis and identification on the subject. The system and the method have the advantage that the tristimania can be comprehensively, systematically and quantificationally identified by using the attention point center distance features, the attention deviation score features, the emotion zone width and the face expression features.

The invention relates to the technical fields of expression identification and pain evaluation, and in particular relates to a method for evaluating pain by face expression. The method includes the following steps: successfully denoising and smoothing an image, detecting the position of a face in the image, conducting normalization, extracting Cabor pain expression features by separately using a Gabor filter and the maximum pooling method, and maximum pooling pain expression features and fusing the features, which realizes anti-interference capability of an expression feature vector set at the maximum, enables the extraction of more comprehensive expression features, such that the evaluation is much more accurate; and eventually training and studying the to-be-trained pain expression feature vector set by using a SVR regression classifier, and obtaining a SVR model. The method herein can effectively, fast, and accurately evaluate the grades of pain expressions.

The embodiment of the invention discloses an image recognition method and a related device for recognizing a facial expression of an image. The method comprises steps: facial feature extraction is carried out on a target image, and facial information is obtained; normalized treatment is carried out on the facial information to obtain a first dimension feature coefficient; and the feature coefficient serves as an input parameter of an expression analysis model, and an expression analysis result of the target image is acquired according to the expression analysis model, wherein the expression analysis model is a linear fitting model for facial expression features obtained through expression feature training.

The invention discloses a terminal face recognition method, which comprises the following steps that when a terminal enters a face recognition mode, corresponding face images are prompted to be sequentially recorded, face images are sequentially collected, and in addition, face expression features are extracted from the collected face images; after the face expression features are extracted, the extracted face expression features are matched with the prestored face expression features; when the extracted face expression features and the prestored face expression features are successfully matched, the condition that the face recognition passes is judged. The invention also discloses a terminal face recognition device. The terminal face recognition method and the terminal face recognition device have the advantages that the complicated degree and the accuracy of the face recognition process are improved, and the face recognition safety is improved.

The invention discloses an expandable three-dimensional display remote video communication method. According to the expandable three-dimensional display remote video communication method, the image of a first user is obtained by means of an RGB-D camera at the data transmission end, the image of the first user comprises a texture image and a depth image, facial feature information and expression feature information are extracted from the texture image, physical feature information is extracted from the depth image, and point clouds of the first user are reconstructed; all the feature information is optimized by means of the point clouds, the optimized feature information is obtained to generate a three-dimensional model A, the three-dimensional model A is projected on a corresponding texture image, the corresponding texture information is extracted, and acquired voice information, the optimized feature information and texture data are sent to a second user; at the data receiving end, the second user receives the data from the first user and extracts the optimized feature information from the received data to generate a three-dimensional model B, the three-dimensional model B is rendered by means of the texture data, and a rendering result is output through a three-dimensional display device, and the voice information is played.

The invention provides a facial expression conversion method based on identity and expression feature conversion, and mainly solves the problem of personalized facial expression. Most of the existingfacial expression synthesis work attempts to learn conversion between expression domains, so that paired samples and marked query images are needed. Identity information and expression feature information of an original image can be stored by establishing the two encoders, and target facial expression features are used as condition tags. The method mainly comprises the following steps: firstly, carrying out facial expression training, preprocessing a neutral expression picture and other facial expression pictures, then extracting identity characteristic parameters and target facial expressioncharacteristic parameters of a neutral expression, and establishing a matching model; Secondly, performing facial expression conversion, inputting the neutral expression picture into a conversion model, and applying model output parameters to expression synthesis to synthesize a target expression image. Pairing data sets of different expressions with the same identity are not limited any more, identity information of an original image can be effectively reserved due to existence of the two encoders, and conversion from a neutral expression to different expressions can be achieved.

The invention provides a micro expression automatic identification method based on multiple-dimensioned sampling. The method comprises micro expression image sequence preprocessing, micro expression feature extraction and micro expression identification. For the purpose of reducing influences exerted by face natural displacement and an ineffective area on micro expression identification, a method for automatically aligning a face and effectively partitioning a face area, and thus the robustness of an identification result is improved; and for the purpose of solving the defect of an existing feature descriptor, the invention brings forward a novel micro expression feature description operator CPTOP, the CPTOP operator the same sampling point number as a LBP-TOP operator yet employs a multiple-dimensioned sampling strategy, and under the same time complexity and space complexity, better description information is obtained.