30 results about "Facial tracking" patented technology

Method of applying virtual makeup and producing makeover effects to 3D face model driven by facial tracking in real-time includes the steps: capturing static or live facial images of a user; performing facial tracking of facial image, and obtaining tracking points on captured facial image; and producing makeover effects according to tracking points in real time. Virtual makeup can be applied using virtual makeup input tool such as a user's finger sliding over touch panel screen, mouse cursor or an object passing through makeup-allowed area. Makeup-allowed area for producing makeover effects is defined by extracting feature points from facial tracking points and dividing makeup-allowed area into segments and layers; and defining and storing parameters of makeup-allowed area. Virtual visual effects including color series, alpha blending, and / or superposition are capable of being applied. Makeover effect takes into account of lighting condition, facial posture rotation, face size scaling, and face translation, respectively.

Herein described is a system and method that tracks the face of a person engaged in a videophone conversation. In addition to performing facial tracking, the invention provides stabilization of facial images that are transmitted during the videophone conversation. The face is tracked by employing one or more algorithms that correlate videophone captured facial images against a stored facial image. The face may be better identified by way of employing one or more voice recognition algorithms. The one or more voice recognition algorithms may correlate utterances of the person engaged in a conversation to one or more stored utterances. The identified utterances are subsequently mapped to a stored facial image. In a representative embodiment, the system used for performing facial tracking and image stabilization comprises an image sensor, a lens, an actuator, and a controller / processor.

The invention provides a target tracking method and device. The method includes the following steps that: a moving object is detected from a shot video stream, wherein the video stream includes various video images; face images are searched from the video images corresponding to the detected moving object; facial tracking features corresponding to the searched face images are obtained, wherein the face tracking features include a facial image feature, the distance between a face and a camera and continuously-lasting time of the face in the video images; a tracking target is determined from the searched face images according to the face tracking features of the face images; and the tracking target is tracked. With the target tracking method and device of the invention adopted, the camera can actively track a figure to be photographed in a video, and the video photographing quality of the camera can be improved.

A facial tracking method for detecting and tracking at least one face image in a region during a time period. The facial tracking method includes a step of performing an image acquiring operation, a step of performing a facial detecting operation to detect whether there is any face image in the entire of a current photo image, and at least one step of performing a facial tracking operation. For performing the facial tracking operation, plural tracking frames are located around a face image of the current photo image, and a similarity between the face image of the current photo image and the image included in each tracking frame in order to judge whether the face image exists in the next photo image. By the facial tracking method of the present invention, the time period of tracking face images is largely reduced.

A method of 3D morphing driven by facial tracking is provided. First, a 3D model is loaded. After that, facial feature control points and boundary control points are picked up respectively. A configure file “A.config” including the facial feature control points and boundary control points data that are picked up corresponding to the 3D avatar is saved. Facial tracking algorithm is started, and then “A.config” is loaded. After that, controlled morphing of a 3D avatar by facial tracking based on “A.config” is performed in real time by a deformation method having control points. Meanwhile, teeth and tongue tracking of the real-time face image, and scaling, translation and rotation of the real-time 3D avatar image is also provided. In addition, a control point reassignment and reconfiguration method, and a pupil movement detection method is also provided in the method of 3D morphing driven by facial tracking.

Method of applying virtual makeup and producing makeover effects to 3D face model driven by facial tracking in real-time includes the steps: capturing static or live facial images of a user; performing facial tracking of facial image, and obtaining tracking points on captured facial image; and producing makeover effects according to tracking points in real time. Virtual makeup can be applied using virtual makeup input tool such as a user's finger sliding over touch panel screen, mouse cursor or an object passing through makeup-allowed area. Makeup-allowed area for producing makeover effects is defined by extracting feature points from facial tracking points and dividing makeup-allowed area into segments and layers; and defining and storing parameters of makeup-allowed area. Virtual visual effects including color series, alpha blending, and / or superposition are capable of being applied. Makeover effect takes into account of lighting condition, facial posture rotation, face size scaling, and face translation, respectively.

Method for automatically measuring pupillary distance includes extracting facial features of face image, a head current center indicator is shown / displayed based on facial feature extraction, elliptical frame and target center indicator are shown, a first distance between head current center indicator and target center indicator is calculated to see if below a threshold range, then allowing head current center indicator, elliptical frame and target center indicator to disappear. Card window based on facial tracking result is shown. Credit card band detection is performed to see if located within card window. Card window then disappear. Elliptical frame of moving head and target elliptical frame are shown. Elliptical frame of the moving head is aligned with the target elliptical frame and maintaining a correct head posture. If elliptical frame of moving head is aligned with target elliptical frame, then allow them to disappear from view, and performing a pupillary distance measurement.

The invention discloses an intelligent interactive teaching system with an emotion recognition function. The system comprises a database, a group of facial tracking systems, an intelligent analysis system and a terminal interaction platform, wherein inverse operation is performed on data tracked by the facial tracking systems to obtain facial feature point information, the feature point information is compared with a standard human face model set in the database, a corresponding expression is obtained through assessment, and the assessment result is sent to a teacher teaching mobile terminal in the interactive platform, so that it is convenient for a teacher to adjust teaching modes and perform information sharing and communication with a parent interactive mobile terminal on the interactive platform. According to the system, student emotions are fully concerned, intelligent teaching equipment is promoted to be more user-friendly, effective communication between a school and a family is realized, teaching quality is improved, and the system is beneficial for healthy growth and development of students.

A method of 3D morphing driven by facial tracking is provided. First, a 3D model is loaded. After that, facial feature control points and boundary control points are picked up respectively. A configure file “A.config” including the facial feature control points and boundary control points data that are picked up corresponding to the 3D avatar is saved. Facial tracking algorithm is started, and then “A.config” is loaded. After that, controlled morphing of a 3D avatar by facial tracking based on “A.config” is performed in real time by a deformation method having control points. Meanwhile, teeth and tongue tracking of the real-time face image, and scaling, translation and rotation of the real-time 3D avatar image is also provided. In addition, a control point reassignment and reconfiguration method, and a pupil movement detection method is also provided in the method of 3D morphing driven by facial tracking.

The invention provides a display device. The display device comprises a display screen module, a detection module, an instruction receiving module and an instruction executing module, wherein the detection module is used for detecting the attention concentration degrees of current one or more users in a previous preset time period and determining subjective viewers according to the attention concentration degree of each user; the instruction receiving module receives instructions sent by the subjective viewers; the instruction executing module is used for operating the display screen module according to the instructions received by the instruction receiving module. According to the scheme, the defects in the prior art are overcome, and facial tracking is carried out on the users by realizing a screen face tracking technology, the functions of automatic rotation, attention detection and voice detection are integrated, and the use convenience of products is greatly improved.

According to the invention, the face directions are divided into nine types, the image information of various face directions is used as an input parameter before neural network training and learning,and the nine face directions are used as output parameters before neural network training and learning. And the neural network performs training learning according to the known input parameters and output parameters, and the learning result is used as hidden layer data of the neural network in the use stage. Photograph information, collected by the camera device in real time, of a user is input into the neural network which completes training and learning, the neural network automatically matches a known learning result of the hidden layer according to new information of the input layer, andthe face direction of the current user is output on the output layer. After a processor obtains the face direction, the processor firstly reads the face direction-display screen ID comparison table, then the brightness of the display screen corresponding to the current face direction is improved, and the brightness of the remaining display screens is reduced. Therefore, the brightness of each display screen is adjusted in real time according to the requirements of users, and the harm of high-brightness display screens and electromagnetic radiation to human eyes is reduced.

The invention discloses a service robot. The service robot comprises a base (1), a charging platform (2), a mechanical arm (3), positioning system, a facial tracking and recognizing system (4), communication and power supply interfaces (10), a guide rail connection device (6) and a functional module. The positioning system and the facial tracking and recognizing system (4) are positioned on the mechanical arm (3); the base (1) and / or the mechanical arm (3) are provided with the communication and power supply interfaces (10); the guide rail connection device (6) is positioned on the base (1) and / or the mechanical arm (3); the functional module is connected with the base (1) and / or the mechanical arm (3) through the guide rail connection device (6). Besides basic functions including automatic charging, moving and the like, the service robot also has functions of positioning and facial recognizing and tracking. In addition, users can expand various functional modules on the mechanical arm and / or the base according to needs to establish a robot in accordance with own preferences and use habits, and accordingly utilization requirements of different users can be met, and design and use functions of the robot are remarkably promoted.

Herein described is a system and method that tracks the face of a person engaged in a videophone conversation. In addition to performing facial tracking, the invention provides stabilization of facial images that are transmitted during the videophone conversation. The face is tracked by employing one or more algorithms that correlate videophone captured facial images against a stored facial image. The face may be better identified by way of employing one or more voice recognition algorithms. The one or more voice recognition algorithms may correlate utterances of the person engaged in a conversation to one or more stored utterances. The identified utterances are subsequently mapped to a stored facial image. In a representative embodiment, the system used for performing facial tracking and image stabilization comprises an image sensor, a lens, an actuator, and a controller / processor.

A facial tracking method for detecting and tracking at least one face image in a region during a time period. The facial tracking method includes a step of performing an image acquiring operation, a step of performing a facial detecting operation to detect whether there is any face image in the entire of a current photo image, and at least one step of performing a facial tracking operation. For performing the facial tracking operation, plural tracking frames are located around a face image of the current photo image, and a similarity between the face image of the current photo image and the image included in each tracking frame in order to judge whether the face image exists in the next photo image. By the facial tracking method of the present invention, the time period of tracking face images is largely reduced.

The invention relates to aggregated facial tracking in a video. A facial detecting system may analyze a video by traversing the video forwards and backwards to create tracks of a person within the video. After separating the video into shots, the frames of each shot may be analyzed using a face detector algorithm to produce some analyzed information for each frame. A facial track may be generated by grouping the faces detected and by traversing the sequence of frames forwards and backwards. Facial tracks may be joined together within a shot to generate a single track for a person's face within the shot, even when the tracks are discontinuous.

A head mounted display (HMD) in a VR system includes sensors for tracking the eyes and face of a user wearing the HMD. The VR system records calibration attributes such as landmarks of the face of theuser. Light sources illuminate portions of the user's face covered by the HMD. In conjunction, facial sensors capture facial data. The VR system analyzes the facial data to determine the orientationof planar sections of the illuminated portions of face. The VR system aggregates planar sections of the face and maps the planar sections to landmarks of the face to generate a facial animation of theuser, which can also include eye orientation information. The facial animation is represented as a virtual avatar and presented to the user. A facial tracking system generates a virtual rendering ofa portion of a face of a user wearing a head-mounted display (HMD). The facial tracking system illuminates portions of the face inside the HMD. The facial tracking system captures a plurality of facial data of the portion of the face using one or more facial sensors located inside the HMD. A plurality of planar sections of the portion of the face are identified based at least in part on the plurality of facial data. The plurality of planar sections are mapped to one or more landmarks of the face. Facial animation information is generated based at least in part on the mapping, the facial animation information describing a portion of a virtual face corresponding to the portion of the user's face.

The embodiment of the invention provides a control method for a dish-washing machine, a processor, the dish-washing machine and a storage medium. The dish-washing machine comprises induction equipment and a control panel. The control method comprises the steps of obtaining behavior data of a user through the induction equipment; determining the position of the user according to the behavior data; when it is determined that the user is close to the dish washing machine, obtaining face data of the user; and adjusting the angle of the control panel according to the face data. According to the control scheme of the dish-washing machine, a user can operate the dish-washing machine more conveniently, and when the user gets close to the dish-washing machine, the machine panel automatically rotates to a proper position, so that the user can complete operation control under the standing condition. Moreover, the face tracking unit captures the face position of the user so as to modulate the rotation angle of the control panel of the dish washing machine, more reasonable rotation angles for all the users can be determined according to the heights of the different users, and the dish washing machine has higher universal applicability.

A head mounted display (HMD) in a VR system includes sensors for tracking the eyes and face of a user wearing the HMD. The VR system records calibration attributes such as landmarks of the face of the user. Light sources illuminate portions of the user's face covered by the HMD. In conjunction, facial sensors capture facial data. The VR system analyzes the facial data to determine the orientation of planar sections of the illuminated portions of face. The VR system aggregates planar sections of the face and maps the planar sections to landmarks of the face to generate a facial animation of the user, which can also include eye orientation information. The facial animation is represented as a virtual avatar and presented to the user. A facial tracking system generates a virtual rendering of a portion of a face of a user wearing a head-mounted display (HMD). The facial tracking system illuminates portions of the face inside the HMD. The facial tracking system captures a plurality of facial data of the portion of the face using one or more facial sensors located inside the HMD. A plurality of planar sections of the portion of the face are identified based at least in part on the plurality of facial data. The plurality of planar sections are mapped to one or more landmarks of the face. Facial animation information is generated based at least in part on the mapping, the facial animation information describing a portion of a virtual face corresponding to the portion of the user's face.

The invention discloses a face tracking method and equipment, which uses a pre-established 3D face model to perform face alignment processing on images of human faces acquired in real time through camera equipment, and uses a frame of image that has completed face alignment for the first time as an initial frame image , and obtain the three-dimensional coordinates of each feature point in the initial frame image, then take the initial frame image as the first frame image, track through the feature points of the previous frame image, and obtain the tracked matching features from the next frame image point set, using the matching feature point set to obtain the three-dimensional coordinates of each feature point in the next frame image. The face tracking method and equipment provided by the present invention are used to solve the technical problem that the existing face tracking method cannot track the rotation of a large angle and have poor robustness, and realize that the face can still be rotated at a large angle. Effective tracking and technical effects that can improve robustness.

The invention discloses a premature infant skin moisture analysis method. The premature infant skin moisture analysis method comprises the following steps: performing face tracking on a face region of an infant by adopting an inter-frame difference method to acquire an infant face video; extracting the ROI region of the baby in each frame of picture of the video; the method comprises the following steps: segmenting a baby ROI region, carrying out three-primary-color separation on a segmented image to generate RGB three-channel images, carrying out skin pixel processing on each channel image, and generating preprocessed digital signals of three channels of green, blue B and red; performing standardization processing on the original signal to generate three new signals; performing FFT (Fast Fourier Transform) to obtain a spectrogram, and selecting the maximum peak frequency as a pulse rate estimation value; according to the obtained pulse rate estimation value, carrying out correlation analysis on the basis of taking a green channel signal as a source signal, and obtaining the absolute value of a correlation coefficient, wherein the change of the correlation coefficient is the change of skin moisture. The method and system have huge application potential and has the advantages of being high in heart rate synchronous measurement accuracy, high in noise interference resistance, large in application potential and the like.

The present invention provides a target tracking method and device. The method includes: detecting a moving target from a captured video stream, wherein the video stream includes each video image; searching for a human face from the video image corresponding to the detected moving target Image; obtain the face tracking feature corresponding to each face image found, wherein the face tracking feature includes: face image features, distance between the face and the camera, and the duration of the face in the video image; According to the face tracking features of each face image, a tracking target is determined from each found face image; and the tracking target is tracked. Through the object tracking method and device provided in the present application, the camera can actively track the person to be photographed in the video, and improve the video shooting quality of the camera.

The present application relates to a double-frame face tracking method and system based on feature extraction, wherein the method includes: obtaining the face position coordinates in the first frame image through a face detection module; Intercept the first target image, and perform feature extraction on the first target image through the face feature extraction model to obtain the first facial features; obtain the height information and width information of the first frame image, and use the height information, width information and face position coordinates Predict the coordinates of the human face area in the subsequent frame; intercept the second target image on the subsequent frame image according to the coordinates of the facial area in the subsequent frame; input the first facial features and the second target image into the double-frame face tracking model, and pass the double-frame human The face tracking model acquires the face position coordinates of the second target image. This application solves the problem of the slow response speed of the access control equipment caused by the large calculation amount of the face tracking algorithm in the related art, reduces the calculation amount in the process of face tracking, and improves the response speed.

An emotional enhancement system for music and film that uses audio and video input to select or generate a stimulation pattern which stimulates the user's face using lights and electrical stimulation directed to certain points on the user's face and head which are believed to induce certain emotions. Using the system, a user's emotional experience of the music or film can be enhanced by inducing emotions in the user coordinated with portions of the music or film. In some embodiments, biometric sensors or cameras and facial tracking software may be used to monitor the emotions displayed by a user while listening to music or watching films, and adjust the stimulation accordingly.

Method for automatically measuring pupillary distance includes extracting facial features of face image, a head current center indicator is shown / displayed based on facial feature extraction, elliptical frame and target center indicator are shown, a first distance between head current center indicator and target center indicator is calculated to see if below a threshold range, then allowing head current center indicator, elliptical frame and target center indicator to disappear. Card window based on facial tracking result is shown. Credit card band detection is performed to see if located within card window. Card window then disappear. Elliptical frame of moving head and target elliptical frame are shown. Elliptical frame of the moving head is aligned with the target elliptical frame and maintaining a correct head posture. If elliptical frame of moving head is aligned with target elliptical frame, then allow them to disappear from view, and performing a pupillary distance measurement.

The invention discloses a service robot. The service robot comprises a base (1), a charging platform (2), a mechanical arm (3), positioning system, a facial tracking and recognizing system (4), communication and power supply interfaces (10), a guide rail connection device (6) and a functional module. The positioning system and the facial tracking and recognizing system (4) are positioned on the mechanical arm (3); the base (1) and / or the mechanical arm (3) are provided with the communication and power supply interfaces (10); the guide rail connection device (6) is positioned on the base (1) and / or the mechanical arm (3); the functional module is connected with the base (1) and / or the mechanical arm (3) through the guide rail connection device (6). Besides basic functions including automatic charging, moving and the like, the service robot also has functions of positioning and facial recognizing and tracking. In addition, users can expand various functional modules on the mechanical arm and / or the base according to needs to establish a robot in accordance with own preferences and use habits, and accordingly utilization requirements of different users can be met, and design and use functions of the robot are remarkably promoted.

The invention discloses a method for preventing cheating by adopting a face tracking technology based on a camera in an online examination. The method comprises the following steps: S1, starting a face recognition technology and a living body detection biological recognition technology; s2, starting a face tracking technology, and marking the face position of the examinee in real time in a video monitoring area of an examination answering page of the examinee; the face tracking technology comprises three modes, namely a multi-person mode, an unmanned mode and a random mode, and the face tracking technology records a face coordinate change curve; and S3, uploading the collected facial coordinates to a terminal, and determining whether the examinee cheats by adopting video attacks and virtual cameras. A face tracking technology is added on the basis of a living body detection biological recognition technology, the face tracking technology comprises a multi-person mode, an unmanned mode and a random mode, the unmanned mode and the multi-person mode can effectively reduce the misjudgment phenomenon caused by the fact that the faces of examinees are not all in a camera viewing frame during photo snapshot in examination and verification, and the examination efficiency is improved. And the workload of manual confirmation of teachers is reduced.