23 results about "Facial tracking" patented technology

The tracking system uses one or more light sources to direct light towards one or more of the user's eyes. A dynamic vision sensor (DVS) operably coupled to a processor is configured to visually recognize the user's eyes. The DVS has an array of photosensitive elements within a known configuration. The DVS outputs a signal corresponding to an event at a corresponding photosensitive element within the array in response to a change in the light from the light source reflected from a portion of the user's eye. The output signal includes information corresponding to the position of the corresponding photosensitive element within the array. The processor determines an association between each event and a corresponding particular light source and adapts the orientation of the user's eyes using the determined association, the relative position of the light source with respect to the user's eyes, and the position of the corresponding photosensitive element within the array.

Filtering subjects subject to facial image processing in a face-tracking environment by capturing at least one image using an image capture device, defining an inclusion polygon having at least three vertices such that at least one angle formed at at least one of said vertices is not a right angle, identifying a plurality of faces in said at least one image, defining a geometric shape around each said identified plurality of faces, respectively, excluding from further processing any of said identified faces with a defined geometric shape that that fails an inclusion criteria. Performing further processing on not-excluded identified faces to thereby determine an identification-linked property linked to such identified faces.

Provided are systems and software to empower users with limited mobility hands-free interaction with a computer system. This hands-free interaction is achieved through the combined use of facial tracking and gesture recognition technologies, to enable precise and intuitive mouse control through the analysis of facial positioning and eye events. The systems and software are adaptable to diverse applications, encompassing general computing tasks, multimedia consumption, and entertainment.

A radar transmit antenna of a head mounted device transmits a transmission radar signal to a face-region. A radar receiver antenna of the head mounted device receives a return radar signal from the face-region. The return radar signal is matched to a selected expression signal included in a plurality of expression signals stored in an expression database.

Techniques are described for improved eye-tracking through the combination of multiple sensor modalities. Embodiments of the present disclosure may include a wearable device (e.g., artificial-reality device) comprising an eye-tracking module that tracks the positions of either or both of the wearer's eyes based on image data of the eye(s) in addition to other sensor data. The additional sensor data may include, for instance, a depth sensor, an inertial sensor, a face-tracking system, or combinations thereof.

The embodiment of the invention discloses a dynamic head portrait Gaussian reconstruction method and system oriented to geometric reality. A specific embodiment of the method comprises the following steps: performing face tracking on each face image in a face image sequence to generate a model patch information set; based on the model patch information, executing a deformation operation on a Gaussian center and a covariance matrix to generate a Gaussian deformation matrix; generating a fusion deformation projection; constructing a dynamic BVH tree based on the fusion deformation projection, and executing topological rotation based on the dynamic BVH tree; selecting at least one Gaussian point as a jump point set, and constructing a local tetrahedral mesh based on the jump point set; and according to the local tetrahedral mesh, executing a triangular mesh extraction and reconstruction operation to generate a dynamic head portrait triangular mesh model. According to the embodiment, the accuracy of geometric reconstruction and the fidelity of facial details are improved, the triangular mesh extraction efficiency is improved, and rapid dynamic reconstruction can be supported.

The invention discloses a face tracking method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a target face image; if it is determined that the target face image meets the face shielding condition, taking a face area and a shielding object area of the target face image as tracking areas; determining the matching degree between the target face image and the reference face image according to the tracking area; and performing target face tracking according to the matching degree between the target face image and the reference face image. According to the invention, the face tracking accuracy can be improved.

A tracking system uses one or more light sources to direct light toward one or more of a user's eyes. A dynamic vision sensor (DVS) operably coupled to a processor is configured to view the user's eyes. The DVS has an array of light-sensitive elements in a known configuration. The DVS outputs signals corresponding to events at corresponding light-sensitive elements in the array in response to changes in light from the light sources reflecting from a portion of the user's eyes. The output signals include information corresponding to locations of the corresponding light-sensitive elements in the array. The processor determines an association between each event and a corresponding particular light source and fits an orientation of the user's eyes using the determined association, the relative location of the light sources with respect to the user's eyes and the locations of the corresponding light-sensitive elements in the array.

The application provides a small animal-oriented face tracking image transmission system, comprising a transmitting end, a receiving end and an animal end stimulator; the transmitting end is an animal wearing structure, comprising a miniature camera and a wireless transmitting module; the miniature camera is used for capturing face images; the wireless transmitting module establishes communication with the receiving end through a wireless image transmission link and sends face video data collected by the miniature camera to the receiving end; the receiving end comprises a wireless receiving module, a video data stream module, a data analysis module and a stimulator control module. Through the cooperative matching of the transmitting end, the receiving end and the animal end stimulator, combined with wireless image transmission, face feature analysis and multi-mode stimulation feedback, the components such as the miniature camera and the wireless transmitting module in the application are small in size and light in weight, can be adapted to various small animals, and can detect small animals and reduce the dependence on manual observation.

The present invention provides a markerless AR-assisted foramen ovale puncture method and device based on facial tracking. The method includes the following steps: in the preoperative preparation stage, obtaining medical scan data of the patient's head, generating a virtual three-dimensional model of the cranial anatomical structure based on the medical scan data, and planning the optimal puncture path to enter the foramen ovale based on the virtual three-dimensional model; in the surgical implementation stage, after the doctor completes facial tracking initialization through the head-mounted display worn by the doctor, the patient's facial features are tracked in real time by the camera to generate the real-time camera posture; the virtual three-dimensional model is rendered in real time according to the real-time camera posture, and the real-time rendered foramen ovale, Meckel's capsule model, and optimal puncture path are displayed in real time on an image of the real surgical scene, so as to be displayed in real time on the head-mounted display. The present invention not only realizes markerless automatic alignment, but also provides the doctor with a clear and intuitive puncture path, significantly improving the accuracy and safety of the surgery.

The invention discloses a face tracking device, system and method. The device determines a behavior state corresponding to a face region of a user based on a plurality of real-time images. The device adjusts an inference rate of a neural network based on the behavior state. The apparatus generates face tracking information corresponding to the user based on the plurality of real-time images and the neural network, where the neural network is controlled to be executed based on the reasoning rate. The face tracking technology provided by the invention improves the execution efficiency of the device.

The present application provides a facial tracking method, device and storage medium, which includes: receiving multiple image frames, the multiple image frames including the face of a target person, obtaining the posture data of the target person's face in two adjacent image frames, obtaining the change in the posture data of the target person's face in the two adjacent image frames, and then adjusting the key point positions of the target person's face in the latter image frame of the two adjacent image frames based on the change in the posture data of the target person's face in the two adjacent image frames, so as to improve the detection and tracking effect of the facial key points.

The invention provides a short play video character facial feature intelligent matching analysis method, which comprises the following steps: analyzing a short play video, identifying adjacent frame pairs before and after hard cutting, separating a facial region and a clothing region from each frame, and obtaining a facial region pixel set and a clothing region pixel set; for the facial region pixel set and the clothing region pixel set, extracting facial Lab color space chromaticity coordinates and clothing Lab color space chromaticity coordinates of the frames before and after hard cutting; extracting the overall light source color temperature of the frames before and after hard cutting through the clothing color synchronous change mark, and correcting the color space chromaticity coordinates of the face Lab by adopting white balance to obtain the corrected skin color chromaticity coordinates; and determining a continuous tracking path according to the identity attribution of the same person and the face tracking chains of the frames before and after hard cutting.

A head mounted display for eye and face tracking includes an optical assembly arranged proximate to a user's eyes, a display panel arranged behind the optical assembly and visible to the user through the optical assembly along a line of sight of the user, a camera arranged within the display panel so that the user's eyes are visible to the camera through the optical assembly, and a light source arranged proximate to the camera so that light from the light source is incident upon the user's eyes through the optical assembly.

A wearable or a mobile device includes a camera to capture an image of a scene with a face and a display for displaying an image overlaid on the face. Execution of programming by a processor configures the device to perform functions, including functions to capture, via a camera of an eyewear device, an image of a scene including a face, identify the face in the image of the scene, track positional information of the face with respect to the eyewear device, generate an overlay image responsive the positional information, and present the overlay image on an image display.

Embodiments described herein include an expressive icon system to present an animated graphical icon, wherein the animated graphical icon is generated by capture facial tracking data at a client device. In some embodiments, the system may track and capture facial tracking data of a user via a camera associated with a client device (e.g., a front facing camera, or a paired camera), and process the facial tracking data to animate a graphical icon.

The utility model relates to the technical field of cosmetic mirrors, and discloses a cosmetic mirror with an angle rotating mechanism, which comprises an electric rotating base body, an adjusting assembly is arranged on the upper surface of the electric rotating base body, the adjusting assembly comprises a support frame, and a swing frame is arranged in the support frame. According to the make-up mirror with the angle rotating mechanism, through cooperation of the electric rotating base body and the adjusting assembly, flexible adjustment of the left-right angle and the up-down inclination of the mirror body is achieved, the best view angle can be easily found for making up, shaving or daily appearance tidying, diversified use requirements are met, and the make-up mirror is suitable for popularization and application. After adjustment is completed, the mirror body can be ensured to be stable and immovable by means of excellent stability, shaking caused by slight touch is avoided, and the use effect is prevented from being affected, the face tracking sensor is additionally arranged, the position change of the face of a user can be sensed in real time, the angle of the mirror body can be rapidly and accurately adjusted, the user does not need to manually adjust, and the optimal visual effect is always kept.

This invention relates to the field of medical image processing technology, and in particular to a system for image recognition and oral motor assessment of neonatal feeding behavior. The system includes a data acquisition module, a feature extraction module, a differential geometry modeling module, a trajectory analysis module, a cooperative motion analysis module, an anomaly detection module, a result display module, and an application service module. The system employs a high-speed camera, a 3D facial tracking camera, and an optical perspective camera working collaboratively. It simultaneously acquires multi-view image data of neonatal facial and oral motor movements through a data acquisition and analysis instrument. Innovatively, it applies differential geometry theory to oral motor analysis, treating facial feature point groups as Riemannian manifolds embedded in 3D Euclidean space. Through curvature feature calculation, shape operator construction, and differential invariant extraction, it accurately characterizes oral motor properties. The system constructs a coupled model of the lip manifold and the mandibular manifold, analyzing the synchronicity measurement and topological features between the manifolds to achieve accurate detection of feeding abnormalities.

This invention provides a facial recognition system, a facial recognition program, and a facial recognition method for appropriately performing authentication processing for online learning. [Solution] A facial recognition system for performing facial recognition of online learning participants, wherein the information processing device 1 comprises an acquisition unit 12, a tracking processing unit 13, and an authentication processing unit 15, and the authentication device 4 comprises an authentication database 5, the authentication database stores authentication facial information for authenticating participants, the acquisition unit acquires the participant's facial information while they are taking the online learning course, the tracking processing unit performs facial tracking based on the facial information, and the authentication processing unit performs authentication based on the facial information from which the facial tracking process was successful and the authenticated facial information.

Embodiments described herein include an expressive icon system to present an animated graphical icon, wherein the animated graphical icon is generated by capture facial tracking data at a client device. In some embodiments, the system may track and capture facial tracking data of a user via a camera associated with a client device (e.g., a front facing camera, or a paired camera), and process the facial tracking data to animate a graphical icon.

A computing system can determine, based on one or more sensors associated with a handheld device, a device pose of the handheld device in a real-world space. The system can determine, based on facial tracking data of the handheld device, a head pose of a first user associated with the handheld device, the head pose being relative to the handheld device in the real-world space; the system can render, in a virtual space, a first avatar associated with the first user based on the head pose of the first user in the real-world space. The system can render, in the virtual space, one or more virtual objects for the first user based on the head pose of the first user in the real-world space.

Methods, systems, and techniques for rendering effects, such as makeup effects, are provided (e.g., in embodiments). In an embodiment, facial shaping of facial features located by a facial tracking engine is performed by mapping and warping. The rendering renders the facial features as distorted. In an embodiment, an input image is processed using a face tracking engine having one or more deep neural networks to locate facial features of a face; and rendering an output image using a rendering pipeline, the output image including a makeup effect at locations associated with at least some of the facial features to simulate a virtual trial of the makeup product, the effect having a 2D shape obtained from a predefined 2D masked image adjusted using the 3D shape of the locations.