1621 results about "Facial expression" patented technology

A system enables capturing biometric information while a user is perceiving a particular product, service, creative work or thing. For example, while movie-goers watch a movie, the system can capture and recognize the facial expressions, vocal expressions and/or eye expressions (e.g., iris information) of one or more person's in the audience to determine an audience's reaction to movie content. Alternatively, the system could be used to evaluate an audience's reaction to a public spokesman, e.g., political figure. The system could be useful to evaluate consumer products or story-boards before substantial investment in movie development occurs. Because these biometric expressions (laughing, crying, etc.) are generally universal, the system is generally independent of language and can be applied easily for global-use products and applications. The system can store the biometric information and/or results of any analysis of the biometric information as the generally true opinion of the particular product, service, creative work or thing, and can then enable other potential users of the product to review the information when evaluating the product.

The present invention is a method and system for measuring human response to retail elements, based on the shopper's facial expressions and behaviors. From a facial image sequence, the facial geometry—facial pose and facial feature positions—is estimated to facilitate the recognition of facial expressions, gaze, and demographic categories. The recognized facial expression is translated into an affective state of the shopper and the gaze is translated into the target and the level of interest of the shopper. The body image sequence is processed to identify the shopper's interaction with a given retail element—such as a product, a brand, or a category. The dynamic changes of the affective state and the interest toward the retail element measured from facial image sequence is analyzed in the context of the recognized shopper's interaction with the retail element and the demographic categories, to estimate both the shopper's changes in attitude toward the retail element and the end response—such as a purchase decision or a product rating.

The present invention provides a system and method for input of images containing faces for accessing, linking, and or visualizing multiple similar facial images and associated electronic data for innovative new on-line commercialization, medical and training uses. The system uses various image capturing devices and communication devices to capture images and enter them into a facial image recognition search engine. Embedded facial image recognition techniques within the image recognition search engine extract facial images and encode the extracted facial images in a computer readable format. The processed facial images are then entered for comparison into at least one database populated with facial images and associated information. Once the newly captured facial images are matched with similar “best-fit match” facial images in the facial image recognition search engine's database, the “best-fit” matching images and each image's associated information are returned to the user. Additionally, the newly captured facial image can be automatically linked to the “best-fit” matching facial images, along with comparisons calculated, and/or visualized. Key new use innovations of the system include but are not limited to: input of user selected facial images for use finding multiple similar celebrity look-a-likes, with automatic linking that return the look-a-like celebrities' similar images, associated electronic information, and convenient opportunities to purchase fashion, jewelry, products and services to better mimic your celebrity look-a-likes; health monitoring and diagnostic use by conveniently organizing and superimposing periodically captured patient images for health professionals to view progress of patients; entirely new classes of semi-transparent superimposed training your face to mimic other similar faces, such as mimic celebrity look-a-like cosmetic applications, and or facial expressions; intuitive automatic linking of similar facial images for enhanced information technology in the context of enhanced and improved organization, classification, and fast retrieval objects and advantages; and an improved method of facial image based indexing and retrieval of information from the web-crawler or spider searched Web, USENET, and other resources to provide new types of intuitive easy to use searching, and/or combined use with current key-word searching for optimized searching.

The present invention is a method and system for measuring human emotional response to visual stimulus, based on the person's facial expressions. Given a detected and tracked human face, it is accurately localized so that the facial features are correctly identified and localized. Face and facial features are localized using the geometrically specialized learning machines. Then the emotion-sensitive features, such as the shapes of the facial features or facial wrinkles, are extracted. The facial muscle actions are estimated using a learning machine trained on the emotion-sensitive features. The instantaneous facial muscle actions are projected to a point in affect space, using the relation between the facial muscle actions and the affective state (arousal, valence, and stance). The series of estimated emotional changes renders a trajectory in affect space, which is further analyzed in relation to the temporal changes in visual stimulus, to determine the response.

A blockchain configured device-driven disintermediated distributed system for facilitating multi-faceted communication over a network. The system includes entities connected with a communications network. Each of the entities and associated devices and sensors and networks serve as a source of data records. The system includes a blockchain configured data bank accessible by each of the plurality of entities based on rules and preferences of the entities upon authorization by the blockchain configured data bank. The blockchain configured data bank includes a processing component for executing stored instructions to process the data records of the entities over the communications network. The system includes a blockchain configured component communicatively coupled to the blockchain configured data bank and adapted to be accessible by each of the plurality of entities. The system includes a validation device including a facial expression-based validation device and a geo-tagging-based validation device.

Embodiments relate to a method for real-time facial animation, and a processing device for real-time facial animation. The method includes providing a dynamic expression model, receiving tracking data corresponding to a facial expression of a user, estimating tracking parameters based on the dynamic expression model and the tracking data, and refining the dynamic expression model based on the tracking data and estimated tracking parameters. The method may further include generating a graphical representation corresponding to the facial expression of the user based on the tracking parameters. Embodiments pertain to a real-time facial animation system.

The invention discloses a conservational robot system. A human face tracking and recognizing module tracks and recognizes a human face image captured by a camera; a human facial expression recognizing module recognizes the expression; and semantic meaning is recognized after voice signals pass through a voice picking module and a voice recognizing module. The robot system understands human demands according to facial expressions and/or voice and then forms conservation statement through a knowledge inquiry module and generates voice for communication with humans through a voice generating module. The conservational robot system has voice recognizing and understanding abilities and can understand commands of users. The invention can be applied to schools, families, hotels, companies, airports, bus stations, docks, meeting rooms and so on for education, chat, conservation, consultation, etc. In addition, the invention can also help users with propaganda and introduction, guest reception, business inquiry, secretary service, foreign language interpretation, etc.

Systems and methods in accordance with embodiments of the invention enable collaborative creation, transmission, sharing, non-linear exploration, and modification of animated video messages. One embodiment includes a video camera, a processor, a network interface, and storage containing an animated message application, and a 3D character model. In addition, the animated message application configures the processor to: capture a video sequence using the video camera; detect a human face within a sequence of video frames; track changes in human facial expression of a human face detected within a sequence of video frames; map tracked changes in human facial expression to motion data, where the motion data is generated to animate the 3D character model; apply motion data to animate the 3D character model; render an animation of the 3D character model into a file as encoded video; and transmit the encoded video to a remote device via the network interface.

An information processing apparatus detects the facial expression and body action of a person image included in image information, and determines the physical/mental condition of the user on the basis of the detection results. Presentation of information by a presentation unit which visually and/or audibly presenting information is controlled by the determined physical/mental condition of the user.

A method for tracking the motion of a person's face for the purpose of animating a 3-D face model of the same or another person is disclosed. The 3-D face model carries both the geometry (shape) and the texture (color) characteristics of the person's face. The shape of the face model is represented via a 3-D triangular mesh (geometry mesh), while the texture of the face model is represented via a 2-D composite image (texture image). Both the global motion and the local motion of the person's face are tracked. Global motion of the face involves the rotation and the translation of the face in 3-D. Local motion of the face involves the 3-D motion of the lips, eyebrows, etc., caused by speech and facial expressions. The 2-D positions of salient features of the person's face and/or markers placed on the person's face are automatically tracked in a time-sequence of 2-D images of the face. Global and local motion of the face are separately calculated using the tracked 2-D positions of the salient features or markers. Global motion is represented in a 2-D image by rotation and position vectors while local motion is represented by an action vector that specifies the amount of facial actions such as smiling-mouth, raised-eyebrows, etc.

A device and system and a method for selecting and displaying images in accordance with attention responses of an image viewer. An image capture device captures a viewer image of a spatial region potentially containing a viewer of the image display device and a viewer detection mechanism analyzes the viewer image and determines whether a potential viewer is observing the display screen. A gaze pattern_analysis mechanism identifies a viewer response to a currently displayed image by analysis of the viewer's emotional response as revealed by the viewer's facial expression and other sensory inputs, and the selection of an image to be displayed is then modified in accordance with the indicated viewer's attention response.

A method of reporting consumer reaction to a stimulus and resultant report generated by (i) recording facial expressions and eye positions of a human subject while exposed to a stimulus throughout a time period, (ii) coding recorded facial expressions to emotions, and (iii) reporting recorded eye positions and coded emotions, along with an identification of the stimulus.

The present invention relates to an in-vehicle device, a vehicle, and a vehicle information processing method, which are used, for example, for assisting in driving an automobile and can properly communicate a vehicle situation to a driver. The invention expresses user's handling of the vehicle by virtual feelings on the assumption that the vehicle has a personality, and displays the virtual feelings by facial expressions of a predetermined character.

A method of assessing an individual through facial muscle activity and expressions includes receiving a visual recording stored on a computer-readable medium of an individual's non-verbal responses to a stimulus, the non-verbal response comprising facial expressions of the individual. The recording is accessed to automatically detect and record expressional repositioning of each of a plurality of selected facial features by conducting a computerized comparison of the facial position of each selected facial feature through sequential facial images. The contemporaneously detected and recorded expressional repositionings are automatically coded to an action unit, a combination of action units, and/or at least one emotion. The action unit, combination of action units, and/or at least one emotion are analyzed to assess one or more characteristics of the individual to develop a profile of the individual's personality in relation to the objective for which the individual is being assessed.

A method of rapidly and precisely managing a dialog turn between a user and an agent by using speech information, facial expression information, and delay time information includes generating first dialog turn information using dialog information analyzed from a speech uttered by the user, generating second dialog turn information using facial expression information analyzed from a face image of the user, and determining a final dialog turn using the first and second dialog turn information, information on a status of the spoken dialog system, information on whether the user speech is input, and information on a no-answer time of the user.

The invention discloses a classroom behavior monitoring system and method based on face and voice recognition. The method comprises the following steps: a camera acquires the video information of students and teachers in classrooms; voice recording equipment acquires the voice information of the students and teachers in the classrooms; a main control processor preprocesses the received video information of the students and teachers and extracts the facial expression features and behavior features of the students and teachers; the main control processor processes the received voice information of the students and extracts the voice features of the students; and the main control processor processes the received voice information of the teachers, extracts the voice features of the teachers, calculates the scores of the teaching effect of the teachers, evaluates the teaching effect of the teachers according to the scores, and provides guidance suggestions. According to the classroom behavior monitoring system and method disclosed by the invention, the classroom behaviors of the teachers and students in the classrooms are observed, and thus the accuracy and objectivity of the evaluation can be increased, the teaching methods can be improved, and the teaching quality can be increased.

The image pickup apparatus 100 comprises the image pickup unit 1 to pick up an image of the subject which a user desires, a detecting of the face image area which includes the face of the subject person in the picked-up image based on the image information of the picked-up image, a recognizing of the expression of the face in the detected face image area, a ranking of the face image areas in the order of good smile of the recognized expressions and a displaying of the face image areas F arranged in the order of ranking and the entire picked-up image G on the same screen.

The present invention relates to a system and method for implementing an assistive emotional companion for a user, wherein the system is designed for capturing emotional as well as performance feedback of a participant participating in an interactive session either with a system or with a presenter participant and utilizing such feedback to adaptively customize subsequent parts of the interactive session in an iterative manner. The interactive presentation can either be a live person talking and/or presenting in person, or a streaming video in an interactive chat session, and an interactive session can be a video gaming activity, an interactive simulation, an entertainment software, an adaptive education training system, or the like. The physiological responses measured will be a combination of facial expression analysis, and voice expression analysis. Optionally, other signals such as camera based heart rate and/or touch based skin conductance may be included in certain embodiments.

The invention relates to the field of intelligent advertisement putting and data analysis, in particular to a method and system for analyzing big data of intelligent advertisements based on face identification. The method comprises the following steps: correlatively presetting, storing face image information in a local database, and distributing corresponding user identifiers; starting application, and displaying a face identification detection interface of which at least one part is used for displaying advertisement information; performing tracking identification on faces, and extracting the characteristic values of the faces; setting the threshold values of images and judging whether the threshold values of the images are matched or not; calling related data of the identifiers and pushing personalized media information; recording advertisement watching time, clicking, residence time and identified facial expressions, and uploading to a server; clustering and analyzing acquired multi-user information to obtain statistic data; adjusting pushing of advertisement information according to the statistic data. According to the method and the system, an advertisement pushing window is added to existing face detection equipment, and consumption habits or behaviors of groups can be obtained according to data analysis, thereby providing guidance for commercial activities.

A computerized assessment system and method may be used to assess opinions or feelings of a subject (e.g., a child patient). The system and method may display a computer-generated face image having a variable facial expression (e.g., changing mouth and eyes) capable of changing to correspond to opinions or feelings of the subject (e.g., smiling or frowning). The system and method may receive a user input signal in accordance with the opinions or feelings of the subject and may display the changes in the variable facial expression in response to the user input signal. The system and method may also prompt the subject to express an opinion or feeling about a matter to be assessed.

The invention discloses an online learning system which comprises a courseware database module, a management module, and a student learning situation monitoring module. The student learning situation monitoring module comprises a face recognition module, a facial expression analysis module, a video scene analysis module, a sound recognition module, a monitoring video storage module, and a video acquisition module, and the like. The learning situation monitoring module can be applied to monitor the student learning and exam situations in real time, thereby preventing other people from taking learning and tests for someone, and improving the learning efficiency of students.