454 results about "Mood state" patented technology

The present invention is a method and system for selectively executing content on a display based on the automatic recognition of predefined characteristics, including visually perceptible attributes, such as the demographic profile of people identified automatically using a sequence of image frames from a video stream. The present invention detects the images of the individual or the people from captured images. The present invention automatically extracts visually perceptible attributes, including demographic information, local behavior analysis, and emotional status, of the individual or the people from the images in real time. The visually perceptible attributes further comprise height, skin color, hair color, the number of people in the scene, time spent by the people, and whether a person looked at the display. A targeted media is selected from a set of media pools, according to the automatically-extracted, visually perceptible attributes and the feedback from the people.

A home control system using galvanic skin responses and heart rate information and a method thereof. Whether a user is awake is judged using a galvanic skin response sensor, and the extent of stress of a user is determined using the user's heart rate, thereby extracting a user's emotional state and sleeping state. Furthermore, based on these, various systems in the home network of a user are controlled according to the user's emotional state and sleeping state. In addition, those control results are stored in a database so as to create the optimum control conditions.

Features, including one or more acoustic features, visual features, linguistic features, and physical features may be extracted from signals obtained by one or more sensors with a processor. The acoustic, visual, linguistic, and physical features may be analyzed with one or more machine learning algorithms and an emotional state of a user may be extracted from analysis of the features. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

A system and method are provided for detecting emotional states using statistics. First, a speech signal is received. At least one acoustic parameter is extracted from the speech signal. Then statistics or features from samples of the voice are calculated from extracted speech parameters. The features serve as inputs to a classifier, which can be a computer program, a device or both. The classifier assigns at least one emotional state from a finite number of possible emotional states to the speech signal. The classifier also estimates the confidence of its decision. Features that are calculated may include a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, and a variety of other statistics.

The invention provides a method for automatically identifying emotional states of a person in real-time based on physiological responses by exposing a person to a stimulus, measuring the person's physiological response to the stimulus, and comparing the measured physiological response to a known baseline physiological. The deviation of the measured physiological response from the baseline physiological response is determinative of the emotional state.

In addition to conveying primary information, human speech also conveys information concerning the speaker's gender, age, socioeconomic status, accent, language spoken, emotional state, or other personal characteristics, which is referred to as secondary information. Disclosed herein are both the means of automatic discovery and use of such secondary information to direct other aspects of the behavior of a controlled system. One embodiment of the invention comprises an improved method to determine, with high reliability, the gender of an adult speaker. A further embodiment of the invention comprises the use of this information to display a gender-appropriate advertisement to the user of an information retrieval system that uses a cell phone as the input and output device. The invention is not limited to gender and such secondary information can include, for example, any of information concerning the speaker's age, socioeconomic status, accent, language spoken, emotional state, or other personal characteristics.

Embodiments of the subject invention relate to a method and apparatus for remote evaluation of a subject's emotive and / or physiological state. Embodiments can utilize a device that can be used to determine the emotional and / or physiological state of a subject through the measurement and analysis of vital signs and / or speech. A specific embodiment relates to a device capable of remotely acquiring a subject's physiological and / or acoustic data, and then correlating and analyzing the data to provide an assessment of a subject's emotional and / or physiological state. In a further specific embodiment, the device can acquire such data, correlate and analyze the data, and provide the assessment of the subject's emotional state and / or physiological in real time.

The present invention provides methods and systems to periodically monitor the emotional state of a subject comprising the steps of: exposing the subject to a plurality of stimuli during a session; acquiring objective data from a plurality of monitoring sensors, wherein at least one sensor measures a physiological parameter; transferring the data to a database; and processing the data to extract objective information about the emotional state of the subject.

Embodiments of the invention provide a method, devices, and system for monitoring and sharing emotion-related data from one or more persons connected via the internet. An emotion monitoring device (EMD) measures physiological signals obtained from biosensors and computes emotion states relating to emotional arousal and valence. Various signal processing methods are employed to reduce artifact and improve the detection of emotional states. The EMD communicates the emotion data to an internet server via a wireless network. The internet server transmits the emotion data to other persons equipped with an EMD. Their emotion data similarly is obtained and shared with others. The networked emotion data can used to enrich online, community experiences such as games and social networks. An implementation of an EMD based on a smart phone enables emotion data to be monitored in wide area, mobile environment. The biosensors can be integrated into the casing or a cover for the mobile phone.

An Intelligent Tutoring System (ITS) system is provided that is able to identify and respond adaptively to the learner's or student's affective states (i.e., emotional states such as confusion. frustration, boredom, and flow / engagement) during a typical learning experience, in addition to adapting to the learner's cognitive states. The system comprises a new signal processing model and algorithm, as well as several non-intrusive sensing devices, and identifies and assesses affective states through dialog assessment techniques, video capture and analysis of the student's face, determination of the body posture of the student, pressure on a pressure sensitive mouse, and pressure on a pressure sensitive keyboard. By synthesizing the output from these measures, the system responds with appropriate conversational and pedagogical dialog that helps the learner regulate negative emotions in order to promote learning and engagement.

A method and apparatus are provided for accepting a call by an automatic call distributor and for automatic call handling of the call. The apparatus for automatic call handling has: a call receiving system that outputs at least one voice signal; a text voice converter having an input for the at least one voice signal, the text voice converter converting the voice signal to a text stream and providing the text stream on an output thereof; an emotion detector having an input for the at least one voice signal, the emotion detector detecting at least one emotional state in the voice signal and producing at least one tag indicator indicative thereof on an output of the emotion detector; and a scripting engine having inputs for the text stream and the at least one tag indicator, the scripting engine providing on an output thereof at least one response based on the text stream and on the at least one tag indicator. The method and apparatus provides the agents with scripts that are based on not only the content of the call from a caller, but that are also based upon the emotional state of the caller. As a result, there is a decrease in call duration, which decreases the cost of operating a call center. This decrease in the cost is a result in the amount of time an agent spends based on the agent's hourly rate and the costs associated with time usage of inbound phone lines or trunk lines.

Cognitive biometrics comprises augmenting the richness of biometric signatures that can be extracted from mouse dynamics by introducing perturbations in the response of the computer mouse and measuring the motor responses of the individual user. User responses to unexpected and subtle perturbations (e.g., small changes in mouse velocity, position and / or acceleration) reveal new unique sources of information in the mouse movement signal that reflect the user's cognitive strategies and are inaccessible via existing mouse biometric technologies. A user's response to these perturbations contains information about intrinsic cognitive qualities that can be used as a robust biometric for personal authentication and to support profiling of the individual (e.g., gender, cultural background, cognitive or emotional state, cognitive quality etc.).

Methods and apparatus for modifying a user interface as a function of the detected emotional state of a system user are described. In one embodiment, stress analysis is performed on received speech to generate an emotional state indicator value, e.g., a stress level indicator value. The stress level indicator value is compared to one or more thresholds. If a first threshold is exceeded the user interface is modified, e.g., the presentation rate of speech is slowed. If a second threshold is not exceeded, another modification to the user interface is made, e.g., the speech presentation rate is accelerated. If the stress level indicator value is between first and second thresholds, user interface operation continues unchanged. The user interface modification techniques of the present invention may be used in combination with known knowledge or expertise based user interface adaptation features.

The subject matter discloses a computerized method for real time emotion detection in audio interactions comprising: receiving at a computer server a portion of an audio interaction between a customer and an organization representative, the portion of the audio interaction comprises a speech signal; extracting feature vectors from the speech signal; obtaining a statistical model; producing adapted statistical data by adapting the statistical model according to the speech signal using the feature vectors extracted from the speech signal; obtaining an emotion classification model; and producing an emotion score based on the adapted statistical data and the emotion classification model, said emotion score represents the probability that the speaker that produced the speech signal is in an emotional state.

A system and method for selectively monitoring, recording, storing, and handling telephone conversations through the use of speech analysis is disclosed. In particular, the present invention utilizes a speech analyzer to analyze a speech signal during a telephone conversation between two parties, and a recording and storage device to record and store the telephone conversation. Based on variations in signal characteristics related to the emotional state of the caller, the system selectively generates a trigger to keep the stored recording of the telephone conversation. The present invention also selectively determines whether to send a notification in response to said trigger.

A system and method and computer program product for cognitive recording and sharing of live events. The system includes: a sensing and transmitting device that can sense the biometric signatures of an individual; a processing unit that analyses the sensed signal and initiate a set of actions; a recording device or the like to record the event; and a networked sharing device configured to subsequently share recorded event content. The system further identifies individuals' pre-cognitive inputs and additional external and internal factor input signals that are precursors to cognitive affirmation of an emotional response. These inputs will be identified, correlated, and used in training the system for subsequent identification and correlation between input factors and resulting emotional state. External factors may include: recognized emotional states, biometric inputs, and / or precognition inputs of other individuals in proximity to the subject individual. Other factors may include an individual's context.

The present invention provides a method for capturing and storing physiological response attributes measured from a user while different stimuli are presented. Each stimulus may be any multimedia object, for example text, picture, or audio / video. The measured physiological response attributes are paired with the input stimulus, and stored conjointly in one or more databases. The physiological response attributes measure an aspect of the user known as emotional valence, and relate to the emotional state of the user, such as angry or sad. The database of physiological responses attributes of multiple users is first established. Then, when the physiological response attributes of a specific user in the future is examined, the system can suggest which objects in the database best correspond. Moreover, the database can be constructed based on the responses of the individual user for their own utilization, and be updated over the course of its continued use.

A personalized service method using a user history in a mobile terminal is provided. The personalized service method using the user history in the mobile terminal includes: checking at least one of event information and context information which occurred due to a user; checking a user's location, a user's condition, a user's emotional state, or an event occurrence time when the at least one of event information and context information occur; reflecting the user's location, the user's condition, the user's emotional state, or the event occurrence time in the at least one of event information and context information, and recording the at least one of event information and context information, having reflected the user's location, the user's condition, the user's emotional state, or the event occurrence time, in a database in a diary type; and displaying a representing image corresponding to the at least one of event information and context information, having been recorded in the diary type.

The present invention relates to a method of adapting computer programs to user profiles, including providing a user with a questionnaire to determine at least one of the user's intelligence, personality, emotional state, computer experience, sensory skills, motor skills, education, and training; compiling a user profile based on data received from the questionnaire; modifying the computer programs used by the user based on the user's profile; and storing the user profile and the computer program modifications in a database for future utilization by the user. The modification of the computer programs includes modifying at least one of a user interface, workstation tools, input device and navigation, image presentation, analysis of information presented, and reporting.

An emotion monitoring method for special people includes: acquiring neural physiological information, and acquiring electroencephalogram signal and brain blood oxygen signal; performing signal treatments including signal pretreatment, feature extraction and emotion recognition; determining intervention type, determining recognized emotions, and returning to a start phase to continue monitoring if a user is calm or positive emotionally, or proceeding a next phase if not; performing systematic intervention, namely determining the manner of systematic auxiliary emotion regulation and intervention or remote intervention according to different emotions; and storing data, drawing an emotion periodic table in a certain period, and recording and storing mood fluctuations of a user. By the aid of portable detection of electroencephalogram and brain blood oxygen signals, accurate emotion status is recognized, unhealthy emotions of users and the outside world can be helped and noticed timely, humane placation measures are taken, emotion statuses of the users can be improved, mental state deterioration can be avoided for the users, and nursing burden and physiological pressure of family members of a patient with emotional disorder can also be relieved.

A biometric sensing apparatus for estimating the emotional state of a user. A self-contained biometric sensing ring is worn on the finger (or fingers) of the user during their normal activities. Biometric information is collected and sent wirelessly to the user's mobile device configured with application programming for analyzing and displaying the biometric information. The biometric ring is configured with sensors that the structure of the ring retains at a proper pressure against the finger of the user. The sensors comprise at least electrodermal response (EDR), photoplethysmograph (PPG), temperature, and acceleration. The ring has a self-contained power source, and is configured for adjustably fitting a wide range of users.

A method for selecting music based on face recognition, a music selecting system and an electronic apparatus are provided. The method includes the following steps: accessing a database to retrieve a plurality of song emotion coordinates corresponding to a plurality of songs; mapping the song emotion coordinates to an emotion coordinate graph; capturing a human face image; identifying an emotion state corresponding to the human face image, and transforming the emotion state to a current emotion coordinate; mapping the current emotion coordinate to the emotion coordinate graph; updating a song playlist according to a relative position between the current emotion coordinate and a target emotion coordinate, wherein the song playlist includes a plurality of songs to be played that direct the current emotion coordinate to the target emotion coordinate.

The invention discloses a brain electric features based emotional state recognition method. The method comprises the following steps of: data acquisition stage: under the condition of international emotional picture induction, extracting 64 brain electric data which is tested under the induction of different-happiness-level pictures; data pretreatment stage: carrying out four stages of reference electric potential variation, down sampling, band-pass filtering, electro-oculogram removal on the collected 64 brain electric data; feature extraction stage: extracting time domain features after signals after pretreatment are filtered by a common space model algorithm; and feature recognition: recognizing the features by using a support vector machine classifier, and differentiating different emotional states. According to the method, an OVR (one versus rest) common space model algorithm is used for removing the interference of background signals, and is used for the signal intensification of multiple types of emotion induced brain electricity; after the background signals are removed, the differences among different types of emotional brain electricity are intensified, the recognition accurate ratio of subjects is relatively ideal when the recognition is carried out by the time domain variance features, and the emotions of different happiness can be differentiated accurately.

A method for providing feedback in an interest centric, interactive communications environment includes providing one or more electronic devices configured to communicate over a communications network. The method includes providing one or more servers configured to provide interactive data to the electronic devices over the communications network and to control the interactive data and to coordinate participant activities via the electronic devices over the communications network. The method includes monitoring a condition of at least one of the participants via a capture device on the electronic device and generating a condition signal responsive to the monitored condition and transmitting the condition signal to one of the servers. The method includes analyzing by the server the condition signal to determine an emotional state of the participant and providing feedback to the participant based upon the determined emotional state.

A computerized method, software, and system for recognizing emotions from a speech signal, wherein statistical and MFCC features are extracted from the speech signal, the MFCC features are sorted to provide a basis for comparison between the speech signal and reference samples, the statistical and MFCC features are compared between the speech signal and reference samples, a scoring system is used to compare relative correlation to different emotions, a probable emotional state is assigned to the speech signal based on the scoring system, and the probable emotional state is communicated to a user.

Systems and methods for inducing a change in a human physiological characteristic. The physiological characteristic may correspond to an emotional state of a dialogue participant. The dialogue participant may be an individual participating in a conversation. The outcome of the conversation may be related to a business objective, such as providing high quality call center services. A sensor may monitor the physiologic characteristic. A processor may relate the physiologic characteristic to an emotional state. The processor may provide feedback to the individual based on the emotional state. The feedback may be formulated to change the individual's emotional state.

A method of recommending songs to a listener. The method obtains a set of feature values for each of a plurality of songs. Whenever a playback event is generated for a song, a first reward and a Mood State Value (“MSV”) based on a set of parameters are determined. Each feature value associated with the song is associated with the MSV and for each feature value, a second reward is calculated based on the first reward and is assigned to the feature value. A current MSV is determined and any songs having a feature value identical to a feature value associated with the current MSV are identified. For each song identified, a cumulative reward is calculated by totaling the second reward assigned to any feature values associated with the current MSV that are also associated with the song. Finally, one or more songs are recommended based on their cumulative rewards.