system

Abstract

We provide the system. [Solution] A means for estimating emotional states by acquiring and analyzing digital data from a voice input device, A means for classifying facial expressions by acquiring and analyzing image data from a visual input means, A means for detecting gestures by analyzing motion data, A means for integrating information obtained from the aforementioned emotional state, facial expression, and gesture to generate action suggestions, A means for displaying the generated action suggestions, A means of supporting social interaction by observing interactions in everyday environments, A system that includes this.

Claims

1. A means for estimating emotional states by acquiring and analyzing digital data from a voice input device, A means for classifying facial expressions by acquiring and analyzing image data from a visual input means, A means for detecting gestures by analyzing motion data, A means for integrating information obtained from the aforementioned emotional state, facial expression, and gesture to generate action suggestions, A means for displaying the generated action suggestions, A means of supporting social interaction by observing interactions in everyday environments, A system that includes this.

2. The system according to claim 1, wherein the suggested action includes instructions to an appropriate interaction partner based on emotional state.

3. The system according to claim 1, further comprising means for visualizing the state of social connections by continuously tracking changes in the emotions of the person interacting with and automatically generating reports.

Images