Information processing apparatus, information processing method, and program

Abstract

To improve technique related to the estimation of mental health.SOLUTION: An information processing apparatus 10 reads the emotion of an object person by analyzing the image of the face of the object person performing a predetermined activity, which is captured by a camera 20A, selects an emotion group including the read emotion from among emotion groups classified into a plurality of groups, selects an emotion group including the emotion after transition every time the emotion of the object person transitions, calculates a first variable on the basis of a ration of time during which the predetermined emotion group is selected, calculates a second variable on the basis of the number of times the emotion of the object person transitions between the respective emotion groups and weighting determined for each transition direction, and analyzes an effect of the predetermined activity on the emotion of the object person on the basis of the calculated first variable and second variable.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Conventionally, techniques related to estimating mental health have been known. For example, Patent Literature 1 discloses a technique for estimating the mental health of a subject based on a captured image of the subject. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-120908 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, Patent Document 1 does not disclose any technology for quantifying the mental health of a photographed subject and analyzing the quantified data. Therefore, there is room for improvement in technology related to mental health estimation.

[0005] In view of the above circumstances, an object of the present disclosure is to improve technology relating to mental health estimation. [Means for solving the problem]

[0006] An information processing device according to an embodiment of the present disclosure is an information processing device that analyzes an effect of a predetermined activity on human emotions, and includes a control unit that reads the emotions of the subject by analyzing an image of the face of the subject performing the predetermined activity captured by a camera, selects an emotion group including the read emotion from among emotion groups divided into a plurality of groups, selects an emotion group including the emotion after the transition each time the subject's emotion transitions, calculates a first variable based on the percentage of time that the predetermined emotion group is selected, calculates a second variable based on the number of times the subject's emotion transitions between each emotion group and a weighting determined for each transition direction, and analyzes the effect of the predetermined activity on the subject's emotions based on the calculated first variable and second variable.

[0007] An information processing method according to an embodiment of the present disclosure is an information processing method executed by an information processing device that analyzes an effect of a predetermined activity on human emotions, and includes: reading the emotion of the subject by analyzing an image of the face of the subject engaged in the predetermined activity captured by a camera; selecting an emotion group including the read emotion from among emotion groups divided into a plurality of groups; each time the subject's emotion transitions, selecting an emotion group including the emotion after the transition; calculating a first variable based on the percentage of time that the predetermined emotion group is selected; calculating a second variable based on the number of times the subject's emotion transitions between each emotion group and a weighting determined for each transition direction; and analyzing the effect of the predetermined activity on the subject's emotions based on the calculated first variable and second variable.

[0008] A program according to an embodiment of the present disclosure causes an information processing device that analyzes an effect of a predetermined activity on human emotions to execute the following steps: read the emotion of the subject by analyzing an image of the face of the subject performing the predetermined activity captured by a camera; select an emotion group including the read emotion from among emotion groups divided into a plurality of groups; each time the subject's emotion transitions, select an emotion group including the emotion after the transition; calculate a first variable based on the percentage of time that the predetermined emotion group was selected; calculate a second variable based on the number of times the subject's emotion transitions between each emotion group and a weighting determined for each transition direction; and analyze the effect of the predetermined activity on the subject's emotions based on the calculated first variable and second variable. Effect of the Invention

[0009] According to one embodiment of the present disclosure, techniques for estimating mental health are improved. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a schematic configuration example of a system according to an embodiment of the present disclosure. [Diagram 2] FIG. 1 illustrates an example of a system according to an embodiment of the present disclosure. [Diagram 3] 11 is a flowchart illustrating an example of the operation of the information processing device. [Figure 4] FIG. 2 is a schematic diagram showing an example of a predetermined activity. [Diagram 5] A list of emotion groups divided into a plurality of groups. [Figure 6] 13 is a diagram illustrating an example of transition directions between a plurality of emotion lists and weightings determined for each transition direction. FIG. [Figure 7] FIG. 13 is a diagram showing an example of a criterion for determining an emotion improving effect. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of the present disclosure will be described.

[0012] (Overview of the embodiment) An overview of a system 1 according to an embodiment of the present disclosure will be described with reference to Fig. 1 and Fig. 2. The system 1 includes an information processing device 10, a camera 20 (20A, 20B), and a microphone 30. The information processing device 10 and the camera 20, and the information processing device 10 and the microphone 30 are connected to each other so as to be able to communicate with each other via wire or wirelessly.

[0013] The information processing device 10 is, for example, a computer such as a server device, etc. The information processing device 10 is communicably connected to a camera 20 and a microphone 30 by wire or wirelessly.

[0014] The camera 20 is, for example, a video camera installed in a room where a predetermined activity is performed, and captures moving or still images. An example of the predetermined activity shown in FIG. 2 is an activity of creating a handicraft work by cutting out a number of pieces of colored paper 3 using a craft punch and attaching the cut out pieces of paper to a mount. The camera 20A is installed, for example, near a table 4, and captures images of the faces of the subjects 2 (in the example of FIG. 2, the number of subjects is four) performing the predetermined activity. The camera 20B is installed, for example, on a wall or ceiling in the room, and captures and monitors the entire predetermined activity. The cameras 20A and 20B transmit the captured images to the information processing device 10 by wire or wirelessly.

[0015] The microphone 30 is, for example, a microphone installed near the table 4, and collects the voice emitted by the subject person 2. The microphone 30 transmits the collected voice to the information processing device 10 via a wired or wireless connection.

[0016] First, an outline of the present embodiment will be described, and details will be described later. The information processing device 10 reads the emotion of the subject 2 by analyzing the image of the face of the subject 2 performing a predetermined activity taken by the camera 20A, selects an emotion group including the read emotion from among emotion groups divided into a plurality of groups, selects an emotion group including the emotion after the transition every time the emotion of the subject 2 transitions, calculates a first variable based on the proportion of time that the predetermined emotion group is selected, calculates a second variable based on the number of times the emotion of the subject 2 transitions between each emotion group and a weighting determined for each transition direction, and analyzes the effect of the predetermined activity on the emotion of the subject 2 based on the calculated first variable and second variable.

[0017] Thus, according to this embodiment, the information processing device 10 can analyze the effect of a predetermined activity on human emotions. Therefore, by changing the type or conditions of the predetermined activity and carrying it out, it is possible to find an element that has an optimal effect on improving emotions for each subject 2. Therefore, the technology related to mental health estimation is improved in that the probability of improving human emotions (mental health) is increased.

[0018] (Configuration of information processing device) Next, a detailed description will be given of the configuration of the information processing device 10. As shown in Fig. 1, the information processing device 10 includes an input unit 11, a storage unit 12, an output unit 13, and a control unit .

[0019] The input unit 11 includes an input interface capable of receiving, by wire or wireless, an image captured by the camera 20, or an image captured by the camera 20 and an audio picked up by the microphone 30. However, the input interface included in the input unit 11 is not limited to these.

[0020] The storage unit 12 includes one or more memories. Each memory included in the storage unit 12 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 stores any information used in the operation of the information processing device 10. For example, the storage unit 12 may store a system program, an application program, a database, software for reading emotions from a facial image and voice of a subject performing a predetermined activity, a list of emotion groups divided into a plurality of groups, and the like.

[0021] The output unit 13 includes an audio output interface capable of outputting audio, and / or a display interface capable of displaying text or video. The audio output interface is, for example, a speaker. The display interface is, for example, a display such as an LCD or an organic EL display. However, the audio output interface and the display interface are not limited to these.

[0022] The control unit 14 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination of these. The processor is, for example, but is not limited to, a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process. The programmable circuit is, for example, but is not limited to, an FPGA (Field-Programmable Gate Array). The dedicated circuit is, for example, but is not limited to, an ASIC (Application Specific Integrated Circuit). The control unit 14 controls the operation of the entire information processing device 10.

[0023] (Operation flow of information processing device) The operation of the information processing device 10 according to the present embodiment will be described with reference to Fig. 3. This operation relates to the analysis of the effect of a given activity on human emotions.

[0024] In the present disclosure, the subject is a person who is deemed to be suitable (without problems) for performing a predetermined activity. The predetermined activity includes (i) a first activity of selecting a colored paper of a favorite color from a plurality of colored papers, (ii) a second activity of cutting out the selected colored paper using a craft punch, (iii) a third activity of combining the cut-out pieces of paper by repeating the first activity and the second activity, and (iv) a fourth activity of attaching the combined pieces of paper to a mount. In the present disclosure, the predetermined activity is described as, for example, an activity of creating a handicraft, but the type of the predetermined activity is not limited to this. The predetermined activity may be, for example, an activity such as origami, playing, or recreation.

[0025] Figure 4 is a schematic diagram showing an example of a predetermined activity. The subject 2 selects a colored paper 3 that suits his / her taste from a variety of colored paper 3 (for example, the number of colors may be limited in advance by the organizer from among 180 colors), cuts the colored paper 3 into a shape of his / her choice using a craft punch, and combines the various cut-out pieces of paper. The subject 2 creates a collage (collage) by gluing the combined pieces of paper to a mount with adhesive.

[0026] In the example shown in Fig. 2, four subjects 2 are performing a predetermined activity around a table 4, but the number of subjects 2 performing the predetermined activity is not limited to four, and may be one person or a group of multiple people (other than four). The subjects 2 continue to perform the predetermined activity within a predetermined time. The predetermined time is, for example, 30 minutes, but is not limited to this.

[0027] S101: The control unit 14 acquires, via the input unit 11, an image of the face of the subject 2 performing a predetermined activity, captured by the camera 20A.

[0028] Cameras 20 (20A, 20B) are video cameras installed in a room where a predetermined activity is performed. The captured images are moving or still images. As shown in FIG. 2, camera 20A is installed, for example, near table 4, and captures an image of the face of subject 2 performing a predetermined activity. Camera 20B is installed, for example, on a wall or ceiling in the room, and captures or monitors the entire predetermined activity.

[0029] The control unit 14 may acquire the voice of the subject 2 picked up by the microphone 30 via the input unit 11.

[0030] S102: The control unit 14 analyzes the image of the face of the subject 2 performing a predetermined activity captured by the camera 20A, thereby reading the emotion of the subject 2.

[0031] The control unit 14 reads the emotion of the subject 2 using software that quantifies emotion from expressions expressed in an image of the face of the subject 2. Commercially available software (e.g., Microsoft® Azure® Face API, etc.) is used to analyze the image.

[0032] The control unit 14 analyzes the image of the face of the subject 2 acquired from the camera 20A, and reads the emotion of the subject 2, for example, once every 0.1 to 1 second.

[0033] The control unit 14 may read the emotion of the subject 2 by analyzing the voice of the subject 2 collected by the microphone 30. For the voice analysis, commercially available software (for example, Empath (registered trademark) or the like) is used.

[0034] The control unit 14 may further analyze the voice of the subject 2 acquired from the microphone 30, and read the emotion of the subject 2, for example, once every 0.1 to 1 second.

[0035] S103: The control unit 14 selects an emotion group including the read emotion from among a plurality of emotion groups.

[0036] American psychologist Paul Ekman proposed that there are six universal facial images that express human emotions: happiness, anger, sadness, disgust, fear, and surprise. In this disclosure, human emotions are considered to include, but are not limited to, the six basic emotions plus a neutral expression, for a total of seven emotions.

[0037] FIG. 5 is a list showing an example of emotion groups divided into a plurality of groups. As shown in FIG. 5, the emotion groups in the present disclosure are a positive emotion group, a negative emotion group, a normal emotion group, and other emotion groups. The emotion included in the positive emotion group is happiness, the emotions included in the negative emotion group are anger, sadness, disgust, and fear, the emotion included in the normal emotion group is expressionless, and the emotion included in the other emotion groups is surprise. In the present disclosure, expressionless refers to an emotion at a level that cannot be read as one of the above-mentioned six basic emotions in a person's normal state. However, the emotions included in each emotion group are not limited to these. The control unit 14 may store the list in the memory unit 12.

[0038] For example, when the emotion read from the subject 2 is "sadness," the control unit 14 selects the negative emotion group corresponding to "sadness."

[0039] S104: The control unit 14 monitors the transition of the emotion of the subject 2. If there is a transition in the emotion of the subject 2, the process proceeds to S105, and if there is no transition, the process proceeds to S106.

[0040] In the present disclosure, the emotion transition of the subject 2 is assumed to be a transition from a positive emotion group to a negative emotion group, a normal emotion group, or other emotion group, a transition from a negative emotion group to a positive emotion group, a normal emotion group, or other emotion group, a transition from a normal emotion group to a positive emotion group, a negative emotion group, or other emotion group, or a transition from other emotion groups to a positive emotion group, a negative emotion group, or normal emotion group, that is, a transition across emotion groups. As described above, the emotion transition of the subject 2 is determined, for example, every 0.1 to 1 second.

[0041] S105: Each time the emotion of the target person 2 changes, the control unit 14 selects an emotion group including the emotion after the transition.

[0042] Each time the emotion of the subject 2 changes, the control unit 14 cancels the selection of the emotion group before the transition and selects an emotion group corresponding to the emotion after the transition. When the emotion of the subject 2 after the transition is "happiness" and the emotion of the subject 2 before the transition is "sadness," the control unit 14 cancels the selection of the negative emotion group before the transition and selects a positive emotion group corresponding to the emotion of the subject 2 after the transition. This makes it possible to calculate the time at which each emotion group was selected from the following formula (1). For example, in the above example, if the time at which the selection of the negative emotion group started is 13:10 and the time at which the selection was cancelled is 13:15, the time at which the selection of the positive emotion group started is 13:15 and the time at which the selection was cancelled is 13:25, then the time at which the negative emotion group was selected is 5 minutes and the time at which the positive emotion group was selected is 10 minutes. Time when emotion group was selected = Time when it was deselected - Time when it was selected (minutes) (1)

[0043] S106: The control unit 14 measures whether or not a predetermined time has elapsed since the start of the predetermined activity. If the predetermined time has elapsed, the process proceeds to S107, and if not, the process returns to S101.

[0044] If it is within the predetermined time, the control unit 14 repeats steps S101 to S105. When the predetermined time has elapsed, the predetermined activity is terminated, and the effect of the predetermined activity on emotions is analyzed.

[0045] S107: The control unit 14 calculates a first variable P based on the proportion of time that a predetermined emotion group is selected.

[0046] The predetermined emotion groups are a positive emotion group and a negative emotion group. The first variable P is a numerical value obtained by subtracting a numerical value obtained by dividing a time Tn in which the negative emotion group was selected by a predetermined time Ts from a numerical value obtained by dividing a time Tp in which the positive emotion group was selected by a predetermined time Ts, as shown in the following formula (2). For example, if Tp=15 minutes, Tn=5 minutes, and Ts=30 minutes, P is calculated as 33% (decimals omitted). Note that Tp and Tn are the total times when the positive emotion group or the negative emotion group is selected multiple times within a predetermined time. P = Tp / Ts - Tn / Ts (%) (2)

[0047] S108: The control unit 14 calculates a second variable K based on the number of times the emotion of the subject 2 has transitioned between the emotion groups and the weighting determined for each transition direction.

[0048] FIG. 6 is a diagram for explaining an example of the transition direction between a plurality of emotion lists and the weighting applied to the calculation formula of the second variable for each transition direction. In FIG. 6, T1 to T12 indicate the transition direction between each emotion group, and (+1), (-1), (±0), (+2), and (-2) indicate the weighting value determined for each transition direction. Generally, when the emotion of the subject 2 transitions to a positive emotion, a positive evaluation is given, and when the emotion transitions to a negative emotion, a negative evaluation is given. As a specific example, when the emotion transitions from a negative emotion group to a positive emotion group, a weighting of plus 2 (+2) is given, and when the emotion transitions from a positive emotion group to a negative emotion group, a weighting of minus 2 (-2) is given.

[0049] As shown in the following formula (3), the second variable K is a numerical value obtained by multiplying the number of times n1 the subject's emotion transitioned from the normal emotion group to the positive emotion group (transition direction T1) and the number of times n2 the subject's emotion transitioned from other emotion groups to the positive emotion group (transition direction T2) by plus one (+1), a numerical value obtained by multiplying the number of times n3 the subject's emotion transitioned from the negative emotion group to the positive emotion group (transition direction T3) by plus two (+2), a numerical value obtained by multiplying the number of times n4 the subject's emotion transitioned from the normal emotion group to the negative emotion group (transition direction T4) and the number of times n5 the subject's emotion transitioned from other emotion groups to the negative emotion group (transition direction T5) by minus one (-1), and a numerical value obtained by multiplying the number of times n6 the subject's emotion transitioned from the positive emotion group to the negative emotion group (transition direction T6) by minus two (-2). K=n1×(+1)+n2×(+1)+n3×(+2)+n4×(-1)+n5×(-1)+n6×(-2) (3)

[0050] S109: The control unit 14 analyzes the effect of the predetermined activity on the emotion of the subject 2 based on the calculated first variable P and second variable K.

[0051] S110: The control unit 14 determines whether or not the predetermined activity has an improving effect on the emotion of the subject 2. If the predetermined activity has an improving effect on the emotion of the subject 2, the information processing is terminated, and if the activity has no improving effect, the process proceeds to S111.

[0052] FIG. 7 is a diagram showing an example of a criterion for judging the emotion improvement effect. As shown in FIG. 7, the control unit 14 judges that the predetermined activity brings about an improvement effect on the emotion of the subject 2 when the first variable P and the second variable K are positive (plus) numerical values. In the above formula (3), when there are many transitions to positive emotions, a high evaluation is given for the emotion improvement. When there is an improvement effect on the emotion of the subject 2, the control unit 14 may display on the display screen of the output unit 13 that the result is good (for example, the word OK).

[0053] S111: The control unit 14 changes the conditions of the predetermined activity and prompts the subject 2 to continue the predetermined activity.

[0054] As shown in FIG. 7, the control unit 14 determines that the predetermined activity does not bring about an improving effect on the emotion of the subject 2 when the first variable P or the second variable K is 0 or a negative numerical value.

[0055] If the predetermined activity does not improve the emotions of the subject 2, the organizer may change the conditions of the predetermined activity to encourage the subject 2 to continue the activity until an improvement effect is obtained. The conditions include, but are not limited to, reselecting a colored paper 3 that matches the preferences of the subject 2 from among the multi-colored colored paper 3, changing the number of subjects 2 who will perform the predetermined activity, lengthening or shortening the predetermined time (the time for which the predetermined activity is continued), changing the time period during which the predetermined activity is performed (performing in the morning or in the afternoon), etc. The control unit 14 may change the conditions of the predetermined activity, obtain a correlation between the first variable P or the second variable K, and present a combination of multiple colored papers 3 that will produce good results in the next activity. By changing the type or conditions of the predetermined activity and performing it, the control unit 14 becomes able to find an element that has an optimal effect on improving the emotions of the subject 2.

[0056] S112: The control unit 14 determines whether or not to continue the predetermined activity.

[0057] If the subject 2 wishes to continue the predetermined activity, the control unit 14 returns to S101 (in the example of the operational flow in FIG. 3, it returns from S112, via the in-page connector "X", to S101), and if the subject 2 does not wish to continue, it ends the information processing. The control unit 14 may store images, audio data, analysis data, etc. in the storage unit 12 during the predetermined activity, and analyze them afterwards to evaluate whether the predetermined activity on that day was good or bad.

[0058] As described above, the information processing device 10 according to this embodiment analyzes an image of the face of the subject 2 captured by the camera 20A while the subject 2 is performing a predetermined activity to read the emotions of the subject 2, selects an emotion group including the read emotion from among a plurality of emotion groups divided into groups, selects an emotion group including the emotion after the transition each time the subject 2's emotion transitions, calculates a first variable P based on the proportion of time that the predetermined emotion group was selected, calculates a second variable K based on the number of times the subject 2's emotion transitions between each emotion group and a weighting determined for each transition direction, and analyzes the effect of the predetermined activity on the emotions of the subject 2 based on the calculated first variable P and second variable K.

[0059] According to this configuration, the information processing device 10 can analyze the effect of a predetermined activity on human emotions. Therefore, by changing the type or conditions of the predetermined activity and carrying it out, it becomes possible to find an element that has an optimal effect on improving emotions for each subject 2. Therefore, the technology related to mental health estimation is improved in that the probability of improving human emotions (mental health) is increased.

[0060] Although the present disclosure has been described based on the drawings and examples, it should be noted that a person skilled in the art may make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, the functions included in each component or each step can be rearranged so as not to be logically contradictory, and multiple components or steps can be combined into one or divided. For example, in the above-mentioned embodiment, an embodiment in which the configuration and operation of the information processing device 10 are distributed to multiple computers that can communicate with each other is also possible.

[0061] Also, for example, an embodiment is possible in which a general-purpose computer functions as the information processing device 10 according to the above-described embodiment. Specifically, a program describing the processing contents for realizing each function of the information processing device 10 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by a processor. Therefore, the present disclosure can also be realized as a program executable by a processor, or a non-transitory computer-readable medium that stores the program. [Explanation of symbols]

[0062] 1 System 2. Eligible Participants 3. Colored Paper 4 Tables 10. Information processing device 11 Input section 12 Storage section 13 Output section 14 Control section 20, 20A, 20B Camera 30. Mike

Claims

1. An information processing device for analyzing an effect of a predetermined activity on a human emotion, comprising: an information processing device comprising: a control unit that reads the emotion of the subject by analyzing an image of the face of the subject performing the specified activity captured by a camera, selects an emotion group including the read emotion from among a plurality of emotion groups divided into groups, selects an emotion group including the emotion after the transition each time the subject's emotion transitions, calculates a first variable based on the percentage of time that a specified emotion group was selected, calculates a second variable based on the number of times the subject's emotion transitions between each emotion group and a weighting determined for each transition direction, and analyzes an effect of the specified activity on the emotion of the subject based on the calculated first variable and second variable.

2. 2. The information processing device according to claim 1, The predetermined activity includes a first activity of the subject selecting a colored paper of his / her favorite color from a plurality of colored papers, a second activity of cutting out the selected colored paper using a craft punch, and a third activity of assembling the plurality of cut-out pieces of paper by repeating the first activity and the second activity.

3. 3. The information processing device according to claim 2, An information processing device, wherein the specified activity further includes a fourth activity of the subject attaching the combined pieces of paper to a backing sheet.

4. 2. The information processing device according to claim 1, The control unit further reads the emotions of the subject by analyzing the voice of the subject picked up by a microphone.

5. 2. The information processing device according to claim 1, The emotion groups divided into a plurality of groups are a positive emotion group, a negative emotion group, a normal emotion group, and other emotion groups, The emotions included in the positive emotion group are happiness, The emotions included in the negative emotion group are anger, sadness, disgust, and fear; The emotion included in the normal emotion group is neutral emotion, The information processing device, wherein the emotion included in the other emotions is surprise.

6. 6. The information processing device according to claim 5, the predetermined activity is performed within a predetermined time period; the first variable is a value obtained by subtracting a value obtained by dividing a time during which the positive emotion group was selected by the predetermined time from a value obtained by dividing a time during which the negative emotion group was selected by the predetermined time, the second variable is a numerical value obtained by multiplying the number of times the subject's emotion has transitioned from the normal emotion group and other emotion groups to the positive emotion group by plus 1, a numerical value obtained by multiplying the number of times the subject's emotion has transitioned from the normal emotion group and other emotion groups to the negative emotion group by minus 1, a numerical value obtained by multiplying the number of times the subject's emotion has transitioned from the negative emotion group to the positive emotion group by plus 2, and a numerical value obtained by multiplying the number of times the subject's emotion has transitioned from the positive emotion group to the negative emotion group by minus 2.

7. 7. The information processing device according to claim 6, The information processing device, wherein the control unit determines that the specified activity has an improving effect on the subject's emotions when the first variable and the second variable are positive numerical values.

8. 7. The information processing device according to claim 6, The control unit changes the conditions of the specified activity when the first variable or the second variable is 0 or a negative numerical value, and encourages the subject to continue the specified activity.

9. 2. The information processing device according to claim 1, The information processing device wherein the control unit cancels selection of an emotion group before the transition each time the subject's emotion transitions, and selects an emotion group corresponding to the emotion after the transition.

10. An information processing method executed by an information processing device for analyzing an effect of a predetermined activity on a human emotion, comprising: Reading the emotion of the subject by analyzing an image of the face of the subject performing the predetermined activity captured by a camera; selecting an emotion group including the read emotion from among a plurality of emotion groups; selecting an emotion group including the emotion after the transition each time the emotion of the subject changes; calculating a first variable based on the percentage of time that the predetermined emotion group is selected; Calculating a second variable based on the number of times the subject's emotion has transitioned between each emotion group and a weighting determined for each transition direction; Analyzing an effect of the predetermined activity on the subject's emotions based on the calculated first variable and the calculated second variable; An information processing method comprising:

11. An information processing device for analyzing the effect of a given activity on human emotions, Reading the emotion of the subject by analyzing an image of the face of the subject performing the predetermined activity captured by a camera; selecting an emotion group including the read emotion from among a plurality of emotion groups; selecting an emotion group including the emotion after the transition each time the emotion of the subject changes; calculating a first variable based on the percentage of time that the predetermined emotion group is selected; Calculating a second variable based on the number of times the subject's emotion has transitioned between each emotion group and a weighting determined for each transition direction; Analyzing an effect of the predetermined activity on the subject's emotions based on the calculated first variable and the calculated second variable; A program to execute.

Images