Estimation device, estimation system, estimation method, and control program

Abstract

To estimate an emotional change of a listener in a communication field where participants have different roles.SOLUTION: An estimation device (10) includes an acquisition unit (11) that acquires first information on a first participant and second information on a second participant, a first calculation unit (121) that calculates a first temperature indicating a state of the first participant as a temperature, a second calculation unit (122) that calculates a second temperature indicating a state of the second participant as a temperature, a third calculation unit (123) that calculates a temperature of a place, and an estimation unit (124) that estimates an emotional change of the second participant.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an estimation device or the like that estimates emotional changes of participants in a communication situation, particularly of participants who will be listeners. [Background technology]

[0002] When communicating with others, people feel a connection with others not only through the information in the words themselves (speech information), but also through non-speech information such as nodding, responses, facial expressions, and gazes, which are not information in the words themselves. In other words, when people communicate with each other, the addition of non-speech information to speech information creates a sense of unity and excitement in the atmosphere, which allows people to feel a connection with others.

[0003] Therefore, it is difficult to estimate the atmosphere of a communication situation from utterance information alone, and various information is required. Therefore, for example, Patent Document 1 describes an emotion estimation device that estimates the group emotion of a group consisting of multiple people from information about the emotions of individuals, using a state transition model that estimates the current group emotion from at least one of individual emotions and previously estimated group emotions. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-186521 Summary of the Invention [Problem to be solved by the invention]

[0005] Communication is not limited to situations where one participant acts as a speaker and the other as a listener, and in other situations, one participant acts as a listener and the other as a speaker, with participants alternately acting as speakers and listeners. For example, there are communication situations where one participant primarily acts as a speaker and the other primarily acts as a listener. Such communication situations where participants play different roles differ from communication situations where all participants are facing the same direction. Therefore, it is difficult for emotion estimation devices of the prior art to uniformly estimate the atmosphere, excitement, emotional changes of participants, etc., of a communication situation.

[0006] One aspect of the present invention has been made in consideration of such problems, and its purpose is to realize an estimation device or the like that can estimate emotional changes of a participant who is primarily a listener in a communication situation where the participants have different roles. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems, an estimating device according to one aspect of the present invention is an estimating device that estimates an emotional change of a first participant who is primarily a speaker and one or more second participants who are primarily listeners in a communication situation, the estimating device including an acquiring unit that acquires one or more types of first information about the first participant and one or more types of second information about the second participant, a first calculating unit that calculates a first temperature that indicates a state of the first participant as a temperature, a second calculating unit that calculates a second temperature that indicates a state of the second participant as a temperature, and a temperature calculating unit that calculates the temperature of the situation. and an estimation unit that estimates an emotional change of the second participant using the second temperature, wherein the first calculation unit calculates the first temperature using a result of a weighted linear combination of the first information and an amount of heat transfer from the first participant to the venue, the second calculation unit calculates the second temperature using a result of a weighted linear combination of the second information and an amount of heat transfer from the venue to the second participant, and the third calculation unit calculates the temperature of the venue using the amount of heat transfer from the first participant to the venue and the amount of heat transfer from the venue to the second participant. Here, "indicating the state of the participants as a temperature" means "indicating the psychological state of the participants as a virtual temperature."

[0008] In order to solve the above problem, an estimation system according to one embodiment of the present invention includes the estimation device, a first participant terminal communicatively connected to the estimation device, which acquires the first information of the first participant from the first participant, and a second participant terminal communicatively connected to the estimation device, which acquires the second information of the second participant from the second participant, wherein the estimation device acquires the first information from the first participant terminal and the second information from the second participant terminal.

[0009] In order to solve the above-mentioned problems, an estimation method according to one embodiment of the present invention is a method for estimating an emotional change of a first participant in a communication situation between a first participant who is primarily a speaker and one or more second participants who are primarily listeners, the method including: an acquisition step of acquiring one or more types of first information about the first participant and one or more types of second information about the second participant; a calculation step of calculating a first temperature indicating the state of the first participant as a temperature, a second temperature indicating the state of the second participant as a temperature, and the temperature of the situation using the first information and the second information; and an estimation step of estimating an emotional change of the second participant using the second temperature.

[0010] The estimation device according to each aspect of the present invention may be realized by a computer. In this case, the control program for the estimation device, which causes the computer to operate as each part (software element) of the estimation device, thereby realizing the estimation device on the computer, and the computer-readable recording medium on which the control program is recorded, also fall within the scope of the present invention. [Effects of the Invention]

[0011] According to one aspect of the present invention, in a communication situation in which participants have different roles, it is possible to estimate the emotional change of a participant who is primarily a listener. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating an overview of an estimation system according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a functional block diagram showing the configuration of a main part of the estimation system. [Figure 3] FIG. 2 is a diagram illustrating an example of a first participant terminal, a second participant terminal, and a sensor terminal. [Figure 4] 10 is a flowchart showing a processing flow in the estimation device. [Figure 5] FIG. 10 is a diagram for explaining an outline of an estimation system according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] [Embodiment 1] An embodiment of the present invention will be described in detail below. First, an overview of an estimation system 1 according to this embodiment will be described with reference to FIG. 1. The estimation system 1 estimates emotional changes of a second participant, i.e., a listener, in a communication space between a first participant who is primarily the speaker and a second participant who is primarily the listener. Hereinafter, the communication space will also be referred to simply as a "space." Specifically, the estimation system 1 treats the communication space as a virtual temperature space, assigns heat capacities to the participants and the space, and estimates emotional changes of the second participant by calculating the temperatures of the first participant, the second participant, and the space using the amount of heat transfer from the first participant to the space and the outside, the amount of heat transfer from the space to the second participant and the outside, and the amount of heat transfer from the second participant to the outside. Note that the temperature, heat capacity, and temperature and heat capacity of the space, as well as the temperature and heat capacity of the participants described in this embodiment, are virtually set and do not represent actual temperatures and heat capacities.

[0014] FIG. 1 shows, as an example, a state in which a first participant S and a second participant L are communicating. Here, the first participant S is the main speaker, and the second participant L is the main listener. In the estimation system 1, the place of communication is defined as a temperature space F, and the temperature of the temperature space F is defined as T F , heat capacity is C F Also, the temperature of the first participant S is set as T S , heat capacity is C S , the temperature of the second participant L is T L , heat capacity is C L Then, the amount of heat transferred from the first participant S to the temperature space F is set as Q SF , the amount of heat transferred from the first participant S to the outside of the temperature space F is Q SO , the amount of heat transferred from the temperature space F to the second participant L is Q FL , the amount of heat moving out from the temperature space F is Q FO , the amount of heat transferred from the second participant L to the outside of the temperature space F is Q LO From the amount of heat transfer, the temperature T of the second participant L is calculated.L The emotional change of the second participant L is estimated using an estimation model that estimates

[0015] Figure 2 shows a functional block diagram of the estimation system 1. As shown in Figure 2, the estimation system 1 includes an estimation device 10, a first participant terminal 20A, and a second participant terminal 20B. The estimation device 10 is communicatively connected to the first participant terminal 20A and the second participant terminal 20B. The first participant terminal 20A is a terminal owned by the first participant S, and the second participant terminal 20B is a terminal owned by the second participant L. When there is no need to distinguish between the first participant terminal 20A and the second participant terminal 20B, they are simply referred to as participant terminals 20.

[0016] The estimation device 10 estimates emotional changes of a listener in a communication situation, and includes an acquisition unit 11, an estimation processing unit 12, and an output unit 13.

[0017] The acquisition unit 11 acquires participant information (first information) about the first participant S from the first participant terminal 20A, and acquires participant information (second information) about the second participant L from the second participant terminal 20B. The participant information is information indicating the participant's speech information, facial expression, gaze direction, presence or absence of body movement, presence or absence of blinking, pupil size, degree of eye opening, heart rate, blood pressure, sweating, breathing, etc.

[0018] The acquisition unit 11 periodically acquires participant information. In the following, with regard to the sampling rate of the participant information acquired by the acquisition unit 11 and processed by the estimation processing unit 12, a sampled frame is represented by a frame number i. For example, the (i+1) frame indicates the frame next to the i frame, and the (i-1) frame indicates the frame immediately before the i frame. The sampling rate may be the same as the frequency at which the acquisition unit 11 acquires participant information, or may be converted from the frequency at which the acquisition unit 11 acquires participant information.

[0019] The speech information may be, for example, the presence or absence of speech, the speech rate, voice volume, shimmer (fluctuation in voice volume), fundamental frequency, jitter (fluctuation in frequency), formants (first, second, and third formants), and speech features (e.g., Mel-Frequency Cepstrum Coefficients (MFCCs)). This information can be acquired using known techniques, and therefore, detailed explanations of the acquisition methods will be omitted.

[0020] Of the participant information, the participant's facial expression, gaze direction, whether or not they made any physical movements, whether or not they blinked, pupil size, and eye opening degree are obtained by, for example, analyzing an image captured by the camera 21 of the participant terminal 20 using an image analysis unit (not shown). Since it is possible to extract facial expression, gaze direction, whether or not they made any physical movements, whether or not they blinked, pupil size, eye opening degree, etc. from the captured image using known technology, detailed explanations thereof will be omitted here.

[0021] Furthermore, the participant's heart rate, blood pressure, amount of sweat, etc. are detected by, for example, the sensor terminal 22 worn by the participant, and are acquired via the participant terminal 20.

[0022] The estimation processing unit 12 estimates emotional changes of listeners in a communication situation using the participant information of the participants acquired by the acquisition unit 11, and includes a first calculation unit 121, a second calculation unit 122, a third calculation unit 123, an estimation unit 124, and an estimation model 125. The first calculation unit 121, the second calculation unit 122, and the third calculation unit 123 may be a single component.

[0023] The estimation model 125 includes calculation formulas used by the first calculation unit 121, the second calculation unit 122, and the third calculation unit 123.

[0024] The first calculation unit 121 calculates a personal temperature T SMore specifically, the first calculation unit 121 calculates the personal temperature T of the first participant S using the following formula (1) stored in the estimation model 125: S Calculate.

[0025]

number

[0026] where T S (i) is the temperature of the first participant S in the i-th frame. S (i) is a linear combination of multiple types of participant information of the first participant S, and is calculated using the following formula (2): C S is the heat capacity of the first participant S.

[0027]

number

[0028] The meaning of each term in equation (2) is as follows: W VOICE ×OnOff S :W VOICE is the weighting constant of the first participant S's utterance, OnOff S indicates whether or not the subject spoke. W GAZE ×Gaze(θ S ):W GAZE is a weighting constant for the gaze direction, Gaze(θ S ) is a value based on the gaze direction. W FACE ×Face(F S ):W FACE is a weighting constant for facial expressions, and Face(F S ) is a value based on facial expression. W BODY ×OnOff S :W BODY is the weighting constant of the body movement, OnOff S indicates whether or not there is physical movement. W BLINK ×OnOff S :W BLINKis the blink weighting constant, OnOff S is the presence or absence of blinking. W PUPIL ×Pupil(P S ):W PUPIL is a weighting constant for pupil size, Pupil(P S ) is the size of the pupil. W heartbeat ×HR(HR S ):W heartbeat is the heart rate weighting constant, HR(HR S ) is the heart rate. W Sweat ×OnOff S :W Sweat is the weighting constant of sweating, OnOff S is the presence or absence of sweating. W Respiration ×R(R S ):W Respiration is the respiratory weighting constant, R(R S ) is a value that indicates the breathing rate. W blood pressure ×BP(BP S ):W blood pressure is the weighting constant for blood pressure, BP(BP S ) is the value relative to the blood pressure value.

[0029] It should be noted that it is sufficient to use two or more types of participant information, and it is not necessary to use all of the participant information described here.

[0030] Also, Q SF (i) is the amount of heat transferred from the first participant S to the field, Q SO is the amount of heat transferred from the first participant S to the outside of the field. These are calculated using the following equations (3) and (4).

[0031]

number

[0032] K 1S , K. 2S is a constant. Also, T O is the temperature outside the temperature space F.

[0033] The second calculation unit 122 calculates the personal temperature T L More specifically, the second calculation unit 122 calculates the personal temperature T of the second participant L using the following equation (5) stored in the estimation model 125: L Calculate.

[0034]

number

[0035] where i is the frame number and T L (i) is the temperature of the second participant L in the i-th frame. L (i) is a linear combination of multiple types of participant information of the second participant L, and is calculated in the same way as equation (2) for the first participant S described above. L is the heat capacity of the second participant L. Q FL (i) is the amount of heat transferred from the field to the second participant L, and Q LO is the amount of heat transferred from the second participant L to the outside of the field. These are calculated using the following equations (6) and (7).

[0036]

number

[0037] K 1L , K. 2L is a constant.

[0038] The third calculation unit 123 calculates the temperature T of the field by using the amount of heat transfer between the first participant S, the second participant L, and the field. F More specifically, the field temperature T is calculated using the following equation (8): F Calculate.

[0039]

number

[0040] Here, Q FO is calculated using the following formula (9).

[0041]

number

[0042] C F is the heat capacity of the field, i.e., the heat capacity of the temperature space F. If the amount of heat transfer from the first participant S is the same, the heat capacity C F The smaller the temperature of the field, T F The fluctuation range of the heat capacity C F The larger the field temperature T F The fluctuation range of becomes smaller.

[0043] The estimation unit 124 estimates the field temperature T F The emotional change of the second participant L in the communication situation is estimated based on the temperature T L is higher than a threshold, it may be estimated that the second participant L is in high spirits. Furthermore, emotional changes may be estimated in a plurality of stages.

[0044] As described above, the acquisition unit 11 acquires the participant information for each i-frame described above, and the estimation unit 124 performs estimation for each i-frame.

[0045] The first participant terminal 20A is a terminal carried by the first participant S, and the second participant terminal 20B is a terminal carried by the second participant L. The first participant terminal 20A is equipped with a camera 21A and a sensor terminal 22A, and can take images of the first participant S and obtain the first participant S's heart rate, blood pressure, sweat rate, etc. The sensor terminal 22A may be worn by the first participant S. The second participant terminal 20B is equipped with a camera 21B and a sensor terminal 22B, and can take images of the second participant L and obtain the second participant L's heart rate, blood pressure, sweat rate, etc. The sensor terminal 22B may be worn by the second participant L.

[0046] FIG. 3 shows examples of participant terminals 20 (first participant terminal 20A, second participant terminal 20B) and sensor terminals 22 (sensor terminal 22A, sensor terminal 22B). In the example shown in FIG. 3, the first participant S and the second participant L are using participant terminals 20 connected to the estimation device 10. The participant terminals 20 are equipped with cameras 21 (camera 21A, camera 21B) that capture images of the first participant S or the second participant L. In addition, the first participant S and the second participant L are equipped with sensor terminals 22 on their wrists. The sensor terminals 22 can wirelessly transmit detected heart rates, blood pressure values, sweat rates, and the like to the first participant terminal 20A and / or the second participant terminal 20B. Here, the estimation device 10 and the first participant terminal 20A and / or the second participant terminal 20B may be a single component.

[0047] In this way, when the first participant S and the second participant L wearing the sensor terminal 22 communicate with each other, the participant information of the first participant S and the second participant L is transmitted to the estimation device 10, and the estimation device 10 can estimate the emotional changes of the second participant L in the communication situation.

[0048] The output unit 13 outputs the emotional change of the second participant L, which is the estimation result estimated by the estimation processing unit 12. The output unit 13 may output the emotional change to an external device and present the emotional change on the external device, or may include a presentation unit (such as a monitor or speaker (not shown)) and present the emotional change via the presentation unit. The output unit 13 may be separate from the estimation device 10.

[0049] The estimation device 10 may present the emotional changes of the second participant L in a graph. By presenting the emotional changes in a graph with time on the horizontal axis, it becomes possible to confirm after the fact what kind of emotional changes occurred at what time period. This allows the organizer, administrator, etc. to develop strategies and measures to enhance the mood of the second participant L, who is the listener, in future communications. In particular, in settings where the speaker often speaks one-sidedly, such as seminars, lectures, and information sessions, the emotions of the second participant can only be perceived subjectively, and it is difficult to objectively determine which time period was best. Even in such cases, the estimation device 10 according to the present embodiment can present the emotional changes of the second participant in a graph, allowing the administrator, etc., to objectively recognize the emotional changes of the second participant for each time period.

[0050] The presentation by the presentation unit is not limited to a graph, and may be a summary of the analysis results, a rank, etc. Furthermore, the emotional changes may be transmitted to an external device and analyzed by the external device.

[0051] [Processing flow] Next, the flow of processing in the estimation device 10 will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of processing in the estimation device 10.

[0052] 4, in the estimation device 10, the acquisition unit 11 first acquires participant information about the first participant S from the first participant terminal 20A and participant information about the second participant L from the second participant terminal 20B (S101, acquisition step). Next, the estimation processing unit 12 uses the participant information acquired by the acquisition unit 11 to estimate the personal temperature T S , the second participant's personal temperature T L , the field temperature T F is calculated (S102, calculation step).

[0053] In detail, the calculation is performed as follows: Here, the personal temperature T S , personal temperature T L , and the field temperature TF An example of calculating the following will be described.

[0054] Personal temperature T in the i frame S is the personal temperature T in the (i-1) frame, as shown in the above equation (1). S , Participant information of the first participant S in the i frame, and the amount of heat transfer Q in the (i-1) frame SF , (i-1) Heat transfer amount Q in the frame SO The amount of heat transfer Q is calculated using SF As shown in the above equation (3), the personal temperature T S , and the field temperature T F The heat transfer amount Q SO As shown in the above equation (4), the personal temperature T S , and the external temperature T O Calculate using:

[0055] In addition, the personal temperature T L is the personal temperature T in the (i-1)th frame, as shown in the above equation (5). L , participant information of the second participant L in the i frame, and the amount of heat transfer Q in the (i-1) frame FL , (i-1) Heat transfer amount Q in the frame LO The amount of heat transfer Q is calculated using FL As shown in the above equation (6), the temperature T of the field in the frame immediately before the (i-1) frame, i.e., the (i-2) frame, is F , and personal temperature T L The heat transfer amount Q LO As shown in the above equation (7), the personal temperature T L , and the external temperature T O Calculate using:

[0056] Also, the field temperature T in the i-frameF is the field temperature T in the (i-1) frame, as shown in the above equation (8). F , (i-1) Heat transfer amount Q in the frame SF , (i-1) Heat transfer amount Q in the frame FL , (i-1) Heat transfer amount Q in the frame FO The amount of heat transfer Q is calculated using FO As shown in the above equation (9), the temperature T of the field in the frame immediately before the (i-1) frame, i.e., the (i-2) frame, F , and the external temperature T O Calculate using:

[0057] In this way, the personal temperature T S , personal temperature T L , and the field temperature T F is calculated using the results of the calculations in the previous frame or two frames.

[0058] Then, the estimation processing unit 12 calculates the personal temperature T L The emotional change of the second participant L is estimated using the above (S103, estimation step). Finally, the output unit 13 outputs the estimated emotional change of the second participant L (S104). The above is the flow of the processing in the estimation device 10.

[0059] As described above, the estimation device 10 according to this embodiment estimates an emotional change of a first participant who is primarily a speaker and one or more second participants who are primarily listeners in a communication situation between the first participant and one or more second participants. The estimation device 10 includes an acquisition unit 11, an estimation processing unit 12, and an output unit 13. The acquisition unit 11 acquires one or more types of participant information (first information) about the first participant S and one or more types of participant information (second information) about the second participant L. The estimation processing unit 12 includes a first calculation unit 121, a second calculation unit 122, a third calculation unit 123, and an estimation unit 124. The first calculation unit 121 calculates a personal temperature T S (first temperature), the result of weighting the first information and linearly combining it, and the amount of heat transfer Q from the first participant S to the fieldSF The second calculation unit 122 calculates the personal temperature T L (second temperature), the result of a weighted linear combination of the second information, and the amount of heat transfer Q from the field to the second participant L FL The third calculation unit 123 calculates the field temperature T F The amount of heat transferred from the first participant S to the field Q SF and the amount of heat transferred from the field to the second participant L, Q FL The estimation unit 124 estimates the emotional change of the second participant L using the personal temperature TL of the second participant L.

[0060] This allows the estimating device 10 to estimate emotional changes of a listener in a communication situation where participants have different roles, such as being divided into a speaker and a listener.

[0061] [Embodiment 2] Other embodiments of the present invention will be described below. For ease of explanation, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0062] In briefings, seminars, and the like, there are often multiple listeners for one speaker, a first participant S. Therefore, in this embodiment, a case where there are multiple listener second participants L will be described. FIG. 5 shows an overview of a case where there are multiple second participants L. In the example shown in FIG. 5, there are three second participants L: a second participant LA, a second participant LB, and a second participant LC.

[0063] In this case, the estimation device 10 estimates the temperature T Ln is calculated using the following equation (10).

[0064]

number

[0065] where:

[0066]

number

[0067] That is, the above-mentioned formula (5) is replaced by formula (10). Then, the temperature of the field is expressed as Q, which is the term related to the second participant L in the above-mentioned formula (8). FL Instead, Q regarding either the second participant LA, the second participant LB, or the second participant LC FLn Substitute Q FLn is the amount of heat transferred from the scene to any of the second participants LA, LB, and LC. In this way, by using equation (10), it is possible to estimate the emotional change of each second participant L even when there are multiple listeners. Note that the number of listeners is not limited to three, and may be two, or four or more.

[0068] [Software implementation example] The functions of the estimation device 10 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly each part included in the estimation processing unit 12).

[0069] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing each function described in the embodiment.

[0070] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0071] In addition, some or all of the functions of each control block can be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each control block is formed is also included in the scope of the present invention. In addition, the functions of each control block can also be realized by, for example, a quantum computer.

[0072] Furthermore, each process described in the above embodiment may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0073] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.

[0074] 〔summary〕 An estimation device according to a first aspect of the present invention is an estimation device that estimates an emotional change of a first participant who is primarily a speaker and one or more second participants who are primarily listeners in a communication situation between the second participant and the first participant, the estimation device including an acquisition unit that acquires one or more types of first information about the first participant and one or more types of second information about the second participant, a first calculation unit that calculates a first temperature that indicates a state of the first participant as a temperature, a second calculation unit that calculates a second temperature that indicates a state of the second participant as a temperature, and a third calculation unit that calculates the temperature of the situation. and an estimation unit that estimates an emotional change of the second participant using the second temperature, wherein the first calculation unit calculates the first temperature using a result of a weighted linear combination of the first information and an amount of heat transfer from the first participant to the space, the second calculation unit calculates the second temperature using a result of a weighted linear combination of the second information and an amount of heat transfer from the space to the second participant, and the third calculation unit calculates the temperature of the space using the amount of heat transfer from the first participant to the space and the amount of heat transfer from the space to the second participant. This makes it possible to appropriately calculate an emotional change of a listener in a communication space where participants have different roles, such as a speaker and a listener. Therefore, it is possible to appropriately estimate an emotional change of a listener in a communication space where participants have different roles.

[0075] An estimation device according to aspect 2 of the present invention is an estimation device as described in claim 1, wherein in aspect 1, the first calculation unit further calculates the first temperature using the amount of heat transfer from the first participant to an outside different from the field, the second calculation unit further calculates the second temperature using the amount of heat transfer from the second participant to an outside different from the field, and the third calculation unit further calculates the temperature of the field using the amount of heat transfer from the field to an outside different from the field.

[0076] In the estimation device according to aspect 3 of the present invention, in the aspect 1 or 2, the acquisition unit repeatedly acquires the first information and the second information, and each time the acquisition unit acquires the first information and the second information, the first calculation unit calculates the first temperature, the second calculation unit calculates the second temperature, and the third calculation unit calculates the temperature of the place, and the estimation unit performs the estimation, the first calculation unit calculates the current first temperature using the currently acquired first information and the previously calculated first temperature, the second calculation unit calculates the current second temperature using the currently acquired second information and the previously calculated second temperature, and the third calculation unit calculates the current place temperature using the previously calculated place temperature and the previous amount of heat transfer, and the estimation unit performs the estimation using the current second temperature. This makes it possible to estimate emotional changes of a listener over time.

[0077] The estimation device according to aspect 4 of the present invention is any one of aspects 1 to 3, wherein the first calculation unit calculates the first temperature using, as the first information, at least one of speech information related to the speech of the first participant, facial expression, gaze, body movement, blinking, pupil size, eye opening degree, heart rate, blood pressure, sweat rate, and respiration, and the second calculation unit calculates the second temperature using, as the second information, at least one of speech information related to the speech of the second participant, facial expression, gaze, body movement, blinking, pupil size, eye opening degree, heart rate, blood pressure, sweat rate, and respiration, thereby making it possible to appropriately calculate the first temperature and the second temperature.

[0078] The estimation device according to a fifth aspect of the present invention is configured as in any one of the first to fourth aspects, and further includes a presentation unit that presents the estimation result of the estimation unit, thereby allowing an administrator or the like to recognize emotional changes of the listener.

[0079] In the estimation device according to a sixth aspect of the present invention, in addition to the fifth aspect, the presentation unit presents the estimation result in a graph, thereby allowing a manager or the like to visually recognize emotional changes of the listener over time.

[0080] An estimation system according to aspect 7 of the present invention includes the estimation device, a first participant terminal communicatively connected to the estimation device, which acquires the first information of the first participant from the first participant, and a second participant terminal communicatively connected to the estimation device, which acquires the second information of the second participant from the second participant, wherein the estimation device acquires the first information from the first participant terminal and the second information from the second participant terminal.

[0081] An estimation method according to aspect 8 of the present invention is a method for estimating emotional changes of a first participant who is primarily a speaker and one or more second participants who are primarily listeners in a communication situation, and includes an acquisition step of acquiring one or more types of first information about the first participant and one or more types of second information about the second participant; a calculation step of calculating a first temperature indicating the state of the first participant as a temperature, a second temperature indicating the state of the second participant as a temperature, and the temperature of the situation using the first information and the second information; and an estimation step of estimating emotional changes of the second participant using the second temperature.

[0082] A control program according to a ninth aspect of the present invention is a control program for causing a computer to function as the estimation device, and causes the computer to function as the first calculation unit, the second calculation unit, and the estimation unit. [Explanation of symbols]

[0083] 1. Estimation System 10 Estimation device 11 Acquisition Department 12 Estimation processing unit 121 First Calculation Unit 122 Second calculation unit 123 Third Calculation Section 124 Estimation Department 125 Estimation Model 13 Output section 20 Participant terminals 20A 1st participant terminal 20B Second participant terminal 21, 21A, 21B Camera 22, 22A, 22B sensor terminal

Claims

1. 1. An estimation device for estimating an emotional change of a first participant who is primarily a speaker and one or more second participants who are primarily listeners in a communication situation, the device comprising: an acquisition unit that acquires one or more types of first information regarding the first participant and one or more types of second information regarding the second participant; a first calculation unit that calculates a first temperature that indicates a state of the first participant as a temperature; a second calculation unit that calculates a second temperature that indicates the state of the second participant as a temperature; a third calculation unit that calculates the temperature of the field; an estimation unit that estimates an emotional change of the second participant using the second temperature; Equipped with the first calculation unit calculates the first temperature using a result of weighting and linearly combining the first information and an amount of heat transfer from the first participant to the field; the second calculation unit calculates the second temperature using a result of a weighted linear combination of the second information and an amount of heat transfer from the field to the second participant; The third calculation unit calculates the temperature of the venue using the amount of heat transfer from the first participant to the venue and the amount of heat transfer from the venue to the second participant.

2. The first calculation unit further calculates the first temperature using a heat transfer amount from the first participant to an outside different from the field; The second calculation unit further calculates the second temperature using an amount of heat transfer from the second participant to an outside different from the field; The estimation device according to claim 1 , wherein the third calculation unit further calculates the temperature of the field using an amount of heat transfer from the field to an outside different from the field.

3. the acquisition unit repeatedly acquires the first information and the second information; Each time the acquisition unit acquires the first information and the second information, the first calculation unit calculates the first temperature; the second calculation unit calculates the second temperature; the third calculation unit calculates the temperature of the field; the estimation unit performs the estimation, the first calculation unit calculates the current first temperature using the currently acquired first information and the previously calculated first temperature; the second calculation unit calculates the current second temperature using the currently acquired second information and the previously calculated second temperature; the third calculation unit calculates the current temperature of the field using a previously calculated temperature of the field and the previous amount of heat transfer; The estimation device according to claim 1 , wherein the estimation unit performs the estimation using the current second temperature.

4. the first calculation unit calculates the first temperature using, as the first information, at least one of speech information related to speech of the first participant, facial expression, gaze, body movement, blinking, pupil size, eye opening degree, heart rate, blood pressure, sweat rate, and respiration; The estimation device described in claim 1, wherein the second calculation unit calculates the second temperature using at least one of the following second information: speech information related to the speech of the second participant, facial expression, gaze, body movement, blinking, pupil size, eye opening degree, heart rate, blood pressure, sweat rate, and respiration.

5. The estimation device according to claim 1 , further comprising a presentation unit that presents the estimation result of the estimation unit.

6. The estimation device according to claim 5 , wherein the presentation unit presents the estimation result in the form of a graph.

7. An estimation device according to any one of claims 1 to 6; a first participant terminal communicably connected to the estimation device, the first participant terminal acquiring the first information of the first participant from the first participant; a second participant terminal communicatively connected to the estimation device, the second participant terminal acquiring the second information of the second participant from the second participant; The estimation device acquires the first information from the first participant terminal and the second information from the second participant terminal.

8. 1. A method for estimating an emotional change of a first participant who is primarily a speaker and one or more second participants who are primarily listeners in a communication situation, the method comprising: an acquiring step of acquiring one or more types of first information regarding the first participant and one or more types of second information regarding the second participant; a calculation step of calculating a first temperature indicating the state of the first participant as a temperature, a second temperature indicating the state of the second participant as a temperature, and a temperature of the venue using the first information and the second information; and estimating an emotional change of the second participant using the second temperature.

9. A control program for causing a computer to function as the estimation device according to claim 1, the control program causing a computer to function as the first calculation unit, the second calculation unit, and the estimation unit.

Images