Information processing device, information processing method, and program

Abstract

An information processing device (100) comprises: a calculation unit (102) that calculates a score representing the mental state of a subject by processing the subject's biological information; an inference unit (104) that uses the score and a reference including a threshold value associated with the subject to estimate the subject's emotions; and an update unit (106) that updates the threshold score using a score history.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program recording medium.

Background Art

[0002] There is a system that processes the voice and expressions of a target person using voice or image recognition and analyzes the emotions of the target person. Patent Document 1 describes an apparatus that processes an image of the expression of a user who operates an image forming apparatus such as a camera, determines whether the user is confused, and displays a help image when it is determined that the user is confused. This Patent Document 1 describes a device for solving the problem of reducing the accuracy of emotion estimation due to individual differences in the upward and downward angles of the corners of the mouth and eyebrows of a person's face. In order to solve this problem, the image forming apparatus described in Patent Document 1 takes a reference face that should be a reference for expression changes and a determination target face as the face image of the user, and based on the amount of change in the expression change from the reference face, determines the emotion in the determination target face, and performs message support corresponding to the emotion in the determination target face. When setting the printing conditions when executing a printing job according to the user's request, it includes a detection means for detecting an input operation made by the user without delay, and an acquisition means for acquiring the face image captured by the imaging means as the reference face when the input operation without delay is detected by the detection means and the user's expression is assumed to be the reference for expression changes.

[0003] Patent Document 2 describes a device that recognizes the individuality of a user, identifies the individual, and improves the recognition accuracy when recognizing the user's emotions. Patent Document 2 describes measures to reduce misrecognition, such as when a user with slanted eyes is mistakenly identified as "angry" even though they are not. In the device described in Patent Document 2, the individuality recognition unit recognizes the individuality of a user by comparing the user's feature quantities extracted by the speech recognition unit, image recognition unit, and motion recognition unit with the personal identification data stored in the individuality database, and identifies the individual, while also reading the individuality data group corresponding to the identified user and outputting it to each emotion recognition unit. Each emotion recognition unit performs emotion recognition using the data stored in the speech database, image database, and motion database based on the difference between the user's feature quantities extracted by the speech recognition unit, image recognition unit, and motion recognition unit and the individuality data group provided by the individuality recognition unit. [Prior art documents] [Patent Documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-163660 [Patent Document 2] Japanese Patent Publication No. 2001-83984 [Overview of the project] [Problems that the invention aims to solve]

[0005] The technologies described in the aforementioned documents focus on estimating user emotions in specific situations, such as when operating an image forming apparatus or driving a car, and therefore aim to improve the accuracy of emotion estimation in those situations. Consequently, the technologies described in the above documents do not anticipate the need to automatically adjust for individual differences among subjects even when employees change, which is required in cases such as estimating the emotions of employees, such as stress and anxiety, in workplaces with high staff turnover, with the aim of improving the work environment. In contrast, the inventors of this invention have investigated how to automatically adjust for individual differences among subjects even in workplaces with high staff turnover, thereby improving the accuracy of emotion estimation to match the individuality of each employee.

[0006] One example of the object of the present invention is, in view of the above-mentioned problems, to provide an information processing device, an information processing method, and a program recording medium that solve the problem of reduced accuracy due to individual differences in biometric information in emotion analysis using biometric information. [Means for solving the problem]

[0007] According to one aspect of the present invention, A calculation means that calculates a score indicating the mental state of the subject by processing the subject's biometric information, An estimation means for estimating the emotions of the subject using criteria including a threshold associated with the subject and the score, An information processing device is provided, which includes an update means for updating the threshold using the history of the score.

[0008] According to one aspect of the present invention, One or more computers, By processing the subject's biometric information, a score indicating the subject's mental state is calculated. Using criteria including thresholds associated with the subject and the score, the subject's emotions are estimated. An information processing method is provided for updating the threshold using the history of the score.

[0009] According to one aspect of the present invention, On the computer, A procedure for calculating a score indicating the mental state of a subject by processing the subject's biometric information. A procedure for estimating the emotions of the subject using criteria including a threshold associated with the subject and the score, A procedure for updating the threshold using the history of the score, A computer-readable program recording medium is provided, which stores a program for executing it. [Effects of the Invention]

[0010] According to one aspect of the present invention, an information processing device, an information processing method, and a program recording medium can be obtained that can improve the accuracy of emotion analysis using biometric information by taking into account individual differences in biometric information. [Brief explanation of the drawing]

[0011] [Figure 1] This diagram shows an overview of the information processing device according to the embodiment. [Figure 2] This is a flowchart showing an example of the operation of the information processing device according to the embodiment. [Figure 3] This diagram conceptually shows the system configuration of the information processing system according to the embodiment. [Figure 4] This is a block diagram illustrating the hardware configuration of a computer that implements an information processing device. [Figure 5] This is a functional block diagram showing a logical configuration example of an information processing device according to the embodiment. [Figure 6] This figure shows an example of a data structure for biological information. [Figure 7] This figure shows an example of the data structure for score history information. [Figure 8] This diagram illustrates a method for estimating emotions using arousal and harmony levels. [Figure 9] This diagram illustrates individual differences in biological information and the adjustment of thresholds. [Figure 10]This is a diagram for explaining sentiment analysis using a threshold value updated by an update unit. [Figure 11] This is a diagram showing an example of the data structure of threshold value information. [Figure 12] This is a flowchart showing an operation example of the information processing apparatus according to the embodiment. [Figure 13] This is a diagram for explaining the adjustment of the threshold value. [Figure 14] This is a diagram for explaining the adjustment of the threshold value. [Figure 15] This is a diagram conceptually showing the system configuration of the information processing system according to the embodiment. [Figure 16] This is a diagram showing an overview of the information processing apparatus according to the embodiment. [Figure 17] This is a diagram conceptually showing the system configuration of the information processing system according to the embodiment. [Figure 18] This is a functional block diagram showing an example of the functional configuration of the information processing apparatus according to the embodiment. [Figure 19] This is a flowchart showing an operation example of the information processing apparatus according to the embodiment. [Figure 20] This is a diagram conceptually showing the system configuration of the information processing system according to the embodiment. [Figure 21] This is a diagram showing an overview of the information processing apparatus according to the embodiment.

Embodiments for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are denoted by the same reference numerals, and the description thereof will be omitted as appropriate. In addition, in each of the following figures, the configuration of the part that does not relate to the essence of the present invention is omitted and not shown.

[0013] In the embodiments, "acquisition" includes at least one of the following: the device retrieving data or information stored in another device or storage medium (active acquisition), and the device inputting data or information output from another device into its own device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a reply, and accessing and reading data from another device or storage medium. Examples of passive acquisition include receiving information that is delivered (or transmitted, push notification, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from among the received data or information, or selecting and receiving data or information that has been delivered.

[0014] <Minimum Configuration Example> Figure 1 shows an overview of the information processing device 100 according to an embodiment. The information processing device 100 includes a calculation unit 102, an estimation unit 104, and an update unit 106. The calculation unit 102 processes the subject's biometric information to calculate a score indicating the subject's mental state. The estimation unit 104 estimates the subject's emotions using criteria and scores, including thresholds associated with the subject. The update unit 106 updates the threshold using the score history.

[0015] <Example of operation> Figure 2 is a flowchart showing an example of the operation of the information processing device 100 of the embodiment. The calculation unit 102 processes the subject's biometric information to calculate a score indicating the subject's mental state (step S101). The estimation unit 104 estimates the subject's emotions using criteria and scores, including thresholds associated with the subject (step S103). The update unit 106 updates the threshold using the score history (step S105).

[0016] Steps S103 and S105 of this process may be executed, for example, each time the subject's biometric information is acquired, or they may be executed periodically at predetermined intervals. These predetermined intervals may be, for example, every hour, every half day, every day, or every week. Step S105 may also be executed periodically at yet another predetermined interval. These other predetermined intervals may be, for example, every week, every two weeks, or every month. The score history uses the historical information accumulated between the execution timing before the current execution timing and the current execution timing.

[0017] In this information processing device 100, the calculation unit 102 calculates a score indicating the subject's mental state by processing the subject's biometric information. The estimation unit 104 estimates the subject's emotions using the score and criteria, including thresholds associated with the subject. The update unit 106 updates the thresholds using the score history. Thus, this information processing device 100 makes it possible to improve the accuracy of emotion analysis using biometric information by taking into account individual differences in biometric information.

[0018] The following describes a detailed example of the information processing device 100.

[0019] (First Embodiment) <System Overview> Figure 3 is a conceptual diagram showing the system configuration of the information processing system 1 according to the embodiment. The information processing system 1 comprises an information processing device 100 and a wearable terminal 50. In this example, the information processing device 100 is the user terminal 60 of user U, which is a computer such as a smartphone, tablet, or personal computer. The user terminal 60 and the wearable device 50 are paired in advance to enable communication using NFC (Near Field Communication).

[0020] In Information Processing System 1, User U is the subject of sentiment analysis, and User U is, for example, an employee of a company. In this example, the user terminal 60 is owned by User U, and the wearable device 50 is lent to User U by the company. However, the user terminal 60 does not necessarily have to be owned by User U; it may be lent to User U by the company. Similarly, the wearable device 50 does not necessarily have to be lent to User U by the company; it may be owned by User U.

[0021] In this scenario, the wearable device 50 is loaned to user U by the company. User U borrows the wearable device 50 upon arrival at work, pairs it with user terminal 60, wears the wearable device 50 while working, and unpairs it with user terminal 60 and returns the wearable device 50 upon leaving work. In other words, the wearable device 50 can be shared and used by employees. Therefore, if the work schedule is shift-based, only the number of wearable devices 50 needed per person present at the office each day is required, rather than the number of employees.

[0022] The wearable device 50 measures the user U's biometric information and transmits it to the user device 60. The biometric information acquired by the wearable device 50 includes, but is not limited to, pulse rate, heart rate, body temperature, blood pressure, activity level, posture, electrocardiogram, respiratory rate, blood oxygen level, and conversation voice.

[0023] The wearable terminal 50 is equipped with various sensors for measuring this biometric information. Furthermore, for conversational audio, the audio collected from the speaker of the wearable terminal 50 is recorded, and the audio data may be transmitted to the user terminal 60. The user terminal 60 processes the audio data to calculate the conversation volume and records it as the user U's biometric information. However, the wearable terminal 50 may process the audio data and transmit the conversation volume to the user terminal 60. Note that the conversation volume does not include information about the content of the conversation. The conversation volume can be expressed, for example, by the number of words spoken per unit of time. In the embodiment described later, in a configuration including a server device 70, the audio data may be transmitted to the server device 70, where the server device 70 processes the audio data to calculate the conversation volume and generate the user U's biometric information.

[0024] User U's user terminal 60 has an application pre-installed for using the services of this information processing system 1. User U puts on the wearable device 50, launches the application on the user terminal 60, and pairs the wearable device 50 with the user terminal 60. As a result, the information processing device 100 can realize its functions on the user terminal 60.

[0025] <Example Hardware Configuration> Figure 4 is a block diagram illustrating the hardware configuration of the computer 1000 that implements the information processing device 100 (user terminal 60). The wearable terminal 50 in Figure 3 is also implemented by the computer 1000. Furthermore, in the example where the information processing device 100 is implemented in combination with a server device 70, as described in the embodiment later, the server device 70 is also implemented by the computer 1000. In addition, the administrator terminal 80, as described in the embodiment later, is also implemented by the information processing device 100.

[0026] Computer 1000 has a bus 1010, a processor 1020, memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0027] Bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060 to send and receive data to and from each other. However, the method of connecting the processor 1020 and the other components to each other is not limited to bus connection.

[0028] The 1020 processor is a processor implemented in components such as the CPU (Central Processing Unit) and GPU (Graphics Processing Unit).

[0029] Memory 1030 is a main memory device implemented using RAM (Random Access Memory), etc.

[0030] The storage device 1040 is an auxiliary storage device implemented as an HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, or ROM (Read Only Memory). The storage device 1040 stores program modules that implement each function of the information processing device 100 (for example, the calculation unit 102, the estimation unit 104, the update unit 106, and the acquisition unit 110, exclusion unit 112, output processing unit 114, etc., which will be described later). The processor 1020 reads each of these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to that program module. The storage device 1040 may also store data from the storage device 120, which will be described later.

[0031] The program module may be recorded on a recording medium. The recording medium on which the program module is recorded includes a non-temporary, tangible medium usable by a computer 1000, and program code that can be read by the computer 1000 (processor 1020) may be embedded in that medium.

[0032] The input / output interface 1050 is an interface for connecting the computer 1000 with various input / output devices. The input / output interface 1050 also functions as a communication interface for short-range wireless communication such as Bluetooth® and NFC (Near Field Communication).

[0033] The network interface 1060 is an interface for connecting the computer 1000 to a communication network. This communication network may be, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The network interface 1060 may connect to the communication network via a wireless connection or a wired connection.

[0034] The computer 1000 then connects to necessary devices (for example, the display, touch panel, indicator, operation buttons, camera, speaker, microphone of the user terminal 60, the display, touch panel, indicator, operation buttons, speaker, microphone of the wearable terminal 50, the keyboard, mouse, speaker, microphone, printer, etc. of the server device 70) via the input / output interface 1050 or the network interface 1060.

[0035] Each component of the information processing device 100 in the embodiments shown in Figure 1, and later in Figures 5, 16, 18, and 21, can be realized by any combination of the hardware and software of the computer 1000 shown in Figure 4. Those skilled in the art will understand that there are various modifications to the implementation method and apparatus. The functional block diagrams showing the information processing device 100 in each embodiment show blocks of logical functional units, not hardware-level configurations.

[0036] <Example of Functional Configuration> Figure 5 is a functional block diagram showing an example of the logical configuration of the information processing device 100 in this embodiment. The information processing device 100 includes the same calculation unit 102, estimation unit 104, and update unit 106 as the information processing device 100 in Figure 1, and also includes an acquisition unit 110. The acquisition unit 110 acquires biometric information from the wearable terminal 50 worn by the user U (the subject). In this embodiment, the biological information acquired by the acquisition unit 110 will be described using pulse rate as an example. However, as described above, various types of information can be used as biological information.

[0037] The timing for acquiring biometric information from the wearable terminal 50 is not particularly limited. Depending on the memory capacity on the wearable terminal 50, a certain amount of biometric information may be stored and transmitted all at once for a predetermined period. Depending on the communication status between the wearable terminal 50 and the user terminal 60, the information may be transmitted when the communication status is good, or it may be transmitted immediately each time biometric information is acquired, or each time after a certain period of time has elapsed.

[0038] Figure 6 shows an example of the data structure of biometric information 130. Biometric information 130 stores biometric information such as time information, pulse rate, activity level, and conversation volume in association with each other. Biometric information 130 is stored in the memory 1030 or storage device 1040 of the computer 1000 that implements the user terminal 60.

[0039] The calculation unit 102 processes the biometric information acquired by the acquisition unit 110 to calculate a score indicating the mental state of user U (the subject). The score indicating the mental state includes multiple scores, each representing a different type of mental state. For example, the score includes scores indicating the arousal level and the harmony level. For instance, the arousal level is a value indicating the degree of arousal, with a higher score indicating a greater degree of arousal and a lower score indicating a greater degree of drowsiness. The harmony level is a value indicating emotions such as pleasure and displeasure, with a higher score indicating a more comfortable state and a lower score indicating an unpleasant state.

[0040] The score may be, but is not limited to, a value expressed within one of the following ranges: 0 to 100, -100 to +100, 0 to 1, and -1 to +1.

[0041] Figure 7 shows an example of the data structure of the score history information 140. The score history information 140 stores time information and the score calculated by the calculation unit 102 in association with each other. The score history information 140 is stored in the memory 1030 or storage device 1040 of the computer 1000 that implements the user terminal 60.

[0042] The estimation unit 104 estimates the emotions of user U (the subject) using criteria including a threshold associated with user U (the subject) and a score indicating user U's (the subject's) mental state. In this embodiment, the estimation unit 104 estimates which of the four emotions user U is feeling from two scores indicating two types of mental states.

[0043] Figure 8 illustrates a method for estimating emotions using arousal and harmony levels. In this example, the arousal level and harmony level are shown as coordinate axes, and the four regions divided by the coordinate axes correspond to user U's four emotions. In this example, the four emotions are "ANGRY," "HAPPY," "SAD," and "RELAXED," and each is defined by one of the four coordinate regions. If user U's score falls within a range that exceeds the threshold, it is estimated that user U is in the emotion of that region.

[0044] The estimation unit 104 plots the scores representing two types of mental states of user U (the subject) as values ​​on two coordinate axes. Each of the four regions divided by the coordinate axes represents a range of four different emotions of the user U (the subject). The estimation unit 104 then estimates that the emotion corresponding to the region where the plotted value exists is the emotion of the user U (the subject) if the plotted value exceeds a threshold.

[0045] Specifically, the estimation unit 104 plots a score indicating the arousal level and a score indicating the harmony level on the graph in Figure 8. A threshold T is pre-set for at least one of the arousal level and the harmony level. This threshold T is represented by a value between 0 and 100 on the Y coordinate of the arousal level in Figure 8. The area that exceeds the circle with a radius based on this threshold and is between 0 and 100 on the Y axis corresponds to each emotion. In other words, if the plotted value of the score falls within each area that exceeds the threshold T, it is estimated that the user U (subject) is experiencing the emotion in that area. For example, Figure 8 shows data d1 plotted with the arousal level score y1 and the harmony level score x1 at time t1. Since the user U (subject)'s data d1 at this time falls within the area labeled "HAPPY" that exceeds the threshold T, it is estimated that the user U is experiencing a happy emotion.

[0046] Figure 9 is a diagram illustrating individual differences in biological information and threshold adjustments. As shown in Figure 9(a), the average change in arousal level over time is shown by a dashed line, and the average threshold T is shown by a dashed line. On the other hand, as shown in Figure 9(a), some individuals show changes in arousal levels as shown by a solid line, while others show changes as shown by a double-dashed line. Thus, there are individual differences in the scores that indicate the mental state of the subjects.

[0047] The individuals shown by the solid line may be misinterpreted as constantly angry, for example, because their arousal level score consistently exceeds threshold T when their emotions are estimated using threshold T.

[0048] Therefore, the update unit 106 updates the threshold T using the score history. In other words, as shown in Figure 9(b), for subjects with a history of arousal level scores indicated by a solid line, threshold T0 is changed to threshold T1. That is, threshold T1 is set higher than threshold T0. This prevents the arousal level score from always exceeding the threshold, as described above, and allows for accurate estimation of the subject's emotions.

[0049] Figure 10 is a diagram illustrating sentiment analysis using the threshold T1 updated by the update unit 106. For example, the data d2 for user U at time t2 lies within the threshold T1, and therefore is outside the "ANGRY" region. Thus, it can be inferred that the subject's emotion at this time is not "ANGRY".

[0050] The update unit 106 sets a threshold for user U (target person) using the maximum and minimum scores of the user U (target person).

[0051] Figure 11 shows an example of the data structure of threshold information 150. In this example, threshold information 150 contains information for updating the arousal level threshold. Threshold information 150 stores associated time information for the start and end of a period, indicating the period of score history information 140 used to calculate the threshold, the maximum and minimum values ​​of the arousal level score during that period, and the threshold updated by the average value calculated from the maximum and minimum values. However, the maximum and minimum values ​​of the arousal level score do not necessarily have to be stored. Threshold information 150 is stored in the memory 1030 or storage device 1040 of the computer 1000 that implements the user terminal 60.

[0052] <Example of operation> Figure 12 is a flowchart showing an example of the operation of the information processing device 100 of the embodiment. The flow in Figure 12 includes the same steps S101 to S105 as the flow in Figure 2, and also includes step S111. However, each step in this flowchart can operate independently, and as described above, the timing of execution for each step may differ.

[0053] First, the acquisition unit 110 acquires biometric information from the wearable terminal 50 worn by user U (step S111). The acquired biometric information is associated with time information and stored as biometric information 130 in the memory 1030 or storage device 1040 of the user terminal 60. The time information is preferably the time when the biometric information was measured by the wearable terminal 50, but it may also be the time when the biometric information was received from the wearable terminal 50, or the time when it was stored as biometric information 130.

[0054] The calculation unit 102 processes the user U's biometric information to calculate a score indicating the user U's mental state (step S101). The calculated score is stored as score history information 140 in the user terminal 60's memory 1030 or storage device 1040.

[0055] The estimation unit 104 estimates the emotions of user U using criteria and scores, including thresholds associated with user U (step S103). The estimated results are stored as score history information 140 in the memory 1030 or storage device 1040 of the user terminal 60.

[0056] The update unit 106 updates the threshold using the score history (step S105). For example, using one week's worth of score history, the update unit 106 extracts the maximum and minimum scores, calculates the average value, and sets the threshold. The calculated threshold is stored as threshold information 150 in the memory 1030 or storage device 1040 of the user terminal 60. The updated threshold is then used by the estimation unit 104 as the threshold for user U in the following week.

[0057] However, if the score value includes a negative value (for example, the sleepy side of the arousal level), the update unit 106 calculates the average of at least one of the positive score values ​​(arousal level) and the negative score values ​​(sleepiness level) and sets it as the threshold.

[0058] Furthermore, if the threshold T updated by the update unit 106 is lower than the previous value, the range of each emotion will widen as shown in Figure 13.

[0059] The update unit 106 may update thresholds for each type of score, for example. For example, as shown in Figure 14(a), only the arousal level threshold T may be updated. Furthermore, the update unit 106 may analyze the trend of score changes, and if user U's score values ​​are generally at the upper end, as shown by the solid line in Figure 9(b), the arousal level threshold T may be shifted upward overall, as shown in Figure 14(b). The update unit 106 may, for example, keep the minimum and maximum values ​​of a standard score and determine how to change the threshold by comparing the minimum and maximum values ​​of user U with the standard values. In other words, if both the minimum and maximum values ​​of user U are below the standard values, the threshold for user U may be shifted downward from the standard threshold.

[0060] As described above, according to this embodiment, the information processing device 100 comprises a calculation unit 102, an estimation unit 104, an update unit 106, and an acquisition unit 110. The acquisition unit 110 acquires biometric information from the wearable terminal 50 worn by user U. The calculation unit 102 calculates a score indicating user U's mental state by processing user U's biometric information. The estimation unit 104 estimates user U's emotions using criteria including thresholds associated with user U and the score. The update unit 106 updates the thresholds using the score history.

[0061] Thus, according to the information processing device 100 of this embodiment, the threshold used for sentiment analysis can be updated using the history of scores indicating the mental state of user U, and the updated threshold can be used for the next sentiment analysis. Therefore, in sentiment analysis using biometric information, individual differences in biometric information can be taken into consideration, and the accuracy can be improved.

[0062] (Second Embodiment) <System Overview> Figure 15 is a conceptual diagram showing the system configuration of the information processing system 1 according to the embodiment. In addition to the information processing system 1 of the embodiment shown in Figure 3, the information processing system 1 further includes a server device 70. In the above embodiment, the information processing device 100 was implemented by a user terminal 60, but in this embodiment, the information processing device 100 is implemented by a combination of the user terminal 60 and a server device 70. Furthermore, the information processing device 100 in this embodiment is the same as in the above embodiment except that it has a configuration that excludes the scores for periods in which specific conditions are met from the score history used to update the threshold. Note that the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that it does not cause inconsistencies.

[0063] The server device 70 is a server computer implemented by the computer 1000 shown in Figure 4 above. The server device 70 may also include a web server. The user terminal 60 is connected to the server device 70 via a communication network 3. The communication network 3 may be a network such as the Internet, or it may be a corporate network. The server device 70 includes a storage device 120. The storage device 120 may be located inside the server device 70 or outside of it. In other words, the storage device 120 may be hardware integrated with the server device 70, or it may be hardware separate from the server device 70.

[0064] In the above embodiment, the information processing device 100 was implemented solely by the user terminal 60. However, in this embodiment, the information processing device 100 is implemented by a combination of a server device 70 and the user terminal 60. Furthermore, user U can use the services provided by this information processing system 1 by accessing the server device 70 using the user terminal 60. Therefore, user U registers in advance and sets up account information. When using the services of the information processing system 1, user U logs in to the information processing system 1 using their account information.

[0065] User U can use the services provided by Information Processing System 1 by installing the above-mentioned application on User Terminal 60, launching the application, and logging in to Information Processing System 1. Alternatively, User U may use the services provided by Information Processing System 1 by launching a designated browser on User Terminal 60, accessing the website for using the services provided by Information Processing System 1, and logging in using account information.

[0066] <Example of Functional Configuration> Figure 16 shows an overview of the information processing device 100 according to the embodiment. In addition to the configuration of the information processing device 100 in Figure 5, the information processing device 100 further includes an exclusion unit 112.

[0067] The exclusion unit 112 excludes scores from the score history for periods that meet specific conditions.

[0068] The specific conditions are, for example, a period specified by user U. In addition to a period specified by user U, the specific conditions may also be a numerical range of scores specified by user U. The exclusion unit 112 displays a UI (User Interface) on the application's operation screen that accepts the user U's specification of the period to be excluded from the score history information 140. In this embodiment, for example, the server device 70 can execute at least some of the functions of the calculation unit 102, estimation unit 104, update unit 106, acquisition unit 110, and exclusion unit 112. Biometric information can be considered personal information of user U. Therefore, in this embodiment, biometric information for periods that user U does not want to send to the server device 70 can be excluded and sent to the server device 70. Furthermore, biometric information from times when user U was in a significantly different mental state than usual may also be excluded, for reasons other than user U "not wanting to send" it.

[0069] The division of functions between the user terminal 60 and the server device 70's information processing device 100 is illustrated below. (a1) The user terminal 60 implements the functions of the acquisition unit 110 to acquire biometric information from the wearable terminal 50 and the exclusion unit 112, while the server device 70 implements the functions of the acquisition unit 110 to acquire biometric information from the user terminal 60 and the calculation unit 102, estimation unit 104, and update unit 106. (a2) The user terminal 60 implements the function of the acquisition unit 110 to acquire biometric information from the wearable terminal 50, and the server device 70 implements the function of the acquisition unit 110 to acquire biometric information from the user terminal 60, as well as the functions of the exclusion unit 112, the calculation unit 102, the estimation unit 104, and the update unit 106. (a3) The user terminal 60 implements the functions of the acquisition unit 110, the exclusion unit 112, the calculation unit 102, the estimation unit 104, and the update unit 106, as well as the function of transmitting the estimation result of the estimation unit 104 to the server device 70. The server device 70 implements the function of recording and presenting the estimation result received from the user terminal 60. (a4) The user terminal 60 implements the functions of the acquisition unit 110, the exclusion unit 112, the calculation unit 102, and the estimation unit 104, as well as the function of transmitting the score calculated by the calculation unit 102 and the estimation result of the estimation unit 104 to the server device 70. The server device 70 implements the function of recording and presenting the estimation result received from the user terminal 60, and the function of the update unit 106 using the score received from the user terminal 60.

[0070] Furthermore, the acquisition unit 110 implemented by the server device 70 may acquire biometric information from the user terminal 60 of user U, as described above, or it may acquire biometric information temporarily stored in an external storage device (or storage medium) from the user terminal 60 of user U by reading it from another storage device. The calculation unit 102 calculates a score using the biometric information acquired by the acquisition unit 110.

[0071] For example, biometric information acquired by the acquisition unit 110 from the wearable terminal 50 is stored in the memory 1030 or storage device 1040 of the user terminal 60. When score history information 140 for a predetermined period has been accumulated, at a predetermined timing, the exclusion unit 112 causes the user terminal 60's display to show a screen that includes a UI for accepting the user U to specify at least one of the periods for which transmission to the server device 70 is permitted or periods for which information to be excluded from transmission. Alternatively, the exclusion unit 112 may show the user terminal 60 a screen that includes a message indicating the period to be transmitted, asking whether or not biometric information for that period should be transmitted to the server device 70, and a UI for accepting or rejecting the user U's response.

[0072] When user U specifies a period to be allowed to transmit or a period to be excluded, the exclusion unit 112 transmits biometric information for the permitted period or biometric information excluding the specified period to the server device 70. Alternatively, when the exclusion unit 112 receives a response accepting the period to be transmitted, it transmits biometric information for the period to be transmitted to the server device 70. When the exclusion unit 112 receives a response rejecting the transmission for the period to be transmitted, it may cause the user terminal 60 to display a screen including a UI that accepts the specification of at least one of the periods to be allowed to transmit or the periods to be excluded from the information to be transmitted to the server device 70, and similarly accept the specification of the period to be allowed to transmit or the period to be excluded, and transmit the biometric information to the server device 70 according to the specification.

[0073] Alternatively, the exclusion unit 112 may accept in advance the specification of the period to be transmitted or the period to be excluded from transmission via a settings screen. For example, the exclusion unit 112 may accept the specification of the days of the week, time slots, etc. to be transmitted, or the days of the week to be excluded from transmission. The exclusion unit 112 transmits the biometric information to the server device 70 according to the pre-specified period.

[0074] The update unit 106 updates the threshold using the score obtained by excluding the scores from the history for periods that meet specific conditions, as determined by the exclusion unit 112. When the update unit 106 is implemented by the server device 70, the biometric information from which periods meeting specific conditions have been excluded by the exclusion unit 112 is transmitted to the server device 70, and the update unit 106 updates the threshold using the received biometric information. On the other hand, when the update unit 106 is implemented by the user terminal 60, the update unit 106 updates the threshold using the biometric information from which periods meeting specific conditions have been excluded by the exclusion unit 112.

[0075] The estimation unit 104 uses the score obtained by excluding the scores from periods in the history that meet specific conditions, as determined by the exclusion unit 112, to estimate the emotions of user U (the target person). When the estimation unit 104 is implemented by the server device 70, the exclusion unit 112 has excluded biometric information from periods that meet specific conditions, and the estimation unit 104 updates the threshold using the received biometric information. On the other hand, when the estimation unit 104 is implemented by the user terminal 60, the estimation unit 104 updates the threshold using biometric information from periods that meet specific conditions, which have been excluded by the exclusion unit 112.

[0076] The calculation unit 102 may calculate the average score for each predetermined period, and the exclusion unit 112 may specify the period to be excluded using the average value that satisfies specific conditions. The period is, for example, one week. The calculation unit 102 calculates the average score of user U for each week, and the exclusion unit 112 excludes the score for a given week if the difference in the average value with other weeks is greater than or equal to a predetermined value. The predetermined period may be on a daily basis and is not particularly limited. By excluding scores for periods where the difference in the calculated average value with other periods is greater than or equal to a predetermined value, it is possible to avoid updating the threshold using the score for a period when the score fluctuates significantly temporarily, which is not due to individual differences and is different from the usual. In other words, the threshold can be prevented from being affected by temporary score fluctuations that are different from the usual.

[0077] The exclusion unit 112 may obtain the schedule information of user U (the person being processed). Then, the exclusion unit 112 uses that schedule information to identify the period to be excluded from processing.

[0078] For example, User U's schedule information includes information indicating User U's break times, and the exclusion unit 112 identifies User U's break times as periods to be excluded from processing. Alternatively, a settings screen including a UI that accepts the user U's specification of which periods of schedule information to exclude may be displayed on the user terminal 60, allowing User U to make the specification. For example, if User U has a scheduled presentation to a client, and knows that User U will be nervous during that time, User U may specify to exclude biometric information for that scheduled time. This allows for the exclusion of scores when User U's mental state is significantly different from normal, thus preventing the threshold from being updated using scores from that period. In other words, the threshold can be prevented from being affected by temporary fluctuations in scores that are different from normal.

[0079] <Example of operation> The operation of the information processing device 100 of this embodiment will be explained using Figure 12. Here, an example of the division of functions in (a1) will be described. First, the acquisition unit 110 acquires biometric information from the wearable terminal 50 worn by user U (step S111). The acquired biometric information is associated with time information and stored as biometric information 130 in the memory 1030 or storage device 1040 of the user terminal 60. Then, at a predetermined timing, the acquisition unit 110 transmits the biometric information accumulated for a predetermined period from the user terminal 60 to the server device 70. Before the acquisition unit 110 transmits the biometric information, the exclusion unit 112 excludes the scores for periods that meet specific conditions.

[0080] In the server device 70, the acquisition unit 110 stores the biometric information 130 of user U received from the user terminal 60 in the storage device 120, associating it with the identification information of user U. Then, in the server device 70, the calculation unit 102 calculates a score indicating the mental state of user U by processing the biometric information of user U (step S101). The calculated score is stored in the storage device 120 as score history information 140.

[0081] Then, in the server device 70, the estimation unit 104 estimates the emotions of user U using criteria and scores, including thresholds associated with user U (step S103). The estimated results are stored in the storage device 120 as score history information 140.

[0082] Then, the update unit 106 updates the threshold using the score history (step S105). For example, using a week's worth of score history, the update unit 106 extracts the maximum and minimum scores, calculates the average value, and sets the threshold. The calculated threshold is stored in the storage device 120 as threshold information 150. The threshold updated in this way will be used by the estimation unit 104 as the threshold for user U in the following week.

[0083] As described above, this embodiment includes an exclusion unit 112. The exclusion unit 112 excludes the scores from the score history for periods that meet specific conditions. The update unit 106 then updates the threshold using the score obtained by the exclusion unit 112, which excludes the scores for specific periods from the history. Furthermore, the estimation unit 104 estimates the emotions of user U using the score obtained by the exclusion unit 112, which excludes the scores for specific periods from the history.

[0084] Thus, the information processing device 100 of this embodiment provides the same effects as the above embodiment, and furthermore, user U can specify biometric information that user U does not want to be used for sentiment analysis. The exclusion unit 112 excludes biometric information for the specified period, and the estimation unit 104 can perform sentiment analysis. Furthermore, the update unit 106 can update the threshold using the score excluding periods that meet specific conditions. By excluding scores from states different from the normal mental state and updating the threshold, the accuracy of the threshold can be improved.

[0085] (Third embodiment) <System Overview> Figure 17 is a conceptual diagram showing the system configuration of the information processing system 1 according to the embodiment. In addition to the information processing system 1 of the embodiment shown in Figure 3, the information processing system 1 further includes an administrator terminal 80. The administrator terminal 80 is a terminal used by administrator M who manages user U at the company where user U works, and is a computer 1000 such as a personal computer, tablet terminal, or smartphone. The administrator terminal 80 can communicate with user terminals 60 via the communication network 3.

[0086] This embodiment is the same as the first embodiment, except that it has a configuration that outputs a message to an external terminal (administrator terminal 80) when the emotion estimation result meets the criteria. However, the configuration of this embodiment may be combined with at least one of the configurations of embodiments other than the first embodiment, to the extent that it does not cause any inconsistencies.

[0087] <Example of Functional Configuration> Figure 18 is a functional block diagram showing an example of the functional configuration of the information processing device 100 according to the embodiment. In addition to the configuration shown in Figure 5, the information processing device 100 further includes an output processing unit 114. The output processing unit 114 outputs a message to the administrator terminal 80 (external terminal) if the emotion estimation result meets the criteria.

[0088] The criteria include, for example, whether the emotion estimation results indicate that User U (the subject) is experiencing high levels of stress, or whether the emotion estimation results indicate that User U (the subject) has been experiencing anxiety for a certain period of time or longer.

[0089] In other words, the criterion is that the emotion estimation result indicates that the administrator M needs to know about user U's mental state and take appropriate action. The output content includes, for example, information that can identify user U to be notified, such as user U's department and name, and the content of the emotion estimation result that meets the criterion. User information, including user U's department and name, is stored in the memory 1030 or storage device 1040 (storage device 120 in the case of server device 70) of user terminal 60, associated with user U's identification information in advance. In the case of server device 70, the output processing unit 114 can obtain user U's department, name, etc., associated with the identification information of the person (user U) who needs notification, and include it in the output content.

[0090] The output processing unit 114 sends a message to the administrator terminal 80 notifying it that the estimated result of user U's emotions meets the criteria, for example, via email or SMS (Short Message Service) message. The recipient information is stored in advance in the storage device 1040 of the user terminal 60.

[0091] In an example where the output processing unit 114 is implemented by the server device 70 described in a later embodiment, for example, administrator M registers the user in advance and sets up account information, similar to the user terminal 60. When using the services of the information processing system 1, user U logs in to the information processing system 1 using the account information.

[0092] Administrator M can use the services provided by Information Processing System 1 by installing the above-mentioned application on the administrator terminal 80, launching the application, and logging in to Information Processing System 1. Alternatively, Administrator M may use the services provided by Information Processing System 1 by launching a designated browser on the administrator terminal 80, accessing the website for using the services provided by Information Processing System 1, and logging in using account information.

[0093] Then, in the server device 70, the output processing unit 114 notifies the administrator terminal 80, via a notification screen on the application or website, that the estimated emotion of user U (the subject) has met the criteria.

[0094] Furthermore, the notification function to the administrator terminal 80 by the output processing unit 114 may be allowed or denied by user U. The output processing unit 114 can accept the specification via a specification screen that includes a UI for accepting the selection of allow or deny. Based on user U's specification, the output processing unit 114 determines whether or not to send a notification to the administrator terminal 80. Alternatively, before sending the notification to the administrator terminal 80, the output processing unit 114 may display a screen on the user terminal 60 that includes the notification content and a UI for accepting the specification of whether to allow or deny the notification, and then determine whether or not to send the notification to the administrator terminal 80 based on user U's specification.

[0095] <Example of operation> Figure 19 is a flowchart showing an example of the operation of the information processing device 100 of the embodiment. This flow may be executed independently of the flows in Figures 2 and 12, and may be executed at any time or periodically at predetermined intervals. For example, it may be executed every week, every month, etc. Alternatively, administrator M may specify when it should be executed, and it may be executed when administrator M's specification is received.

[0096] The output processing unit 114 determines whether the emotion estimation result of user U, estimated by the estimation unit 104, meets the criteria (step S121). If the emotion estimation result meets the criteria (YES in step S121), the output processing unit 114 causes the administrator terminal 80 (external terminal) to output that the emotion estimation result of user U meets the criteria (step S113). The output processing unit 114 obtains user U's department, name, etc., includes this information in the output, and sends a message to administrator M's administrator terminal 80. If the emotion estimation result does not meet the criteria (NO in step S121), step S113 is bypassed and this process ends.

[0097] When the server device 70 implements the functions of the output processing unit 114, the output processing unit 114 obtains the emotion estimation result for each user U, determines whether the emotion estimation result for each user U meets the criteria, and if it meets the criteria, obtains the department, name, etc. of user U associated with the user U's identification information and includes them in the output. The output processing unit 114 then outputs a notification screen to the application on administrator M's administrator terminal 80 or to administrator M's web page.

[0098] As described above, this embodiment includes an output processing unit 114. When the emotion estimation result meets the criteria, the output processing unit 114 outputs a message to the administrator terminal 80 (external terminal). Thus, the information processing device 100 of this embodiment provides the same effects as the above embodiment, and furthermore, when the estimated result of user U's (the subject's) emotions meets the criteria, it can output that fact to the administrator M's administrator terminal 80. As a result, administrator M can quickly find out about user U's mental state when necessary and take appropriate action. User U can work with peace of mind because administrator M will be able to take appropriate action by knowing about their mental state.

[0099] (Fourth Embodiment) <System Overview> Figure 20 is a conceptual diagram showing the system configuration of the information processing system 1 according to the embodiment. The information processing system 1 includes, in addition to, the information processing system 1 of the embodiment in Figure 3, a server device 70 and an administrator terminal 80. In other words, it includes, in addition to, the information processing system 1 of the embodiment in Figure 15, an administrator terminal 80.

[0100] <Example of Functional Configuration> Figure 21 is a diagram showing an overview of the information processing device 100 according to an embodiment. In this embodiment, the information processing device 100 is realized by combining a user terminal 60 and a server device 70. Furthermore, the information processing device 100 includes all the units described in the above embodiment. In other words, the information processing device 100 includes a calculation unit 102, an estimation unit 104, an update unit 106, an acquisition unit 110, an exclusion unit 112, and an output processing unit 114.

[0101] The division of functions between the user terminal 60 and the server device 70's information processing device 100 is illustrated below. (b1) The user terminal 60 implements the functions of the acquisition unit 110 to acquire biometric information from the wearable terminal 50 and the exclusion unit 112, while the server device 70 implements the functions of the acquisition unit 110 to acquire biometric information from the user terminal 60 and the calculation unit 102, estimation unit 104, update unit 106, and output processing unit 114. (b2) The user terminal 60 implements the function of the acquisition unit 110 to acquire biometric information from the wearable terminal 50, and the server device 70 implements the function of the acquisition unit 110 to acquire biometric information from the user terminal 60, as well as the functions of the exclusion unit 112, calculation unit 102, estimation unit 104, update unit 106, and output processing unit 114. (b3) The user terminal 60 implements the functions of the acquisition unit 110, the exclusion unit 112, the calculation unit 102, the estimation unit 104, the update unit 106, and the output processing unit 114, as well as the function of transmitting the estimation results of the estimation unit 104 to the server device 70. The server device 70 implements the function of recording and presenting the estimation results received from the user terminal 60. (b4) The user terminal 60 implements the functions of the acquisition unit 110, the exclusion unit 112, the calculation unit 102, the estimation unit 104, and the output processing unit 114, as well as the function of transmitting the score calculated by the calculation unit 102 and the estimation result of the estimation unit 104 to the server device 70. The server device 70 implements the function of recording and presenting the estimation result received from the user terminal 60, and the function of the update unit 106 using the score received from the user terminal 60.

[0102] <Example of operation> The operation of the information processing device 100 in this embodiment will be explained using Figures 12 and 19. Here, an example of the division of functions in (b1) will be explained. First, the acquisition unit 110 acquires biometric information from the wearable terminal 50 worn by user U (step S111 in Figure 12). The acquired biometric information is associated with time information and stored as biometric information 130 in the memory 1030 or storage device 1040 of the user terminal 60. Then, at a predetermined timing, the acquisition unit 110 transmits the biometric information accumulated for a predetermined period from the user terminal 60 to the server device 70. Before the acquisition unit 110 transmits the biometric information, the exclusion unit 112 excludes the scores for periods that meet specific conditions.

[0103] In the server device 70, the acquisition unit 110 stores the biometric information 130 of user U received from the user terminal 60 in the storage device 120, associating it with the identification information of user U. Then, in the server device 70, the calculation unit 102 calculates a score indicating the mental state of user U by processing the biometric information of user U (step S101 in Figure 12). The calculated score is stored in the storage device 120 as score history information 140.

[0104] Then, in the server device 70, the estimation unit 104 estimates the emotions of user U using criteria and scores, including thresholds associated with user U (step S103 in Figure 12). The estimated results are stored in the storage device 120 as score history information 140.

[0105] Then, the update unit 106 updates the threshold using the score history (step S105 in Figure 12). For example, using one week's worth of score history, the update unit 106 extracts the maximum and minimum scores, calculates the average value, and sets the threshold. The calculated threshold is stored in the storage device 120 as threshold information 150. The threshold updated in this way will be used by the estimation unit 104 as the threshold for user U in the following week.

[0106] Meanwhile, the output processing unit 114 determines whether the emotion estimation result for each user U estimated by the estimation unit 104 meets the criteria (step S121 in Figure 19). For user U whose emotion estimation result meets the criteria (YES in step S121 in Figure 19), the output processing unit 114 causes the administrator terminal 80 (external terminal) to output that the emotion estimation result for user U meets the criteria (step S113 in Figure 19). The output processing unit 114 obtains the department, name, etc. of the user U, includes this information in the output, and sends a message to the administrator terminal 80 of administrator M. Alternatively, it displays a notification screen containing the output content in the application on the administrator terminal 80 or on the web page for administrator M. For user U whose emotion estimation result does not meet the criteria (NO in step S121 in Figure 19), step S113 in Figure 19 is bypassed, and the process in Figure 19 ends.

[0107] As described above, according to this embodiment, the information processing system 1 comprises a wearable terminal 50, a user terminal 60, a server device 70, and an administrator terminal 80. The information processing device 100 comprises a calculation unit 102, an estimation unit 104, an update unit 106, an acquisition unit 110, an exclusion unit 112, and an output processing unit 114. The functions of each unit of the information processing device 100 are shared and realized by the user terminal 60 and the server device 70.

[0108] Thus, the information processing device 100 of this embodiment provides the same effects as the embodiment described above. Specifically, by using the history of scores indicating user U's mental state, the threshold used for sentiment analysis can be updated, and the updated threshold can be used for the next sentiment analysis. This allows for improved accuracy in sentiment analysis using biometric information, taking into account individual differences in biometric information. Furthermore, user U can specify biometric information that they do not want to be used for sentiment analysis. Alternatively, the accuracy of the threshold can be improved by excluding scores from states different from the normal mental state when updating the threshold. In addition, administrator M can quickly learn about user U's mental state when necessary and take appropriate action. Because administrator M knows about user U's mental state, user U can work with peace of mind knowing that appropriate action will be taken.

[0109] The embodiments of the present invention have been described above with reference to the drawings, but these are merely examples of the present invention, and various other configurations can also be adopted. For example, in the above embodiment, the update unit 106 updates the threshold using the user U's score history. In another embodiment, when the threshold is updated by the update unit 106, the threshold update history is recorded, and the output processing unit 114 monitors the trend of threshold changes and outputs a message to the administrator terminal 80 if the threshold updates continue. In this configuration, it is possible to respond to situations such as when user U gradually becomes depressed.

[0110] Furthermore, while the flowcharts used in the above description show multiple steps (processes) in sequence, the execution order of the steps performed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content. Also, the above embodiments can be combined to the extent that their contents do not conflict.

[0111] Although the present invention has been described above with reference to embodiments, the present invention is not limited to the above embodiments. Various modifications to the structure and details of the present invention can be made, as can be understood by those skilled in the art within the scope of the present invention. Furthermore, when acquiring or using user information in this invention, such acquisition or use shall be conducted lawfully.

[0112] Some or all of the above embodiments may also be described as follows, but are not limited to the following: 1. A calculation means that calculates a score indicating the mental state of the subject by processing the subject's biometric information, An estimation means for estimating the emotions of the subject using criteria including a threshold associated with the subject and the score, An information processing apparatus comprising: an update means for updating the threshold using the history of the score. 2. In the information processing device described in 1., The update means is an information processing device that sets the threshold for a subject using the maximum and minimum values ​​of the subject's score. 3. In the information processing device described in 1. or 2., An information processing device further comprising exclusion means for excluding the scores from the history of the score for a period in which a specific condition is met. 4. In the information processing device described in 3. The update means is an information processing device that updates the threshold using the score obtained by excluding the score for the period from the history using the exclusion means. 5. In the information processing device described in 3. or 4., The estimation means is an information processing device that estimates the emotions of the subject using the score obtained by excluding the score for the period from the history using the exclusion means. 6. In the information processing device described in any one of 3 to 5, The calculation means calculates the average value of the score for each predetermined period, The exclusion means is an information processing device that identifies a period to be excluded using the average value that satisfies the specific conditions. 7. In the information processing device described in any one of 3 to 6, The exclusion means is, Obtain the schedule information of the aforementioned person, An information processing device that uses the schedule information to identify periods to be excluded from processing. 8. In the information processing device described in any one of items 1 to 7, The aforementioned score is an information processing device that includes multiple scores, each representing a different type of mental state. In the information processing device described in 9.8, The estimation means is, The scores representing the two types of mental states of the subject are plotted on a coordinate system, with each score representing a different coordinate axis. An information processing device that, on the aforementioned coordinates, divides the region exceeding the threshold into four regions using the coordinate axes, each of which represents one of four different emotional ranges for the subject, and estimates that the emotion corresponding to the region where the plotted value exists is the emotion of the subject when the plotted value exists in the region exceeding the threshold. 10. In the information processing device described in any one of items 1 to 9, The system further comprises means for acquiring biometric information from a wearable device worn by the subject, The calculation means is an information processing device that uses the biological information acquired by the acquisition means. 11. In the information processing device described in any one of items 1 to 10, The system further includes means for acquiring biometric information from external storage means, The calculation means is an information processing device that uses the biological information acquired by the acquisition means. 12. In the information processing device described in any one of items 1 to 11, An information processing device further comprising output processing means for outputting a notification to an external terminal if the aforementioned emotion estimation result meets the criteria.

[0113] 13. One or more computers, By processing the subject's biometric information, a score indicating the subject's mental state is calculated. Using criteria including thresholds associated with the subject and the score, the subject's emotions are estimated. An information processing method for updating the threshold using the history of the score. 14. In the information processing method described in 13., The aforementioned one or more computers An information processing method for setting the threshold for a subject using the maximum and minimum values ​​of the subject's score. 15. In the information processing method described in 13. or 14., The aforementioned one or more computers further An information processing method for excluding the scores from the history of the score for periods in which specific conditions are met. 16. In the information processing method described in 15., The aforementioned one or more computers An information processing method that updates the threshold using the score obtained by excluding the score for the aforementioned period from the aforementioned history. 17. In the information processing method described in 15. or 16., The aforementioned one or more computers An information processing method for estimating the emotions of the subject using the score obtained by excluding the score for the aforementioned period from the aforementioned history. 18. In the information processing method described in any one of 15. to 17., The aforementioned one or more computers The average value of the score is calculated for each predetermined period, An information processing method for identifying a period to be excluded using the average value that satisfies the aforementioned specific conditions. 19. In the information processing method described in any one of 15. to 18., The aforementioned one or more computers Obtain the schedule information of the aforementioned person, An information processing method that uses the schedule information to identify periods to be excluded from processing. 20. In any of the information processing methods described in 13. to 19., The aforementioned score is an information processing method that includes multiple scores, each representing a different type of mental state. 21. In the information processing method described in 20., The aforementioned one or more computers The scores representing the two types of mental states of the subject are plotted on a coordinate system, with each score representing a different coordinate axis. An information processing method comprising: defining each of the four regions divided into four by the coordinate axes in the region exceeding the threshold on the aforementioned coordinates as representing four different emotional ranges of the subject; and estimating that the emotion corresponding to the region where the plotted value exists is the emotion of the subject when the plotted value exists in the region exceeding the threshold. 22. In the information processing method described in any one of 13. to 21., The aforementioned one or more computers further Biometric information is acquired from the wearable device worn by the aforementioned subject. An information processing method for calculating the score using the acquired biometric information. 23. In the information processing method described in any one of 13. to 22., The aforementioned one or more computers further By acquiring biometric information from an external storage device, An information processing method for calculating the score using the acquired biometric information. 24. In the information processing method described in any one of 13 to 23, The aforementioned one or more computers further An information processing method that outputs a notification to an external terminal if the aforementioned emotion estimation result meets the criteria.

[0114] 25. To the computer, A procedure for calculating a score indicating the mental state of a subject by processing the subject's biometric information. A procedure for estimating the emotions of the subject using criteria including a threshold associated with the subject and the score, A procedure for updating the threshold using the history of the score, A computer-readable program storage medium that stores a program to execute. 26. In the program recording medium described in 25., A computer-readable program recording medium storing a program that causes the computer to perform the update procedure described above, which involves setting the threshold for the subject using the maximum and minimum values ​​of the subject's score. 27. In the program recording medium described in 25. or 26., A computer-readable program recording medium storing a program that causes the computer to further execute a procedure for excluding the scores from the history of the score for a period in which specific conditions are met. 28. In the program recording medium described in 27., A computer-readable program recording medium storing a program that causes the computer to perform the updating procedure, which involves updating the threshold using the score obtained by excluding the score for the period in the history in the exclusion procedure. 29. In the program recording medium described in 27. or 28., A computer-readable program recording medium storing a program that causes the computer to perform the estimation procedure, wherein the estimation procedure involves using the score obtained by excluding the score for the period in the history in accordance with the exclusion procedure, to estimate the emotions of the subject. 30. In a program recording medium described in any one of 27. to 29., In the calculation procedure described above, the average value of the score is calculated for each predetermined period, A computer-readable program recording medium storing a program that causes the computer to perform the exclusion procedure, which involves specifying the period to be excluded using the average value that satisfies the specific conditions. 31. In a program recording medium described in any one of 27. to 30., In the exclusion procedure described above, Obtain the schedule information of the aforementioned person, A computer-readable program recording medium that stores a program causing the computer to perform the task of identifying periods to be excluded from processing using the said schedule information. 32. In a program recording medium described in any one of 25. to 31., The aforementioned score is a computer-readable program recording medium containing multiple scores, each representing a different type of mental state. 33. In the program recording medium described in 32., In the estimation procedure described above, The scores representing the two types of mental states of the subject are plotted on a coordinate system, with each score representing a different coordinate axis. A computer-readable program recording medium storing a program that causes the computer to perform the following operation: on the coordinate system, each of the four regions divided into four sections by the coordinate axes in the region exceeding the threshold represents one of four different emotions of the subject; and if the plotted value is in a region exceeding the threshold, the emotion corresponding to the region where the plotted value exists is estimated to be the emotion of the subject. 34. In a program recording medium described in any one of 25. to 33., The computer is further instructed to perform a procedure to acquire biometric information from a wearable device worn by the subject. A computer-readable program recording medium storing a program that causes the computer to perform the calculation procedure, which involves using the biometric information acquired in the acquisition procedure, to calculate the score. 35. In a program recording medium described in any one of 25. to 34., The computer is further instructed to perform a procedure to acquire biometric information from an external storage means. A computer-readable program recording medium storing a program that causes the computer to perform the calculation procedure using the biometric information acquired in the acquisition procedure. 36. In a program recording medium described in any one of 25. to 35., A computer-readable program recording medium storing a program that causes the computer to execute a procedure for outputting a notification to an external terminal if the emotion estimation result meets the criteria.

[0115] 37. To the computer, A procedure for calculating a score indicating the mental state of a subject by processing the subject's biometric information. A procedure for estimating the emotions of the subject using criteria including a threshold associated with the subject and the score, A procedure for updating the threshold using the history of the score, A program to execute. 38. In the program described in 37, A program that causes the computer to perform the update procedure described above, which involves setting the threshold for a subject using the maximum and minimum values ​​of the subject's score. 39. In the programs described in 37. or 38., A program that causes the computer to further perform a procedure to exclude the scores from the history of the score for a period in which a specific condition is met. In the program described in 40.39., A program that causes the computer to perform the updating procedure, wherein the updating procedure involves updating the threshold using the score obtained by excluding the score for the period in the history from the history in the exclusion procedure. 41. In the programs described in 39. or 40., A program that causes the computer to perform the estimation procedure, wherein the estimation procedure involves using the score obtained by excluding the score for the period in the history in accordance with the exclusion procedure, to estimate the emotions of the subject. 42. In any of the programs described in 39. to 41., In the calculation procedure described above, the average value of the score is calculated for each predetermined period, A program that causes the computer to perform the exclusion procedure, which involves using the average value that satisfies the specific conditions, to identify the period to be excluded. 43. In any of the programs described in 39. through 42., In the exclusion procedure described above, Obtain the schedule information of the aforementioned person, A program that causes the computer to use the schedule information to identify periods that will be excluded from processing. 44. In any of the programs described in 37. through 43., The aforementioned score is a program that includes multiple scores, each representing a different type of mental state. 45. In the program described in 44., In the estimation procedure described above, The scores representing the two types of mental states of the subject are plotted on a coordinate system, with each score representing a different coordinate axis. A program to cause the computer to perform the following actions: on the coordinate system, in the region exceeding the threshold, each of the four regions divided by the coordinate axes represents one of four different emotional ranges for the subject; and if the plotted value is in a region exceeding the threshold, the program estimates that the emotion corresponding to the region where the plotted value is located is the emotion of the subject. 46. ​​In any one of the programs described in 37. through 45., The computer is further instructed to perform a procedure to acquire biometric information from a wearable device worn by the subject. A program that causes the computer to perform the calculation procedure, using the biometric information acquired in the acquisition procedure, in the calculation procedure described above. 47. In any of the programs described in 37. through 46., The computer is further instructed to perform a procedure to acquire biometric information from an external storage means. A program that causes the computer to perform the calculation procedure described above, using the biometric information acquired in the acquisition procedure described above, in order to calculate the score. 48. In any of the programs described in 37. to 47., A program that causes the computer to execute a procedure to output a notification to an external terminal if the emotion estimation result meets the criteria. [Explanation of Symbols]

[0116] 1. Information Processing System 3. Communication Network 50 wearable devices 60 User Terminals 70 Server Devices 80 Administrator terminal 100 Information Processing Devices 102 Calculation Unit 104 Estimation part 106 Update section 110 Acquisition Department 112 Exclusion part 114 Output Processing Unit 120 Storage device 130 Biometric Information 140 Score History Information 150 Threshold Information 1000 computers 1010 Bus 1020 Processor 1030 memory 1040 Storage Devices 1050 Input / Output Interface 1060 Network Interfaces

Claims

1. A calculation means that calculates a score indicating the mental state of the subject by processing the subject's biometric information, An estimation means for estimating the emotions of the subject using criteria including a threshold associated with the subject and the score, The update means updates the threshold using the score history, The system includes a means for accepting designations by the subject for specific conditions to exclude the aforementioned score, and for excluding the aforementioned score from the history of the score for periods in which the specific conditions are met, The update means is an information processing device that updates the threshold using the score from which the score for the period in which the specific conditions were met by the exclusion means has been excluded from the history.

2. In the information processing apparatus according to claim 1, The update means is an information processing device that sets the threshold for a subject using the maximum and minimum values ​​of the subject's score.

3. In the information processing apparatus according to claim 1 or 2, The system further comprises means for acquiring biometric information from a wearable device worn by the subject, The calculation means is an information processing device that uses the biological information acquired by the acquisition means.

4. In the information processing apparatus according to claim 1 or 2, The update means is an information processing device that updates the threshold using the score obtained by excluding the score for the period from the history using the exclusion means.

5. In the information processing apparatus according to claim 1 or 2, The estimation means is an information processing device that estimates the emotions of the subject using the score obtained by excluding the score for the period from the history using the exclusion means.

6. In the information processing apparatus according to claim 1 or 2, The calculation means calculates the average value of the score for each predetermined period, The exclusion means is an information processing device that identifies a period to be excluded using the average value that satisfies the specific conditions.

7. In the information processing apparatus according to claim 1 or 2, The exclusion means is, Obtain the schedule information of the aforementioned person, An information processing device that uses the schedule information to identify periods to be excluded from processing.

8. One or more computers, By processing the subject's biometric information, a score indicating the subject's mental state is calculated. Using criteria including thresholds associated with the subject and the score, the subject's emotions are estimated. The threshold is updated using the score history. The subject accepts designation of specific conditions for excluding the aforementioned score, and excludes the aforementioned score from the history of the score for the period in which the specific conditions are met. An information processing method for updating the threshold, wherein the threshold is updated using the score from which the scores for periods that satisfy the specific conditions are excluded from the history.

9. On the computer, A procedure for calculating a score indicating the mental state of a subject by processing the subject's biometric information. A procedure for estimating the emotions of the subject using criteria including a threshold associated with the subject and the score, A procedure for updating the threshold using the history of the score, The procedure involves accepting the subject's designation of specific conditions for excluding the aforementioned score, and excluding the aforementioned score from the score history for periods in which the specific conditions are met, A program for performing the updating procedure, which involves updating the threshold using the score from which the score for the period in the exclusion procedure that satisfies the specific conditions was excluded in the history.

Images