Information processing device, information processing method, and program

Abstract

An information processing device (100) comprises: a storage processing unit (102) that stores an emotion analysis result of a subject in association with a category of work in which the subject is engaged when the emotion analysis result is under analysis; and a display processing unit (104) that displays each schedule by category of work that has been carried out or is scheduled to be carried out in association with the emotion analysis result corresponding to the category of work in a plan displaying the subject's schedule.

Description

Information processing device, information processing method, and recording medium

[0001] The present invention relates to an information processing device, an information processing method, and a recording medium.

[0002] Patent Literature 1 describes a system for predicting a target person's future level of a specific emotion. The system described in Patent Literature 1 includes a storage unit that stores an emotion history that associates the level of the specific emotion generated based on a user's behavioral history obtained from the user's posts on a social networking service (SNS), the date and time and location at which the specific emotion occurred, and keywords related to the occurrence of the specific emotion, and a control unit that predicts the user's future level of the specific emotion based on the user's future schedule, the level of the specific emotion stored as the emotion history, and the keywords related to the occurrence of the specific emotion level.

[0003] Furthermore, Patent Document 2 describes a technology for appropriately investigating the level of stress experienced by a subject. The information processing device described in Patent Document 2 generates a mathematical formula for converting a heart rate stress value into a subjective stress value for each task, stores stress weights and offset values ​​forming the mathematical formula, generates and stores a threshold value for the subjective stress value for each task, estimates a subjective stress value for each task on a weekly basis based on the heart rate stress value using the generated mathematical formula, determines whether the estimated subjective stress value for each task is equal to or greater than the threshold, and if there is a task for which the estimated subjective stress value is equal to or greater than the threshold, outputs an alert for the task for which the estimated subjective stress value is equal to or greater than the threshold.

[0004] JP 2020-177696 A JP 2022-1115 A

[0005] The technology described in Patent Document 1 above is intended to enable a user to check a nationwide happiness forecast on the morning of a business trip, understand the happiness level at the business trip destination or stopover at a specific time, and prepare in advance. Furthermore, the technology described in Patent Document 2 above quantifies the stress experienced by a subject at work, issues an alert when the stress exceeds a threshold, and enables companies to provide appropriate support to employees. In other words, neither of the technologies described in the above patent documents is intended to estimate the subject's emotions for each task and visualize the subject's emotions for each task on a schedule, both for the subject's past and future work schedules.

[0006] Furthermore, none of the technologies described in the above patent documents anticipates visualizing the emotions of a subject during work by associating keywords extracted by processing the subject's conversational voice during work. In response to this, the present inventors have considered estimating the subject's emotions for each work task and visualizing the subject's emotions for each work task in at least one of the subject's past work schedule and future work schedule, or visualizing the emotions of a subject during work by associating keywords extracted by processing the subject's conversational voice during work with the subject's emotions during work.

[0007] The present invention has been made in consideration of the above circumstances, and its purpose is to provide an information processing device, an information processing method, and a recording medium that make it easier to understand the impact of a subject's work on their mental state by visualizing the subject's emotions while they are working.

[0008] According to one aspect of the present invention, there is provided an information processing device comprising: a storage processing means for storing in a storage means the emotion analysis results of a subject in association with the category of work that the subject was engaged in when the emotion analysis results were analyzed; and a display processing means for displaying, on a screen displaying the subject's schedule, each scheduled or previously performed schedule by category of work in association with the emotion analysis results corresponding to the work category.

[0009] According to one aspect of the present invention, there is provided an information processing device comprising: a storage processing means for storing in a storage means the emotion analysis results of a subject in association with the category of work in which the subject was engaged when the subject was the subject of analysis of the emotion analysis results; an extraction means for processing a conversational voice of the subject while engaged in the work that was the subject of analysis of the emotion analysis results, and extracting keywords that include at least one of words and phrases included in the conversational voice; and a display processing means for displaying a screen including information that associates the category of the subject's emotion regarding the work with the keywords included in the conversational voice while engaged in the work.

[0010] According to one aspect of the present invention, an information processing method is provided in which one or more computers store in a storage means the emotion analysis results of a subject in association with the category of work that the subject was engaged in when the subject became the subject of the emotion analysis results, and display, on a screen displaying the subject's schedule, each scheduled or previously performed schedule by category of work in association with the emotion analysis results corresponding to the work category.

[0011] According to one aspect of the present invention, there is provided an information processing method in which one or more computers store in a storage means emotion analysis results of a subject in association with the category of work that the subject was engaged in when the subject was the subject of analysis of the emotion analysis results, process conversational voice of the subject while engaged in the work that was the subject of analysis of the emotion analysis results, extract keywords that include at least one of words and phrases included in the conversational voice, and display a screen including information that associates the category of emotion that the subject has regarding the work with the keywords included in the conversational voice while engaged in the work.

[0012] According to one aspect of the present invention, there is provided a computer-readable recording medium storing a program for causing a computer to execute the steps of: storing in a storage means the emotion analysis results of a subject in association with the category of work that the subject was engaged in when the emotion analysis results were analyzed; and displaying, on a screen displaying the subject's schedule, each scheduled or previously performed schedule by category of work in association with the emotion analysis results corresponding to the work category.

[0013] According to one aspect of the present invention, there is provided a computer-readable recording medium having stored thereon a program for causing a computer to execute the following steps: storing in a storage means the emotion analysis results of a subject in association with the category of work that the subject was engaged in when the emotion analysis results were analyzed; processing the conversational voice of the subject while engaged in the work that was the subject of the emotion analysis results, and extracting keywords that include at least one of words and phrases contained in the conversational voice; and displaying a screen that includes information that associates the category of the subject's emotion regarding the work with the keywords contained in the conversational voice while engaged in the work.

[0014] According to one aspect of the present invention, an information processing device, an information processing method, and a recording medium can be obtained that make it easier to understand the impact of a subject's work on their mental state by visualizing the subject's emotions while they are working.

[0015] 1 is a diagram illustrating an overview of an information processing device according to an embodiment. FIG. 2 is a flowchart illustrating an example of operation of the information processing device according to an embodiment. FIG. 3 is a diagram illustrating an overview of an information processing device according to an embodiment. FIG. 4 is a flowchart illustrating an example of operation of the information processing device according to an embodiment. FIG. 5 is a diagram conceptually illustrating an example of a system configuration of an information processing system according to an embodiment. FIG. 6 is a diagram conceptually illustrating another example of the system configuration of the information processing system according to an embodiment. FIG. 7 is a block diagram illustrating an example of a hardware configuration of a computer that realizes an information processing device. FIG. 8 is a functional block diagram illustrating an example of a logical configuration of an information processing device according to an embodiment. FIG. 9 is a diagram illustrating an example of a data structure of biometric information. FIG. 10 is a diagram illustrating an example of a data structure of task information. FIG. 11 is a diagram illustrating an example of a data structure of score history information. FIG. 12 is a diagram for explaining an emotion estimation method using an arousal level and a harmony level. FIG. 13 is a diagram illustrating an example of a data structure of emotion analysis result information. FIG. 14 is a diagram illustrating an example of a schedule screen. FIG. 15 is a diagram illustrating an example of a schedule screen. FIG. 16 is a diagram illustrating an example of a data structure of task-specific emotion information. FIG. 17 is a diagram illustrating an example of a task ranking screen. FIG. 18 is a flowchart illustrating an example of operation of an information processing device according to an embodiment. FIG. 19 is a functional block diagram illustrating an example of a logical configuration of an information processing device according to an embodiment. FIG. 19 is a functional block diagram illustrating an example of a configuration of a modified aspect of the information processing device according to an embodiment. FIG. 19 is a diagram illustrating an example of a keyword ranking screen. FIG. 19 is a flowchart illustrating an example of operation of the information processing device according to an embodiment. 10 is a diagram showing an example of a report screen. FIG. 11 is a diagram showing a graph showing the distribution of users' emotions. FIG.

[0016] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all drawings, similar components are designated by similar reference numerals, and their description will be omitted as appropriate. In addition, in the following drawings, configurations of parts that are not related to the essence of the present invention are omitted and are not shown.

[0017] In the embodiments, "acquisition" includes at least one of the following: a device going to retrieve data or information stored in another device or storage medium (active acquisition); and inputting data or information output from another device into the device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a response, and accessing and reading information from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0018] <Minimum Configuration Example 1> Fig. 1 is a diagram showing an overview of an information processing device 100 according to an embodiment. The information processing device 100 includes a storage processing unit 102 and a display processing unit 104. The storage processing unit 102 stores emotion analysis results of a subject in association with the category of work that the subject was engaged in when the emotion analysis results were analyzed. The display processing unit 104 displays, on a screen displaying the subject's schedule, each scheduled or previously performed work schedule by category in association with the emotion analysis results corresponding to the work category.

[0019] 2 is a flowchart showing an example of operation of the information processing apparatus 100 according to the embodiment. The storage processing unit 102 stores the emotion analysis results of the subject in association with the category of work that the subject was engaged in when the emotion analysis results were analyzed (step S101). The display processing unit 104 displays, on a screen displaying the subject's schedule, each scheduled or past work schedule by category in association with the emotion analysis results corresponding to the work category (step S103).

[0020] Steps S101 and S103 of this process may be executed at different times. For example, step S101 is executed when the emotion analysis result and the work category of the subject are acquired, and step S103 is executed when the display screen of the subject's schedule is displayed.

[0021] In this information processing device 100, the storage processing unit 102 stores the emotion analysis results of the subject in association with the category of work the subject was engaged in when the emotion analysis results were analyzed. The display processing unit 104 displays, on a screen displaying the subject's schedule, each scheduled or past work schedule by category in association with the emotion analysis results corresponding to the work category. In this way, the information processing device 100 visualizes the subject's emotions while working, making it easier to understand the impact of the subject's work on their mental state.

[0022] <Minimum Configuration Example 2> Fig. 3 is a diagram illustrating an overview of an information processing device 100 according to an embodiment. The information processing device 100 includes a storage processing unit 102, a display processing unit 104, and an extraction unit 106. The storage processing unit 102 stores the emotion analysis results of the subject in association with the category of work in which the subject was engaged when the subject became the subject of the emotion analysis results. The extraction unit 106 processes the conversational voice of the subject when the subject became the subject of the emotion analysis results and extracts keywords including at least one of words and phrases included in the conversational voice. The display processing unit 104 displays a screen including information, by work category, associating the classification of the subject's emotions regarding the work with keywords included in the conversational voice while the subject was engaged in the work.

[0023] <Operation Example> Figure 4 is a flowchart showing an operation example of the information processing device 100 according to the embodiment. The storage processing unit 102 stores the emotion analysis results of the subject in association with the category of work the subject was engaged in when the subject was the subject of the emotion analysis results (step S101). The extraction unit 106 processes the conversational voice of the subject when the subject was the subject of the emotion analysis results and extracts keywords including at least one of words and phrases included in the conversational voice (step S111). The display processing unit 104 displays a screen including information that associates, by work category, the classification of the subject's emotions regarding the work with keywords included in the conversational voice while the subject was engaged in the work (step S113).

[0024] Steps S101, S111, and S113 of this process may be executed at different times. For example, step S101 is executed when the emotion analysis result of the subject and the task category are acquired, step S111 is executed when the conversational voice of the subject is acquired, and step S113 is executed when the display screen of the emotion analysis result of the subject is displayed.

[0025] In this information processing device 100, the storage processing unit 102 stores the emotion analysis results of the subject in association with the category of work the subject was engaged in when the subject was the subject of the emotion analysis results. The extraction unit 106 processes the conversational voice of the subject when the subject was the subject of the emotion analysis results and extracts keywords including at least one of words and phrases contained in the conversational voice. The display processing unit 104 displays a screen including information that associates, by work category, the subject's emotions regarding the work with keywords contained in the conversational voice while the subject was engaged in the work. In this way, the information processing device 100 visualizes the subject's emotions while working, making it easier to understand the impact of the subject's work on their mental state.

[0026] A detailed example of the information processing device 100 will be described below.

[0027] First Embodiment <System Overview> Fig. 5 is a diagram conceptually illustrating an example of the system configuration of an information processing system 1 according to an embodiment. The information processing system 1 includes an information processing device 100 and a wearable terminal 50. In this example, the information processing device 100 is a user terminal 60 of a user U, and is, for example, a computer such as a smartphone, a tablet terminal, or a personal computer. The user terminal 60 and the wearable terminal 50 perform a pairing procedure in advance so that they can communicate using near field communication (NFC).

[0028] In the information processing system 1, the user U is the subject of emotion analysis, and the user U is, for example, an employee of a company. In this example, the user terminal 60 is owned by the user U, and the wearable terminal 50 is loaned to the user U by the company. However, the user terminal 60 does not necessarily have to be owned by the user U, and may be loaned to the user U by the company. Furthermore, the wearable terminal 50 does not necessarily have to be loaned to the user U by the company, and may be owned by the user U.

[0029] In this example, the wearable device 50 is loaned to the user U by the company, and the user U borrows the wearable device 50 when coming to work, pairs the wearable device 50 with the user device 60, wears the wearable device 50 while working, and cancels the pairing between the wearable device 50 and the user device 60 when leaving work and returns the wearable device 50. In other words, the wearable device 50 can be shared and used among employees. Therefore, if the work style is a shift system, it is sufficient to prepare wearable devices 50 for the number of people present at their desks each day, rather than for the number of employees.

[0030] The wearable device 50 measures the biometric information of the user U and transmits it to the user terminal 60. The biometric information acquired by the wearable device 50 includes, but is not limited to, various types of information such as pulse rate, heart rate, body temperature, blood pressure, activity level, posture, electrocardiogram, respiratory rate, blood oxygen level, and conversation voice.

[0031] The wearable terminal 50 is equipped with various sensors for measuring such biological information. Regarding conversational voice, voice collected from a speaker of the wearable terminal 50 may be recorded, and the voice data may be transmitted to the user terminal 60. Alternatively, the user terminal 60 may be placed around the user U at all times during work hours, and the voice data collected by the speaker of the user terminal 60 may be used.

[0032] An application for using the services of the information processing system 1 is pre-installed on the user terminal 60 of the user U. The user U wears the wearable terminal 50, starts the application on the user terminal 60, and pairs the wearable terminal 50 with the user terminal 60. This allows the information processing device 100 to realize its functions on the user terminal 60.

[0033] Furthermore, the information processing system 1 according to the embodiment may have the configuration shown in Fig. 6. Fig. 6 is a diagram conceptually illustrating another example of the system configuration of the information processing system 1 according to the embodiment. The information processing system 1 of this example further includes a server device 70 in addition to the information processing system 1 according to the embodiment shown in Fig. 5.

[0034] The server device 70 is a server computer realized by a computer 1000 in FIG. 7 , which will be described later. The server device 70 may also include a web server. The user terminal 60 is connected to the server device 70 via a communication network 3. The communication network 3 may be a network such as the Internet, or may be an in-house network. The server device 70 includes a storage device 120. The storage device 120 may be provided inside or outside the server device 70. In other words, the storage device 120 may be hardware that is integrated with the server device 70, or may be hardware that is separate from the server device 70.

[0035] In the configuration example of Fig. 5, the information processing device 100 is realized by only the user terminal 60, but in the configuration example of Fig. 6, the information processing device 100 is realized by a combination of the server device 70 and the user terminal 60. Furthermore, it is assumed that the user U can use the services provided by the information processing system 1 by accessing the server device 70 using the user terminal 60. For this purpose, the user U performs user registration in advance and sets account information. When using the services of the information processing system 1, the user U logs in to the information processing system 1 using the account information.

[0036] The user U can use the services provided by the information processing system 1 by installing the above-mentioned application on the user terminal 60, starting the application, and logging in to the information processing system 1. Alternatively, the user U can use the services provided by the information processing system 1 by starting a predetermined browser on the user terminal 60, accessing a website for using the services provided by the information processing system 1, and logging in using account information.

[0037] 7 is a block diagram illustrating an example of the hardware configuration of a computer 1000 that realizes the information processing device 100 (user terminal 60). The wearable terminal 50 and the server device 70 are also realized by the computer 1000. In addition, the administrator terminal 80 described in the embodiment below is also realized by the information processing device 100.

[0038] The computer 1000 has a bus 1010 , a processor 1020 , a memory 1030 , a storage device 1040 , an input / output interface 1050 , and a network interface 1060 .

[0039] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0040] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0041] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0042] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read-only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the information processing device 100 (e.g., the storage processing unit 102, the display processing unit 104, the extraction unit 106, and the sentiment analysis unit 110, the counting unit 112, and the acquisition unit 114, which will be described later). The processor 1020 loads each of these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to the program module. The storage device 1040 may also store each piece of data of the storage device 120, which will be described later.

[0043] The program module may be recorded on a recording medium. The recording medium on which the program module is recorded may include a non-transitory, tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.

[0044] The input / output interface 1050 is an interface for connecting the computer 1000 with various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).

[0045] The network interface 1060 is an interface for connecting the computer 1000 to a communication network. This communication network may be, for example, a local area network (LAN) or a wide area network (WAN). The network interface 1060 may connect to the communication network wirelessly or by wire.

[0046] The computer 1000 then connects to necessary equipment (e.g., the display, touch panel, display, operation buttons, camera, speaker, microphone of the user terminal 60, the display, touch panel, display, operation buttons, speaker, microphone of the wearable terminal 50, the keyboard, mouse, speaker, microphone, printer, etc. of the server device 70) via the input / output interface 1050 or the network interface 1060.

[0047] The components of the information processing device 100 of each embodiment shown in Figures 1 and 3, and Figures 8, 19, and 20 described below, are realized by any combination of hardware and software of the computer 1000 of Figure 7. Those skilled in the art will understand that there are various variations in the realization methods and devices. The functional block diagrams showing the information processing device 100 of each embodiment show logical functional blocks rather than a hardware-based configuration.

[0048] 8 is a functional block diagram showing an example of the logical configuration of the information processing device 100 according to the embodiment. The information processing device 100 includes the same storage processing unit 102 and display processing unit 104 as the information processing device 100 in FIG. 1 , and further includes a sentiment analysis unit 110 and an acquisition unit 114.

[0049] The acquisition unit 114 acquires emotion analysis data of the subject, and when acquiring the emotion analysis data, acquires business information related to the business that the subject was engaged in. The emotion analysis data includes biometric information of the user U (the subject) acquired from the wearable device 50 worn by the user U.

[0050] There is no particular limitation on the timing of acquiring the biometric information from the wearable terminal 50. Depending on the storage capacity of the wearable terminal 50, a certain amount of biometric information may be stored and transmitted collectively for a predetermined period of time. Depending on the communication status between the wearable terminal 50 and the user terminal 60, the biometric information may be transmitted when the communication status is good, or may be transmitted immediately each time the biometric information is acquired, or after a certain time has elapsed.

[0051] 9 is a diagram showing an example of the data structure of the biological information 130. The biological information 130 stores time information and biological information such as pulse rate, activity level, and conversation level in association with each other. The biological information 130 is stored in the memory 1030 or storage device 1040 of the computer 1000 that implements the user terminal 60 or the server device 70, or in the storage device 120.

[0052] 10 is a diagram showing an example of the data structure of the task information 150. The task information 150 includes schedule information for user U during working hours. In this example, the start time and end time for each task category are stored in association with each other. The task category also includes breaks. Therefore, the task information 150 also stores the start time and end time of breaks in association with each other.

[0053] The business information 150 is stored in the memory 1030 or storage device 1040 of the computer 1000 that implements the user terminal 60 or the server device 70, or in the storage device 120.

[0054] The task categories are not particularly limited and may be set as appropriate by the user U or an administrator M who manages the user U at the company where the user U works. Task categories may include not only classifications based on the work content (meetings, business trips to clients, new customer development, new employee training, document preparation, reporting, etc.), but also classifications based on a specific project, the target product of the task, the field of that product, the client (company or person in charge) targeted by the task, the team members of the task, and the person in charge of the task. The information processing device 100 may display a UI (User Interface) for accepting the setting of task categories on a specific operation screen (not shown) and may have a reception unit (not shown) for accepting the setting.

[0055] Furthermore, the task information 150 may be a schedule showing future plans, a schedule showing the actual work that the user U has done, or both a schedule and an actual work.

[0056] The emotion analysis unit 110 performs emotion analysis of the user U using the emotion analysis data of the user U acquired by the acquisition unit 114 from the wearable device 50 of the user U, and outputs the emotion analysis result. The emotion analysis result is output as, for example, a score value indicating the mental state of the user U.

[0057] The score indicating the mental state includes multiple scores indicating multiple types of mental states, respectively. As an example, the score includes scores indicating an alertness level and a harmony level. For example, the alertness level is a value indicating the degree of wakefulness that indicates a state of drowsiness, and a larger score value indicates a higher level of wakefulness, and a smaller score value indicates a higher level of drowsiness. The harmony level is a value indicating emotions such as pleasant or unpleasant, and a larger score value indicates a more comfortable state, and a smaller score value indicates a more unpleasant state.

[0058] The score may be a value indicated in any of the ranges of values, for example, 0 to 100, −100 to +100, 0 to 1, and −1 to +1, but is not limited to these.

[0059] 11 is a diagram showing an example of the data structure of the score history information 140. The score history information 140 stores time information and scores output by the sentiment analysis unit 110 in association with each other. The score history information 140 is stored in the memory 1030 or storage device 1040 of the computer 1000 that realizes the user terminal 60 or the server device 70, or in the storage device 120.

[0060] 12 is a diagram illustrating an emotion estimation method using an arousal level and a harmony level. In this example, the arousal level and the harmony level, which are two scores indicating mental states, are shown as coordinate axes, and the four regions divided by the coordinate axes correspond to the four emotion categories of user U. In this example, the four emotion categories, "ANGRY," "HAPPY," "SAD," and "RELAXED," are each set by four coordinate regions. If user U's score value falls within a range exceeding a threshold T, user U is estimated to be in the emotion of that region.

[0061] Specifically, a score indicating the arousal level and a score indicating the harmony level are plotted on the graph of FIG. 12 . A threshold value T is preset for at least one of the arousal level and the harmony level. This threshold value T is represented by a value between 0 and 100 on the Y-axis of the arousal level in FIG. 12 . The range of each emotion is the area beyond the circle having a radius based on this threshold and extending up to 100 on the Y-axis. In other words, when the score plot falls within each area exceeding the threshold value T, it is estimated that user U (the subject) is experiencing the emotion in that area. For example, FIG. 12 shows data d1 plotting the arousal level score y1 and the harmony level score x1 at time t1. At this time, data d1 for user U (the subject) falls within the area indicated as "ANGRY," which exceeds the threshold value T, and therefore it is estimated that user U is experiencing anger. However, the range of threshold value T may be elliptical rather than circular. In other words, the threshold values ​​on the X-axis and Y-axis may be different values.

[0062] Furthermore, in this embodiment, the emotion analysis unit 110 may estimate whether the emotion of the user U is included in the negative area and identify cases in which it is estimated that the user U is harboring negative emotions. Whether the user U is harboring negative emotions may be determined by whether data d, which is a plot of the scores of the user U's arousal level and harmony level, is included in the "ANGRY" and "SAD" areas.

[0063] Furthermore, if the hatched area in Figure 12 contains data d plotting the scores of user U's arousal level and harmony level, it may be determined that the user is experiencing particularly negative emotions. The hatched area is, for example, a region within the "ANGRY" region representing negative emotions that extends in a fan shape from the negative side of the x-axis coordinate to the positive direction of the y-axis at a predetermined angle θ1. Also, for example, the hatched area is a region within the "SAD" region representing negative emotions that extends in a fan shape from the negative side of the x-axis coordinate to the negative direction of the y-axis at a predetermined angle θ2. θ1 is set in the range of 0 to +90°, and θ2 is set in the range of 0 to -90°.

[0064] In this example, the range of negative emotions is shown using a single level, but in other examples, it may be shown using multiple levels. For example, a fan-shaped area at angle θ3 may be set to be even narrower than the area defined by angle θ1, which indicates the negative emotion "ANGRY." Then, based on whether data d is included in the fan-shaped area at angle θ3, the emotion analysis unit 110 may determine whether an even stronger negative emotion is being felt. Furthermore, the storage processing unit 102 may store the level of the negative emotion (indicating high or low) in the emotion analysis result information 160. Note that angle θ3 is smaller than angle θ1.

[0065] Similarly to negative emotions, positive emotions may also be identified by the emotion analysis unit 110 and stored in the emotion analysis result information 160 by the storage processing unit 102. Positive emotions may be determined, for example, by whether data d plotting the scores of the user U's arousal level and harmony level is included in the "HAPPY" and "RELAXED" areas. Similarly to negative emotions, the level of a positive emotion may also be determined by whether data d is included in a fan-shaped area indicated by a predetermined angle within the "HAPPY" and "RELAXED" areas.

[0066] The storage processing unit 102 associates the emotion analysis result of the user U output by the emotion analysis unit 110 with the category of work that the user U was engaged in when the emotion analysis result was analyzed, and stores the result as emotion analysis result information 160. The category of work that the user U was engaged in when the emotion analysis result was analyzed can be obtained from the work information acquired by the acquisition unit 114.

[0067] FIG. 13 is a diagram illustrating an example data structure of the emotion analysis result information 160. The emotion analysis result information 160 stores time information, the emotion category of the user U at that time estimated by the emotion analysis unit 110, and a negative flag indicating whether the user U is feeling a negative emotion (for example, "1" is set if the user is determined to be feeling a negative emotion), all of which are associated with each other. The emotion analysis result information 160 may also store a positive flag indicating whether the user U is feeling a positive emotion (for example, "1" is set if the user is determined to be feeling a positive emotion). The emotion analysis result information 160 also stores the task category in which the user U is currently engaged, all of which are associated with each other. The emotion analysis result information 160 is stored in the memory 1030, storage device 1040, or storage device 120 of the computer 1000 that implements the user terminal 60 or the server device 70.

[0068] The display processing unit 104 displays, on a screen displaying user U's schedule, each schedule by category of scheduled or past work, in association with the emotion analysis results corresponding to the work category.

[0069] 14 and 15 are diagrams showing examples of schedule screens 300. Each schedule screen 300 may be displayed by selecting a display operation for the schedule screen 300 from an operation menu. Alternatively, the schedule screen 300 may be automatically displayed on the user terminal 60 at a timing (e.g., 9:00 on a work day) designated in advance by the user U or the administrator M.

[0070] FIG. 14 is an example of a screen that does not include emotion analysis results. The schedule screen 300 displays user U's schedule by task category. However, the method of displaying the schedule is not limited to this, and various display formats are possible. The legend list 310 includes a legend display section 312, which displays a legend for each task category. User U can input and view the schedule on the schedule screen 300. In the embodiment described below, administrator M may also be able to view the schedule screen 300. When the emotion analysis result display button 320 is pressed, the display processing unit 104 transitions to the schedule screen 300 of FIG. 15.

[0071] The schedule screen 300 in Fig. 15 displays each scheduled or past work by category in association with the emotion analysis results corresponding to the work category. In the schedule screen 300 in Fig. 15, the emotion analysis result display button 320 is displayed in an inverted state compared to the emotion analysis result display button 320 in Fig. 14 to indicate that it is selected.

[0072] The display processing unit 104 displays the schedule by task category in a distinguishable manner using colors or display elements 322 according to the emotion analysis results of the user U. In this example, four types of display elements 322 are used to indicate the emotion categories of the user U. For example, the display elements 322 are face marks that show emotions with facial expressions. The display element 322a is a smiling face mark indicating the emotion category of "HAPPY". The display element 322b is a straight face mark indicating the emotion category of "RELAXED". The display element 322c is an angry face mark indicating the emotion category of "ANGRY". The display element 322d is a crying face mark indicating the emotion category of "SAD".

[0073] Furthermore, the display processing unit 104 displays, as display elements 322, in a color-changed display 324 for the task categories for which the user U had strong negative emotions. The color-changed display 324 may be displayed in four colors corresponding to four types of emotions, or, as in this example, may display only particularly strong emotions in a color-changed display. For example, the negative emotion category "ANGRY" may be displayed in red, "SAD" in purple, the positive emotion category "RELAXED" in green, and "HAPPY" in yellow.

[0074] By displaying user U's emotions for each task on the schedule in a distinguishable manner in this way, in the case of a past schedule, the emotions user U felt when performing each task can be visualized on the schedule. Therefore, if user U is feeling mentally fatigued, it may be possible to identify the task that caused this. Furthermore, in the case of a future schedule, user U's emotions regarding each task are visualized, so if tasks that may cause user U negative emotions are concentrated in a certain period, it becomes clear at a glance that this is the case. This makes it easier to adjust the schedule, such as distributing tasks to others or moving the task schedule to another day.

[0075] Furthermore, by visualizing the user U's feelings toward each task, it is possible to understand which tasks the user U is good at. For example, a task that the user U is likely to feel positive about is likely to be a task that the user U is good at. Therefore, for example, the manager M can appropriately allocate tasks to the user U by taking into consideration the tasks that the user U is good at (tasks that the user U is likely to feel positive about) and the tasks that the user U is not good at (tasks that the user U is likely to feel negative about).

[0076] The method of displaying the emotion analysis results by the display processing unit 104 may be settable by the user U or the administrator M via a setting screen.

[0077] The following are examples of the division of functions between the user terminal 60 and the server device 70 in the information processing device 100. (a1) In the system configuration of FIG. 5 without the server device 70, all functions are realized by the user terminal 60. The following is an example of the division of functions in the system configuration of FIG. 6 with the user terminal 60 and the server device 70. (a2) The user terminal 60 realizes the function of the acquisition unit 114 acquiring biometric information from the wearable device 50, and the server device 70 realizes the function of the acquisition unit 114 acquiring biometric information from the user terminal 60, as well as the functions of the emotion analysis unit 110, the storage processing unit 102, and the display processing unit 104. In other words, the user terminal 60 acquires biometric information from the wearable device 50 and transmits it to the server device 70. The server device 70 performs emotion analysis processing using the biometric information received by the user terminal 60, stores and manages the information, and displays a schedule screen 300 on the user terminal 60 for the user U to view. (a3) The user terminal 60 realizes the functions of the acquisition unit 114, the emotion analysis unit 110, and the storage processing unit 102, and the function of transmitting the emotion analysis results and the task categories to the server device 70, and the server device 70 realizes the function of the storage processing unit 102 to record the emotion analysis results and the task categories received from the user terminal 60, and the function of the display processing unit 104. In other words, the user terminal 60 performs processing up to associating the emotion analysis results with the task categories, and the server device 70 stores and manages the information received by the user terminal 60 and displays the schedule screen 300 on the user terminal 60 for the user U to view.

[0078] The emotion analysis result information 160 (emotion analysis result) may include an emotion score indicating the degree of at least one of the positive and negative emotions of the user U (subject) toward the work, for each work category. The emotion analysis unit 110 may determine the emotion score for each work category based on the emotion analysis results for the user U for each work category over a predetermined period. The predetermined period may be set to any period, such as the past month, six months, or one year. For example, the emotion score may be determined as the proportion of time that the score value indicating the mental state falls within the positive emotion region or the negative emotion region. More specifically, the emotion score may be determined as the proportion of time estimated to be spent in positive or negative emotions relative to work hours.

[0079] 16 is a diagram showing an example data structure of task-specific emotion information 170. The task-specific emotion information 170 stores at least one of a positive score and a negative score for each task category, in association with the start and end dates of a predetermined period. The task-specific emotion information 170 is stored in the memory 1030 or storage device 1040, or storage device 120, of the computer 1000 that implements the user terminal 60 or server device 70.

[0080] The display processing unit 104 displays a screen showing the ranking of the emotion scores for each task of the user U. The task ranking screen 330 may be displayed by selecting a display operation for the task ranking screen 330 from the operation menu.

[0081] 17 is a diagram showing an example of a task ranking screen 330. The task ranking screen 330 includes a category display section 332, a legend display section 312, and a score display section 334. The display processing section 104 displays task categories on the task ranking screen 330 in descending order of negative score, for example, based on the information stored in the task-specific emotion information 170. The display of negative scores and positive scores may be switched by a radio button (not shown) or the like.

[0082] Furthermore, the display processing unit 104 displays, on the schedule screen 300 showing the schedule indicating future plans, colors or display elements that indicate the degree of at least one of the positive and negative feelings of the user U toward the work corresponding to the work category in a distinguishable manner. For example, the color may be shaded depending on the degree of each emotion. For example, the stronger the degree of the emotion of "ANGRY," the darker the red, and the weaker the degree of the emotion of "ANGRY," the lighter the red.

[0083] As shown in the schedule screen 300 of FIG. 15 , the display processing unit 104 may refer to the task-specific emotion information 170 and display the display elements 322 and color-coded indicators 324 in a distinguishable manner based on the emotion scores corresponding to the task categories of the schedule.

[0084] <Operation Example> Figure 18 is a flowchart showing an operation example of the information processing device 100 according to the embodiment. Here, an example of the function allocation (a1) will be described. The flow of Figure 18 includes the same steps S101 and S103 as the flow of Figure 2, and also includes steps S121 and S123. However, each step of the flowchart can operate independently, and as described above, the timing of execution of each step may differ.

[0085] First, in the user terminal 60, the acquisition unit 114 acquires data for emotion analysis of the user U, and when acquiring the data for emotion analysis, acquires business information 150 related to the work that the user U was engaged in (step S121).

[0086] The emotion analysis data includes biometric information of the user U acquired from the wearable device 50 worn by the user U. The acquired biometric information is stored in the memory 1030 or storage device 1040 of the user terminal 60 as biometric information 130 in association with time information. The time information is preferably the time when the biometric information is measured by the wearable terminal 50, but may also be the time when the biometric information is received from the wearable terminal 50 or the time when the biometric information is stored as the biometric information 130. The acquired business information 150 is stored in the memory 1030 or storage device 1040 of the user terminal 60.

[0087] The emotion analysis unit 110 performs emotion analysis of the user U using the emotion analysis data of the user U acquired by the acquisition unit 114 from the wearable device 50 of the user U, and outputs the emotion analysis result (step S123). The emotion analysis result is output, for example, as a score value indicating the mental state of the user U. The output score value is stored in the memory 1030 or the storage device 1040 of the user terminal 60 as score history information 140 in association with time information. The time information is time information of the biometric information 130 used to estimate the score value.

[0088] The storage processing unit 102 associates the emotion analysis result of the user U with the category of work that the user U was engaged in when the emotion analysis result was analyzed, and stores the result as emotion analysis result information 160 (step S101). The emotion analysis result information 160 is stored in the memory 1030 or storage device 1040 of the user terminal 60, with time information associated with the emotion classification, negative flag, and work category as the emotion analysis result.

[0089] The display processing unit 104 displays each scheduled or previously performed work category on the schedule screen 300 that displays the user U's schedule, in association with the emotion analysis results corresponding to the work category (step S103).

[0090] As described above, according to this embodiment, the information processing device 100 includes a storage processing unit 102, a display processing unit 104, a sentiment analysis unit 110, and an acquisition unit 114. The acquisition unit 114 acquires sentiment analysis data of the user U and, when acquiring the sentiment analysis data, acquires task information related to the tasks the user U was engaged in. The sentiment analysis unit 110 performs sentiment analysis of the user U using the sentiment analysis data of the user U acquired by the acquisition unit 114 from the wearable device 50 of the user U and outputs the sentiment analysis results. The storage processing unit 102 associates the sentiment analysis results of the user U output by the sentiment analysis unit 110 with the task category in which the user U was engaged when the emotion analysis result was analyzed, and stores them as sentiment analysis result information 160. The display processing unit 104 displays each scheduled or previously performed task by task category in association with the sentiment analysis results corresponding to the task category on a schedule screen 300 displaying the user U's schedule.

[0091] As described above, the information processing device 100 according to the embodiment visualizes the emotions of the subject U during work, making it easier to understand the impact of the subject U's work on their mental state. Furthermore, as described above, by displaying the user U's emotions for each task on the schedule in a distinctive manner using the display processing unit 104, in the case of a past schedule, the user U's emotions during the work can be visualized on the schedule. Therefore, if the user U is feeling mentally fatigued, it may be possible to identify the task that caused this. Furthermore, in the case of a future schedule, the display processing unit 104 visualizes the user U's emotions regarding each task. This makes it easy to recognize at a glance if a certain period of time is packed with tasks that may cause the user U negative emotions. This facilitates schedule adjustments, such as distributing tasks to others or rescheduling tasks to another day.

[0092] Furthermore, by visualizing the user U's feelings toward each task, it is possible to understand which tasks the user U is good at. For example, a task that the user U is likely to feel positive about is likely to be a task that the user U is good at. Therefore, for example, the manager M can appropriately allocate tasks to the user U by taking into consideration the tasks that the user U is good at (tasks that the user U is likely to feel positive about) and the tasks that the user U is not good at (tasks that the user U is likely to feel negative about).

[0093] This may prevent the user U from becoming mentally fatigued due to work, and may also allow the manager M to recognize that the user U is under excessive stress due to work, enabling appropriate measures to be taken and potentially preventing a deterioration in the user's mental state. Furthermore, the manager M may be able to easily grasp the tasks that the user U is good at and the tasks that the user U is not good at, and may be able to provide the user U with appropriate training.

[0094] In addition, the display processing unit 104 can display a ranking of user U's work categories, which can be used as a reference when scheduling work, thereby preventing user U from being overly burdened by work.

[0095] 19 is a functional block diagram showing an example of the logical configuration of an information processing device 100 according to an embodiment. This embodiment differs from the above-described embodiments in that it has a configuration in which keywords included in the conversational voice of a user U are displayed by task category in association with the emotional category of the user U during the task. However, the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0096] <System Overview> The information processing system 1 of this embodiment may have either the system configuration of FIG. 5 or the system configuration of FIG. 6 described in the above embodiment.

[0097] <Example of Functional Configuration> The information processing device 100 includes the same storage processing unit 102, display processing unit 104, and extraction unit 106 as the information processing device 100 in Fig. 3 , and further includes a sentiment analysis unit 110 and an acquisition unit 114. The sentiment analysis unit 110 performs sentiment analysis of the user U (subject person) using sentiment analysis data of the user U acquired from the wearable device 50 of the user U, and outputs the sentiment analysis result. The sentiment analysis unit 110 and the acquisition unit 114 are similar to the sentiment analysis unit 110 and the acquisition unit 114 in Fig. 8 .

[0098] The acquisition unit 114 acquires emotion analysis data of the user U, and, when acquiring the emotion analysis data, acquires business information related to the business in which the user U was engaged. The emotion analysis data includes biometric information of the user U acquired from the wearable device 50 worn by the user U. The biometric information acquired by the acquisition unit 114 is stored as biometric information 130 ( FIG. 9 ) in the memory 1030 or storage device 1040 of the computer 1000 that realizes the user terminal 60 or the server device 70, or in the storage device 120.

[0099] The emotion analysis results output by the emotion analysis unit 110 are stored as score history information 140 (FIG. 11) in the memory 1030 or storage device 1040 of the computer 1000 that implements the user terminal 60 or the server device 70, or in the storage device 120.

[0100] Furthermore, the emotion analysis unit 110 may estimate whether the emotion of the user U is included in the negative area, as in the above embodiment, and identify cases in which it is estimated that the user U is harboring negative emotions.

[0101] The memory processing unit 102 may associate the emotion analysis results of user U with the category of work that user U was engaged in at the time the emotion analysis results were analyzed, and store the emotion analysis result information 160 (Figure 13) in the memory 1030 or storage device 1040 of the computer 1000 that realizes the user terminal 60 or server device 70, or in the storage device 120.

[0102] Furthermore, similar to the above embodiment, the emotion analysis unit 110 may determine an emotion score for each task category based on the emotion analysis results for each task category of the user U over a predetermined period. For example, the emotion score may be determined as the percentage of time that the score value indicating the mental state falls within the above-described positive emotion area or negative emotion area. More specifically, the emotion score may be determined as the percentage of time estimated to be spent with positive emotions or negative emotions relative to the total task time.

[0103] The extraction unit 106 processes the conversational voice of the user U when the conversational voice is the subject of the emotion analysis result analysis, and extracts keywords including at least one of words and phrases included in the conversational voice. The display processing unit 104 displays a screen including information associating the category of emotions the user U has about their work with the keywords included in the conversational voice while they are engaged in the work.

[0104] The display processing unit 104 may display keywords contained in conversational voices during work that correspond to at least one of the emotion categories of "ANGRY" and "SAD," which are negative emotions, or "HAPPY" and "RELAXED," which are positive emotions, for example. The display of keywords for negative emotions and keywords for positive emotions may be switched by a radio button (not shown) or the like.

[0105] Alternatively, the display processing unit 104 may display, for each of the four emotion classifications, keywords contained in conversational voices during work that match the emotion.

[0106] 20 is a functional block diagram showing a configuration example of a modified version of the information processing device 100 according to the embodiment. In this example, the information processing device 100 further includes a counting unit 112 that counts the number of occurrences of each keyword included in conversational voices during work. The display processing unit 104 may display the keywords on the screen in descending order of frequency of occurrence.

[0107] There are various possible ways to display the keywords, but for example, they may be displayed in a word cloud format. That is, the more the number of occurrences of a keyword counted by the counting unit 112, the larger the character representing the keyword may be displayed, or the character representing the keyword may be surrounded by a larger figure.

[0108] 21 is a diagram showing an example of a keyword ranking screen 350. The keyword ranking screen 350 may be displayed by selecting a display operation for the keyword ranking screen 350 from an operation menu. In this example, the keyword ranking screen 350 includes a keyword display section 352 and an occurrence count display section 354. Keywords with a high occurrence count are displayed at the top of the keyword display section 352. The occurrence count display section 354 may display, for example, the number of occurrences included in the conversational voice during work that was the subject of the sentiment analysis, or the ratio of the occurrence count of the keyword to the total number of keywords extracted from the conversational voice during work that was the subject of the sentiment analysis.

[0109] Furthermore, similar to the above embodiment, the areas identifying the negative emotion category and the positive emotion category may be determined based on whether they are included within a fan-shaped area indicated by a predetermined angle within the area of ​​each emotion category.

[0110] The following are examples of the division of functions between the user terminal 60 and the server device 70 in the information processing device 100. (b1) In the system configuration of FIG. 5 without the server device 70, all functions are realized by the user terminal 60. The following is an example of the division of functions in the system configuration of FIG. 6 with the user terminal 60 and the server device 70. (b2) The user terminal 60 realizes the function of the acquisition unit 114 acquiring biometric information from the wearable device 50, and the server device 70 realizes the function of the acquisition unit 114 acquiring biometric information from the user terminal 60, as well as the functions of the emotion analysis unit 110, the storage processing unit 102, the extraction unit 106, the counting unit 112, and the display processing unit 104. In other words, the user terminal 60 acquires biometric information from the wearable device 50 and transmits it to the server device 70. The server device 70 performs emotion analysis processing, voice processing, and the like using the biometric information received by the user terminal 60, stores and manages the information, and displays the keyword ranking screen 350 on the user terminal 60 for the user U to view. (b3) Of the functions of the server device 70 described in (b2) above, the functions of the extraction unit 106 and the counting unit 112 may be configured to be realized by the user terminal 60. (b4) Of the functions of the server device 70 described in (b2) above, the function of the emotion analysis unit 110 may be configured to be realized by the user terminal 60. (b5) The user terminal 60 realizes the functions of the acquisition unit 114, the emotion analysis unit 110, the storage processing unit 102, the extraction unit 106, and the counting unit 112, as well as a function of transmitting the emotion analysis results and the task categories to the server device 70, and the server device 70 realizes a function of the storage processing unit 102 recording the emotion analysis results and the task categories received from the user terminal 60, as well as the function of the display processing unit 104. In other words, the user terminal 60 associates the emotion analysis results with business categories, and performs processes such as extracting and counting keywords, while the server device 70 stores and manages the information received by the user terminal 60 and displays the keyword ranking screen 350 on the user terminal 60 for user U to view.

[0111] <Operation Example> Figure 22 is a flowchart showing an operation example of the information processing device 100 of the embodiment. Here, an example of the function allocation (b2) will be described. The flow of Figure 22 includes steps S101, S111, and S113, which are the same as the flow of Figure 4, and also includes steps S121 and S123, which are the same as the flow of Figure 18 of the above embodiment. However, each step of this flowchart can operate independently, and as described above, the timing of execution of each step may differ.

[0112] First, in the user terminal 60, the acquisition unit 114 acquires emotion analysis data (biometric information) of the user U (step S121). The acquired biometric information is stored in the memory 1030 or the storage device 1040 of the user terminal 60 as biometric information 130 in association with time information. In the server device 70, the acquisition unit 114 receives the emotion analysis data (biometric information 130) of the user U from the user terminal 60 and stores the data in the storage device 120 in association with the identification information of the user U.

[0113] In the server device 70, the acquisition unit 114 acquires the emotion analysis data and also acquires task information 150 related to the task performed by the user U (step S121). Then, in the server device 70, the emotion analysis unit 110 performs emotion analysis on the user U using the emotion analysis data of the user U acquired by the acquisition unit 114, and outputs the emotion analysis result (step S123).

[0114] Then, in the server device 70, the storage processing unit 102 stores the emotion analysis results of user U as emotion analysis result information 160 in association with the category of work in which user U was engaged when the emotion analysis results were analyzed (step S101).

[0115] In the server device 70, the extraction unit 106 processes the conversational voice of the user U when the conversational voice was the subject of the emotion analysis result and extracts keywords including at least one of words and phrases included in the conversational voice (step S111). In the server device 70, the display processing unit 104 displays a screen including information that associates, by work category, the classification of the user U's emotions regarding the work with the keywords included in the conversational voice while the user U was engaged in the work (step S113).

[0116] The display processing unit 104 of the server device 70 displays a screen on the display of the user terminal 60. Alternatively, the display processing unit 104 of the server device 70 may display a screen on the display of the administrator terminal 80, which will be described in an embodiment later.

[0117] 23 is a flowchart showing the process of counting keywords. In the server device 70, after keywords are extracted from the conversation in step S111 of FIG. 22, the counting unit 112 counts the number of occurrences of each keyword (step S131). Then, in the server device 70, the display processing unit 104 displays the keywords in descending order of frequency of occurrence on the keyword ranking screen 350 (FIG. 21) (step S133). This screen is also displayed on the display of at least one of the user terminal 60 and the administrator terminal 80.

[0118] As described above, according to this embodiment, the information processing device 100 includes a storage processing unit 102, a display processing unit 104, an extraction unit 106, a sentiment analysis unit 110, and an acquisition unit 114. The sentiment analysis unit 110 performs sentiment analysis of the user U (subject) using sentiment analysis data of the user U acquired from the wearable device 50 of the user U and outputs the sentiment analysis result. The acquisition unit 114 acquires the sentiment analysis data of the user U and, when acquiring the sentiment analysis data, acquires task information related to the task the user U was engaged in. The storage processing unit 102 stores the sentiment analysis result of the user U in association with the task category in which the user U was engaged or the task category indicating that the user U was on a break when the user U became the subject of the sentiment analysis result. The extraction unit 106 processes the conversational voice of the user U when the user U became the subject of the sentiment analysis result and extracts keywords including at least one of words and phrases included in the conversational voice. The display processing unit 104 displays a screen including information associating the user U's emotional category regarding the work with keywords included in the conversation voice while the user is engaged in the work.

[0119] In this way, according to the information processing device 100 of the embodiment, by visualizing the emotions of the subject during work, it is possible to easily understand the impact of the subject's work on the mental state.

[0120] (Third Embodiment) <System Overview> Fig. 24 is a diagram conceptually illustrating an example of the system configuration of an information processing system 1 according to an embodiment. In addition to the configuration of the information processing system 1 in Fig. 6, the information processing system 1 further includes an administrator terminal 80. The administrator terminal 80 is, for example, a terminal used by an administrator M who manages a user U at the company where the user U works, and is a computer 1000 such as a personal computer, a tablet terminal, or a smartphone. The administrator terminal 80 can communicate with a user terminal 60 via a communication network 3.

[0121] <Example of Functional Configuration> This embodiment is the same as any of the above-described embodiments, except that it has a configuration in which the various screens displayed by the display processing unit 104 of the above-described embodiments can also be displayed on the administrator terminal 80. Here, the information processing device 100 will be described as having the configuration of the first embodiment, and therefore will be described using FIG. 8. However, the configuration of this embodiment may be combined with at least one of the configurations of embodiments other than the first embodiment, as long as no contradiction occurs.

[0122] In this embodiment, the work includes answering calls with customers at a call center. The subject, described as user U in the above embodiment, is described as an operator in this embodiment. The emotion analysis unit 110 performs emotion analysis of the operator (subject) for each call and outputs the emotion analysis results. The emotion analysis unit 110 may perform emotion analysis of the operator by processing the operator's conversational voice. Alternatively, the emotion analysis unit 110 may perform emotion analysis using biometric information such as the operator's pulse rate. In this case, the operator's conversational voice is used to extract keywords by the extraction unit 106. The storage processing unit 102 stores the emotion analysis results of the operator output by the emotion analysis unit 110 for each call in the memory 1030, storage device 1040, or storage device 120 of the computer 1000 that implements the user terminal 60 or the server device 70. The display processing unit 104 associates the category of the operator's emotion during the call with keywords for each call and displays a screen (e.g., a report screen 360 described below).

[0123] The division of functions of the information processing device 100 between the user terminal 60 and the server device 70 will be described in the example of (b2) above.

[0124] 25 and 26 are diagrams showing examples of a report screen 360 displayed on the display of the administrator terminal 80. However, the report screen 360 may also be displayed on the display of the user terminal 60. The report screen 360 may be displayed by selecting a display operation for the report screen 360 from the operation menu.

[0125] The report screen 360 is a screen for creating or viewing a report that an operator in a call center or the like records and submits after recording the contents of a call received. The report screen 360 includes a display unit that displays information such as the report's identification information (here, the report number), the date and time the call was received, the operator's name (receptionist), the category of the call inquiry, the product the inquiry is about (product name, model number, etc.), the content of the inquiry, the response to the inquiry, and the attributes of the customer who made the received call (gender, age group, etc.). In the case of a report editing screen, the report screen 360 may include an appropriate UI such as a text input field, a category selection menu, etc., and may be able to accept operations by the person entering the information.

[0126] The "keywords" associated with the above-mentioned emotion categories of the operator correspond to the keywords contained in the inquired product (such as the product name or model number), the category of the telephone inquiry, the content of the inquiry, the response to the inquiry, and the response content displayed on the report screen 360. The display processing unit 104 can particularly display keywords contained in speech that corresponds to the negative emotion categories of "ANGRY" and "SAD" on the report screen 360 in a distinguishable manner using at least one of color and display elements. For example, the display processing unit 104 may change the color or highlight keywords contained in speech that corresponds to the negative emotion category among the keywords contained in the inquiry content.

[0127] Furthermore, when the emotion analysis result display button 370 is pressed, the display processing unit 104 transitions to a report screen 360 of Fig. 26. The report screen 360 of Fig. 26 further includes an emotion analysis result display section 362 in addition to the report screen 360 of Fig. 25. On the report screen 360 of Fig. 26, the emotion analysis result display button 370 is displayed in an inverted state compared to the emotion analysis result display button 370 of Fig. 25, for example, to indicate that it is selected.

[0128] In the server device 70, the display processing unit 104 displays the emotion categories in a distinguishable manner using at least one of colors and display elements. For example, the emotion analysis result display section 362 of the report screen 360 displays at least one of a display element 364 and a score graph 366. The display element 364 may be similar to the display element 322 of the schedule screen 300 described above. For example, the display element 364 may indicate the emotion category that occurred most frequently during the call.

[0129] 27, the score graph 366 is a graph showing the distribution of the emotions of the operator based on the emotion analysis results of the operator during the call that is the subject of the report. For example, the display processing unit 104 identifies the emotion category of the operator during the call based on the score history information 140, measures the time spent in each emotion category, and displays the proportion of the call time spent in each emotion category on the score graph 366.

[0130] As described above, according to this embodiment, the information processing device 100 includes the storage processing unit 102, the display processing unit 104, the extraction unit 106, the emotion analysis unit 110, and the acquisition unit 114. The emotion analysis unit 110 analyzes the emotion of the operator for each telephone call and outputs the emotion analysis results. The storage processing unit 102 stores the emotion analysis results of the user U output by the emotion analysis unit 110 for each telephone call. The display processing unit 104 associates the category of the emotion of the operator when answering the telephone with keywords and displays the screen for each telephone call.

[0131] In this way, the information processing device 100 of the embodiment visualizes the emotions of the operators while answering calls at the call center, making it easier to understand the impact of the operators' work on their mental states. In particular, since the report screen 360 can be displayed on the manager terminal 80 of the manager M, the manager M can understand the mental states of the operators as well as the work reports, and can take appropriate measures.

[0132] For example, keywords extracted from conversations during phone calls can be displayed in association with emotions, making it possible to estimate the keywords that cause the operator's emotional fluctuations. This allows the operator to understand the factors that make the operator feel anxious, and allows them to take measures to alleviate their anxiety, such as strengthening their study or education in the field that corresponds to the factors that make them anxious, or improving the FAQ (Frequently Asked Questions) in the telephone answering manual.

[0133] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.

[0134] In addition, although the flowcharts used in the above description show multiple steps (processes) in a sequential order, the order of steps executed in each embodiment is not limited to the order shown. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not cause any problems in terms of content. Furthermore, the above-described embodiments can be combined as long as the content is not contradictory.

[0135] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. Note that when information about users is acquired and used in the present invention, this must be done lawfully.

[0136] Some or all of the above embodiments may be described as, but are not limited to, the following notes. 1. An information processing device comprising: a storage processing means for storing in a storage means the emotion analysis results of a subject in association with the category of work that the subject was engaged in when the emotion analysis results were analyzed; and a display processing means for displaying, on a screen displaying the subject's schedule, each scheduled or previously performed schedule for each category of work in association with the emotion analysis results corresponding to the work category. 2. An information processing device described in 1., wherein the display processing means displays the schedule for each work category in a distinguishable manner using a color or display element according to the emotion analysis results of the subject. 3. An information processing device described in 1. or 2., wherein the emotion analysis results include an emotion score indicating the degree of at least one of positivity and negativity of the subject's emotion toward the work for each work category, and the display processing means displays a screen showing the ranking of the emotion scores for each of the subject's work. 4. 3. 5. The information processing device described in any one of 1. to 4., wherein the display processing means displays, on a schedule screen showing future plans, a color or display element indicating at least one of the positive and negative degrees of the subject's feelings toward the work corresponding to the work category in a distinguishable manner. 5. The information processing device described in any one of 1. to 4., further comprising emotion analysis means for analyzing the subject's emotions using emotion analysis data of the subject acquired from the subject's terminal, and outputting the emotion analysis results.6. An information processing device comprising: a storage processing means for storing in a storage means the emotion analysis results of a subject in association with the category of work in which the subject was engaged when the subject became the subject of analysis of the emotion analysis results; an extraction means for processing a conversational voice of the subject when the subject became the subject of analysis of the emotion analysis results and extracting keywords including at least one of words and phrases included in the conversational voice; and a display processing means for displaying a screen including information associating a category of the subject's emotion regarding the work with the keywords included in the conversational voice while the subject was engaged in the work. 7. The information processing device described in 6., further comprising: a counting means for counting the number of occurrences of each keyword included in the conversational voice while engaged in the work, and the display processing means further displays the keywords on the screen in order of frequency of occurrence. 8. 6. or 7. 9. The information processing device described in any one of items 6 to 8, wherein the work includes telephone answering work with customers at a call center, and further comprises an emotion analysis means for analyzing the emotions of the subject for each telephone answering and outputting the emotion analysis results, and the memory processing means stores the emotion analysis results of the subject output by the emotion analysis means in the memory means for each telephone answering, and the display processing means displays the screen by associating the emotion category of the subject at the time of answering the telephone with the keyword for each telephone answering. 9. The information processing device described in any one of items 6 to 8, wherein the display processing means displays the emotion category distinguishably using at least one of color and display elements. 10. The information processing device described in any one of items 1 to 9, and further comprises an acquisition means for acquiring emotion analysis data of the subject, and for acquiring work information related to the work in which the subject was engaged when acquiring the emotion analysis data.

[0137] 11. An information processing method in which one or more computers store in a storage means the emotion analysis results of a subject in association with the category of work that the subject was engaged in when the emotion analysis results were analyzed, and display, on a screen displaying the subject's schedule, each scheduled or past schedule for each category of work in association with the emotion analysis results corresponding to the work category. 12. An information processing method described in 11., in which the one or more computers display the schedule for each category of work in a distinguishable manner using colors or display elements according to the emotion analysis results of the subject. 13. An information processing method described in 11. or 12., in which the emotion analysis results include emotion scores that indicate the degree of at least one of the positive and negative feelings of the subject toward their work for each category of work, and the one or more computers display a screen showing the ranking of the emotion scores for each of the work of the subject. 14. 13. 15. The information processing method described in any one of 11. to 14., wherein the one or more computers display, on a schedule screen showing future plans, colors or display elements that indicate at least one of the positive and negative degrees of the subject's feelings toward the work corresponding to the work category in a distinguishable manner. 15. The information processing method described in any one of 11. to 14., wherein the one or more computers perform an emotion analysis of the subject using emotion analysis data of the subject acquired from the subject's terminal, and output the emotion analysis results. 16. The information processing method described in any one of 11. to 14., wherein the one or more computers store the emotion analysis results of the subject in a storage means in association with the category of work in which the subject was engaged when the subject became the subject of the emotion analysis results, process conversational voice of the subject while engaged in the work that was the subject of the analysis results, and extract keywords that include at least one of words and phrases included in the conversational voice, and display a screen including information that associates the subject's emotion classification toward the work with the keywords included in the conversational voice while engaged in the work.17. An information processing method according to 16., wherein the one or more computers further count the number of occurrences of each keyword included in the conversational voice during the work, and further display the keywords on the screen in order of frequency of occurrence. 18. An information processing method according to 16. or 17., wherein the work includes answering the phone with customers at a call center, and the one or more computers further analyze the emotions of the subject for each call and output the emotion analysis results, store the output emotion analysis results of the subject in the storage means for each call, and display the screen by associating the emotion categories of the subject at the time of answering the phone with the keywords for each call. 19. An information processing method according to any one of 16. to 18., wherein the one or more computers display the emotion categories distinguishably using at least one of color and display elements. 20. An information processing method according to 11. 19. The information processing method according to any one of items 1 to 19, wherein the one or more computers further acquire emotion analysis data of the subject, and, when acquiring the emotion analysis data, acquire business information related to the business in which the subject was engaged.

[0138] 21. A computer-readable recording medium storing a program for causing a computer to execute the following procedures: storing in a storage means the results of an emotion analysis of a subject in association with the category of work the subject was engaged in when the emotion analysis result was analyzed; and displaying, on a screen displaying the subject's schedule, each scheduled or past schedule for each category of work in association with the emotion analysis result corresponding to the work category. 22. A computer-readable recording medium stored with a program for causing the computer to execute the following procedures: displaying the schedule for each work category in a distinguishable manner using colors or display elements according to the emotion analysis result of the subject. 23. A computer-readable recording medium stored with a program for causing the computer to execute the following procedures: the emotion analysis result includes an emotion score indicating, for each work category, the degree of at least one of positivity and negativity of the subject's emotion toward the work, and displaying a screen showing the ranking of the emotion scores for each of the work of the subject. 24. 23. 24. A computer-readable recording medium storing a program for causing the computer to execute the following procedure: on a schedule screen showing future plans, distinguishably displaying colors or display elements indicating at least one of the positive and negative degrees of the subject's feelings toward the work corresponding to the work category. 25. A computer-readable recording medium storing a program for causing the computer to execute the following procedure: performing an emotion analysis of the subject using emotion analysis data of the subject acquired from the subject's terminal, and outputting the emotion analysis results.26. A computer-readable recording medium storing a program for causing a computer to execute the following steps: storing in a storage means the results of an emotion analysis of a subject in association with the category of work the subject was engaged in when the subject became the subject of analysis of the emotion analysis results; processing conversational voice of the subject while engaged in the work that became the subject of analysis of the emotion analysis results and extracting keywords including at least one of words and phrases included in the conversational voice; and displaying a screen including information associating the category of the subject's emotion toward the work with the keywords included in the conversational voice while engaged in the work. 27. A computer-readable recording medium in the recording medium described in 26., further storing a program for causing the computer to execute the following steps: counting the number of occurrences of each keyword included in the conversational voice while engaged in the work; and further displaying the keywords on the screen in order of frequency of occurrence. 28. 26. or 27. 29. A computer-readable recording medium storing a program for causing the computer to execute the following procedures: a) analyzing the emotions of the subject and outputting emotion analysis results for each telephone call; b) storing the output emotion analysis results of the subject in the storage means for each telephone call; and c) associating the emotion categories of the subject at the time of each telephone call with the keywords and displaying the results on the screen for each telephone call. 29. A computer-readable recording medium storing a program for causing the computer to execute the following procedures: a) displaying the emotion categories distinguishably using at least one of color and display elements for each telephone call; 30. A computer-readable recording medium storing a program for causing the computer to execute the following procedures: a) acquiring emotion analysis data of the subject, and, when acquiring the emotion analysis data, acquiring task information related to the task in which the subject was engaged.

[0139] 31. A program causing a computer to execute the following procedures: storing in a storage means the results of an emotion analysis of a subject in association with the category of work the subject was engaged in at the time the emotion analysis results were analyzed; and displaying, on a screen displaying the subject's schedule, each scheduled or past schedule for each category of work in association with the emotion analysis results corresponding to the work category. 32. A program medium described in 31., causing the computer to execute the following procedures: displaying the schedule for each work category in a distinguishable manner using colors or display elements according to the emotion analysis results of the subject. 33. A program described in 31. or 32., wherein the emotion analysis results include emotion scores that indicate the degree of at least one of positivity and negativity of the subject's emotions toward their work for each work category, and displaying a screen showing the ranking of the emotion scores for each of the subject's work. 34. 33. 34. A program for causing a computer to execute a procedure for displaying, on a schedule screen showing future plans, colors or display elements that indicate at least one of the positive and negative degrees of the subject's feelings toward the work corresponding to the work category in a distinguishable manner. 35. A program for causing a computer to execute a procedure for performing an emotion analysis of the subject using emotion analysis data of the subject acquired from the subject's terminal and outputting the emotion analysis results.36. A program causing a computer to execute the following steps: storing in a storage means the results of an emotion analysis of a subject in association with the category of work the subject was engaged in when the subject became the subject of analysis of the emotion analysis results; processing conversational voice of the subject while engaged in the work that became the subject of analysis of the emotion analysis results, and extracting keywords including at least one of words and phrases included in the conversational voice; and displaying a screen including information associating the category of the subject's emotion toward the work with the keywords included in the conversational voice while engaged in the work. 37. A program in the program described in 36., further causing the computer to execute the steps of counting the number of occurrences of each keyword included in the conversational voice while engaged in the work, and further displaying the keywords on the screen in order of frequency of occurrence. 38. 36. or 37. 39. A program described in any one of items 36. to 38., wherein the work includes telephone answering work with customers at a call center, and further causes the computer to execute the following procedures: analyzing the emotions of the subject for each telephone answering and outputting the emotion analysis results; storing the outputted emotion analysis results of the subject in the storage means for each telephone answering; and associating the emotion categories of the subject at the time of each telephone answering with the keywords and displaying them on the screen for each telephone answering. 39. A program described in any one of items 36. to 38., wherein the work includes telephone answering work with customers at a call center, and further causes the computer to execute the following procedures: analyzing the emotions of the subject for each telephone answering and outputting the emotion analysis results; storing the outputted emotion analysis results of the subject in the storage means for each telephone answering; and associating the emotion categories of the subject at the time of each telephone answering with the keywords and displaying them on the screen for each telephone answering. 40. A program described in any one of items 31. to 39., wherein the program causes the computer to execute the procedures of acquiring emotion analysis data of the subject, and acquiring work information related to the work in which the subject was engaged when acquiring the emotion analysis data.

[0140] REFERENCE SIGNS LIST 1 Information processing system 3 Communication network 50 Wearable terminal 60 User terminal 70 Server device 80 Administrator terminal 100 Information processing device 102 Storage processing unit 104 Display processing unit 106 Extraction unit 110 Emotion analysis unit 112 Counting unit 114 Acquisition unit 120 Storage device 130 Biometric information 140 Score history information 150 Task information 160 Emotion analysis result information 170 Task-specific emotion information 300 Schedule screen 310 Legend list 320 Emotion analysis result display button 330 Task ranking screen 350 Keyword ranking screen 360 Report screen 362 Emotion analysis result display unit 364 Display element 366 Score graph 370 Emotion analysis result display button 1000 Computer 1010 Bus 1020 Processor 1030 Memory 1040 Storage device 1050 Input / output interface 1060 Network interface

Claims

1. a storage processing means for storing the emotion analysis result of the subject in the storage means in association with the category of the work in which the subject was engaged at the time the emotion analysis result was analyzed; An information processing device comprising: a display processing means for displaying, on a screen displaying the subject's schedule, each schedule by category of the work that is planned or has been carried out in the past, in association with the emotion analysis result corresponding to the work category.

2. 2. The information processing device according to claim 1, The display processing means displays the schedule in a distinguishable manner by task category using colors or display elements corresponding to the emotion analysis result of the subject.

3. 3. The information processing device according to claim 1, the emotion analysis result includes an emotion score indicating at least one of a positive and a negative degree of the subject's emotion toward the task for each task category; The display processing means is an information processing device that displays a screen showing a ranking of the emotion scores for each of the tasks of the subject.

4. 4. The information processing device according to claim 3, The display processing means is an information processing device that displays the schedule on a schedule screen showing future plans in a distinguishable manner using colors or display elements that indicate at least one of the positive and negative degrees of the subject's feelings toward the work corresponding to the work category.

5. 3. The information processing device according to claim 1, An information processing device comprising: an emotion analysis means for performing emotion analysis of the subject using emotion analysis data of the subject acquired from the subject's terminal, and outputting the emotion analysis result.

6. a storage processing means for storing the emotion analysis result of the subject in the storage means in association with the category of the work in which the subject was engaged at the time the emotion analysis result was analyzed; an extraction means for processing a conversational voice of the subject at the time of analysis of the emotion analysis result and extracting keywords including at least one of a word and a phrase included in the conversational voice; An information processing device comprising: a display processing means for displaying a screen including information associating a classification of the subject's emotions regarding the work with the keywords included in the conversation voice while the subject is engaged in the work.

7. One or more computers storing the emotion analysis result of the subject in a storage means in association with the category of work in which the subject was engaged at the time the emotion analysis result was analyzed; An information processing method in which, on a screen displaying the subject's schedule, each scheduled or past schedule by category of work is displayed in association with the emotion analysis result corresponding to the work category.

8. One or more computers storing the emotion analysis result of the subject in a storage means in association with the category of work in which the subject was engaged at the time the emotion analysis result was analyzed; processing a conversational voice of the subject engaged in the work that was the subject of the analysis of the emotion analysis result, and extracting keywords including at least one of a word and a phrase included in the conversational voice; An information processing method comprising: displaying a screen including information relating the subject's emotional category regarding the task to the keywords included in the conversation voice while the subject is engaged in the task.

9. On the computer, a step of storing the emotion analysis result of the subject in a storage means in association with the category of work in which the subject was engaged at the time the emotion analysis result was analyzed; A program for executing a procedure for displaying, on a screen displaying the subject's schedule, each scheduled or past schedule by work category in association with the emotion analysis results corresponding to the work category.

10. On the computer, a step of storing the emotion analysis result of the subject in a storage means in association with the category of work in which the subject was engaged at the time the emotion analysis result was analyzed; a step of processing a conversational voice of the subject engaged in the work that is the subject of the analysis of the emotion analysis result, and extracting keywords including at least one of words and phrases included in the conversational voice; A program for executing a procedure for displaying a screen including information associating the subject's emotional category regarding the work with the keywords included in the conversation voice while engaged in the work.

Images