Control device, control method, and program

By designing a control device and method for identifying and classifying daily events that lead to external stimuli, the problem that prior art cannot effectively support understanding of these events is solved, and better management of stress is achieved.

JP7673835B2Active Publication Date: 2025-05-09NEC CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023567280
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-12-13
Publication Date
2025-05-09
Estimated Expiration
2041-12-13

AI Technical Summary

Technical Problem

The prior art fails to effectively support understanding of the daily events leading to external stimuli, which in turn affects the ability to cope with stress.

Method used

A control device and method is designed to obtain the event information resulting in the external stimulus by calculating the external stimulus estimation based on observation information, and classify the events according to the subjective comfort score, and finally display the classification results on the display device.

Benefits of technology

Effective identification and classification of events leading to external stimuli are achieved, helping users understand the impact of these events on their stress, thereby improving stress management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007673835000001
    Figure 0007673835000001
  • Figure 0007673835000002
    Figure 0007673835000002
  • Figure 0007673835000003
    Figure 0007673835000003
Patent Text Reader

Abstract

A control device 1X primarily includes a first acquisition means 17X, a second acquisition means 16X, a classification means 18X, and a display control means 19X. The first acquisition means 17X acquires an event that is a contributing factor to an external stimulus that a subject has received. The second acquisition means 16X acquires information relating to pleasure / discomfort from the external stimulus based on the subjective opinion of the subject. The classification means 18X classifies the event on the basis of the information relating to pleasure / discomfort. The display control means 19X displays classification results for the event on a display device.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to the technical field of a control device, a control method, and a storage medium that estimate an inner surface state and control display of the estimation result. [Background technology]

[0002] There is known a device or system for judging a stress state of a subject based on data measured from the subject. For example, Patent Document 1 discloses a system for measuring biological information of a subject and judging the stress state of the subject in the daily life of the subject. In addition, Patent Document 2 discloses a method for extracting a feature amount from biological data of a subject and calculating an estimated value of chronic stress from the extracted feature amount. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-209128 A [Patent Document 2] International Publication WO2020 / 209117 Summary of the Invention [Problem to be solved by the invention]

[0004] Events occurring in the subject's daily life are factors of external stimuli that cause stress (including acute stress) in the subject, and therefore understanding how such daily events affect the subject is important for self-understanding and stress management. Meanwhile, Patent Documents 1 and 2 do not disclose any specific method for supporting understanding of events that are factors of external stimuli.

[0005] In consideration of the above-mentioned problems, one object of the present disclosure is to provide a control device, a control method, and a storage medium capable of presenting information that is a cause of an external stimulus to a subject. [Means for solving the problem]

[0006] One aspect of the control device is An external stimulus estimation means for calculating an estimate of an external stimulus received by a subject based on observation information obtained by observing the subject; When the estimated value is equal to or greater than a predetermined threshold value, A first acquisition means for acquiring an event that is a cause of the external stimulus; At the time A second acquisition means for acquiring information regarding the pleasantness / unpleasantness of the external stimulus based on the subjective opinion of the subject; A classification means for classifying the event based on the information on pleasantness / unpleasantness; a display control means for displaying the event classification result on a display device; It is a control device having the following.

[0007] One aspect of the control method includes: The computer Calculating an estimate of an external stimulus received by the subject based on observation information obtained by observing the subject; When the estimated value is equal to or greater than a predetermined threshold value, Acquire events that cause external stimuli, At the time Obtaining information regarding the pleasantness / unpleasantness of the external stimulus based on the subjective opinion of the subject, Classifying the event based on the information on pleasantness / unpleasantness; displaying the event classification result on a display device; It is a control method. Note that the "computer" includes any electronic device (it may be a processor included in an electronic device), and may be configured by multiple electronic devices.

[0008] One aspect of the program is Calculating an estimate of an external stimulus received by the subject based on observation information obtained by observing the subject; When the estimated value is equal to or greater than a predetermined threshold value, Acquire events that cause external stimuli, At the time Obtaining information regarding the pleasantness / unpleasantness of the external stimulus based on the subjective opinion of the subject, Classifying the event based on the information on pleasantness / unpleasantness; The program causes a computer to execute a process of displaying the event classification result on a display device. Effect of the Invention

[0009] According to the present disclosure, information that is a cause of an external stimulus can be presented to a subject. [Brief description of the drawings]

[0010] [Figure 1] 1 shows a schematic configuration of an external stimulus management system according to a first embodiment. [Diagram 2] 2 illustrates an example of a hardware configuration of an external stimulus management device common to each embodiment. [Diagram 3] 2 is an example of a functional block of the external stimulus management device according to the first embodiment. [Figure 4] 13 is a display example of an external stimulus registration screen. [Diagram 5] 13 is a display example of an external stimulus feedback screen in the first embodiment. [Figure 6] 4 is an example of a flowchart executed by the external stimulus management device in the first embodiment. [Figure 7] 13 is an example of a functional block of an external stimulus management device according to a second embodiment. [Figure 8] 13 is a display example of an external stimulus feedback screen in the second embodiment. [Figure 9] 13 is an example of a functional block of an external stimulus management device according to a third embodiment. [Figure 10] 13 is a display example of an evaluation screen in the third embodiment. [Figure 11] 13 is an example of a flowchart executed by the external stimulus management device in the third embodiment. [Figure 12] 13 shows a schematic configuration of an external stimulus management system according to a fourth embodiment. [Figure 13] FIG. 13 is a block diagram of a control device in a fifth embodiment. [Figure 14] 13 is an example of a flowchart executed by the external stimulus management device in the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of a control device, a control method, and a storage medium will be described with reference to the drawings.

[0012] First Embodiment (1) System Configuration 1 shows a schematic configuration of an external stimulus management system 100 according to a first embodiment. The external stimulus management system 100 manages and displays information related to external stimuli of a subject. Here, the "subject" may be an athlete or employee for whom external stimuli are managed by an organization, or may be an individual user.

[0013] The external stimulus management system 100 mainly includes an external stimulus management device 1, an input device 2, a display device 3, a storage device 4, and a sensor 5.

[0014] The external stimulus management device 1 classifies events that are the cause of external stimuli that cause stress (including acute stress) in the subject according to whether they are stimuli that bring about pleasure (good stimuli) or stimuli that bring about discomfort (bad stimuli), and presents the classification results. The external stimulus management device 1 performs data communication with the input device 2, the display device 3, and the sensor 5 via a communication network or by direct wireless or wired communication. For example, the external stimulus management device 1 receives an input signal "S1" supplied from the input device 2, a sensor signal "S3" supplied from the sensor 5, and various information stored in the storage device 4. The external stimulus management device 1 also generates a display control signal "S2" for displaying the classification results of events that are the cause of external stimuli in the subject, and supplies the generated display control signal S2 to the display device 3.

[0015] The input device 2 is an interface that accepts external input (manual input) of information about each subject. The user who inputs information using the input device 2 may be the subject himself / herself, or may be a person who manages or supervises the subject's activities. The input device 2 may be, for example, various external input interfaces such as a touch panel, a button, a keyboard, a mouse, or a voice input device. The input device 2 supplies an input signal S1 generated based on a user's input to the external stimulus management device 1. The display device 3 displays predetermined information based on a display control signal S2 supplied from the external stimulus management device 1. Examples of the display device 3 include a display, a virtual (augmented) reality terminal, or a projector.

[0016] The sensor 5 measures the subject's biological signals and the like, and supplies the measured biological signals and the like to the external stimulus management device 1 as a sensor signal S3. In this case, the sensor signal S3 may be any biological signal (including vital information) such as the subject's heart rate, brain waves, pulse waves, sweat rate, hormone secretion amount, cerebral blood flow, blood pressure, body temperature, electromyography, respiratory rate, and acceleration. The sensor 5 may also be a device that analyzes blood collected from the subject and outputs a sensor signal S3 indicating the analysis result. The sensor 5 may also be a wearable terminal worn by the subject, a camera that photographs the subject, a microphone that generates an audio signal of the subject's speech, or a terminal such as a personal computer or smartphone operated by the subject. For example, the above-mentioned wearable terminal includes a GNSS (global navigation satellite system) receiver, an acceleration sensor, and any other sensor that detects biological signals, and outputs the output signal of each of these sensors as a sensor signal S3. The sensor 5 may also supply information corresponding to the amount of operation of a personal computer, smartphone, or the like to the external stimulus management device 1 as a sensor signal S3. The sensor 5 may also output a sensor signal S3 representing biological data (including the sleeping time) from the subject while the subject is sleeping.

[0017] The storage device 4 is a memory that stores various information necessary for estimating a stress state, etc. The storage device 4 may be an external storage device such as a hard disk connected to or built into the external stimulus management device 1, or may be a storage medium such as a flash memory. The storage device 4 may also be a server device that performs data communication with the external stimulus management device 1. The storage device 4 may also be composed of multiple devices.

[0018] The storage device 4 functionally comprises an observation information storage section 40 , an external stimulus estimated value storage section 41 , a pleasure / displeasure related information storage section 42 , and an event information storage section 43 .

[0019] The observation information storage unit 40 stores information (also referred to as "observation information") obtained by observing (measuring) the subject using the sensor 5 or the like. Here, the sensor signal S3 itself output by the sensor 5 may be treated as the observation information, or a feature amount (including an index representing facial expression, emotion, etc. analyzed from image or voice data) calculated based on the sensor signal S3 may be treated as the observation information. The observation information may also include questionnaire information based on the input signal S1 or a diagnosis result of personality, etc. based on the information. The observation information is stored in the observation information storage unit 40, for example, in association with identification information (subject ID) of the subject to be observed and date and time information representing the observation date and time.

[0020] The external stimulus estimated value storage unit 41 stores an external stimulus estimated value, which is an estimated value of an external stimulus to a subject calculated by the external stimulus management device 1 based on the observation information stored in the observation information storage unit 40. In this embodiment, the external stimulus management device 1 calculates an acute stress value representing the degree of acute stress caused by an external stimulus as an example of an index corresponding to an estimated value of an external stimulus, and uses the acute stress value as an external stimulus estimated value. It is to be noted that the use of the acute stress value as an external stimulus estimated value is not limited, and any feature value of a biological signal that changes according to an external stimulus (for example, index values ​​related to a heart rate, a pulse wave, a sweat amount, a blood pressure, a body temperature, a respiratory rate, etc.) may be used as an external stimulus estimated value. The external stimulus estimated value is stored in the external stimulus estimated value storage unit 41, for example, in association with date and time information on when the subject received the estimated external stimulus and a subject ID, etc.

[0021] The pleasure / discomfort related information storage unit 42 stores pleasure / discomfort related information, which is information regarding pleasure / discomfort of an external stimulus based on the subject's subjective opinion. The pleasure / discomfort related information indicates, for example, whether an external stimulus received by the subject at a specific timing is a stimulus that brings pleasure to the subject (good stimulus) or a stimulus that brings discomfort (bad stimulus). The external stimulus management device 1 recognizes the pleasure / discomfort of the external stimulus based on the subject's subjective opinion based on the input signal S1, and generates pleasure / discomfort related information based on the recognition result. The pleasure / discomfort related information is stored in the pleasure / discomfort related information storage unit 42, for example, in association with date and time information indicating the date and time of occurrence of the external stimulus at which the pleasure / discomfort determination was made, the subject's ID, etc.

[0022] The event information storage unit 43 stores event information caused by an external stimulus of the subject. The event information is information that represents an event of the subject at the date and time of occurrence of an external stimulus received by the subject or the date and time immediately before that, and includes, for example, at least information regarding the type (category) of the event, the content, and the date and time of the event (or / and the date and time of occurrence of an external stimulus caused by the event). The event information is stored in the event information storage unit 43, for example, linked to the subject ID.

[0023] The configuration of the external stimulus management system 100 shown in FIG. 1 is an example, and various changes may be made to the configuration. For example, the input device 2 and the display device 3 may be configured as one unit. In this case, the input device 2 and the display device 3 may be configured as a tablet terminal that is integrated with or separate from the external stimulus management device 1. In this case, the external stimulus management device 1, the input device 2, the display device 3, and the sensor 5 (and may include the storage device 4) may be configured as one smartphone used by the subject. The external stimulus management device 1 may also be configured as a plurality of devices. In this case, the plurality of devices that configure the external stimulus management device 1 transmit and receive information required to execute a process assigned in advance between these plurality of devices. The external stimulus management device 1 may also be connected to or built into a sound output device such as a speaker, and may output a sound or the like corresponding to the display content output by the display device 3 from the sound output device.

[0024] (2) Hardware configuration of the external stimulus management device 2 shows a hardware configuration of the external stimulus management device 1. The external stimulus management device 1 includes, as hardware, a processor 11, a memory 12, and an interface 13. The processor 11, the memory 12, and the interface 13 are connected via a data bus 90.

[0025] The processor 11 functions as a controller (arithmetic unit) that performs overall control of the external stimulus management device 1 by executing a program stored in the memory 12. The processor 11 is, for example, a processor such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or a TPU (Tensor Processing Unit). The processor 11 may be composed of multiple processors. The processor 11 is an example of a computer.

[0026] The memory 12 is composed of various types of volatile and non-volatile memories such as a RAM (Random Access Memory), a ROM (Read Only Memory), and a flash memory. The memory 12 also stores programs for executing the processes executed by the external stimulus management device 1. Note that a part of the information stored in the memory 12 may be stored in one or more external storage devices capable of communicating with the external stimulus management device 1, or may be stored in a storage medium that is detachable from the external stimulus management device 1.

[0027] The interface 13 is an interface for electrically connecting the external stimulus management device 1 to other devices. These interfaces may be wireless interfaces such as a network adapter for wirelessly transmitting and receiving data to and from other devices, or may be hardware interfaces for connecting to other devices via cables or the like.

[0028] The hardware configuration of the external stimulus management device 1 is not limited to the configuration shown in Fig. 2. For example, the external stimulus management device 1 may include at least one of the input device 2 and the display device 3. Furthermore, the external stimulus management device 1 may be connected to or built-in a sound output device such as a speaker.

[0029] (3) Event Classification Processing Next, an event classification process executed by the external stimulus management device 1 will be described, which is a process related to classifying events that cause external stimuli. In general, the external stimulus management device 1 receives an input of the pleasantness / unpleasantness felt by the subject in response to a prominent external stimulus, and determines the pleasantness / unpleasantness experienced by the subject in response to the event that caused the external stimulus. The external stimulus management device 1 then compiles the results of event classification based on pleasantness / unpleasantness for each of a plurality of periods, and displays the results of event classification for each period. In this way, the external stimulus management device 1 presents to the subject the results of event classification based on pleasantness / unpleasantness experienced by the subject, and changes in the classification results.

[0030] (3-1) Functional block Fig. 3 is an example of functional blocks of the external stimulus management device 1. The processor 11 of the external stimulus management device 1 functionally includes an observation information acquisition section 14, an external stimulus estimation section 15, a comfort / discomfort determination section 16, an event acquisition section 17, a classification section 18, and a display control section 19. Note that in Fig. 3, blocks between which data is exchanged are connected by solid lines, but the combination of blocks between which data is exchanged is not limited to that shown in Fig. 3. The same applies to other functional block diagrams described later.

[0031] The observation information acquiring unit 14 acquires the subject's observation information based on the sensor signal S3, and stores the acquired observation information in the observation information storage unit 40. In this case, as described above, the observation information acquiring unit 14 may acquire the sensor signal S3 as the observation information, or may acquire a feature amount (including an index representing facial expression, emotion, etc. analyzed from image or voice data) calculated based on the sensor signal S3 as the observation information. Note that the observation information acquiring unit 14 may acquire questionnaire information based on the input signal S1 or a diagnosis result of personality, etc. based on the information as the observation information.

[0032] The external stimulus estimation unit 15 calculates the external stimulus estimated value of the subject, and stores the calculated external stimulus estimated value in the external stimulus estimated value storage unit 41. In this embodiment, the external stimulus estimation unit 15 extracts the observation information of the subject for a predetermined period from the observation information storage unit 40, and calculates the acute stress value in a time series for the same period calculated based on the extracted observation information as the external stimulus estimated value for the same period. In this case, the external stimulus estimation unit 15 may estimate the acute stress value using a stress estimation model that estimates the acute stress value based on the observation information. Here, the above-mentioned stress estimation model is, for example, a model that has been trained in advance to output the acute stress value of the subject when the observation information of the subject is input, and parameters for configuring the model are stored in advance in the storage device 4 or the like.

[0033] The pleasure / displeasure determination section 16 determines whether the subject feels pleasure or displeasure in response to a significant external stimulus based on the input signal S1, and stores the result of the pleasure / displeasure determination in the pleasure / displeasure related information storage section 42. Here, the external stimulus for which pleasure / displeasure is to be determined (also referred to as the "target external stimulus") may be an external stimulus identified by an input by the subject via the input device 2, or an external stimulus identified by the external stimulus management device 1 based on peak detection processing (including threshold processing) for a time-series estimated value of the external stimulus. A specific example of the pleasure / displeasure determination for a target external stimulus will be described later with reference to the display example of FIG. 4.

[0034] The event acquiring unit 17 acquires event information indicating an event of the subject that caused the target external stimulus (also referred to as an "external stimulus cause event"), and stores the acquired event information in the event information storage unit 43. The event acquiring unit 17 may acquire the event information from a schedule management system that manages schedule information related to the schedule of the subject, or may generate the event information based on an input signal S1 generated by the input operation of the subject by the input device 2.

[0035] When a predetermined request is received from the display control unit 19, the classification unit 18 refers to the comfort / discomfort related information stored in the comfort / discomfort related information storage unit 42 and the event information stored in the event information storage unit 43, and classifies the external stimulus cause events that have occurred by period. Then, the classification unit 18 supplies the above classification result to the display control unit 19 as a response to the above request. Here, the period into which the external stimulus cause events are classified is set to include, for example, at least a predetermined period (e.g., the most recent one month) with respect to the current date and time when the display is performed and a period immediately before the predetermined period (e.g., between one month and two months ago). Note that the length of the above-mentioned period is not limited to a month, and may be any length such as a day, a week, a multiple month, or a year. Hereinafter, the most recent predetermined period will be referred to as the "target period", and the period immediately before the target period will be referred to as the "comparison period". Therefore, the classification result supplied by the classification unit 18 to the display control unit 19 includes a classification result based on the pleasantness / unpleasantness of the external stimulus factor events in the target period and a classification result based on the pleasantness / unpleasantness of the external stimulus factor events in the comparison period. The target period is an example of the first period, and the comparison period is an example of the second period.

[0036] When the display control unit 19 detects a display request for the classification result of the external stimulus factor event based on the input signal S1 or the like, it controls the display device 3 to display a display screen of the classification result of the external stimulus factor event. In this case, the display control unit 19 requests the classification unit 18 to classify the external stimulus factor event, and receives the classification result of the external stimulus factor event from the classification unit 18 in response. The display control unit 19 also controls the display device 3 to display an input screen that accepts the subject's input regarding comfort / discomfort with respect to the target external stimulus. The display control unit 19 generates a display control signal S2 for displaying these screens on the display device 3, and supplies the display control signal S2 to the display device 3 via the interface 13.

[0037] Each of the components of the observation information acquisition unit 14, the external stimulus estimation unit 15, the comfort / discomfort determination unit 16, the event acquisition unit 17, the classification unit 18, and the display control unit 19 described in FIG. 3 can be realized, for example, by the processor 11 executing a program. Also, the necessary programs may be recorded in any non-volatile storage medium and installed as necessary to realize each component. At least a part of these components may be realized not only by software by a program, but also by any combination of hardware, firmware, and software. At least a part of these components may be realized by using a programmable integrated circuit such as a field-programmable gate array (FPGA) or a microcontroller. In this case, the integrated circuit may be used to realize a program composed of each of the above components. At least a part of each component may be configured by an application specific standard produce (ASSP), an application specific integrated circuit (ASIC), or a quantum processor (quantum computer control chip). In this way, each component may be realized by various hardware. The above is the same in other embodiments described later. Furthermore, each of these components may be realized by the cooperation of multiple computers, for example, using cloud computing technology.

[0038] (3-2) Generation of pleasant / unpleasant information Next, a specific example of a method for generating comfort / discomfort related information will be described. Fig. 4 shows an example of an external stimulus registration screen that accepts input of comfort / discomfort by a subject in response to a target external stimulus. Here, as an example, a case is shown in which a subject uses the input device 2 to register external stimulus cause events and comfort / discomfort in response to a target external stimulus that occurred at the end of the day while referring to the display device 3.

[0039] The display control unit 19 generates a display control signal S2 for the external stimulus registration screen by referring to the external stimulus estimated value storage unit 41, and supplies the generated display control signal S2 to the display device 3 via the interface 13, thereby causing the display device 3 to display the external stimulus registration screen. The display control unit 19 mainly provides an external stimulus transition display field 60, an external stimulus factor event designation field 62 (62A, 62B), a comfort / discomfort designation field 63 (63A, 63B), and a registration button 64 on the external stimulus registration screen.

[0040] The display control unit 19 displays an external stimulus estimated value graph showing the transition of the external stimulus estimated value for one day calculated on the current date (here, xxth month and xxth day) on the external stimulus transition display field 60. In addition, the display control unit 19 clearly indicates the points (two points in total) corresponding to the target external stimulus on the external stimulus estimated value graph by surrounding them with dashed circles 61A and 61B. Here, the display control unit 19 detects the points corresponding to the maximum value of the external stimulus estimated value graph and exceeding a predetermined threshold as the target external stimulus. Note that the display control unit 19 is not limited to the above example, and may detect the points of increase / decrease, change, inflection, or switching points of the external stimulus estimated value graph as the target external stimulus. In addition, the display control unit 19 may specify the points of the external stimulus estimated value graph designated by the subject on the external stimulus registration screen based on the input signal S1, and detect the specified points as the target external stimulus.

[0041] The display control unit 19 also displays an external stimulus factor event designation field 62 (62A, 62B) and a comfort / discomfort designation field 63 (63A, 63B) corresponding to the two target external stimuli, respectively. Specifically, the display control unit 19 provides an external stimulus factor event designation field 62A and a comfort / discomfort designation field 63A corresponding to the target external stimulus at 13:30, and provides an external stimulus factor event designation field 62B and a comfort / discomfort designation field 63B corresponding to the target external stimulus at 16:30.

[0042] Moreover, the external stimulus factor event designation field 62 (62A, 62B) is, for example, a text input field. When the event acquisition unit 17 acquires an external stimulus factor event of the subject based on the schedule information of the subject, the display control unit 19 displays the acquired external stimulus factor event in the external stimulus factor event designation field 62 (62A, 62B) without input by the subject. Moreover, the external stimulus factor event designation field 62 (62A, 62B) may be an input field in the form of a pull-down menu or any other arbitrary format.

[0043] Moreover, the pleasant / unpleasant designation field 63 (63A, 63B) is, as one example, an input field in the form of a pull-down menu (here, two options, "pleasant" and "unpleasant"). Alternatively, 63 (63A, 63B) may accept an input of a score indicating the degree of pleasantness / unpleasantness. In this case, the pleasant / unpleasant determination unit 16 may, for example, determine whether the input score corresponds to pleasantness or unpleasantness, and generate pleasant / unpleasant related information. In yet another example, the display control unit 19 may display pictograms corresponding to each option of "pleasant" and "unpleasant" in 63 (63A, 63B) so as to be selectable, and the pleasant / unpleasant determination unit 16 may generate pleasant / unpleasant related information based on the type of the selected pictogram.

[0044] When the display control unit 19 detects that the registration button 64 has been selected, the event acquisition unit 17 associates the event information based on the content entered into the external stimulus factor event designation field 62 (62A, 62B) with date and time information, etc., indicating the date and time of occurrence of the corresponding target external stimulus, and stores it in the event information storage unit 43. Similarly, the pleasure / discomfort determination unit 16 stores the pleasure / discomfort related information based on the content entered into the pleasure / discomfort designation field 63 (63A, 63B) in the pleasure / discomfort related information storage unit 42, associated with date and time information, etc., indicating the date and time of occurrence of the corresponding target external stimulus.

[0045] The display control unit 19 may further display a calendar or the like on the external stimulus registration screen and accept date selection by the subject. In this case, the display control unit 19 updates the display of the external stimulus registration screen to accept input of an external stimulus cause event and comfort / discomfort for the target external stimulus on the selected date. This allows the display control unit 19 to generate event information and comfort / discomfort related information for the target external stimulus that occurred on an arbitrary date.

[0046] (3-3) Display of classification results of external stimulus events Next, a specific example of classification of external stimulus factor events and display of the classification results will be described. FIG. 5 is a display example of an external stimulus feedback screen that displays feedback to the subject regarding external stimuli. Here, as an example, the display control unit 19 displays events that caused good stimuli and events that caused bad stimuli in the most recent month and the month before that (i.e., 1 to 2 months ago) on the external stimulus feedback screen. That is, here, the display control unit 19 sets the length of the aggregation period to one month, and displays the classification results of external stimulus factor events for the target period corresponding to the most recent month and the comparison period corresponding to the period immediately before the target period side by side on the external stimulus feedback screen so that they can be compared.

[0047] The display control section 19 provides a past good stimulus display field 70A, a past bad stimulus display field 70B, a latest good stimulus display field 70C, and a latest bad stimulus display field 70D on the external stimulus feedback screen. The past good stimulus display field 70A displays external stimulus factor events that were judged to be pleasant (i.e., good stimulus) in the comparison period of one to two months ago, and the past bad stimulus display field 70B displays external stimulus factor events that were judged to be unpleasant (i.e., bad stimulus) in the same period. The latest good stimulus display field 70C displays external stimulus factor events that were judged to be pleasant in the most recent one month, which is the target period, and the latest bad stimulus display field 70D displays external stimulus factor events that were judged to be unpleasant in the same period.

[0048] Here, the display control unit 19 detects external stimulus factor events that are classified differently between the target period and the comparison period, and highlights the detected external stimulus factor events. Here, the display control unit 19 highlights "Presentation" in the past bad stimulus display field 70B and the latest good stimulus display field 70C because the event "Presentation", which was a bad stimulus factor in the comparison period, has changed to an event that was a good stimulus factor in the target period. This allows the display control unit 19 to easily allow the subject to recognize the external stimulus factor events that are classified into different classes between the target period and the comparison period.

[0049] Meanwhile, the display control unit 19 displays external stimulus factor events that were common to both the target period and the comparison period as causes of good stimuli at the same position in the past good stimulus display field 70A and the latest good stimulus display field 70C. Similarly, the display control unit 19 displays external stimulus factor events that were common to both the target period and the comparison period as causes of bad stimuli at the same position in the past bad stimulus display field 70B and the latest bad stimulus display field 70D. In this way, the display control unit 19 displays external stimulus factor events whose classification results do not change between the target period and the comparison period in association with each other, allowing the subject to easily recognize external stimulus factor events whose classification results do not change.

[0050] The display control unit 19 may display the external stimulus cause events displayed in each column of the external stimulus feedback screen in a manner according to the frequency of occurrence within the period. For example, if "running" becomes a good stimulus cause once during the comparison period and "light exercise" becomes a good stimulus cause multiple times during the comparison period, the display control unit 19 may display "light exercise" in a more prominent manner (for example, in a larger font size) than "running" in the past good stimulus display column 70A.

[0051] Furthermore, when a pleasant / unpleasant score is input on the external stimulus registration screen, the display control unit 19 may display the external stimulus cause event to be displayed on the external stimulus feedback screen in a manner corresponding to the corresponding pleasant / unpleasant score. For example, when the pleasant / unpleasant score corresponding to "running", which is an external stimulus cause event in the comparison period, is higher than the pleasant / unpleasant score corresponding to "light exercise", which is an external stimulus cause event in the comparison period, the display control unit 19 may display "running" in a more prominent manner than "light exercise" in the past good stimulus display area 70A.

[0052] (3-4) Processing flow 6 is an example of a flowchart executed by the external stimulus management device 1 in the first embodiment. The external stimulus management device 1 repeatedly executes the process of the flowchart.

[0053] First, the external stimulus management device 1 acquires observation information (step S11). In this case, the external stimulus management device 1 acquires the observation information based on the sensor signal S3 supplied from the sensor 5, and stores the acquired observation information in the observation information storage unit 40.

[0054] Next, the external stimulus management device 1 estimates the external stimulus based on the observation information stored in the observation information storage unit 40 (step S12). The external stimulus management device 1 stores an external stimulus estimated value, which is the estimation result, in the external stimulus estimated value storage unit 41.

[0055] Then, the external stimulus management device 1 determines the target external stimulus (step S13). In this case, the external stimulus management device 1 may determine the target external stimulus based on the subject's input, or may determine the target external stimulus based on peak detection processing or the like. Then, the external stimulus management device 1 acquires event information indicating an event (i.e., an external stimulus factor event) that is the cause of each determined target external stimulus (step S14). In this case, the external stimulus management device 1 may generate the external stimulus factor event and its event information based on the subject's schedule information, or may generate the external stimulus factor event and its event information based on the subject's input.

[0056] Then, the external stimulus management device 1 determines the subjective pleasantness / unpleasantness of each of the determined target external stimuli (step S15). In this case, the external stimulus management device 1 generates pleasure / unpleasantness related information on the pleasantness / unpleasantness of the subject for each of the determined target external stimuli based on the subject's input.

[0057] Then, the external stimulus management device 1 determines whether it is time to provide feedback regarding the classification of the external stimulus factor event (step S16). In this case, for example, when the external stimulus management device 1 detects a display request for an external stimulus feedback screen based on the input signal S1, it determines that it is time to provide feedback regarding the classification of the external stimulus factor event. When the external stimulus management device 1 determines that it is not time to provide feedback regarding the classification of the external stimulus factor event (step S16; No), it continues to execute the processes of steps S11 to S15.

[0058] On the other hand, if it is time to provide feedback regarding the classification of the external stimulus factor events (step S16; Yes), the external stimulus management device 1 classifies the external stimulus factor events into the target period and the comparison period (step S17). In this case, the external stimulus management device 1 classifies the external stimulus factor events in the target period based on the corresponding pleasure / displeasure related information, and classifies the external stimulus factor events in the comparison period based on the corresponding pleasure / displeasure related information.

[0059] Then, the external stimulus management device 1 displays the classification result of the external stimulus cause events for each period (step S18). In this case, for example, the external stimulus management device 1 supplies a display control signal S2 to the display device 3 to cause the display device 3 to display the external stimulus feedback screen shown in Fig. 5. This allows the external stimulus management device 1 to present to the subject how the subject has received the external stimulus between the target period and the comparison period and the change in the reception of the external stimulus.

[0060] (4) Variations Next, modified examples of the above-described embodiment will be described. The following modified examples may be applied to the above-described embodiment in any combination.

[0061] (Variation 1) The external stimulus management device 1 may classify the external stimulus factor events into three or more classes and display the classification results, instead of classifying the external stimulus factor events into two classes based on pleasantness and unpleasantness and displaying the classification results.

[0062] In this case, the external stimulus management device 1 accepts three classes, "pleasant," "unpleasant," and "neither," as options in the pleasant / unpleasant designation field 63 on the external stimulus registration screen. The external stimulus management device 1 then refers to the pleasant / unpleasant related information generated based on the input in the pleasant / unpleasant designation field 63 to classify and display the external stimulus factor events in the target period and the comparison period into the above three classes. In this case, the external stimulus management device 1 performs display control similar to the display example of FIG. 5. Specifically, the external stimulus management device 1 highlights the external stimulus factor events with different classification results between the target period and the comparison period, and displays the external stimulus factor events with the same classification results between the target period and the comparison period at the same position in the corresponding display field. Similarly, when classifying the external stimulus factor events into four or more classes, the external stimulus management device 1 generates pleasant / unpleasant related information in which the target external stimulus is classified into a predetermined number of classes based on the subject's input, and classifies and displays the external stimulus factor events in the target period and the comparison period into a predetermined number of classes.

[0063] In this modified example as well, the external stimulus management device 1 can present to the subject how the subject perceives the external stimuli between the target period and the comparison period and the change therein.

[0064] (Variation 2) The external stimulus management device 1 may set a plurality of comparison periods and display the classification results of the external stimulus factor events in the plurality of comparison periods and the classification results of the external stimulus factor events in the target period.

[0065] In this case, for example, the external stimulus management device 1 displays the classification results of the external stimulus factor events in the target period and the classification results of the external stimulus factor events in each comparison period side by side so that they can be compared. In this case, too, the external stimulus management device 1 highlights the external stimulus factor events whose classification has changed between the target period and each comparison period, and displays the external stimulus factor events of the same classification in the target period and each comparison period in the same position on the corresponding display field, as in the display example of Fig. 5.

[0066] According to this modification, the external stimulus management device 1 can present to the subject how the subject perceives the external stimuli and the changes therein between a target period and a plurality of comparison periods.

[0067] <Second embodiment> In the second embodiment, the external stimulus management system 100 executes a process of determining the timing of feeding back the classification result of the external stimulus event to the subject based on the degree of change in the chronic stress of the subject. Hereinafter, the same reference numerals are appropriately used for the components of the second embodiment that are the same as those of the first embodiment, and the description thereof will be omitted.

[0068] FIG. 7 is a functional block diagram of the external stimulus management device 1A in the second embodiment. The processor 11 of the external stimulus management device 1A in the second embodiment has a chronic stress estimation unit 20 and a display timing determination unit 21 in addition to the observation information acquisition unit 14, the external stimulus estimation unit 15, the comfort / discomfort determination unit 16, the event acquisition unit 17, the classification unit 18, and the display control unit 19 described in the first embodiment. The storage device 4 has a chronic stress estimated value storage unit 44 that stores a chronic stress estimated value that is an estimated value of the chronic stress of the subject in addition to the observation information storage unit 40, the external stimulus estimated value storage unit 41, the comfort / discomfort related information storage unit 42, and the event information storage unit 43 described in the first embodiment. Chronic stress is stress from a long-term (chronic) perspective on a period of several days to a week or month.

[0069] The chronic stress estimation unit 20 calculates a chronic stress estimation value based on the observation information stored in the observation information storage unit 40. The chronic stress estimation unit 20 extracts, from the observation information storage unit 40, observation information within a period in which the state of the subject is considered in estimating chronic stress (i.e., a period of several days to a week or month as described above) that is correlated with the chronic stress value, and estimates the chronic stress value from the extracted observation information. In this case, the chronic stress estimation unit 20 may estimate the chronic stress value from the observation information based on an arbitrary method. The chronic stress estimation unit 20 may also estimate the chronic stress value from observation information based on the answer result of a questionnaire for estimating chronic stress (i.e., information measured subjectively). Note that, as a questionnaire for estimating a chronic stress value, there is a PSS (Perceived Stress Scale) questionnaire, etc. In addition, the chronic stress estimation unit 20 may estimate the chronic stress value using an estimation model for estimating a chronic stress value. Patent Document 2 describes an example of a method for estimating chronic stress. The chronic stress estimation unit 20 stores the calculated chronic stress estimated value in the chronic stress estimated value storage unit 44 in association with the subject ID and date and time information indicating the date and time of the subject.

[0070] The display timing determination unit 21 determines the timing to display the external stimulus feedback screen (i.e., the timing to feed back the classification result of the external stimulus event to the subject) based on the chronic stress estimated value. In this case, the display timing determination unit 21 determines that it is the timing to display the external stimulus feedback screen when it detects that the current chronic stress estimated value is higher (or lower) by a predetermined value or more compared to the chronic stress estimated value on a predetermined reference date. The above-mentioned reference date may be, for example, the date on which the previous external stimulus feedback screen was displayed, a date specified by the subject, or the first day of the target period (for example, the beginning of the month). In another example, the display timing determination unit 21 monitors the transition of the chronic stress estimated value, and when it detects an inflection point (a change point or a switching point) in the transition, it determines that it is the timing to display the external stimulus feedback screen. Note that the display timing determination unit 21 may also determine that it is the timing to display the external stimulus feedback screen when it detects a day on which the chronic stress estimated value becomes a maximum value or a minimum value.

[0071] Then, when the display timing determination unit 21 determines that it is time to display the external stimulus feedback screen, the classification unit 18 executes classification of the external stimulus factor event based on the request of the display timing determination unit 21. Then, the display control unit 19 performs display control of the external stimulus feedback screen showing the classification result of the external stimulus factor event. In this case, preferably, the display control unit 19 refers to the chronic stress estimated value storage unit 44 and displays the transition of the chronic stress estimated value on the external stimulus feedback screen. Note that, when the display timing determination unit 21 determines that it is time to display the external stimulus feedback screen, a warning (notification) for prompting an operation to instruct the display of the external stimulus feedback screen may be output by the display device 3 or the like. In this case, when a display request for the external stimulus feedback screen is detected by the input signal S1 in response to the above warning, the classification unit 18 performs classification of the external stimulus factor event, and the display control unit 19 performs display control of the external stimulus feedback screen.

[0072] In this way, the external stimulus management device 1A of the second embodiment displays an external stimulus feedback screen at times such as when chronic stress suddenly decreases or increases, allowing the subject to recognize changes in the classification of external stimulus cause events based on the quality of the external stimulus, thereby deepening the subject's self-understanding.

[0073] 8 is a display example of an external stimulus feedback screen in the second embodiment. Here, as an example, the display control unit 19 calculates a chronic stress estimate based on the subject's observation information for the past month for each day, and upon detecting a sudden increase in the chronic stress estimate, causes the display device 3 to display the external stimulus feedback screen.

[0074] The display control unit 19 displays on the external stimulus feedback screen a chronic stress trend display column 60A showing the trend of the chronic stress estimated value on a daily basis, a past good stimulus display column 70A, a past bad stimulus display column 70B, a latest good stimulus display column 70C, and a latest bad stimulus display column 70D.

[0075] The display control unit 19 refers to the chronic stress estimated value storage unit 44 and displays a graph showing the transition of the chronic stress estimated value for each day in one month from June 15th to the current date of July 14th on the chronic stress transition display field 60A. Here, as an example, the display timing determination unit 21 determines that it is time to display the external stimulus feedback screen because the chronic stress estimated value on today's date of July 14th is higher than the predetermined threshold value compared to the chronic stress estimated value on June 15th, one month before the present. The display control unit 19 then sets the period from the current date of July 14th to the most recent one month (June 15th to July 14th) as the target period and the previous one month (May 15th to June 14th) as the comparison period, and displays the classification results of the external stimulus factor events for each period in each display field.

[0076] The display control unit 19 then highlights in the corresponding display field the external stimulus factor events whose classification results are different between the target period and the comparison period. This allows the display control unit 19 to feed back to the subject the factors that increased chronic stress, and promote the subject's deepening of self-understanding. Specifically, since the subject did not have time to run during the target period, running, which was a factor of good stimulus during the comparison period, did not occur during the target period, and the good stimulus during the target period was reduced compared to the comparison period. On the other hand, a meeting for a new PJ (project) occurred due to a change in the subject's work relationship, and the bad (pressurized) stimulus during the target period was increased compared to the comparison period. Therefore, the display control unit 19 highlights "running" and "meeting for new PJ" in the corresponding display field.

[0077] Similarly, when the external stimulus management device 1A detects that chronic stress has decreased, it determines that it is time to display the external stimulus feedback screen and displays the classification results of the external stimulus cause events in the target period and the comparison period and the changes therein. In this way, the external stimulus management device 1A can provide the subject with feedback on the factors that caused the chronic stress to decrease, thereby promoting the subject's deepening of self-understanding.

[0078] Here, the processing flow in the second embodiment will be further described with reference to FIG. 6. The external stimulus management device 1A calculates a chronic stress estimated value at any timing from step S12 to step S15, and stores the calculated chronic stress estimated value in the chronic stress estimated value storage unit 44. Then, in step S16, the external stimulus management device 1A determines whether or not it is feedback timing based on the chronic stress estimated value stored in the chronic stress estimated value storage unit 44. Then, when the external stimulus management device 1A determines that it is feedback timing based on the chronic stress estimated value, it advances the processing to step S17. Note that, as described above, the external stimulus management device 1A may output a predetermined warning (notification) after determining that it is feedback timing, and advance the processing to step S17 when it detects an input of a display request for an external stimulus feedback screen in response to the warning.

[0079] <Third embodiment> In the third embodiment, in addition to the processing in the first or second embodiment, the external stimulus management system 100 displays an evaluation result based on the presence or absence of changes in the pleasantness / unpleasantness of an external stimulus factor event over a medium to long term period, and accepts input for correction of the evaluation result (i.e., re-evaluation). As a result, the external stimulus management system 100 displays the evaluation result of an external stimulus factor event for each medium to long term period, and accepts correction of the evaluation result. Hereinafter, the same reference numerals are used appropriately for the components of the third embodiment that are the same as those of the first embodiment, and their explanations are omitted.

[0080] FIG. 9 is a functional block diagram of the external stimulus management device 1B in the third embodiment. The processor 11 of the external stimulus management device 1B in the third embodiment has a display control unit 19A in addition to the observation information acquisition unit 14, the external stimulus estimation unit 15, the comfort / discomfort determination unit 16, the event acquisition unit 17, and the classification unit 18 described in the first embodiment. In addition to the processing executed by the display control unit 19 described in the first embodiment, the display control unit 19A displays the evaluation result based on the presence or absence of a change in comfort / discomfort of the external stimulus factor event in the medium- to long-term period on the display device 3, and performs processing to accept correction of the evaluation result. The "medium- to long-term period" is a period to be evaluated, and is hereinafter also referred to as the "evaluation target period." In addition to the observation information storage unit 40, the external stimulus estimated value storage unit 41, the comfort / discomfort related information storage unit 42, and the event information storage unit 43 described in the first embodiment, the storage device 4 has a reevaluation information storage unit 45 that stores reevaluation information regarding the reevaluation of the classification result of the external stimulus factor event input on the evaluation screen.

[0081] 10 is a display example of the evaluation screen in the third embodiment. Here, as an example, the display control unit 19 sets the year 2021 as the evaluation target period, displays the evaluation results of each external stimulus factor event in 2021 on the evaluation screen based on the result of classifying the external stimulus factor event into pleasant and unpleasant for each month in 2021, and accepts an input to modify the evaluation results.

[0082] The display control unit 19 provides an evaluation result display field 65 and a completion button 66 on the evaluation screen. The evaluation result display field 65 displays the evaluation result of each external stimulus factor event based on the pleasant / unpleasant classification result of the external stimulus factor event for each month in 2021. The evaluation of the external stimulus factor event here is an evaluation of which of the patterns (a) to (d) the external stimulus factor event falls into, namely (a) the external stimulus factor event is consistently pleasant (good stimulus) throughout 2021, or (b) the external stimulus factor event is consistently unpleasant (bad stimulus) throughout 2021, or (c) the external stimulus factor event changed from pleasant to unpleasant in the middle of 2021, or (d) the external stimulus factor event changed from unpleasant to pleasant in the middle of 2021. In this way, the display control unit 19 evaluates which of the patterns (a) to (d) each external stimulus factor event falls into by aggregating the classification results of the external stimulus factor events for each month, and displays the evaluation result in the evaluation result display field 65.

[0083] Furthermore, the display control unit 19 accepts an input for changing the display position of each external stimulus factor event on the evaluation result display field 65 based on a drag-and-drop operation or the like. For example, in FIG. 10, the display control unit 19 moves "Meeting", which was initially displayed in the "Unpleasant" field corresponding to pattern (b), to the "Unpleasant -> Pleasant" field corresponding to pattern (c) by a drag-and-drop operation. Then, the display control unit 19 highlights the moved external stimulus factor event (here, "Meeting"). Note that the display control unit 19 may accept a change in evaluation (i.e., re-evaluation) of each external stimulus factor event based on any input method (including voice input, etc.) other than drag-and-drop.

[0084] Then, when the display control unit 19 detects that the done button 66 has been selected, it stores information about the external stimulus factor event whose evaluation has been changed (here, "meeting") as reevaluation information in the reevaluation information storage unit 45. In this case, the reevaluation information is information that includes at least the target external stimulus factor event (here, "meeting"), the final evaluation of the external stimulus factor event (here, "unpleasant -> pleasant"), and the target ID, for example.

[0085] The reevaluation information stored in the reevaluation information storage unit 45 may be used as information to support the subject's input regarding comfort / discomfort. In this case, for example, when an event specified in the external stimulus factor event specification field 62 on the external stimulus registration screen matches an external stimulus factor event indicated by the reevaluation information, the display control unit 19 displays an evaluation based on the reevaluation information of the event specified in the external stimulus factor event specification field 62. For example, after the reevaluation information is generated on the evaluation screen shown in FIG. 10, when "meeting" is specified in the external stimulus factor event specification field 62 on the external stimulus registration screen displayed thereafter, the display control unit 19 displays a display notifying the subject that the evaluation of "meeting" has changed from "unpleasant" to "pleasant". This allows the display control unit 19 to favorably support input regarding comfort / discomfort in the comfort / discomfort specification field 63.

[0086] 11 is an example of a flowchart executed by the external stimulus management device 1B in the third embodiment. The external stimulus management device 1B executes the process of this flowchart in addition to the process of the flowchart shown in FIG.

[0087] First, the external stimulus management device 1B determines whether it is time for mid- to long-term evaluation of the external stimulus factor event (step S21). For example, when the external stimulus management device 1B detects an input from the subject instructing the execution of evaluation during the evaluation period based on the input signal S1, the external stimulus management device 1B determines that it is time for mid- to long-term evaluation of the external stimulus factor event. In this case, the evaluation period may be a period designated by the subject. In another example, when the external stimulus management device 1B determines that a predetermined timing (e.g., a predetermined time point at the end or beginning of a period) that marks a mid- to long-term dividing point has arrived, the external stimulus management device 1B determines that it is time for mid- to long-term evaluation of the external stimulus factor event with the evaluation period being the current period or the immediately preceding period.

[0088] Next, the external stimulus management device 1B determines an evaluation based on the change in the classification result for each external stimulus factor event that occurred during the evaluation period, and displays the evaluation on the display device 3 (step S22). In this case, the external stimulus management device 1B generates, for example, a display control signal S2 and supplies the display control signal S2 to the display device 3, thereby causing the display device 3 to display information indicating which of the patterns (a) to (d) each external stimulus factor event that occurred during the evaluation period corresponds to.

[0089] Then, the external stimulus management device 1B accepts a correction to the evaluation for each external stimulus factor event displayed in step S22 (step S23). Then, the external stimulus management device 1B generates re-evaluation information indicating the correction content of the evaluation accepted in step S23, and stores the generated re-evaluation information in the re-evaluation information storage unit 45.

[0090] <Fourth embodiment> 12 shows a schematic configuration of an external stimulus management system 100C in the fourth embodiment. The external stimulus management system 100C in the fourth embodiment is a server-client model system, and an external stimulus management device 1C functioning as a server device performs the processing of the external stimulus management device 1 in the first embodiment, the external stimulus management device 1A in the second embodiment, or the external stimulus management device 1B in the third embodiment. Hereinafter, the same components as those in the first to third embodiments are appropriately designated by the same reference numerals, and the description thereof will be omitted.

[0091] The external stimulus management system 100C mainly includes an external stimulus management device 1C functioning as a server, a storage device 4, and a terminal device 8 functioning as a client. The external stimulus management device 1C and the terminal device 8 perform data communication via a network 7.

[0092] The terminal device 8 is a terminal used by the subject, has an input function, a display function, and a communication function, and functions as the input device 2 and the display device 3 shown in FIG. 1. The terminal device 8 may be, for example, a personal computer, a tablet terminal such as a smartphone, or a PDA (Personal Digital Assistant). The terminal device 8 is electrically connected to a sensor 5 such as a wearable sensor worn by a user, and transmits a biological signal of the subject output by the sensor 5 (i.e., information corresponding to the sensor signal S3 in FIG. 1) to the external stimulus management device 1C. The terminal device 8 also transmits information generated by an external input (information corresponding to the input signal S1 in FIG. 1) to the external stimulus management device 1C.

[0093] The external stimulus management device 1C has the same hardware configuration as the external stimulus management device 1 shown in Fig. 2, and the processor 11 of the external stimulus management device 1C has any of the functional blocks described in the first to third embodiments. The external stimulus management device 1C receives information corresponding to the input signal S1 and the sensor signal S3 in Fig. 1 from the terminal device 8 via the network 7, and executes an event classification process and the like. Based on a display request from the terminal device 8, the external stimulus management device 1C transmits a display control signal for outputting the event classification result to the terminal device 8 via the network 7.

[0094] According to the fourth embodiment, based on the subject's biological signals and input signals, etc. received from the terminal device 8 used by the subject, the results of event classification based on the pleasure or discomfort experienced by the subject and changes in the classification results according to time periods can be presented to the subject by the terminal device 8.

[0095] <Fifth embodiment> FIG. 13 is a block diagram of a control device 1X in the fifth embodiment. The control device 1X can be, for example, any one of the external stimulus management device 1 according to the first embodiment, the external stimulus management device 1A according to the second embodiment, the external stimulus management device 1B according to the third embodiment, and the external stimulus management device 1C according to the fourth embodiment. The control device 1X mainly includes a first acquisition means 17X, a second acquisition means 16X, a classification means 18X, and a display control means 19X. The control device 1X may be composed of a plurality of devices.

[0096] The first acquisition means 17X acquires an event that is a cause of an external stimulus received by the subject. The first acquisition means 17X can be, for example, the event acquisition unit 17 that generates event information in the first to fourth embodiments, or the classification unit 18 that acquires event information from the event information storage unit 43.

[0097] The second acquisition means 16X acquires information regarding the pleasure / displeasure of the external stimulus based on the subjective opinion of the subject. The second acquisition means 16X can be, for example, the pleasure / displeasure determination unit 16 that generates the pleasure / displeasure related information in the first to fourth embodiments, or the classification unit 18 that acquires the pleasure / displeasure related information from the pleasure / displeasure related information storage unit 42. Note that the "information regarding pleasure / displeasure" is not limited to information indicating whether the target external stimulus is pleasant or unpleasant, and may be information indicating the degree of pleasure / displeasure in three or more stages, similar to the pleasure / displeasure related information in Modification 1 of the first embodiment.

[0098] The classification means 18X classifies the events based on information regarding comfort and discomfort. The classification means 18X can be the classification unit 18 in the first to fourth embodiments. The display control means 19X causes the display device to display the event classification results. In this case, the external stimulus management device 1X can be the same device as the display device (i.e., a device configured integrally with the display device), or can be a different device. The display control means 19X can be the display control unit 19 or the display control unit 19A in the first to fourth embodiments.

[0099] FIG. 14 is an example of a flowchart executed by the external stimulus management device 1X in the fifth embodiment. The first acquisition means 17X acquires an event that is a cause of the external stimulus received by the subject (step S31). The second acquisition means 16X acquires information on the pleasantness / unpleasantness of the external stimulus based on the subjective opinion of the subject (step S32). The classification means 18X classifies the event based on the information on pleasantness / unpleasantness (step S33). The display control means 19X causes the display device to display the event classification result (step S34).

[0100] According to the fifth embodiment, the external stimulus management device 1X can suitably present the classification result regarding the pleasantness / unpleasantness of the event that is the cause of the external stimulus received by the subject.

[0101] In each of the above-described embodiments, the program can be stored using various types of non-transitory computer readable media and can be supplied to a computer, such as a processor. The non-transitory computer readable medium includes various types of tangible storage media. Examples of the non-transitory computer readable medium include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, and RAM (Random Access Memory)). The program may also be supplied to the computer by various types of transitory computer readable media. Examples of the transitory computer readable medium include electric signals, optical signals, and electromagnetic waves. The transitory computer readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

[0102] In addition, some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes.

[0103] [Appendix 1] A first acquisition means for acquiring an event that is a cause of an external stimulus received by a subject; A second acquisition means for acquiring information regarding the pleasantness / unpleasantness of the external stimulus based on the subjective opinion of the subject; A classification means for classifying the event based on the information on pleasantness / unpleasantness; a display control means for displaying the event classification result on a display device; A control device having the above configuration. [Appendix 2] The control device according to claim 1, wherein the display control means causes the display device to display a classification result of the event that occurred in a first period and a classification result of the event that occurred in a second period prior to the first period. [Appendix 3] 3. The control device according to claim 2, wherein the first period is a period immediately before the display device displays a result of the classification of the event, and the second period is a period immediately before the first period. [Appendix 4] The control device according to claim 2 or 3, wherein the display control means detects the event for which the classification results are different in the first period and the second period, and highlights the detected event. [Appendix 5] The control device according to any one of appendices 1 to 4, wherein the display control means causes the display device to display a display column relating to the events classified as pleasant and a display column relating to the events classified as unpleasant. [Appendix 6] The display control means causes the display device to display an input screen regarding comfort / discomfort, The control device according to any one of appendix 1 to appendix 5, wherein the second acquisition means generates the information regarding comfort / discomfort based on an input regarding comfort / discomfort on the input screen. [Appendix 7] The control device according to any one of appendices 1 to 6, wherein the first acquisition means acquires the event based on schedule information relating to the schedule of the subject, or input on an input screen specifying an event that is a cause of the external stimulus. [Appendix 8] an external stimulus estimation means for calculating an estimated value of the external stimulus based on observation information obtained by observing the subject; a determination means for determining the external stimulus from which information regarding the event and the pleasantness / unpleasantness is to be acquired based on an estimated value of the external stimulus in a time series; 8. The control device according to any one of claims 1 to 7, further comprising: [Appendix 9] The method further includes a chronic stress acquisition means for acquiring an estimated value of chronic stress of the subject, The control device according to any one of claims 1 to 8, wherein the display control means determines a timing for displaying the event classification result on a display device based on the estimated value of chronic stress. [Appendix 10] The control device according to any one of appendixes 1 to 9, wherein the display control means causes the display device to display an evaluation of the event based on a change in the classification result during a predetermined evaluation period. [Appendix 11] The control device according to claim 10, wherein the display control means receives an input for correcting the rating, and generates information regarding the correction of the rating based on the input. [Appendix 12] The computer Acquire events that are the cause of the external stimuli received by the subject, Obtaining information regarding the pleasantness / unpleasantness of the external stimulus based on the subjective opinion of the subject, Classifying the event based on the information on pleasantness / unpleasantness; displaying the event classification result on a display device; Control methods. [Appendix 13] Acquire events that are the cause of the external stimuli received by the subject, Obtaining information regarding the pleasantness / unpleasantness of the external stimulus based on the subjective opinion of the subject, Classifying the event based on the information on pleasantness / unpleasantness; A storage medium storing a program for causing a computer to execute a process for displaying the event classification results on a display device.

[0104] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In other words, the present invention naturally includes various modifications and corrections that a person skilled in the art could make in accordance with the entire disclosure, including the claims, and the technical ideas. In addition, the disclosures of the above cited patent documents and the like are incorporated herein by reference. [Explanation of symbols]

[0105] 1, 1A~1C external stimulation management device 1X Control Unit 2 Input Devices 3 Display device 4 Storage device 5 Sensors 8 Terminal Equipment 100, 100C External Stimulus Management System

Claims

1. An external stimulus estimation means for calculating an estimate of an external stimulus received by a subject based on observation information obtained by observing the subject; a first acquisition means for acquiring an event that is a cause of the external stimulus at a time point when the estimated value becomes equal to or greater than a predetermined threshold; A second acquisition means for acquiring information regarding the pleasantness / unpleasantness of the external stimulus based on the subjective opinion at the time point; A classification means for classifying the event based on the information on pleasantness / unpleasantness; a display control means for displaying the event classification result on a display device; A control device having the above configuration.

2. The control device according to claim 1 , wherein the display control means causes the display device to display a classification result of the event that occurred in a first period and a classification result of the event that occurred in a second period prior to the first period.

3. The control device according to claim 2 , wherein the first period is a period immediately before the display device displays the classification result of the event, and the second period is a period immediately before the first period.

4. The control device according to claim 2 , wherein the display control means detects the event for which the classification results differ between the first period and the second period, and highlights the detected event.

5. The control device according to any one of claims 1 to 4, wherein the display control means causes the display device to display a display column relating to the events classified as pleasant and a display column relating to the events classified as unpleasant, respectively.

6. The display control means displays an input screen regarding the comfort / discomfort on the display device, The control device according to claim 1 , wherein the second acquisition means generates the information regarding comfort / discomfort based on an input regarding comfort / discomfort on the input screen.

7. The control device according to any one of claims 1 to 6, wherein the first acquisition means acquires the event based on schedule information regarding the schedule of the subject, or input on an input screen specifying an event that is a cause of the external stimulus.

8. The method further includes a chronic stress acquisition means for acquiring an estimated value of chronic stress of the subject, The control device according to claim 1 , wherein the display control means determines a timing for displaying the event classification result on a display device based on the estimated value of chronic stress.

9. The control device according to any one of claims 1 to 8, wherein the display control means causes the display device to display an evaluation of the event based on a change in the classification result during a predetermined evaluation period.

10. The control device according to claim 9 , wherein the display control means receives an input for correcting the rating, and generates information regarding the correction of the rating based on the input.

11. The computer Calculating an estimate of an external stimulus received by the subject based on observation information obtained by observing the subject; Acquire an event that is a cause of the external stimulus at a time point when the estimated value is equal to or greater than a predetermined threshold value; Obtaining information regarding the pleasantness / unpleasantness of the external stimulus based on the subjective opinion of the subject at the time point; Classifying the event based on the information on pleasantness / unpleasantness; displaying the event classification result on a display device; Control methods.

12. Calculating an estimate of an external stimulus received by a subject based on observation information obtained by observing the subject; Acquire an event that is a cause of the external stimulus at a time point when the estimated value is equal to or greater than a predetermined threshold value; Obtaining information regarding the pleasantness / unpleasantness of the external stimulus based on the subjective opinion of the subject at the time point; Classifying the event based on the information on pleasantness / unpleasantness; A program that causes a computer to execute a process of displaying the event classification result on a display device.

Citation Information

Patent Citations

  • Emotion estimation device and emotion estimation method

    JP2013105232A

  • Information processing device for presenting content, control method therefor, and control program

    JP2018018492A

  • Stress evaluation device, stress evaluation method, and program

    JP2019209128A

  • Stress estimation device, stress estimation method, and computer-readable recording medium

    WO2020209117A1