Processing device and processing method

Abstract

This processing device comprises a processor. The processor: causes an environmental control device to execute first environmental control for forming an environment for inducing rest for a user and second environment control for forming an environment for inducing awakening of the user; acquires first heartbeat information about the heartbeat of the user during a period in which the first environment control is being executed; acquires second heartbeat information about the heartbeat of the user during a period in which the second environment control is being executed; and estimates the degree of refreshment on the basis of the result of comparison between a heart rate included in the first heartbeat information and a heart rate included in the second heartbeat information.

Description

Processing device and processing method

[0001] The present disclosure relates to a technique for inducing a user to rest and wake up.

[0002] Patent Document 1 discloses that when the heart rate of a passenger in a vehicle seat is greater than or equal to a threshold value, it is determined that the passenger is not in a relaxed state, and in order to relax the passenger, the lighting is changed to blue.

[0003] Patent Document 2 discloses that based on the biological information of a user in a private room, when it is estimated that the user is in a relaxed state, in order to induce the user to a refreshed state, a sound that enhances the awakening effect of the user is provided.

[0004] However, in Patent Documents 1 and 2, quantitatively and objectively evaluating the degree to which a user is refreshed by the environment that induces the user to rest and wake up is not considered.

[0005] Japanese Patent No. 7206522 Japanese Patent No. 5123138

[0006] An object of the present disclosure is to provide a technique capable of quantitatively and objectively evaluating the degree to which a user is refreshed by an environment that induces the user to rest and wake up.

[0007] A processing device according to an aspect of the present disclosure includes a processor, and the processor causes an environment control device to execute first environment control for forming an environment that induces a user to rest and second environment control for forming an environment that induces the user to wake up, obtains first heart rate information regarding the heart rate of the user during a period in which the first environment control is being executed, obtains second heart rate information regarding the heart rate of the user during a period in which the second environment control is being executed, and estimates the degree of refreshment of the user based on a comparison result between the heart rate included in the first heart rate information and the heart rate included in the second heart rate information.

[0008] This is a block diagram showing the configuration of the information processing system in the embodiment of this disclosure. This is a diagram showing an example of the installation location of the environmental control device and sensors. This is a diagram showing an example of the control contents of the first environmental control and the second environmental control. This is a flowchart showing a first example of the refresh rate estimation process performed by the processing device. This is a diagram showing an example of a questionnaire. This is a flowchart showing a second example of the refresh rate estimation process performed by the processing device. This is a flowchart showing a third example of the refresh rate estimation process performed by the processing device. This is a graph showing an example of the change in heart rate over time in an experiment. This is a graph showing an example of the change in heart rate over time in an experiment. This is a scatter plot showing the relationship between the difference in heart rate and the difference in refresh rate in each experiment. This is a flowchart showing a fourth example of the refresh rate estimation process performed by the processing device. This is a flowchart showing a fourth example of the refresh rate estimation process performed by the processing device. This is a flowchart showing a fifth example of the processing related to the first environmental control in the refresh rate estimation process performed by the processing device. This is a graph showing an example of the change in heart rate over time in an experiment.

[0009] (Principles of this disclosure) Research is underway on technologies that refresh users by creating an environment that induces rest and then an environment that induces alertness within booths such as car rooms and private rooms in internet cafes. However, the above-mentioned Patent Documents 1 and 2 do not consider quantitatively and objectively evaluating the degree to which users are refreshed by the environments that induce rest and alertness.

[0010] Therefore, the inventors created environments to induce rest and wakefulness in the user, measured the user's heart rate in each environment, and had the user subjectively evaluate the degree of refreshment after the measurement. This experiment was repeated 16 times. In this experiment, in order to induce rest in the user, an environment to induce relaxation was created for 3 minutes, followed by an environment to induce napping for 20 minutes. After that, an environment to induce wakefulness was created for 3 minutes.

[0011] Figures 8 and 9 are graphs showing examples of changes in heart rate over time in an experiment. Figure 8 shows an example where the refresh rate difference was high at 48, and Figure 9 shows an example where the refresh rate difference was low at -22. The refresh rate difference is the result of subtracting the degree of refresh that the user self-assessed on a scale of 0 to 100 immediately before creating an environment that induces rest from the degree of refresh that the user self-assessed on a scale of 0 to 100 after creating an environment that induces wakefulness. Note that a higher refresh rate value indicates a higher degree of refreshment, and a larger refresh rate difference indicates a greater improvement in the degree of refreshment due to the environment.

[0012] The horizontal axis in Figures 8 and 9 shows the elapsed time since the environment began to be created. The vertical axis in Figures 8 and 9 shows the measured heart rate. Waveform G10 in Figure 8 and waveform G20 in Figure 9 show the temporal changes in the measured heart rate. Line G11 in Figure 8 and line G21 in Figure 9 show the average heart rate measurements during the period when an environment that induces relaxation in the user is created. G12 in Figure 8 and G22 in Figure 9 show the average heart rate measurements from 45 seconds after the start of the period when an environment that induces wakefulness in the user is created until the end of that period.

[0013] As a result of the above experiment, the inventors found that, as shown in waveform G10 in Figure 8 and waveform G20 in Figure 9, the user's heart rate decreases in an environment that induces rest and increases in an environment that induces wakefulness.

[0014] Furthermore, the inventors have found that, as shown in Figure 8, when the average heart rate measurement in an environment that induces wakefulness in the user (G12 in Figure 8) rises to a level greater than the average heart rate measurement in an environment that induces relaxation in the user (straight line G11 in Figure 8), the user tends to rate the level of refreshment as high.

[0015] On the other hand, the inventors have found that, as shown in Figure 9, if the average heart rate measurement in an environment that induces wakefulness (G22 in Figure 9) only rises to a level lower than the average heart rate measurement in an environment that induces relaxation (straight line G21 in Figure 9), users tend to evaluate that they are not refreshed or that their level of refreshment is low.

[0016] Furthermore, the inventors created a scatter plot showing the relationship between the difference in heart rate and the difference in refreshness in each experiment. This scatter plot is shown in Figure 10. The difference in heart rate shown on the horizontal axis is the result of subtracting the average heart rate in the environment that induces the user to rest from the average heart rate in the environment that induces the user to wake. The vertical axis shows the difference in refreshness.

[0017] The inventors calculated the correlation coefficient between the heart rate difference and the refresh rate difference to be 0.582. This led the inventors to discover a strong correlation between the heart rate difference and the refresh rate difference. Therefore, the inventors decided to estimate that a refresh rate difference of 20 or more indicates a high degree of refreshment, a refresh rate difference of less than 20 indicates a low degree of refreshment, and in this case, if the heart rate difference is 0 or greater, the degree of refreshment is estimated to be high. The estimation results using this method matched the results of users' subjective evaluations of whether their refresh rate was high or low in 12 out of 16 experiments. In other words, the accuracy rate of estimation using this method was 75%.

[0018] Based on the above findings, the inventors have discovered that the degree to which a user is refreshed by an environment can be evaluated quantitatively and objectively with high accuracy based on a comparison of heart rate before and after the creation of an environment that induces rest and alertness in the user. Therefore, based on the above findings, the inventors have come up with each aspect of this disclosure.

[0019] (1) A processing device in one aspect of the present disclosure includes a processor, the processor causes an environment control device to perform a first environment control to form an environment that induces the user to rest, and a second environment control to form an environment that induces the user to wake up, the processor obtains first heart rate information relating to the user's heart rate during the period in which the first environment control is performed, the processor obtains second heart rate information relating to the user's heart rate during the period in which the second environment control is performed, and the processor estimates the degree of the user's refreshment based on a comparison result between the heart rate included in the first heart rate information and the heart rate included in the second heart rate information.

[0020] In this configuration, the degree of user refreshment is estimated based on a comparison of the user's heart rate during the period when the first environmental control is being implemented and the user's heart rate during the period when the second environmental control is being implemented. Therefore, the degree to which the user is refreshed by an environment that induces rest and alertness can be evaluated quantitatively and objectively.

[0021] (2) In the processing device described in (1) above, the first heart rate information may be information relating to the user's heart rate at the start of the first environmental control.

[0022] In this configuration, the degree of user refreshment is estimated based on a comparison between the user's heart rate at the start of the first environmental control and the user's heart rate during the period in which the second environmental control is being performed. Therefore, the degree to which the user has been refreshed by the first and second environmental control after the start of the first environmental control can be evaluated quantitatively and objectively.

[0023] (3) In the processing device described in (1) above, the processor may estimate that the degree of the user's refreshment is higher the greater the degree to which the heart rate included in the second heart rate information exceeds the heart rate included in the first heart rate information.

[0024] According to this configuration, the greater the degree to which the heart rate included in the second heart rate information exceeds the heart rate included in the first heart rate information, the higher the user's level of refreshment is estimated to be. Therefore, the user's level of refreshment can be evaluated more quantitatively than when it is estimated using a binary value of whether or not it is above a predetermined level.

[0025] (4) In the processing device described in (1) or (3) above, the first heart rate information includes a first average heart rate which is the average value of a plurality of heart rates measured during the period in which the first environmental control is performed, and the second heart rate information includes a second average heart rate which is the average value of a plurality of heart rates measured during the period in which the second environmental control is performed, and the processor may estimate the degree of the user's refreshment based on the comparison result of the first average heart rate and the second average heart rate when estimating the degree of the user's refreshment.

[0026] In this configuration, the degree of user refreshment is estimated based on a comparison of the average values ​​of multiple heart rates measured during the periods in which the first and second environmental controls are performed. Therefore, the degree to which the user has been refreshed by the first and second environmental controls can be accurately evaluated, taking into account the variability in heart rate.

[0027] (5) In the processing apparatus described in (4) above, the first average heart rate may be the average value of a plurality of heart rates measured at the start of the first environmental control.

[0028] In this configuration, the degree of user refreshment is estimated based on a comparison of the average values ​​of multiple heart rates measured at the start of the first environmental control and during the period in which the second environmental control is being performed. Therefore, the degree to which the user has been refreshed by the first and second environmental control after the start of the first environmental control can be accurately evaluated, taking into account the variability in heart rate.

[0029] (6) In the processing apparatus described in (1) or (3) above, the environmental control device may include at least one of the following: a display device for displaying images, a lighting device, a speaker, a vibration device, a fragrance release device, and a massage device.

[0030] According to this configuration, first environmental control and second environmental control can be performed using at least one of the following: a display device for displaying images, a lighting device, a speaker, a vibration device, a fragrance release device, and a massage device.

[0031] (7) In the processing apparatus described in (1) or (3) above, the processor further acquires response information indicating the user's response to the questionnaire, and after acquiring the response information, causes the environment control device to execute the first environment control and the second environment control, and in estimating the degree of refreshment, estimates the degree of refreshment based on the comparison result of the heart rate included in the first heart rate information and the heart rate included in the second heart rate information, and the response information, and the questionnaire may include items asking about at least one of mental agility and motivation.

[0032] When the first and second environmental controls are executed while the user's level of refreshment is high, the user's level of refreshment may decrease. However, with this configuration, even in such cases, the degree to which the user has been refreshed by the first and second environmental controls can be accurately estimated by taking into account at least one of the user's mental agility and motivation before the first and second environmental controls are executed.

[0033] (8) In the processing apparatus described in (1) or (3) above, the processor further obtains response information indicating the user's answers to the questionnaire after the completion of the first and second environmental control, and estimates the degree of refreshment based on the comparison result of the heart rate included in the first heart rate information and the heart rate included in the second heart rate information, and the response information, and the questionnaire may include items asking about at least one of mental agility and motivation.

[0034] According to this configuration, the degree of user refreshment is estimated not only by comparing the user's heart rate during the period when the first environmental control is being performed with the user's heart rate during the period when the second environmental control is being performed, but also based on the response information obtained after the completion of the first and second environmental control. Therefore, by taking into account subjective responses from the user regarding at least one of their mental agility and motivation after the completion of the first and second environmental control, the degree to which the user was refreshed by the first and second environmental control can be estimated with high accuracy.

[0035] (9) In the processing apparatus described in (1) or (3) above, the first environmental control may include a third environmental control that creates an environment that induces the user to sleep.

[0036] According to this configuration, the first environmental control includes a third environmental control that creates an environment that induces sleep in the user, thereby improving the effect of the first environmental control in inducing rest in the user. This increases the amount of change in the user's heart rate before and after the first and second environmental controls are performed. As a result, the accuracy of estimating the degree to which the user has been refreshed by the first and second environmental controls, based on the comparison result between the heart rate contained in the first heart rate information and the heart rate contained in the second heart rate information, can be improved.

[0037] (10) In the processing apparatus described in (1) or (3) above, the first environmental control may include a fourth environmental control that creates an environment that induces the user to relax.

[0038] According to this configuration, the first environmental control includes a fourth environmental control that creates an environment that induces relaxation in the user, thereby improving the effect of the first environmental control in inducing rest in the user. This increases the amount of change in the user's heart rate before and after the first and second environmental controls are performed. As a result, the accuracy of estimating the degree to which the user has been refreshed by the first and second environmental controls, based on the comparison result between the heart rate contained in the first heart rate information and the heart rate contained in the second heart rate information, can be improved.

[0039] (11) In the processing apparatus described in (9) above, the first environmental control further includes a fourth environmental control that creates an environment that induces the user to relax, and the processor may, if the third environmental control is executed before the fourth environmental control, acquire information regarding the user's heart rate during the period in which the third environmental control is executed as first heart rate information, and if the fourth environmental control is executed before the third environmental control, acquire information regarding the user's heart rate during the period in which the fourth environmental control is executed as first heart rate information.

[0040] In this configuration, if the third environmental control is executed before the fourth environmental control, the degree of user refreshment is estimated based on a comparison of the user's heart rate during the period when the third environmental control is being executed and the user's heart rate during the period when the second environmental control is being executed. On the other hand, if the fourth environmental control is executed before the third environmental control, the degree of user refreshment is estimated based on a comparison of the user's heart rate during the period when the fourth environmental control is being executed and the user's heart rate during the period when the second environmental control is being executed. Therefore, the degree to which the user has refreshed can be evaluated quantitatively and objectively by the fourth and second environmental control, or by the third and second environmental control.

[0041] (12) A processing apparatus in another aspect of the present disclosure comprises a processor which causes an environment control device to perform a first environment control to form an environment that induces a user to rest and a second environment control to form an environment that induces the user to be alert, and after the completion of the first and second environment control, obtains first response information indicating the user's answers to a questionnaire, estimates the degree of the user's refreshment based on the first response information, and the questionnaire includes items asking about at least one of mental agility and motivation.

[0042] According to this configuration, based on the first response information obtained after the completion of the first environmental control and the second environmental control, the degree of user refreshment is estimated. Therefore, by taking into account the subjective responses regarding at least one of the user's head rotation and motivation after the completion of the first environmental control and the second environmental control, the degree to which the user is refreshed by the first environmental control and the second environmental control can be easily estimated.

[0043] (13) In the processing device according to (12) above, the processor further obtains second response information indicating the user's response to the questionnaire, and after obtaining the second response information, causes the environmental control device to execute the first environmental control and the second environmental control, and based on the first response information and the second response information, may estimate the degree of user refreshment.

[0044] When the first environmental control and the second environmental control are executed when the degree of user refreshment is high, the degree of user refreshment may decrease. However, according to this configuration, even in such a case, by taking into account at least one of the user's head rotation and motivation before the execution of the first environmental control and the second environmental control indicated by the second response information, the degree to which the user is refreshed by the first environmental control and the second environmental control can be easily and accurately estimated.

[0045] (14) A processing method in another aspect of the present disclosure is a processing method in a computer, which causes an environmental control device to execute a first environmental control for forming an environment that induces a user to rest and a second environmental control for forming an environment that induces the user to wake up, obtains first heartbeat information regarding the user's heartbeat during the period when the first environmental control is being executed, obtains second heartbeat information regarding the user's heartbeat during the period when the second environmental control is being executed, and estimates the degree of user refreshment based on the comparison result between the heart rate included in the first heartbeat information and the heart rate included in the second heartbeat information.

[0046] According to this configuration, the same operational effects as those of the processing device described in (1) above can be obtained.

[0047] (15) A processing method according to another aspect of the present disclosure is a processing method in a computer, which causes an environmental control device to perform first environmental control for forming an environment that induces a user to rest and second environmental control for forming an environment that induces the user to wake up. After the first environmental control and the second environmental control are completed, response information indicating the user's response to a questionnaire is acquired, and based on the response information, the degree of the user's refreshment is estimated. The questionnaire includes items that ask at least one of head rotation and motivation.

[0048] According to this configuration, the same operational effects as those of the processing device described in (12) above can be obtained.

[0049] A processing device according to another aspect of the present disclosure includes a photodetector, an environmental control device, and a processor. The processor causes the environmental control device to perform first environmental control for forming an environment that induces a user to rest and second environmental control for forming an environment that induces the user to wake up. Based on a first electrical signal generated by the photodetector receiving light from the user during a period in which the first environmental control is being executed, first heartbeat information regarding the user's heartbeat is generated. Based on a second electrical signal generated by the photodetector receiving light from the user during a period in which the second environmental control is being executed, second heartbeat information regarding the user's heartbeat is generated. A numerical value indicating the degree of the user's refreshment is calculated based on a comparison result between the heart rate included in the first heartbeat information and the heart rate included in the second heartbeat information.

[0050] According to this configuration, the same operational effects as those of the processing device described in (1) above can be obtained.

[0051] Further, in order to increase the possibility of inducing a user to a target state by various environmental controls, the inventors have come up with the following aspects shown below.

[0052] (16) In the processing device described in any one of (1) to (11) above, the processor may further acquire third heart rate information relating to the user's heart rate at the end of the first environmental control, determine whether the user is resting based on the heart rate included in the third heart rate information, and if it determines that the user is not resting, perform at least one of extending the first environmental control or changing the environment to be formed by the first environmental control.

[0053] According to this configuration, it is possible to determine whether the user is resting or not based on the user's heart rate at the end of the first environmental control. If it is determined that the user is not resting, it becomes possible to extend the first environmental control or change the environment created by the first environmental control. As a result, the likelihood of inducing the user to rest through the first environmental control can be increased.

[0054] (17) In the processing apparatus described in any one of (1) to (11) and (16) above, the processor may further perform at least one of the following actions if it estimates that the user's refresh level is low: extend the second environment control, strengthen the environment to be formed by the second environment control, or, after the termination of the second environment control, present information to the user prompting them to stretch.

[0055] According to this configuration, if the user's level of refreshment is estimated to be low, it becomes possible to extend the second environment control, strengthen the environment created by the second environment control, or present information to the user encouraging stretching after the end of the second environment control. As a result, the possibility of inducing the user to become alert through the second environment control or stretching after the end of the second environment control can be increased.

[0056] (18) In the processing apparatus described in (11) above, the processor may further acquire fourth heart rate information relating to the user's heart rate at the end of the fourth environmental control, determine whether the user is relaxed based on the heart rate included in the fourth heart rate information, and if it determines that the user is not relaxed, extend the fourth environmental control or change the environment to be formed by the fourth environmental control, or perform at least one of these actions.

[0057] This configuration allows for determining whether the user is relaxed or not based on their heart rate at the end of the fourth environmental control phase. If it is determined that the user is not relaxed, this allows for extending the fourth environmental control phase or changing the environment created by it. As a result, the likelihood of inducing relaxation through the fourth environmental control phase can be increased.

[0058] (19) In the processing apparatus described in (11) or (18) above, the processor may further acquire fifth heart rate information relating to the user's heart rate at the end of the third environmental control, determine whether the user is asleep or not based on the heart rate included in the fifth heart rate information, and if it determines that the user is not asleep, extend the third environmental control.

[0059] This configuration allows for the determination of whether the user is asleep or not based on their heart rate at the end of the third environmental control phase. If it is determined that the user is not asleep, the third environmental control phase can be extended. As a result, the likelihood of inducing sleep through the third environmental control phase can be increased.

[0060] (20) In the processing apparatus described in any one of (1) to (6), (9) to (11), and (16) to (19) above, the processor may further acquire third heart rate information relating to the user's heart rate at the end of the first environmental control, and in estimating the degree of refresh, estimate the degree of refresh based on the comparison result of the heart rate included in the first heart rate information and the heart rate included in the second heart rate information, and the comparison result of the heart rate included in the first heart rate information and the heart rate included in the third heart rate information.

[0061] In this configuration, the degree of user refreshment is estimated based on a comparison of the user's heart rate during the period when the first environmental control is being performed, the user's heart rate during the period when the second environmental control is being performed, and the user's heart rate at the end of the first environmental control.

[0062] Therefore, by comparing the heart rate during the period when the first environmental control is being performed with the heart rate during the period when the second environmental control is being performed and the heart rate at the end of the first environmental control, it is possible to estimate with higher accuracy the degree of user refreshment achieved by performing both the first and second environmental control.

[0063] The embodiments described below are all specific examples of this disclosure. The numerical values, shapes, components, steps, and order of steps shown in the following embodiments are examples only and are not intended to limit this disclosure. Furthermore, among the components in the following embodiments, those not described in the independent claim representing the highest-level concept will be described as optional components. In addition, the contents of each embodiment can be combined.

[0064] The embodiments of this disclosure will be described below with reference to the drawings.

[0065] (First Embodiment) Figure 1 is a block diagram showing the configuration of an information processing system 100 in an embodiment of the present disclosure. As shown in Figure 1, the information processing system 100 includes a processing unit 1, a sensor 2, an environmental control device 3, and a terminal device 4.

[0066] The processing unit 1 is connected to the sensor 2, the environmental control device 3, and the terminal device 4 via a network 8 so as to be able to communicate with them. The processing unit 1 is composed of a computer such as a cloud server or an edge server. If the processing unit 1 is a cloud server, the network 8 is composed of, for example, the internet, and if the processing unit 1 is an edge server, the network 8 is composed of, for example, a local area network. The processing unit 1 may be implemented in any of the environmental control device 3, the sensor 2, or the terminal device 4.

[0067] Sensor 2, environmental control device 3, and terminal device 4 are installed in booth 5. Booth 5 is a space used by user 6 (Figure 2) for rest. Booth 5 includes, for example, a car cabin, bedroom, nap room, private room in an internet cafe, and private space such as a study. The space used by user 6 for rest is not limited to booth 5. The space may be, for example, a space inside a mobile vehicle, such as a seat inside an aircraft or a seat inside a train.

[0068] Sensor 2 is a device that measures information (hereinafter referred to as heart rate information) regarding the heart rate of user 6 (Figure 2) who is present in booth 5. Sensor 2 is composed of, for example, a wristwatch-type electrocardiograph, an electrocardiograph with electrodes attached to the chest, a pulse meter, and a camera. Sensor 2 includes a communication circuit that can communicate with the control device 30 (Figure 2), which will be described later and is provided by the environmental control device 3. Sensor 2 periodically measures the electrocardiogram of user 6 (Figure 2) and transmits information indicating the measured electrocardiogram as heart rate information to the control device 30 (Figure 2).

[0069] Furthermore, sensor 2 may have a photodetector that detects light (reflected light and / or diffused light) from user 6. This photodetector may be, for example, an electrical signal with a signal level corresponding to the received intensity of light incident on the detection surface, or a photodetector that detects light incident at a received intensity above a threshold and converts it into an electrical signal. The photodetector may also be, for example, an image sensor that captures light incident on the detection surface (e.g., the imaging surface) and generates an image signal (electrical signal) with a signal level corresponding to the received intensity.

[0070] Furthermore, the information processing system 100 may include a light source. The photodetector may detect reflected and / or diffused light caused by the illumination light emitted from the light source. The illumination light emitted from the light source may include light in the visible wavelength range or light in the infrared wavelength range. The photodetector may be provided on the back side, which is the side opposite to the display surface of the smartwatch and the side that comes into contact with the user 6. In that case, the light source may be provided on the back side together with the photodetector.

[0071] In this case, the electrical signal output from the photodetector is transmitted to the processing unit 1 via the communication circuit and the control device 30. The processing unit 1 generates heart rate information based on the electrical signal output from the photodetector. For example, the processing unit 1 generates heart rate information by measuring the peak interval of the signal intensity based on the time-dependent change in the signal intensity indicated by the electrical signal.

[0072] Furthermore, the sensor 2 may have electrodes that can be attached to the surface of the user 6's body. These electrodes have an adhesive surface, with an electrode exposed on a portion of the adhesive surface. The adhesive surface may be divided into multiple sections, with an electrode exposed on each section. In this case, the sensor 2 acquires an electrical signal by attaching the electrodes to the user 6's body surface by wrapping them around the body surface with a belt or the like. The sensor 2 has a signal amplification unit, which is composed of an electrical circuit, etc., that amplifies the electrical signal acquired by the electrodes, and a processing unit that processes the electrical signal. The processing unit transmits the electrical signal acquired by the electrodes and amplified by the signal amplification unit to the processing unit 1 via a communication circuit and a control device 30. The sensor 2 may also have a communication circuit and a battery that communicate with the processing unit 1.

[0073] The environmental control device 3 performs control to create the environment inside booth 5 (hereinafter referred to as environmental control). The environment inside booth 5 is an environment that stimulates one of the five senses of the user 6 (Figure 2) inside booth 5. The five senses are sight, hearing, touch, taste, and smell.

[0074] Figure 2 shows an example of the installation location of the environmental control device 3 and the sensor 2. Figure 2 shows an example in which a user 6 is sitting in a massage chair 51 and resting inside a booth 5. Figure 2 shows an example in which a wristwatch-type electrocardiograph is installed inside the booth 5 as the sensor 2. The environmental control device 3 includes a control device 30, a display device 31, a lighting device 32, a speaker 33, a vibration device 34, a fragrance release device 35, and a massage device 36.

[0075] The control device 30 is composed of a stationary computer including a processor, memory, and communication circuit, such as a personal computer. The control device 30 is connected to the sensor 2, display device 31, lighting device 32, speaker 33, vibration device 34, fragrance release device 35, and massage device 36 via the communication circuit.

[0076] The control device 30 transmits heart rate information received by the communication circuit from the sensor 2 to the processing device 1 via the network 8, by controlling the communication circuit. The control device 30 then causes one or more of the devices specified from the display device 31, lighting device 32, speaker 33, vibration device 34, fragrance release device 35, and massage device 36 to perform operations to create the specified environment, according to the control information received by the communication circuit from the processing device 1 via the network 8.

[0077] The display device 31, under the control of the control device 30, displays the instructed video content as an action that stimulates the user's (user's) vision. The display device 31 is composed of, for example, an organic EL display.

[0078] The display device 31 may also be configured as a screen. Under the control of the control device 30, the projector may project video content onto the screen so that the video content is displayed. The screen may be semi-transparent or opaque.

[0079] If booth 5 is a vehicle compartment, the display device 31 may be installed between the front seats and the rear seats. The front seats include the driver's seat, and the rear seats do not include the driver's seat. For example, if the vehicle is a so-called three-row seat vehicle, and the first row of seats includes the driver's seat and the passenger seat, then the seats included in the second and third rows may be the rear seats, and the seats included in the first row of seats (driver's seat and passenger seat) may be the front seats. Alternatively, the seats included in the third row may be the rear seats, and the seats included in the first row of seats (driver's seat and passenger seat) and the seats included in the second row may be the front seats.

[0080] The lighting device 32 includes, for example, a plurality of RGBW type LED (Light Emitting Diode) elements that emit blue light, green light, red light, and white light. Under the control of the control device 30, the lighting device 32 turns on illumination light of the instructed hue and / or brightness as an action that stimulates the user's vision 6.

[0081] The lighting device 32 is installed around the display device 31 and / or the massage chair 51. The lighting device 32 may also be installed on the floor and / or ceiling of the booth 5. Furthermore, the lighting device 32 may be installed above, below, to the left and right of the display device 31. Additionally, the lighting device 32 may be provided on the massage chair 51, etc. Multiple lighting devices 32 may also be installed within the booth 5.

[0082] The lighting device 32 is not limited to RGBW type LED elements, but may also be composed of RGB type LED elements that emit blue light, green light, and red light, or LED elements that emit blue light and white light. The lighting device 32 is not limited to LED elements, but may also be composed of one or more elements capable of emitting colored light.

[0083] The speaker 33, under the control of the control device 30, plays the instructed audio content as an action to stimulate the user's hearing 6. The speaker 33 may be installed in a massage chair 51 or the like. Alternatively, multiple speakers 33 may be installed in the booth 5.

[0084] Under the control of the control device 30, the vibration device 34 applies the instructed vibration to the parts of the massage chair 51 that come into contact with the user's back and lower body, stimulating the user's sense of touch. If the booth 5 is a car interior, the vibration device 34 may be installed in the front and / or rear seats.

[0085] The fragrance release device 35 is configured, for example, as an aroma diffuser. Under the control of the control device 30, the fragrance release device 35 releases the specified fragrance into the booth 5 as an action that stimulates the user's sense of smell 6.

[0086] The massage device 36 is composed of, for example, an air cell that expands and contracts due to the supply and exhaust of air. The massage device 36 is installed in the massage chair 51. Under the control of the control device 30, the massage device 36 stimulates the user's sense of touch by massaging the back of the user's head, back, and lower body while the user is sitting in the massage chair 51, at a specified speed and intensity. In the following description, the massage device 36 is capable of providing a fast massage in the order of "fast," "normal," and "slow," and a strong massage in the order of "strong," "normal," and "weak."

[0087] Furthermore, the environmental control device 3 may include at least one of the following devices: a display device 31, a lighting device 32, a speaker 33, a vibration device 34, a fragrance release device 35, and a massage device 36, and the control device 30. The control device 30 is not limited to being installed inside the booth 5, but may also be installed outside the booth 5 in a location where it can communicate with the aforementioned at least one device.

[0088] Furthermore, each of the devices, at least one of the display device 31, lighting device 32, speaker 33, vibration device 34, fragrance release device 35, and massage device 36, and the sensor 2, may be equipped with a communication circuit that communicates with the processing device 1 via the network 8. In this case, the environmental control device 3 may not be equipped with the control device 30.

[0089] Terminal device 4 is an information processing device owned by user 6. Terminal device 4 consists of, for example, a portable computer such as a smartphone, tablet terminal or notebook computer, and a stationary computer. Terminal device 4 includes an input device for inputting various information and instructions into terminal device 4, a display for displaying various information, a speaker, a processor, and a communication circuit.

[0090] The terminal device 4 presents the information indicated by the information presentation instruction received from the processing device 1 via the network 8 by the communication circuit. Presenting the information indicated by the presentation instruction includes displaying the information indicated by the presentation instruction on a display and outputting audio representing the information indicated by the presentation instruction to a speaker. The terminal device 4 may also be used as the control device 30 (Figure 2).

[0091] Returning to Figure 1, the processing unit 1 includes a storage unit 11, a communication unit 12, and a control unit 10. The control unit 10 is communicated with the storage unit 11 and the communication unit 12.

[0092] The storage unit 11 is composed of a non-volatile, rewritable storage device such as a hard disk drive or a solid-state drive. The storage unit 11 stores various data used by the control unit 10.

[0093] The communication unit 12 is composed of a communication circuit that connects the processing unit 1 to the network 8. The communication unit 12 receives heart rate information transmitted from the sensor 2 to the processing unit 1 and outputs the received heart rate information to the control unit 10. Under the control of the control unit 10, the communication unit 12 transmits control information to the control device 30 (Figure 2) via the network 8. Under the control of the control unit 10, the communication unit 12 transmits an information presentation instruction to the terminal device 4 via the network 8.

[0094] The control unit 10 is composed of a microcontroller (computer) which includes a processor such as a central processing unit (CPU), a ROM that stores the control program, and a memory such as RAM. If the booth 5 is a vehicle compartment, the control unit 10 may be an ECU (Electronic Control Unit) that is standard equipment on the vehicle, or it may be configured separately from the ECU.

[0095] The control unit 10 includes an execution unit 101, a calculation unit 102, an estimation unit 103, and an output unit 104.

[0096] The execution unit 101 causes the environment control device 3 to perform a first environment control to create an environment that induces the user 6 to rest, and then causes the environment control device 3 to perform a second environment control to create an environment that induces the user 6 to wake up.

[0097] Specifically, the execution unit 101 first causes the environment control device 3 to perform a fourth environmental control (a first environmental control) that creates an environment that induces the user 6 to relax, and then causes the environment control device 3 to perform a third environmental control (a third environmental control) that creates an environment that induces the user 6 to take a nap. After the first environmental control, the execution unit 101 causes the environment control device 3 to perform a second environmental control.

[0098] Hereafter, the period during which the first environmental control, which creates an environment that induces user 6 to relax, is performed will be referred to as the relaxation period. The period during which the first environmental control, which creates an environment that induces user 6 to take a nap, is performed will be referred to as the nap period. The period during which the second environmental control is performed will be referred to as the wake period.

[0099] (First environmental control during the relaxation period) Figure 3 is a diagram showing an example of the control contents of the first and second environmental controls. In detail, when the start of the relaxation period is reached, the execution unit 101 transmits control information to the control device 30, along with the data of the video content, instructing the display device 31 to display a predetermined video content showing nature. As a result, the display device 31 displays the video content under the control of the control device 30 during the relaxation period. The data of the video content is stored in the storage unit 11 in advance. The video content is a video that shows nature as the subject, which changes over time from an image corresponding to a green hue (hereinafter referred to as the first image) to an image corresponding to a blue hue (hereinafter referred to as the second image).

[0100] The first video is one in which, when viewed on a time-average basis, the area of ​​green hues is larger than the area of ​​hues other than green. The area of ​​a certain hue when viewed on a time-average basis in a given video refers to the average number of pixels of that hue contained in each still image when multiple still images are extracted from the video at predetermined time intervals. In other words, when multiple still images are extracted from the first video at predetermined time intervals, the average number of pixels of green hues contained in each still image is greater than the average number of pixels of hues other than green contained in each still image.

[0101] Here, the green hue refers to the hue included in the chromaticity of "green" or "yellow-green" as defined in JIS Z 8701. The green hue is known to have the effect of easing tension and stabilizing the psychological state of a person who views images of that hue. As the first image, for example, images of a forest or a lush green river taken during the daytime can be used.

[0102] The second video is one in which, when viewed on a time-averaged basis, the area of ​​blue hues is larger than the area of ​​hues other than blue. In other words, when multiple still images are extracted from the second video at predetermined time intervals, the average number of blue hues in each still image is greater than the average number of pixels of hues other than blue in each still image.

[0103] Here, the blue hue refers to the hue included in the chromaticity of "blue," "blue-green," or "blue-violet" as defined in JIS Z 8701. The blue hue is known to have a calming effect on the psychological state of a person who views images of that hue. As a second image, for example, footage of a forest at night can be used.

[0104] Furthermore, when the relaxation period begins, the execution unit 101 transmits control information to the control device 30, along with the data for the predetermined sound content, which represents a babbling brook or bird song, to the speaker 33. The data for the sound content is stored in the storage unit 11 beforehand. As a result, the speaker 33 outputs the sound content under the control of the control device 30 during the relaxation period.

[0105] Furthermore, when the relaxation period begins, the execution unit 101 transmits control information to the control device 30 instructing the lighting device 32 to turn on a green-hued illumination light and then change the color of the illumination light to blue over time. The color of the illumination light is specified, for example, by the hue value, lightness value, and saturation value of the illumination light or the corresponding RGBW values. As a result, during the relaxation period, the lighting device 32, under the control of the control device 30, turns on a green-hued illumination light and then changes the color of the illumination light to blue over time.

[0106] When the start of the relaxation period is reached, the execution unit 101 transmits control information to the control device 30 instructing the fragrance release device 35 to release a fragrance that indicates the scent of cedar. As a result, during the relaxation period, the fragrance release device 35 releases a fragrance that indicates the scent of cedar under the control of the control device 30.

[0107] The execution unit 101 transmits control information to the control device 30 instructing the massage device 36 to perform a "slow" and "weak" massage. As a result, during the relaxation period, the massage device 36 performs a "slow" and "weak" massage under the control of the control device 30.

[0108] (First environmental control during nap period) When the relaxation period ends and the nap period begins, the execution unit 101 transmits control information to the control device 30, along with the data for the black video content, instructing the display device 31 to display a predetermined black video content. As a result, the display device 31 displays the black video content during the nap period under the control of the control device 30.

[0109] The data for the black video content is pre-stored in the storage unit 11. This black video content has lower brightness than the second video and provides less visual stimulation to the user 6 than the second video. This video is content that displays a video (hereinafter referred to as the third video) in which the color or brightness fluctuates periodically (a fluctuating video).

[0110] As the third image, for example, an image such as a signal waveform with a black background can be used, in which the area that is blacked out is larger than the area that is not blacked out when viewed on a time average. The blacked-out area refers to the area that is perceived as black by the user 6. In other words, when multiple still images are extracted from the third image at predetermined time intervals, the average number of blacked-out pixels in each still image is greater than the average number of non-blacked-out pixels in each still image.

[0111] When the nap period begins, the execution unit 101 transmits control information to the control device 30, along with the data for the predetermined sound content, instructing the speaker 33 to output a predetermined sound content that is silent or soft. The data for the sound content is stored in the storage unit 11 beforehand. As a result, the speaker 33 outputs the sound content under the control of the control device 30 during the nap period.

[0112] When the nap period begins, the execution unit 101 transmits control information to the control device 30 instructing the lighting device 32 to either turn off the lighting or dimly illuminate the lighting. As a result, during the nap period, the lighting device 32 will either turn off the lighting or dimly illuminate the lighting under the control of the control device 30. For example, when the lighting device 32 dimly illuminates the lighting, it will illuminate the lighting so that the horizontal illuminance at the user's eye level is 30 lx or less.

[0113] When the start of the nap period is reached, the execution unit 101 transmits control information to the control device 30 instructing the fragrance release device 35 to stop releasing fragrance. As a result, the fragrance release device 35 stops releasing fragrance during the nap period under the control of the control device 30.

[0114] The execution unit 101 transmits control information to the control device 30 instructing the massage device 36 to stop its massage operation. As a result, the massage device 36 stops its massage operation under the control of the control device 30 during the nap period.

[0115] In this embodiment, we will describe an example in which the execution unit 101 instructs the environmental control device 3 to perform environmental control (third environmental control) to create an environment that induces the user 6 to take a nap during the nap period. However, the control (third environmental control) that the execution unit 101 instructs the environmental control device 3 to perform during the nap period may more broadly be environmental control that creates an environment that induces the user 6 to sleep.

[0116] (Second environmental control during the wakefulness period) When the nap period ends and the wakefulness period begins, the execution unit 101 transmits control information to the control device 30, along with the data of the video content, instructing the display device 31 to display a predetermined video content. As a result, the display device 31 displays the video content under the control of the control device 30 during the wakefulness period.

[0117] The data for the video content is pre-stored in the storage unit 11. The video content is such that, as time progresses, it changes from a third image to an image showing sunlight filtering through trees (hereinafter referred to as the fourth image), and then changes to an image featuring natural objects as the subject.

[0118] As the fourth image, we can use an image showing dappled sunlight where, when viewed on a time average, the area of ​​whiteout is larger than the area of ​​non-whiteout. The area of ​​whiteout refers to the area that is perceived as white by user 6. In other words, when multiple still images are extracted from the fourth image at predetermined time intervals, the average number of whiteout pixels in each still image is greater than the average number of non-whiteout pixels in each still image.

[0119] When the start of the wakefulness period, the execution unit 101 transmits control information to the control device 30, along with the data for the audio content, instructing the speaker 33 to output a predetermined audio content that indicates a song whose volume gradually increases. The data for the audio content is stored in the storage unit 11 beforehand. As a result, the speaker 33 outputs the audio content under the control of the control device 30 during the wakefulness period.

[0120] Furthermore, when the start of the wakefulness period is reached, the execution unit 101 transmits control information to the control device 30 instructing the lighting device 32 to turn on the gradually increasing light. The gradually increasing light is a standard color illumination light in the lighting device 32, whose brightness gradually increases. As a result, the lighting device 32 turns on the gradually increasing light during the wakefulness period under the control of the control device 30.

[0121] When the start of the wakefulness period is reached, the execution unit 101 transmits control information to the control device 30 instructing the fragrance release device 35 to release a fragrance exhibiting a citrus scent. As a result, during the wakefulness period, the fragrance release device 35 releases a fragrance exhibiting a citrus scent under the control of the control device 30.

[0122] When the start of the wakefulness period, the execution unit 101 transmits control information to the control device 30 instructing the vibration device 34 to apply vibrations corresponding to the volume of the music output by the speaker 33. As a result, during the wakefulness period, the vibration device 34, under the control of the control device 30, applies vibrations corresponding to the volume of the music output by the speaker 33 to the parts of the massage chair 51 that come into contact with the user's back and lower body.

[0123] A vibration corresponding to the volume of a song is a vibration with an amplitude at the same level as the volume level of the song. For example, suppose the speaker 33 can adjust the volume in 10 steps and the vibration device 34 can adjust the amplitude of the vibration in 5 steps. In this case, when the volume of the song output by the speaker 33 is at the fourth highest volume, the vibration device 34 will apply the second highest amplitude vibration to the parts of the massage chair 51 that come into contact with the user's back and lower body.

[0124] The execution unit 101 transmits control information to the control device 30 instructing the massage device 36 to perform a "fast" and "strong" massage. As a result, during the awake period, the massage device 36 performs a fast and strong massage under the control of the control device 30.

[0125] The calculation unit 102 acquires the user 6's heart rate information (hereinafter referred to as "first heart rate information") received by the communication unit 12 during the period in which the first environment control is being performed by the execution unit 101.

[0126] For example, the first heart rate information is the heart rate information of user 6 at the start of the first environmental control. The start of the first environmental control is the period from the start to the end of the relaxation period. However, the start of the first environmental control is not limited to this, and may be a predetermined time including the start of the relaxation period, a predetermined time before or after the start of the relaxation period, or a predetermined time within the relaxation period.

[0127] Furthermore, the first heart rate information is not limited to the user's heart rate information at the start of the first environmental control, but may also be the user's heart rate information during the period from the start of the relaxation period to the end of the nap period.

[0128] The calculation unit 102 acquires the user 6's heart rate information (hereinafter referred to as "second heart rate information") received by the communication unit 12 during the period in which the second environment control is being performed by the execution unit 101. For example, the second heart rate information is the user 6's heart rate information from the start to the end of the wakefulness period.

[0129] However, the second heart rate information is not limited to this; it may also be heart rate information from multiple users 6 received within a predetermined time period including the end of the wakefulness period, or heart rate information from multiple users 6 received between the end of the wakefulness period and the end of a predetermined time period.

[0130] The calculation unit 102 calculates the heart rate included in the first heart rate information (hereinafter referred to as the first heart rate). Specifically, if the first heart rate information indicates one electrocardiogram, the calculation unit 102 calculates one heart rate based on the R-R interval (interval from R wave to R wave) in the said electrocardiogram using a known calculation method, and sets this as the first heart rate.

[0131] If the first heart rate information shows multiple electrocardiograms, the calculation unit 102 calculates multiple heart rates based on the R-R interval in each of the multiple electrocardiograms using a known calculation method, and sets the average value of the multiple heart rates (first average heart rate) as the first heart rate.

[0132] The calculation unit 102 calculates the heart rate included in the second heart rate information (hereinafter referred to as the second heart rate). Specifically, if the second heart rate information indicates an electrocardiogram 1, the calculation unit 102 calculates the heart rate 1 based on the R-R interval in the electrocardiogram 1 using a known calculation method, and sets this as the second heart rate.

[0133] When the second heart rate information shows multiple electrocardiograms, the calculation unit 102 calculates multiple heart rates based on the R-R interval in each of the multiple electrocardiograms using a known calculation method, and sets the average value of the multiple heart rates (second average heart rate) as the second heart rate.

[0134] The second heart rate information is assumed to be the heart rate information of multiple users 6 received by the communication unit 12 between the start and end of the wakefulness period. In this case, the calculation unit 102 may calculate the average of the multiple heart rates at a point later than the first peak heart rate among the multiple calculated heart rates as the second heart rate. Alternatively, the calculation unit 102 may calculate the amount of change over time of the multiple calculated heart rates and calculate the average of the multiple heart rates from the point in time when the amount of change over time falls below a predetermined value as the second heart rate. Alternatively, the calculation unit 102 may extract multiple heart rates from the multiple calculated heart rates from the point in time when the difference between the maximum and minimum heart rates within a predetermined time period first falls below a predetermined value, and calculate the average of the extracted multiple heart rates as the second heart rate.

[0135] The estimation unit 103 estimates (determines or judges) the degree of refreshment of the user 6 based on the comparison result of the first heart rate and the second heart rate. The degree of refreshment can also be described as the degree to which the user feels refreshed, the degree to which they feel energetic, or the degree to which they feel they can perform well afterward. Performance refers to performance in cognitive activities such as meetings and work, and physical activities such as sports.

[0136] Specifically, the estimation unit 103 estimates that the degree to which the second heart rate exceeds the first heart rate is higher, and that the user 6 is more refreshed. For example, the estimation unit 103 may determine a numerical value indicating the user 6's refresh level. The estimation unit 103 may determine a numerical value indicating the user 6's refresh level such that the greater the degree to which the second heart rate exceeds the first heart rate, the larger this value becomes. Alternatively, the estimation unit 103 may determine a binary value indicating whether the user 6 is more refreshed or not. The estimation unit 103 may determine that the user 6 is more refreshed when the second heart rate exceeds the first heart rate, and that the user 6 is less refreshed when the second heart rate falls below the first heart rate. Alternatively, the estimation unit 103 may determine that the user 6 has a high degree of refreshment if the difference between the second heart rate and the first heart rate (second heart rate - first heart rate) is greater than or equal to a predetermined threshold, and determine that the user 6 has a low degree of refreshment if the difference is less than the threshold.

[0137] The output unit 104 outputs the estimation result of the user 6's refresh rate calculated by the estimation unit 103. Specifically, the output unit 104 controls the communication unit 12 to send an instruction to the terminal device 4 to present information indicating the estimation result of the user 6's refresh rate calculated by the estimation unit 103. As a result, the terminal device 4 presents the information indicated by the instruction in accordance with the instruction.

[0138] Furthermore, the output unit 104 may transmit control information to the control device 30, along with the information indicating the estimation result, instructing the communication unit 12 to display information indicating the estimation result of the user 6's refresh rate by the estimation unit 103 on the display device 31. This may cause the display device 31 to display the information indicating the estimation result.

[0139] Furthermore, if the sensor 2 and / or terminal device 4 are equipped with a display, the output unit 104 may transmit control information to the control device 30, along with the information indicating the estimation result, instructing the communication unit 12 to display information indicating the estimation result of the user 6's refresh rate by the estimation unit 103 on the sensor 2 and / or terminal device 4. This allows the sensor 2 and / or terminal device 4 to display the information indicating the estimation result on its own display.

[0140] Alternatively, the output unit 104 may transmit control information to the control device 30 instructing the communication unit 12 to output a sound to the speaker 33 indicating the estimation result of the user 6's refresh rate by the estimation unit 103. This may cause the speaker 33 to output the sound indicating the estimation result.

[0141] Furthermore, the output unit 104 may store information in the storage unit 11 indicating the estimation result of the estimation unit 103's assessment of the user 6's refresh rate. In conjunction with this, the output unit 104 may output the estimation result of the estimation unit 103's assessment of the user 6's refresh rate together with the previous estimation result of the estimation unit 103's assessment of the user 6's refresh rate. This allows the sensor 2 and display device 31, which are equipped with a display, to simultaneously display information indicating the previous and current estimation results of the user 6's refresh rate.

[0142] Next, the refresh rate estimation process performed by the processing unit 1 in the first embodiment will be described. Figure 4 is a flowchart showing a first example of the refresh rate estimation process performed by the processing unit 1.

[0143] When the communication unit 12 receives an instruction from the terminal device 4 to start the refresh rate estimation process shown in Figure 4, the control unit 10 starts the refresh rate estimation process shown in Figure 4. This instruction is input by the user 6 through operation of the terminal device 4. However, the control unit 10 is not limited to this; it may also start the refresh rate estimation process shown in Figure 4 when the communication unit 12 receives heart rate information from the control device 30 of the user 6.

[0144] (Step S01) In step S01, the execution unit 101 causes the environment control device 3 to execute a first environment control that creates an environment that guides the user 6 to rest.

[0145] (Step S02) In step S02, the calculation unit 102 acquires first heart rate information, which is the heart rate information of user 6 received by the communication unit 12 during the period in which the first environment control is being executed. The calculation unit 102 calculates the first heart rate, which is the heart rate included in the first heart rate information.

[0146] (Step S03) In step S03, the execution unit 101 causes the environment control device 3 to execute a second environment control that creates an environment that induces the user 6 to become awake.

[0147] (Step S04) In step S04, the calculation unit 102 acquires second heart rate information, which is the heart rate information of user 6 received by the communication unit 12 during the period in which the second environment control is being performed. The calculation unit 102 calculates the second heart rate, which is the heart rate included in the second heart rate information.

[0148] (Step S05) In step S05, the estimation unit 103 calculates the difference between the second heart rate and the first heart rate (second heart rate - first heart rate). If the difference between the second heart rate and the first heart rate is positive (YES in step S05), the estimation unit 103 executes step S06. If the difference between the second heart rate and the first heart rate is 0 or less (NO in step S05), the estimation unit 103 executes step S07. Alternatively, the YES or NO in step S05 may be determined based on whether the difference between the second heart rate and the first heart rate exceeds a predetermined threshold. A threshold value of -4 bpm or more and 4 bpm or less can be used. That is, if the difference exceeds the threshold, the system may determine YES in step S05, and if the difference does not exceed the threshold, the system may determine NO in step S05.

[0149] (Step S06) In step S06, the estimation unit 103 estimates that the user 6 has a high degree of refreshment. (Step S07) In step S07, the estimation unit 103 estimates that the user 6 has a low degree of refreshment. After steps S06 and S07, the output unit 104 executes step S08.

[0150] (Step S08) In step S08, the output unit 104 outputs the estimated result of the refresh rate performed by the estimation unit 103 in step S06 or step S07. After step S08, the control unit 10 terminates the refresh rate estimation process.

[0151] As described above, in the configuration of this embodiment, the degree of refreshment of user 6 is estimated based on a comparison between the first heart rate, which is the user 6's heart rate during the period in which the first environmental control is performed, and the second heart rate, which is the user 6's heart rate during the period in which the second environmental control is performed, and this estimation result is output. Therefore, the degree to which user 6 has been refreshed by the first and second environmental control can be evaluated quantitatively and objectively based on the outputted estimation result.

[0152] Incidentally, a typical computer system for estimating a user's state is thought to have a configuration that constantly acquires and / or processes information from sensors in order to capture changes in state, and processes while accumulating a vast amount of time-series data in memory. Such a configuration presents the challenge of a large computational load on the control unit 10 (processor).

[0153] In contrast, the processing unit 1 in this embodiment has a configuration in which, during a specific period in which the execution unit 101 has performed the first and second environmental control, the calculation unit 102 selectively acquires and / or processes the necessary heart rate information (first heart rate information and second heart rate information) (for example, in steps S02 and S04). In other words, this configuration reduces the computational load on the control unit 10 and improves the performance of the computer by intentionally not acquiring and / or processing data for periods that are unnecessary for estimating the degree of refreshment of the user 6.

[0154] In addition, in the first embodiment, the estimation unit 103 may, instead of step S05, estimate that the greater the degree to which the second heart rate exceeds the first heart rate (i.e., second heart rate - first heart rate), the higher the degree of refreshment of the user 6. Accordingly, steps S06 and S07 may be omitted.

[0155] According to this configuration, the greater the degree to which the second heart rate exceeds the first heart rate, the higher the estimated degree of user 6's refreshment. Therefore, the degree to which user 6 has been refreshed by the first and second environmental controls can be evaluated more quantitatively than when it is estimated using a binary value of whether or not it is higher than a predetermined degree.

[0156] (Second Embodiment) In the first embodiment, an example was described in which the estimation unit 103 estimates the degree of refreshment of user 6 based on the comparison result of the first heart rate and the second heart rate. In the second embodiment, the estimation unit 103 acquires response information indicating the user 6's answers to the questionnaire before the start and after the end of the first and second environmental control, and estimates the degree of refreshment of user 6 based on said response information.

[0157] Specifically, the questionnaire is pre-stored in the memory unit 11. Figure 5 shows an example of a questionnaire. For example, as shown in Figure 5, the questionnaire includes multiple questionnaire items asking about "mental agility," "motivation," "awakening," and "stress." In the example in Figure 5, the questionnaire asking about "mental agility" includes 3 questionnaire items. The questionnaire asking about "motivation" includes 4 questionnaire items. The questionnaire asking about "awakening" includes 3 questionnaire items. The questionnaire asking about "stress" includes 7 questionnaire items.

[0158] Furthermore, the questionnaire is not limited to the example shown in Figure 5; it should include questionnaire items that ask about at least one of "mental agility" and "motivation." Also, questionnaire items that ask about "awakening" and / or "stress," which can be used to subjectively evaluate a state different from the degree of refreshment, may be omitted.

[0159] The estimation unit 103 controls the communication unit 12 to send a display instruction to the terminal device 4 for an operation screen (hereinafter referred to as the questionnaire screen) for inputting answers to the questionnaire. The terminal device 4 then displays the questionnaire screen on its own display in accordance with the display instruction received from the processing unit 1. However, the terminal device 4 is not limited to this; it may also display the questionnaire screen on the display device 31. Furthermore, if the sensor 2 has a display, the terminal device 4 may display the questionnaire screen on the display of the sensor 2.

[0160] The survey screen includes display fields for multiple survey items and answer fields for entering responses to each of the survey items. The answer fields are configured to allow users to input responses to each survey item using methods such as a visual analog scale (VAS), a five-point rating scale, binary selection, or voice input.

[0161] When user 6 operates terminal device 4 and enters an answer to the questionnaire into the answer field on the questionnaire screen, terminal device 4 sends information indicating the answer to that questionnaire back to processing device 1. Estimation unit 103 acquires the information indicating the answers to multiple questionnaires received by communication unit 12 from terminal device 4 as answer information.

[0162] The memory unit 11 stores a trained model (hereinafter referred to as the first model) generated by machine learning, in which the explanatory variables are the response information obtained from each of the multiple users 6 before the start of the first and second environmental control and the response information obtained from each of the multiple users 6 after the completion of the first and second environmental control, and the dependent variable is information indicating the degree of refreshment (hereinafter referred to as refresh information) that each of the multiple users 6 self-evaluated after the completion of the first and second environmental control. For machine learning, algorithms such as logistic regression, multiple regression, SVM, decision trees, and neural networks can be employed.

[0163] In the first machine learning model, the target variable can be a binary value indicating whether the degree of refresh is high or low. Alternatively, to indicate, for example, what score or level the degree of refresh is, a numerical value representing the degree of refresh may be used as the target variable in the first machine learning model.

[0164] The estimation unit 103 inputs the response information obtained before the start of the first and second environmental control and the response information obtained after the end of the first and second environmental control to the first model. At this time, the estimation unit 103 outputs the refresh information output by the first model as the estimated result of the degree of refreshment of the user 6.

[0165] Next, the refresh rate estimation process performed by the processing unit 1 in the second embodiment will be described. Figure 6 is a flowchart of the second example of the refresh rate estimation process performed by the processing unit 1. In the following, steps that are the same as those described in the first embodiment will be denoted by the same reference numerals as in the first embodiment, and their descriptions will be omitted.

[0166] When the communication unit 12 receives a command from the terminal device 4 to start the refresh rate estimation process shown in Figure 6, the control unit 10 starts the refresh rate estimation process shown in Figure 6. This command is input by the user 6 through operation of the terminal device 4. However, the control unit 10 is not limited to this; it may also start the refresh rate estimation process shown in Figure 6 when the communication unit 12 receives heart rate information from the control device 30 of the user 6.

[0167] (Step S11) In step S11, the estimation unit 103 obtains response information (hereinafter referred to as pre-experience response information) that shows the user 6's response to the questionnaire.

[0168] After step S11 is completed, the first environmental control is performed in step S01, and the second environmental control is performed in step S03.

[0169] (Step S12) In step S12, the estimation unit 103 obtains response information (hereinafter referred to as post-experience response information) that shows the user 6's response to the questionnaire.

[0170] (Step S13) In step S13, the estimation unit 103 estimates the degree of refreshment of user 6 based on the pre-experience response information obtained in step S11 and the post-experience response information obtained in step S12. In the next step S08, the output unit 104 outputs the estimation result of the degree of refreshment performed by the estimation unit 103 in step S13.

[0171] When the first and second environmental controls are executed while the user 6 is highly refreshed, the user 6's level of refreshment may decrease. However, according to the configuration of this embodiment, even in such cases, the degree to which the user 6 has been refreshed by the first and second environmental controls can be easily and accurately estimated by taking into account at least one of the user 6's mental agility and motivation before the first and second environmental controls are executed, as indicated by the pre-experience response information.

[0172] Furthermore, in the refresh rate estimation process in the second embodiment (Figure 6), step S11 may be omitted. Accordingly, the estimation unit 103 may estimate the refresh rate of user 6 in step S13 based on the response information after the experience. This configuration can be implemented, for example, as follows.

[0173] The memory unit 11 stores a trained model (hereinafter referred to as the second model) generated by machine learning, in which the response information obtained from each of the multiple users 6 after the completion of the first and second environmental control processes is used as explanatory variables and the refresh information is used as the target variable. For machine learning, algorithms such as logistic regression, multiple regression, SVM, decision trees, and neural networks can be employed. Similar to the target variable in the first model's machine learning, the target variable in the second model's machine learning can be binary information indicating whether the refresh rate is high or low, or a numerical value indicating the refresh rate.

[0174] In step S13, the estimation unit 103 outputs the refresh information that the second model outputs when it inputs the response information acquired after the completion of the first and second environmental control as an estimated result of the degree of refreshment of the user 6.

[0175] According to this configuration, the degree of user 6's refreshment is estimated based on the post-experience response information obtained after the completion of the first and second environmental control processes. Therefore, by taking into account the subjective responses of user 6 regarding at least one of their mental agility and motivation after the completion of the first and second environmental control processes, the degree to which user 6 was refreshed by the first and second environmental control processes can be easily estimated.

[0176] (Third Embodiment) In the first embodiment, an example was described in which the estimation unit 103 estimates the degree of refreshment of user 6 based on the comparison result of the first heart rate and the second heart rate. In the second embodiment, an example was described in which the estimation unit 103 estimates the degree of refreshment of user 6 based on pre-experience response information and post-experience response information. In the third embodiment, the estimation unit 103 estimates the degree of refreshment of user 6 based on the comparison result of the first heart rate and the second heart rate, pre-experience response information, and post-experience response information.

[0177] Figure 7 is a flowchart showing a third example of the refresh rate estimation process performed by the processing unit 1. In the following, steps that are the same as those described in the first and second embodiments will be denoted by the same reference numerals as in the first and second embodiments, and their descriptions will be omitted.

[0178] Specifically, when the communication unit 12 receives an instruction from the terminal device 4 to start the refresh rate estimation process shown in Figure 7, the control unit 10 starts the refresh rate estimation process shown in Figure 7. This instruction is input by the user 6 through operation of the terminal device 4. However, the control unit 10 is not limited to this; it may also start the refresh rate estimation process shown in Figure 7 when the communication unit 12 receives heart rate information from the control device 30 of the user 6.

[0179] In the third embodiment, similar to the second embodiment, after pre-experience response information is acquired in step S11, the first environment control is performed in step S01. After step S01, similar to the first embodiment, the first heart rate information is acquired and the first heart rate is calculated in step S02. After step S02, similar to the first embodiment, the second environment control is performed in step S03, and the second heart rate information is acquired and the second heart rate is calculated in step S04. After step S04, similar to the second embodiment, post-experience response information is acquired in step S12.

[0180] (Step S21) In the next step S21, the estimation unit 103 estimates the degree of refreshment of user 6 based on the comparison result of the first heart rate calculated in step S02 and the second heart rate calculated in step S04, the pre-experience response information obtained in step S11, and the post-experience response information obtained in step S12.

[0181] Specifically, the memory unit 11 stores a trained model (hereinafter referred to as the third model) generated by machine learning, with refresh information as the dependent variable, and the results of subtracting the first heart rate from the second heart rate of each of the multiple users 6 (= second heart rate - first heart rate), pre-experience response information obtained from each of the multiple users 6, and post-experience response information obtained from each of the multiple users 6 as explanatory variables. For this machine learning, algorithms such as logistic regression, multiple regression, SVM, decision trees, and neural networks can be employed. Similar to the dependent variable in the first model's machine learning, the dependent variable in the third model's machine learning can be binary information indicating whether the degree of refresh is high or low, or a numerical value indicating the degree of refresh.

[0182] The estimation unit 103 inputs the result of subtracting the first heart rate calculated in step S02 from the second heart rate calculated in step S04, the pre-experience response information obtained in step S11, and the post-experience response information obtained in step S12 to the third model. At this time, the estimation unit 103 outputs the refresh information output by the third model as the estimated result of the degree of refreshment of user 6.

[0183] In the next step, S08, the output unit 104 outputs the estimated result of the refresh rate calculated by the estimation unit 103 in step S21.

[0184] According to the configuration of this embodiment, the degree of refreshment of user 6 is estimated not only based on the comparison result between the first heart rate and the second heart rate, but also based on the response information acquired before and after the execution of the first and second environmental control. Therefore, by taking into account the subjective responses of user 6 regarding at least one of their mental agility and motivation before and after the execution of the first and second environmental control, the degree to which user 6 has been refreshed by the first and second environmental control can be estimated with high accuracy.

[0185] In addition, step S12 may be omitted in the refresh rate estimation process in the third embodiment (Figure 7). Accordingly, the estimation unit 103 may estimate the refresh rate of user 6 in step S21 based on the comparison result of the first heart rate calculated in step S02 and the second heart rate calculated in step S04, and the pre-experience response information obtained in step S11. This configuration can be realized, for example, as follows.

[0186] The memory unit 11 stores a trained model (hereinafter referred to as the fourth model) generated by machine learning, with the result of subtracting the first heart rate from the second heart rate of each of the multiple users 6 (= second heart rate - first heart rate), and the pre-experience response information obtained from each of the multiple users 6, as explanatory variables, and refresh information as the objective variable. For machine learning, algorithms such as logistic regression, multiple regression, SVM, decision trees, and neural networks can be used. Similar to the objective variable in the first model, the objective variable in the fourth model's machine learning can be binary information indicating whether the degree of refresh is high or low, or a numerical value indicating the degree of refresh.

[0187] In step S21, the estimation unit 103 inputs the comparison result between the first heart rate calculated in step S02 and the second heart rate calculated in step S04, along with the pre-experience response information obtained in step S11, to the fourth model. At this time, the estimation unit 103 outputs the refresh information output by the fourth model as the estimated result of the user 6's refresh level.

[0188] When the first and second environmental controls are executed while user 6 is highly refreshed, user 6's level of refreshment may decrease. However, with this configuration, even in such cases, the degree to which user 6 has been refreshed by the first and second environmental controls can be accurately estimated by taking into account at least one of user 6's mental agility and motivation before the first and second environmental controls are executed.

[0189] Alternatively, in the refresh rate estimation process in the third embodiment (Figure 7), step S11 may be omitted. Accordingly, the estimation unit 103 may, in step S21, estimate the refresh rate of user 6 based on the comparison result of the first heart rate calculated in step S02 and the second heart rate calculated in step S04, and the post-experience response information obtained in step S12. This configuration can be realized, for example, as follows.

[0190] The memory unit 11 stores a trained model (hereinafter referred to as the fifth model) generated by machine learning, with the result of subtracting the first heart rate from the second heart rate of each of the multiple users 6 (= second heart rate - first heart rate), and the post-experience response information obtained from each of the multiple users 6, as explanatory variables, and refresh information as the objective variable. For machine learning, algorithms such as logistic regression, multiple regression, SVM, decision trees, and neural networks can be used. Similar to the objective variable in the first model's machine learning, the objective variable in the fifth model's machine learning can be binary information indicating whether the degree of refreshment is high or low, or a numerical value indicating the degree of refreshment.

[0191] In step S21, the estimation unit 103 inputs the comparison result between the first heart rate calculated in step S02 and the second heart rate calculated in step S04, and the post-experience response information obtained in step S12, to the fifth model. At this time, the estimation unit 103 outputs the refresh information output by the fifth model as the estimated result of the degree of refreshment of the user 6.

[0192] With this configuration, the degree of user 6's refreshment is estimated not only based on the comparison results between the first and second heart rates, but also on the response information obtained after the completion of the first and second environmental control processes. Therefore, by taking into account the subjective responses of user 6 regarding at least one of their mental agility and motivation after the completion of the first and second environmental control processes, the degree to which user 6 was refreshed by the first and second environmental control processes can be estimated with high accuracy.

[0193] (Fourth Embodiment) In the first to third embodiments, even if the first environmental control is performed, it is not necessarily guaranteed that the user 6 will be guided to rest. Similarly, even if the second environmental control is performed, it is not necessarily guaranteed that the user 6 will be guided to wakefulness.

[0194] Therefore, in the fourth embodiment, the estimation unit 103 further determines whether the user 6 is resting or not based on the heart rate information included in the information regarding the user's heart rate at the end of the first environmental control. If the estimation unit 103 determines that the user 6 is not resting, the execution unit 101 performs at least one of the following: extend the first environmental control or change the environment that is to be formed by the first environmental control.

[0195] Furthermore, if the estimation unit 103 estimates that the user 6's refresh level is low, the execution unit 101 performs at least one of the following actions: extend the second environment control, strengthen the environment to be formed by the second environment control, or, after the end of the second environment control, present information to the user 6 prompting them to stretch.

[0196] Figures 11 and 12 are flowcharts illustrating a fourth example of the refresh rate estimation process performed by the processing unit 1. In the following, steps that are the same as those described in the first to third embodiments will be denoted by the same reference numerals as in the first to third embodiments, and their descriptions will be omitted.

[0197] Specifically, when the communication unit 12 receives a command from the terminal device 4 to start the refresh rate estimation process shown in Figure 11, the control unit 10 starts the refresh rate estimation process shown in Figure 11. This command is input by the user 6 through operation of the terminal device 4. However, the control unit 10 is not limited to this; it may also start the refresh rate estimation process shown in Figure 11 when the communication unit 12 receives heart rate information from the control device 30 of the user 6.

[0198] (Step S31) In step S31, the calculation unit 102 acquires the user 6's heart rate information received by the communication unit 12 during the period from the start of the refresh rate estimation process until a predetermined time has elapsed, as heart rate information before environmental control by the execution unit 101 (hereinafter referred to as pre-heart rate information). The calculation unit 102 also calculates the heart rate included in the pre-heart rate information (hereinafter referred to as pre-heart rate) using the same calculation method as for the first heart rate.

[0199] Next, in step S01, the execution unit 101 causes the environmental control device 3 to execute the first environmental control.

[0200] (Step S32) In step S32, when the end time of the first environmental control has elapsed, the calculation unit 102 acquires the heart rate information of user 6 at the end time (hereinafter referred to as third heart rate information). The calculation unit 102 calculates the heart rate included in the third heart rate information (hereinafter referred to as third heart rate) using the same calculation method as for the first heart rate. The calculation unit 102 also acquires the first heart rate information and calculates the first heart rate included in the first heart rate information, similar to step S02 of the first embodiment.

[0201] The end time of the first environmental control is, for example, a predetermined time before the end of the nap period. However, the end time of the first environmental control is not limited to this, and may be a predetermined time including the end of the nap period, a predetermined time after the end of the nap period, a predetermined time including the end of the relaxation period, or a predetermined time before or after the end of the relaxation period.

[0202] (Step S33) In step S33, the estimation unit 103 determines whether the difference between the third heart rate and the pre-heart rate (third heart rate - pre-heart rate) is negative. If the difference is negative (YES in step S33), the estimation unit 103 executes step S34, and if the difference is 0 or greater (NO in step S33), it executes step S36.

[0203] (Step S34) In step S34, the estimation unit 103 estimates that user 6 is resting. (Step S36) In step S36, the estimation unit 103 estimates that user 6 is not resting.

[0204] Furthermore, the estimation unit 103 may perform the process of estimating whether or not the user 6 is resting in steps S33, S34, and S36 using a trained model generated by machine learning, as shown below.

[0205] Specifically, a trained model (hereinafter referred to as the sixth model) generated by machine learning is stored in the memory unit 11. This model uses the third heart rate and pre-heart rate obtained from each of the multiple users 6 as explanatory variables, and information indicating whether or not each of the multiple users 6 is resting (hereinafter referred to as rest information), which is self-assessed by each of the multiple users 6 after the completion of the first environmental control, as the objective variable. For machine learning, algorithms such as logistic regression, multiple regression, SVM, decision trees, and neural networks can be employed.

[0206] In step S33, the estimation unit 103 obtains the sixth model from the memory unit 11 and inputs the third heart rate and the pre-heart rate into the sixth model to obtain rest information output by the sixth model. The estimation unit 103 executes step S34 if the rest information indicates that the person is resting, and executes step S36 if the rest information indicates that the person is not resting.

[0207] Furthermore, estimating whether user 6 is resting may also be done by estimating whether user 6 is relaxed or sleeping.

[0208] (Step S37) After step S36, in step S37, the execution unit 101 extends the period for performing the first environment control by a predetermined extension time. A fixed time (for example, 10 minutes) can be used as the extension time. However, it is not limited to this, and the longer the difference calculated in step S33, the longer the extension time may be set.

[0209] Specifically, in step S37, the execution unit 101 transmits control information to the control device 30 instructing the display device 31, lighting device 32, speaker 33, vibration device 34, fragrance emitter 35, and massage device 36 to extend the period during which they perform their current operations by a predetermined extension time. As a result, the display device 31, lighting device 32, speaker 33, vibration device 34, fragrance emitter 35, and massage device 36 extend the relaxation period or nap period, which is the period during which they perform their current operations, by a predetermined extension time under the control of the control device 30. After transmitting the control information, the execution unit 101 waits for the extension time to elapse, and then performs the next step S35.

[0210] In addition, in step S37, the execution unit 101 may, instead of extending the period for performing the first environmental control by a predetermined extension time, change the environment to be formed by the first environmental control as shown below.

[0211] Specifically, the execution unit 101 transmits an instruction to the control device 30 to change at least one of the following, which are the environment to be formed by the first environment control: the video content displayed on the display device 31, the audio content output to the speaker 33, the illumination light turned on by the lighting device 32, the fragrance emitted by the fragrance emitter 35, the vibration applied to the vibration device 34, and the massage performed by the massage device 36.

[0212] As a result, during the relaxation or nap period, at least one of the following will be changed: the video content displayed by the display device 31, the audio content output by the speaker 33, the lighting light from the lighting device 32, the fragrance emitted by the fragrance emitter 35, the vibrations applied by the vibration device 34, and the massage actions performed by the massage device 36.

[0213] Furthermore, after step S36, the execution unit 101 may send an instruction to the terminal device 4 to display an input screen indicating whether or not to continue the first environmental control. Then, when the user 6 uses an input device to input information indicating whether or not to continue the first environmental control on the input screen displayed on the terminal device 4's display, the terminal device 4 may send this information to the processing unit 1. Accordingly, the execution unit 101 may perform step S37 if the information received by the communication unit 12 indicates that the first environmental control should be continued, and skip step S37 and perform step S35 if it indicates that the first environmental control should not be continued.

[0214] (Step S35) In step S35, the execution unit 101 instructs the environmental control device 3 to terminate the first environmental control. Specifically, the execution unit 101 transmits control information to the control device 30 instructing the display device 31, lighting device 32, speaker 33, vibration device 34, fragrance release device 35, and massage device 36 to stop operating. As a result, the display device 31, lighting device 32, speaker 33, vibration device 34, fragrance release device 35, and massage device 36 stop operating under the control of the control device 30. Consequently, the first environmental control is terminated.

[0215] Therefore, if the end time of the first environmental control is a predetermined time including the end of the relaxation period or a predetermined time before or after the end of the relaxation period, then in step S32, the third heart rate calculated when the end time has elapsed is used to estimate in step S34 that the user 6 is resting, and then step S35 is performed. In this case, the first environmental control is performed only until the end time has elapsed, and is interrupted for a period shorter than the predetermined period (relaxation period + nap period).

[0216] On the other hand, suppose that in step S36 it is presumed that user 6 is not resting, and in step S37 the first environmental control is extended for a predetermined extension time, and then step S35 is performed. In this case, the first environmental control is executed until the said termination time has elapsed, and then again until the said extension time has elapsed. For this reason, the first environmental control is either interrupted for a period shorter than the predetermined period (relaxation period + nap period), or terminated after being executed for a period longer than the predetermined period.

[0217] If the end time of the first environmental control is a predetermined time before the end of the nap period, then in step S32, when the end time has elapsed, i.e., using the third heart rate calculated at the end of the nap period, it is estimated in step S34 that the user 6 is resting, and then step S35 is performed. In this case, the first environmental control is terminated after being performed for a predetermined period (relaxation period + nap period).

[0218] On the other hand, suppose that in step S36 it is presumed that user 6 is not resting, and after step S37 the first environmental control is extended for a predetermined extension time, step S35 is performed. In this case, the first environmental control is executed for a period longer than the predetermined period (relaxation period + nap period) by the extension time, and then terminates.

[0219] If the end time of the first environmental control is a predetermined time including the end of the nap period or a predetermined time after the end of the nap period, then in step S32, the third heart rate calculated when the end time has elapsed is used to estimate in step S34 that the user 6 is resting, and then step S35 is performed. In this case, the first environmental control is performed for a predetermined period (relaxation period + nap period), and then continues to be performed until the end time has elapsed before being terminated.

[0220] On the other hand, suppose that in step S36 it is presumed that user 6 is not resting, and in step S37 the first environmental control is extended for a predetermined extension time, and then step S35 is performed. In this case, the first environmental control is executed for a predetermined period (relaxation period + nap period), then executed until the end time of the first environmental control has elapsed, and then executed until the said extension time has elapsed, after which it is terminated.

[0221] Furthermore, the system may be configured to extend the period during which the first environmental control is performed until it is presumed that user 6 is at rest, as shown below.

[0222] Specifically, after step S37, the calculation unit 102 calculates the heart rate included in the heart rate information of user 6 received by the communication unit 12 within the most recent predetermined time. The estimation unit 103 uses this heart rate instead of the third heart rate and estimates whether user 6 is resting or not in the same manner as in steps S33, S34, and S36, or using the estimation method that uses the sixth model described above. Then, if the execution unit 101 estimates that user 6 is not resting, it returns to step S37, and if it estimates that user 6 is resting, it proceeds to step S35.

[0223] After step S35, in step S03, the execution unit 101 causes the environment control device 3 to perform the second environment control. In the next step S04, the calculation unit 102 acquires second heart rate information and calculates the second heart rate from the second heart rate information.

[0224] In step S05, the difference between the second heart rate and the first heart rate (second heart rate - first heart rate) is calculated. If this difference is positive (YES in step S05), in step S06, the estimation unit 103 estimates that the user 6 has a high degree of refreshment. After step S06, the execution unit 101 executes step S38. If this difference is 0 or less (NO in step S05), in step S07, the estimation unit 103 estimates that the user 6 has a low degree of refreshment. After step S07, the execution unit 101 executes step S39.

[0225] (Step S38) In step S38, the execution unit 101 performs control to lower or maintain the output of the second environment control when the period corresponding to the second heart rate information has elapsed. (Step S39) In step S39, the execution unit 101 performs control to raise the output of the second environment control when the period corresponding to the second heart rate information has elapsed.

[0226] The period corresponding to the second heartbeat information is the period required for the communication unit 12 to receive the heartbeat information acquired as the second heartbeat information. For example, if the second heartbeat information is the heartbeat information of user 6 received between the start and end of the wakefulness period, the period corresponding to that second heartbeat information is the period from the start to the end of the wakefulness period.

[0227] If the second heart rate information is the heart rate information of user 6 received within a predetermined time period including the end of the wakefulness period, the period corresponding to the second heart rate information is the period from the start to the end of that predetermined time period.

[0228] If the second heart rate information is the heart rate information of user 6 received between the end of the wakefulness period and the end of a predetermined time, the period corresponding to the second heart rate information is the period from the end of the wakefulness period to the end of the predetermined time.

[0229] Specifically, in step S39, the execution unit 101 sends an instruction to the control device 30 to change at least one of the video content displayed on the display device 31 or the audio content output to the speaker 33, which is the environment to be formed by the second environment control, to content that is more effective in inducing the user 6 to wake up than the one shown in Figure 3.

[0230] Alternatively, or in addition to the above, the execution unit 101 transmits an instruction to the control device 30 to increase the volume of the audio content output to the speaker 33, increase the illuminance of the lighting device 32, increase the amount of fragrance released by the fragrance release device 35, strengthen the intensity of the vibration applied to the vibration device 34, increase the speed of the massage performed by the massage device 36, or strengthen the intensity of the massage performed by the massage device 36.

[0231] As a result, during the wakefulness period, the degree to which at least one of the following induces wakefulness in the user 6 is enhanced: the video content displayed by the display device 31, the audio content output by the speaker 33, the illumination light from the lighting device 32, the fragrance emitted by the fragrance emitter 35, the vibrations applied by the vibration device 34, and the massage actions performed by the massage device 36.

[0232] Furthermore, if step S07 is performed, the execution unit 101 may, without performing step S39, or after performing step S39 and then terminating the second environment control in step S40, transmit information prompting the user 6 to stretch, along with an instruction to present the information, to the terminal device 4. The information prompting the user 6 to stretch can include video content and audio content that prompts the user 6 to stretch.

[0233] On the other hand, in step S38, the execution unit 101 sends an instruction to the control device 30 to change at least one of the video content displayed on the display device 31 or the audio content output to the speaker 33, which is the environment to be formed by the second environment control, to content that is less effective in inducing the user 6 to wake up than the one shown in Figure 3. Alternatively, the execution unit 101 does not send an instruction to the control device 30. As a result, the execution unit 101 maintains the video content displayed on the display device 31 or the audio content output to the speaker 33 as the environment to be formed by the second environment control.

[0234] Alternatively, the execution unit 101 may transmit or not transmit at least one of the following instructions to the control device 30: an instruction to reduce the volume of the audio content output to the speaker 33; an instruction to reduce the illuminance of the lighting device 32; an instruction to reduce the amount of fragrance released by the fragrance release device 35; an instruction to weaken the intensity of the vibration applied to the vibration device 34; an instruction to reduce the speed of the massage performed by the massage device 36; or an instruction to weaken the intensity of the massage performed by the massage device 36.

[0235] As a result, during the wakefulness period, the degree to which at least one of the following induces wakefulness in the user 6 is weakened or maintained: the video content displayed by the display device 31, the audio content output by the speaker 33, the illumination light from the lighting device 32, the fragrance emitted by the fragrance emitter 35, the vibrations applied by the vibration device 34, and the massage actions performed by the massage device 36.

[0236] (Step S40) In step S40, the execution unit 101 instructs the environmental control device 3 to terminate the second environmental control. Specifically, the execution unit 101 transmits control information to the control device 30 instructing the display device 31, lighting device 32, speaker 33, vibration device 34, fragrance release device 35, and massage device 36 to stop operating. As a result, the display device 31, lighting device 32, speaker 33, vibration device 34, fragrance release device 35, and massage device 36 stop operating under the control of the control device 30. Consequently, the second environmental control is terminated.

[0237] In step S39, similar to step S37, the execution unit 101 may extend the period for performing the second environment control by a predetermined extension time. A fixed time (for example, 10 minutes) can be used as this extension time.

[0238] However, as described above, the estimation unit 103 may be configured to, instead of step S05, estimate that the degree to which the second heart rate exceeds the first heart rate (= second heart rate - first heart rate) is greater, the higher the degree of refreshment of the user 6, and set the extension time for the second environment control period to a longer time, the lower the degree of refreshment.

[0239] In this case, if the period corresponding to the second heartbeat information is the period from the start to the end of the wakefulness period, and if it is estimated in step S07 that the degree of refreshment of user 6 is low, the second environment control is executed for a predetermined extension time longer than the predetermined wakefulness period execution time before being terminated. On the other hand, if it is estimated in step S06 that the degree of refreshment of user 6 is high, step S38 is performed, and the second environment control is not extended and is terminated after the predetermined wakefulness period execution time.

[0240] If the period corresponding to the second heartbeat information is a predetermined time including the end of the wakefulness period or the period from the end of the wakefulness period until a predetermined time has elapsed, and if it is estimated in step S07 that the degree of refreshment of user 6 is low, the second environment control is executed for a predetermined wakefulness period, then further executed until the period corresponding to the second heartbeat information ends, and then terminated after a predetermined extension time has elapsed. On the other hand, if it is estimated in step S06 that the degree of refreshment of user 6 is high, step S38 is performed, and the second environment control is executed for a predetermined wakefulness period, then further executed until the period corresponding to the second heartbeat information ends, and then terminated.

[0241] Furthermore, after step S07, the execution unit 101 may send an instruction to the terminal device 4 to display an input screen indicating whether or not to continue the second environmental control. Then, when the user 6 uses an input device to input information indicating whether or not to continue the second environmental control on the input screen displayed on the terminal device 4's display, the terminal device 4 may send this information to the processing unit 1. Accordingly, the execution unit 101 may perform step S39 if the information received by the communication unit 12 indicates that the second environmental control should be continued, and skip step S39 and perform step S40 if it indicates that the second environmental control should not be continued.

[0242] Furthermore, the configuration may extend the period for executing the second environment control until it is estimated that the user 6 has a high degree of refreshment, as shown below.

[0243] Specifically, after step S39, the calculation unit 102 calculates the heart rate included in the heart rate information of user 6 received by the communication unit 12 within the most recent predetermined time. The estimation unit 103 uses this heart rate instead of the second heart rate to estimate whether the user 6's refresh level is high or low, similar to steps S05, S06, and S07. Then, the execution unit 101 returns to step S39 if it estimates that the user 6's refresh level is low, and proceeds to step S40 if it estimates that the user 6's refresh level is high.

[0244] With this configuration, it is possible to determine whether user 6 is resting or not based on the user's heart rate at the end of the first environmental control. If it is determined that the user is not resting, it becomes possible to extend the first environmental control or change the environment created by the first environmental control. As a result, the likelihood of inducing user 6 to rest through the first environmental control can be increased.

[0245] Furthermore, if it is estimated that the user 6's level of refreshment is low, it becomes possible to extend the second environmental control, strengthen the environment created by the second environmental control, or present information to the user 6 to encourage stretching after the end of the second environmental control. As a result, the possibility of inducing awakening in the user 6 through the second environmental control or stretching after the end of the second environmental control can be increased.

[0246] (Fifth Embodiment) In the first environmental control in the first to fourth embodiments, the fourth environmental control and the third environmental control are performed. However, even if the fourth environmental control is performed, it is not always possible to induce the user 6 to relax, and even if the third environmental control is performed, it is not always possible to induce the user 6 to take a nap. As a result, there is a risk that the first environmental control may not be able to induce the user 6 to rest.

[0247] Therefore, in the fifth embodiment, the estimation unit 103 determines whether or not the user 6 is relaxed based on the heart rate information included in the information regarding the user's heart rate at the end of the relaxation period. If the estimation unit 103 determines that the user 6 is not relaxed, it performs at least one of the following: extend the fourth environment control or change the environment that is formed by the fourth environment control.

[0248] Furthermore, the estimation unit 103 determines whether or not user 6 is napping based on the heart rate information contained in the information regarding the user's heart rate at the end of the nap period. If it determines that user 6 is not napping, it extends the third environment control.

[0249] Figure 13 is a flowchart showing a fifth example of the processing related to the first environment control in the refresh rate estimation process performed by the processing device 1. In the following, steps that are the same as those described in the first to fourth embodiments will be denoted by the same reference numerals as in the first to fourth embodiments, and their descriptions will be omitted.

[0250] In step S31, pre-heart rate information is acquired, and once the pre-heart rate included in the said pre-heart rate information is calculated, step S41 is performed.

[0251] (Step S41) In step S41, the execution unit 101 causes the environmental control device 3 to execute the fourth environmental control.

[0252] (Step S42) In step S42, when the end time of the fourth environmental control has elapsed, the calculation unit 102 acquires the heart rate information of user 6 at that end time (hereinafter referred to as the fourth heart rate information). The calculation unit 102 calculates the heart rate included in the fourth heart rate information (hereinafter referred to as the fourth heart rate) using the same calculation method as for the first heart rate. The calculation unit 102 also acquires the first heart rate information and calculates the first heart rate included in the first heart rate information, similar to step S02 of the first embodiment.

[0253] The end time of the fourth environmental control is, for example, a predetermined time including the end of the relaxation period. However, the end time of the fourth environmental control is not limited to this, and may be a predetermined time before or after the end of the relaxation period.

[0254] (Step S43) In step S43, the estimation unit 103 determines whether the difference between the fourth heart rate and the pre-heart rate (fourth heart rate - pre-heart rate) is negative. If the difference is negative (YES in step S43), the estimation unit 103 executes step S44, and if the difference is 0 or greater (NO in step S43), it executes step S46.

[0255] (Step S44) In step S44, the estimation unit 103 estimates that user 6 is relaxed. (Step S46) In step S46, the estimation unit 103 estimates that user 6 is not relaxed.

[0256] Furthermore, the estimation unit 103 may perform the process of estimating whether or not the user 6 is relaxed in steps S43, S44, and S46 using a trained model generated by machine learning, as shown below.

[0257] Specifically, a trained model (hereinafter referred to as the seventh model) generated by machine learning is stored in the memory unit 11. This model uses the fourth heart rate and pre-flight heart rate obtained from each of the multiple users 6 as explanatory variables, and information indicating whether or not each of the multiple users 6 is relaxed (hereinafter referred to as relaxation information), which they self-assessed after the completion of the fourth environmental control, as the objective variable. For machine learning, algorithms such as logistic regression, multiple regression, SVM, decision trees, and neural networks can be employed.

[0258] In step S43, the estimation unit 103 obtains the seventh model from the memory unit 11 and inputs the fourth heart rate and the pre-heart rate into the seventh model to obtain the relaxation information output by the seventh model. The estimation unit 103 executes step S44 if the relaxation information indicates that the person is relaxed, and executes step S46 if the relaxation information indicates that the person is not relaxed.

[0259] (Step S47) After step S46, in step S47, the execution unit 101 extends the period for performing the fourth environment control by a predetermined extension time, similar to step S37 (Figure 11). A fixed time (for example, 10 minutes) can be used as the extension time. However, it is not limited to this, and the longer the difference calculated in step S43, the longer the extension time may be set.

[0260] In addition, in step S47, the execution unit 101 may, instead of extending the period for performing the fourth environmental control by a predetermined extension time, change the environment to be formed by the fourth environmental control in the same manner as the method for changing the environment to be formed by the first environmental control described in the fourth embodiment.

[0261] Furthermore, after step S46, the execution unit 101 may send an instruction to the terminal device 4 to display an input screen indicating whether or not to continue the fourth environmental control. Then, when the user 6 uses an input device to input information indicating whether or not to continue the fourth environmental control on the input screen displayed on the terminal device 4's display, the terminal device 4 may send this information to the processing unit 1. Accordingly, the execution unit 101 may perform step S47 if the information received by the communication unit 12 indicates that the fourth environmental control should be continued, and skip step S47 and perform step S45 if it indicates that the fourth environmental control should not be continued.

[0262] (Step S45) In step S45, the execution unit 101 causes the environmental control device 3 to terminate the fourth environmental control, similar to step S35 (Figure 11).

[0263] Therefore, if the end time of the fourth environmental control is a predetermined time before the end of the relaxation period, then in step S42, when the end time has elapsed, i.e., using the fourth heart rate calculated at the end of the relaxation period, it is estimated in step S44 that the user 6 is relaxed, and then step S45 is performed. In this case, the fourth environmental control is terminated after it has been performed for a predetermined relaxation period.

[0264] On the other hand, suppose that in step S46 it is estimated that user 6 is not relaxed, and after step S47 the fourth environmental control is extended for a predetermined extension time, step S45 is performed. In this case, the fourth environmental control is executed for a period longer than the predetermined relaxation period by that extension time before being terminated.

[0265] If the end time of the fourth environmental control is a predetermined time including the end of the relaxation period or a predetermined time after the end of the relaxation period, then in step S42, the fourth heart rate calculated when the end time has elapsed is used to estimate in step S44 that the user 6 is relaxed, and then step S45 is performed. In this case, the fourth environmental control is executed for a predetermined relaxation period, and then continues to be executed until the end time has elapsed before being terminated.

[0266] On the other hand, suppose that in step S46 it is estimated that user 6 is not relaxed, and after step S47 the fourth environment control is extended for a predetermined extension time, step S45 is performed. In this case, the fourth environment control is executed for a predetermined relaxation period, then executed until the end time of the fourth environment control has elapsed, and then terminated after the said extension time has elapsed.

[0267] Furthermore, similar to the configuration described in the fourth embodiment, which extends the period for executing the first environmental control until it is estimated that user 6 is resting, the configuration may also extend the period for executing the fourth environmental control until it is estimated that user 6 is relaxed.

[0268] (Step S51) After step S45, in step S51, the execution unit 101 causes the environmental control device 3 to execute the third environmental control.

[0269] (Step S52) In the next step S52, when the end time of the third environment control has elapsed, the calculation unit 102 acquires the heart rate information of user 6 at that end time (hereinafter referred to as the fifth heart rate information). The calculation unit 102 calculates the heart rate included in the fifth heart rate information (hereinafter referred to as the fifth heart rate) using the same calculation method as for the first heart rate.

[0270] (Step S53) In the next step S53, the calculation unit 102 calculates the difference between the fifth heart rate and the fourth heart rate (fifth heart rate - fourth heart rate). If the difference is negative (YES in step S53), the execution unit 101 executes step S54. If the difference is 0 or greater (NO in step S53), step S56 is executed.

[0271] (Step S54) In step S54, the estimation unit 103 estimates that user 6 is taking a nap. (Step S56) In step S56, the estimation unit 103 estimates that user 6 is not taking a nap.

[0272] Furthermore, the estimation unit 103 may perform the process of estimating whether or not user 6 is napping in steps S53, S54, and S56 using an image of user 6's face, as shown below.

[0273] Specifically, a camera capable of communicating with the control device 30 is installed inside booth 5 in a position where it can capture the face of user 6. The camera periodically captures the face of user 6 and transmits the captured image (hereinafter referred to as the face image) to the control device 30. The control device 30 transmits the face image received from the camera to the processing device 1.

[0274] In step S53, the estimation unit 103 performs known image recognition processing and, if it recognizes that the eyes of user 6 included in the face image received by the communication unit 12 from the control device 30 have been closed for a predetermined period of time or longer, it executes step S54; otherwise, it executes step S56.

[0275] (Step S57) After step S56, in step S57, the execution unit 101 extends the period for performing the third environment control by a predetermined extension time, similar to step S47. A fixed time (for example, 10 minutes) can be used as the extension time. However, it is not limited to this, and the longer the difference calculated in step S53, the longer the extension time may be set.

[0276] Furthermore, after step S56, the execution unit 101 may send an instruction to the terminal device 4 to display an input screen indicating whether or not to continue the third environment control. Then, when the user 6 uses an input device to input information indicating whether or not to continue the third environment control on the input screen displayed on the terminal device 4's display, the terminal device 4 may send this information to the processing unit 1. Accordingly, the execution unit 101 may perform step S57 if the information received by the communication unit 12 indicates that the third environment control should be continued, and skip step S57 and perform step S55 if it indicates that the third environment control should not be continued.

[0277] (Step S55) In step S55, the execution unit 101, in the same manner as in step S45, instructs the environment control device 3 to terminate the third environment control. As a result, the first environment control is terminated, and the processes from step S03 onwards shown in Figure 12 are carried out.

[0278] Therefore, if the end time of the third environmental control is a predetermined time before the end of the nap period, and the fifth heart rate calculated in step S52 has elapsed, i.e., the end of the nap period, is used to estimate that the user 6 is napping in step S54, then step S55 is performed. In this case, the third environmental control is terminated after the predetermined nap period has been performed.

[0279] On the other hand, suppose that in step S56 it is presumed that user 6 is not napping, and in step S57 the third environmental control is extended for a predetermined extension time, and then step S55 is performed. In this case, the third environmental control is executed for a period longer than the predetermined napping period by that extension time before being terminated.

[0280] If the end time of the third environmental control is a predetermined time including the end of the nap period or a predetermined time after the end of the nap period, then in step S52, the fifth heart rate calculated when the end time has elapsed is used to estimate in step S54 that the user 6 is napping, and then step S55 is performed. In this case, the third environmental control is executed for a predetermined nap period, and then continues to be executed until the end time has elapsed before being terminated.

[0281] On the other hand, suppose that in step S56 it is presumed that user 6 is not napping, and in step S57 the third environmental control is extended for a predetermined extension time, and then step S55 is performed. In this case, the third environmental control is executed for a predetermined nap period, then executed until the end time of the third environmental control has elapsed, and then terminated after the said extension time has elapsed.

[0282] Furthermore, similar to the configuration in which the period for performing the fourth environmental control is extended until it is presumed that user 6 is relaxed, the configuration may also extend the period for performing the third environmental control until it is presumed that user 6 is napping.

[0283] With this configuration, it is possible to determine whether user 6 is relaxed or not based on the fourth heart rate, which is the user's heart rate at the end of the fourth environmental control. This makes it possible to extend the fourth environmental control or change the environment created by the fourth environmental control if it is determined that user 6 is not relaxed. As a result, the possibility of inducing relaxation in user 6 through the fourth environmental control can be increased.

[0284] Furthermore, this configuration allows for the determination of whether or not the user is napping based on the fifth heart rate, which is the user's heart rate at the end of the third environmental control phase. This makes it possible to extend the third environmental control phase if it is determined that the user is not napping. As a result, the likelihood of inducing the user to nap through the third environmental control phase can be increased.

[0285] This disclosure may be modified in the following ways.

[0286] (1) In the above embodiment, an example was described in which, in the first environment control, an environment that induces relaxation for the user 6 is created first, and then an environment that induces napping for the user 6 is created. However, in the first to fourth embodiments, instead, in the first environment control, an environment that induces napping for the user 6 may be created before an environment that induces relaxation for the user 6 is created. In this case, the calculation unit 102 assumes that the start time of the first environment control is the period from the start to the end of the napping period, and acquires the heart rate information of the user 6 at the start time of the first environment control as the first heart rate information. However, the start time of the first environment control is not limited to this, and may be a predetermined time including the start of the napping period, a predetermined time before or after the start of the napping period, or a predetermined time within the napping period. Furthermore, the first heart rate information is not limited to the heart rate information of the user 6 at the start time of the first environment control, but may also be the heart rate information of the user 6 during the period from the start of the napping period to the end of the relaxation period.

[0287] Alternatively, in the first environmental control, it is not necessary to create an environment that induces relaxation in the user 6, but not to create an environment that induces napping in the user 6. Alternatively, in the first environmental control, it is not necessary to create an environment that induces napping in the user 6, but not to create an environment that induces relaxation in the user 6. That is, in the first environmental control, it is possible to create at least one of an environment that induces relaxation in the user 6 and an environment that induces napping in the user 6.

[0288] (2) In the first embodiment and the third to fifth embodiments, an example was described in which the estimation unit 103 estimates the degree of refreshment using the first heart rate calculated by the calculation unit 102 from the electrocardiogram shown by the first heart rate information, and the second heart rate calculated from the electrocardiogram shown by the second heart rate information. However, the calculation unit 102 may calculate the R-R interval (hereinafter referred to as the first R-R interval) from the electrocardiogram shown by the first heart rate information, and the R-R interval (hereinafter referred to as the second R-R interval) from the electrocardiogram shown by the second heart rate information. The estimation unit 103 may then use the first R-R interval instead of the first heart rate, and the second R-R interval instead of the second heart rate to estimate the degree of refreshment.

[0289] (3) In the first, fourth, and fifth embodiments, the estimation unit 103 may estimate the degree of refreshment based on the comparison result of the first heart rate and the second heart rate, and the comparison result of the first heart rate and the third heart rate (fifth heart rate).

[0290] Figure 14 is a graph showing an example of the change in heart rate over time in an experiment. Specifically, in step S05 (Figures 4 and 12) in the first, fourth, and fifth embodiments, the estimation unit 103 may perform step S06 if the sum of the difference between the second heart rate G22 and the first heart rate G21 (G22 - G21) and the difference between the first heart rate G21 and the third heart rate (fifth heart rate) G23 (G21 - G23) is greater than or equal to a predetermined threshold, as shown in Figure 14, and perform step S07 if the sum is less than the threshold.

[0291] In this configuration, the degree of user 6's refreshment is estimated based on a comparison between the first heart rate G21, the second heart rate G22, and the third (fifth) heart rate G23. Therefore, by comparing the second heart rate G22 and the third (fifth) heart rate G23 with the first heart rate G21 as a reference, the degree of user 6's refreshment achieved by performing both the first and second environmental control can be estimated with greater accuracy.

[0292] (4) In the fourth embodiment, steps S31, S33 to S37 shown in Figure 11 may be omitted, and in step S32, the third heart rate information may not be acquired and the third heart rate may not be calculated. Alternatively, steps S38 to S40 shown in Figure 12 may be omitted.

[0293] (5) In the fifth embodiment, steps S31 and S43 to S47 shown in Figure 13 may be omitted. Alternatively, steps S52 to S57 shown in Figure 13 may be omitted.

[0294] The technology disclosed herein is useful in the field of technology for creating environments within booths such as vehicle compartments and private rooms.

Claims

Equipped with a processor, The aforementioned processor, The environmental control device is made to perform a first environmental control that creates an environment that induces the user to rest, and a second environmental control that creates an environment that induces the user to wake up. The system acquires first heart rate information relating to the user's heart rate during the period in which the first environmental control is being performed. The second heart rate information relating to the user's heart rate during the period in which the second environmental control is being performed is obtained. Based on the comparison result between the heart rate contained in the first heart rate information and the heart rate contained in the second heart rate information, the degree of the user's refreshment is estimated. Processing device. 　 The first heart rate information is information relating to the user's heart rate at the start of the first environmental control. The apparatus according to claim 1. 　 The processor, in estimating the degree of user refresh, The greater the degree to which the heart rate included in the second heart rate information exceeds the heart rate included in the first heart rate information, the higher the user's degree of refreshment is estimated to be. The apparatus according to claim 1. 　 The first heart rate information includes a first mean heart rate, which is the average value of multiple heart rates measured during the period in which the first environmental control is performed. The second heart rate information includes a second mean heart rate, which is the average value of multiple heart rates measured during the period in which the second environmental control is being performed. The processor, in estimating the degree of user refresh, Based on the comparison result between the first average heart rate and the second average heart rate, the degree of the user's refreshment is estimated. The apparatus according to claim 1 or 3. 　 The first average heart rate is the average value of multiple heart rates measured at the start of the first environmental control. The apparatus according to claim 4. 　 The environmental control device includes at least one of the following: a display device for displaying images, a lighting device, a speaker, a vibration device, a fragrance release device, and a massage device. The apparatus according to claim 1 or 3. 　 The aforementioned processor, Furthermore, we obtain response information showing the user's answers to the survey. After obtaining the aforementioned response information, the environmental control device is instructed to execute the first environmental control and the second environmental control. In estimating the degree of refreshment, Based on the comparison result between the heart rate contained in the first heart rate information and the heart rate contained in the second heart rate information, and the response information, the degree of refreshment is estimated. The processing apparatus according to claim 1 or 3, wherein the questionnaire includes items that inquire about at least one of mental agility and motivation. 　 The aforementioned processor, Furthermore, after the completion of the first and second environmental control processes, response information indicating the user's answers to the questionnaire is obtained. In estimating the degree of refreshment, Based on the comparison result between the heart rate contained in the first heart rate information and the heart rate contained in the second heart rate information, and the response information, the degree of refreshment is estimated. The processing apparatus according to claim 1 or 3, wherein the questionnaire includes items that inquire about at least one of mental agility and motivation. 　 The first environmental control includes a third environmental control that creates an environment that induces sleep in the user. The apparatus according to claim 1 or 3. 　 The first environmental control includes a fourth environmental control that creates an environment that induces the user to relax. The apparatus according to claim 1 or 3. 　 The first environmental control further includes a fourth environmental control that creates an environment that induces the user to relax, The aforementioned processor, If the third environmental control is performed before the fourth environmental control, information regarding the user's heart rate during the period in which the third environmental control is performed is acquired as the first heart rate information. If the fourth environmental control is performed before the third environmental control, information regarding the user's heart rate during the period in which the fourth environmental control is performed is obtained as the first heart rate information. The apparatus according to claim 9. 　 Equipped with a processor, The aforementioned processor, The environmental control device is made to perform a first environmental control that creates an environment that induces the user to rest, and a second environmental control that creates an environment that induces the user to wake up. After the completion of the first and second environmental control processes, first response information indicating the user's response to the questionnaire is obtained. Based on the first response information, the degree of refreshment of the user is estimated. The aforementioned questionnaire includes items that inquire about at least one of mental agility and motivation, and is a processing device. 　 The aforementioned processor, Furthermore, a second response information showing the user's response to the aforementioned questionnaire is obtained, After obtaining the second response information, the environmental control device is instructed to execute the first environmental control and the second environmental control. Based on the first and second response information, the degree of the user's refresh is estimated. The apparatus according to claim 12. 　 A processing method in a computer, The environmental control device is made to perform a first environmental control that creates an environment that induces the user to rest, and a second environmental control that creates an environment that induces the user to wake up. The system acquires first heart rate information relating to the user's heart rate during the period in which the first environmental control is being performed. The second heart rate information relating to the user's heart rate during the period in which the second environmental control is being performed is obtained. Based on the comparison result between the heart rate contained in the first heart rate information and the heart rate contained in the second heart rate information, the degree of the user's refreshment is estimated. Processing method. 　 A processing method in a computer, The environmental control device is made to perform a first environmental control that creates an environment that induces the user to rest, and a second environmental control that creates an environment that induces the user to wake up. After the completion of the first and second environmental control processes, response information indicating the user's answers to the questionnaire is obtained. Based on the aforementioned response information, the degree of refreshment of the user is estimated. The aforementioned questionnaire is a processing method that includes items asking about at least one of the following: mental agility and motivation. 　 The aforementioned processor further, The third heart rate information relating to the user's heart rate at the end of the first environmental control is acquired. Based on the heart rate included in the third heart rate information, it is determined whether the user is resting or not. If it is determined that the user is not resting, at least one of the following is performed: extend the first environmental control, or change the environment that is formed by the first environmental control. The apparatus according to claim 1. 　 The aforementioned processor further, If it is estimated that the user's level of refreshment is low, at least one of the following will be performed: extend the second environmental control, strengthen the environment formed by the second environmental control, or present information to the user to encourage stretching after the end of the second environmental control. The apparatus according to claim 1. 　 The aforementioned processor, Furthermore, the fourth heart rate information relating to the user's heart rate at the end of the fourth environmental control is acquired. Based on the heart rate included in the fourth heart rate information, it is determined whether the user is relaxed or not. If it is determined that the user is not relaxed, at least one of the following is performed: extend the fourth environmental control, or change the environment that is being created by the fourth environmental control. The apparatus according to claim 11. The aforementioned processor further, The fifth heart rate information relating to the user's heart rate at the end of the third environmental control is acquired. Based on the heart rate included in the fifth heart rate information, it is determined whether the user is asleep or not. If it is determined that the user is not asleep, the third environmental control is extended. The apparatus according to claim 11. 　 The aforementioned processor, Furthermore, a third heart rate information relating to the user's heart rate at the end of the first environmental control is acquired. In estimating the degree of refreshment, Based on the comparison result between the heart rate contained in the first heart rate information and the heart rate contained in the second heart rate information, and the comparison result between the heart rate contained in the first heart rate information and the heart rate contained in the third heart rate information, the degree of refresh is estimated. The apparatus according to claim 1.

Images