Air conditioning control system, learning device and inference device

Abstract

To provide an air conditioning control system that becomes advantageous for a user in obtaining good quality sleep.SOLUTION: An air conditioning control system includes an air conditioner 1 for performing indoor air conditioning, a bathing information acquisition part 10 for acquiring information on a parameter related to a rise amount of core part temperature when a user takes a bath, a time information acquisition part 20 for acquiring information on time from when the user gets out of the bath until the user falls asleep, and an air conditioning control part 30 for controlling the air conditioner 1 on the basis of the information acquired by the bathing information acquisition part 10 and the information acquired by the time information acquisition part 20.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an air conditioning control system, a learning device, and an inference device. [Background technology]

[0002] There is a technology for controlling the operation of an air conditioner while a user is sleeping, with the aim of improving the quality of sleep. As such a technology, Patent Document 1 discloses an air conditioning control system. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-159250 Summary of the Invention [Problem to be solved by the invention]

[0004] The quality of sleep is affected by the user's behavior before going to bed and the thermal environment. In particular, bathing has a large impact on sleep quality. The conventional technology disclosed in Patent Document 1 and the like has a problem in that it fails to take into account the impact of bathing on sleep quality.

[0005] The present disclosure is intended to solve the above-mentioned problems. An object of the present disclosure is to provide an air conditioning control system, a learning device, and an inference device that are advantageous for a user to obtain good quality sleep. [Means for solving the problem]

[0006] The air conditioning control system of the present disclosure includes an air conditioning device that conditions the air in a room, a bathing information acquisition unit that acquires parameter information related to the amount of rise in core body temperature when a user is bathing, a time information acquisition unit that acquires information on the time from when the user leaves the bath to when the user goes to sleep in the room, and an air conditioning control unit that controls the air conditioning device based on the information acquired by the bathing information acquisition unit and the information acquired by the time information acquisition unit. In addition, the learning device according to the present disclosure includes a data acquisition unit that acquires learning data including information regarding the amount of rise in core body temperature when the user takes a bath, information regarding the time from when the user leaves the bath until when the user goes to sleep in the room, and information regarding the operating status of the air conditioning device when the user goes to sleep after bathing, and a model generation unit that uses the learning data to generate a trained model for inferring the air conditioning conditions of the air conditioning device that are suitable for sleep from the information regarding the amount of rise in core body temperature when the user takes a bath and the information regarding the time from when the user leaves the bath until when the user goes to sleep in the room. In addition, the inference device of the present disclosure includes a data acquisition unit that acquires information regarding the amount of rise in deep body temperature when the user takes a bath and information regarding the time from when the user gets out of the bath to when the user goes to sleep in the room, and an inference unit that uses a trained model for inferring the operating conditions of an air conditioner from the information regarding the amount of rise in deep body temperature when the user takes a bath and information regarding the time from when the user takes a bath to when the user goes to sleep in the room, and outputs the air conditioning conditions of the air conditioner that are suitable for sleep from the information regarding the amount of rise in deep body temperature when the user takes a bath acquired by the data acquisition unit and the information regarding the time from when the user takes a bath to when the user goes to sleep in the room. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to provide an air conditioning control system, a learning device, and an inference device that are advantageous for users to get good quality sleep. [Brief explanation of the drawings]

[0008] [Figure 1]1 is a block diagram showing the configuration of an air-conditioning control system according to a first embodiment. [Figure 2] 10 is a table showing an example of the relationship between the amount of rise in core body temperature and combinations of parameters related to the amount of rise in core body temperature when a user is bathing. [Figure 3] FIG. 10 is a diagram showing an example of the change in core body temperature over time. [Figure 4] 3 is a table showing an example of control of the set temperature of an air conditioner by the air conditioning control system according to the first embodiment. [Figure 5] 3 is a diagram showing an example of control of the set temperature of an air conditioner by the air conditioning control system according to the first embodiment. FIG. [Figure 6] 1 is a configuration diagram of a learning device for an air-conditioning control system according to a first embodiment. [Figure 7] 10 is a flowchart relating to a learning process of the learning device. [Figure 8] 1 is a configuration diagram of an inference device related to an air-conditioning control system according to a first embodiment. [Figure 9] 4 is a flowchart showing an example of the operation of an air-conditioning control system to which the inference device according to the first embodiment is applied. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments will be described with reference to the drawings. Common or corresponding elements in the various drawings will be designated by the same reference numerals, and redundant explanations will be simplified or omitted.

[0010] Embodiment 1 Fig. 1 is a block diagram showing the configuration of an air conditioning control system according to embodiment 1. The air conditioning control system according to this embodiment includes an air conditioner 1 that conditions the air in a room where a user sleeps. The air conditioner 1 can adjust the temperature. For example, the air conditioner 1 conditions the air so that the temperature in the room becomes a set temperature.

[0011] In this disclosure, "going to bed" means that the user goes to bed, i.e., starts going to bed. In this disclosure, "while sleeping" means the period from when the user goes to bed until when the user wakes up.

[0012] As shown in FIG. 1, the air conditioning control system according to this embodiment includes a bathing information acquisition unit 10. The bathing information acquisition unit 10 acquires information related to the amount of rise in core body temperature when the user takes a bath. As an example, the bathing information acquisition unit 10 acquires at least one of the following when the user actually takes a bath: water temperature, water volume, bathing time, bathing duration, and bathroom temperature, as information related to the amount of rise in core body temperature. The water temperature, water volume, bathing duration, and bathroom temperature are examples of parameters related to the amount of rise in core body temperature when the user takes a bath.

[0013] We will now explain an example of a specific method for obtaining parameters related to the amount of rise in core body temperature during bathing. Information on water temperature can be obtained, for example, from operating information on the water heater used by the user. Alternatively, information on water temperature can be obtained from a temperature sensor installed in the pipes that make up the water heater or in the bathtub, etc. The amount of hot water can be obtained, for example, from operating information on the water heater used by the user. Alternatively, information on an estimated value of the amount of hot water can be obtained from detection information from a water level sensor equipped in the water heater. Information on bathroom temperature can be obtained from operating information on the bathroom air conditioner or detection information from a temperature sensor installed in the bathroom.

[0014] Bathing time can be estimated, for example, from information detected by a water level sensor installed in the water heater. Bathing time can also be estimated from information detected by a biosensor or human presence sensor installed in the bathroom or changing room. The user may also input bathing time information using a device such as a bathroom remote control. The user may press a specific button when starting to bathe and when leaving the bath, and the bathing time may be calculated from the information on the time this button was pressed. The start of bathing and leaving the bath may be detected by a specific sensor, and the bathing time may be calculated from the difference between the respective detection times.

[0015] The amount of rise in core body temperature during bathing can be estimated based on biometric information such as the user's skin temperature or pulse rate during or before and after bathing, obtained using a biometric sensor or wearable sensor installed in the bathroom or changing room, for example.

[0016] 1, the air conditioning control system according to this embodiment includes a time information acquisition unit 20. The time information acquisition unit 20 acquires information about the time from when the user takes a bath until when the user goes to bed indoors.

[0017] An example of a specific method for acquiring information on the time from when a user leaves the bath to when they go to bed in the room will be described below. For example, a specific sensor detects when the user leaves the bath, and acquires information on the time from when the user leaves the bath to when they go to bed. Information on the time when the user leaves the bath may be acquired by the user pressing a specific button when they leave the bath.

[0018] Information about the user's bedtime can be obtained by the user inputting their planned bedtime using any input means, such as a smartphone app, a bathroom remote control, or a remote control outside the bathroom. The user may input their planned bedtime in advance, or the user may obtain information about their actual bedtime by operating a predetermined button or the like when they actually start going to bed. For example, the actual bedtime may be determined as the time when the user presses the bedtime start button or the sleep mode start button on the smartphone app or the remote control of the air conditioner 1. The air conditioning control system may automatically obtain information about the user's bedtime without user input. For example, a camera, surface temperature sensor, biosensor, or motion sensor installed in the room where the user sleeps may be used to detect that the user has entered their bedding, i.e., fallen asleep, and the time of this detection may be determined as the actual bedtime. If both information about the planned bedtime input by the user in advance and information about the actual bedtime are obtained, the latter information, the actual bedtime information, may be used preferentially.

[0019] The air conditioning control system according to this embodiment is characterized by controlling the air conditioner 1 based on the information acquired as described above regarding the amount of rise in core body temperature while the user is bathing and information regarding the time from when the user leaves the bath until when the user goes to sleep indoors. As shown in Fig. 1, the air conditioning control system according to this embodiment includes an air conditioning control unit 30. The air conditioning control unit 30 controls the operation of the air conditioner 1 while the user is sleeping based on the information acquired by the bathing information acquisition unit 10 and the information acquired by the time information acquisition unit 20.

[0020] The air conditioning control unit 30 performs a predetermined calculation based on the information acquired by the bathing information acquisition unit 10 and the information acquired by the time information acquisition unit 20 to calculate air conditioning conditions suitable for sleep. The air conditioning control unit 30 controls the operation of the air conditioner 1 based on the calculated air conditioning conditions. For example, the air conditioning control unit 30 estimates the amount of rise in core body temperature due to bathing from the information acquired by the bathing information acquisition unit 10. The air conditioning control unit 30 calculates the air conditioning conditions suitable for sleep based on two parameters: the estimated amount of rise in core body temperature and the time from the time of leaving the bath to going to bed, acquired by the time information acquisition unit 20.

[0021] As an example, the air conditioning control unit 30 stores data such as an arithmetic formula for calculating air conditioning conditions suitable for sleep in advance. Alternatively, the air conditioning control unit 30 may calculate air conditioning conditions suitable for sleep based on data stored in an external database on the Internet. Alternatively, the calculation of air conditioning conditions suitable for sleep may be performed externally, and the air conditioning control unit 30 may control the air conditioner 1 based on the calculation results. Data such as an arithmetic formula for calculating air conditioning conditions suitable for sleep may be stored in advance based on, for example, the results of experiments.

[0022] The functions of the bathing information acquisition unit 10, the time information acquisition unit 20, and the air conditioning control unit 30 can be realized by a processing circuit. The processing circuit may include at least one processor and at least one memory. When the processing circuit includes at least one processor and at least one memory, each function of the control unit may be realized by software, firmware, or a combination of software and firmware. At least one of the software and firmware may be written as a program. At least one of the software and firmware may be stored in at least one memory. The at least one processor may realize each function by reading and executing a program stored in at least one memory. The at least one memory may include a non-volatile or volatile semiconductor memory, a magnetic disk, etc.

[0023] The processing circuit may include at least one dedicated hardware. When the processing circuit includes at least one dedicated hardware, the processing circuit may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof. Furthermore, the functions of each component constituting the ventilation system may be realized by a separate processing circuit, or may be realized collectively by a single processing circuit. Some of the functions of the control system may be realized by dedicated hardware, and other parts may be realized by software or firmware. The processing circuit may realize each function by hardware, software, firmware, or a combination thereof.

[0024] The functions of the bathing information acquisition unit 10, the time information acquisition unit 20 and the air conditioning control unit 30 may be realized by equipment provided in the air conditioning unit 1, by equipment provided outside the air conditioning unit 1, or by cooperation between the equipment provided in the air conditioning unit 1 and external equipment.

[0025] The amount of rise in core body temperature is expected to increase with increasing bathing time. The amount of rise in core body temperature is also expected to increase with increasing water temperature. The amount of rise in core body temperature is also expected to increase with increasing water volume. Figure 2 is a table showing an example of the relationship between the amount of rise in core body temperature and the combination of parameters related to the amount of rise in core body temperature during bathing. As shown in the table in Figure 2, the air conditioning control unit 30 may estimate the amount of rise in core body temperature in three stages: large, medium, and small, based on the combination of parameters. The air conditioning control unit 30 may also calculate the estimated amount of rise in core body temperature using an arithmetic formula with parameters such as bathing time, water temperature, and water volume as variables. Furthermore, as shown in Figure 2, because the amount of water is expected to have a relatively small effect on the amount of rise in core body temperature, the amount of water may be used as a parameter with two stages: large or small, or full-body bathing or half-body bathing.

[0026] For example, if a user goes to bed immediately after thoroughly warming up in a bath, it is expected that the user will feel too hot and have difficulty falling asleep, even if the room temperature is the same as usual. On the other hand, if the user goes to bed some time after thoroughly warming up in a bath, the user's core body temperature will have dropped significantly, making the user feel cold even if the room temperature is the same as usual. In this way, the thermal environment suitable for sleep changes depending on how the user warms up in the bath, particularly the amount of rise in core body temperature and the time elapsed since leaving the bath. The air conditioning control system of this embodiment controls the air conditioner 1 based on both information regarding the amount of rise in core body temperature during the user's bath and information regarding the time between the user leaving the bath and going to sleep indoors. This makes it possible to realize a thermal environment suitable for sleep. This embodiment provides an air conditioning control system that is advantageous for users to get good quality sleep.

[0027] FIG. 3 is a diagram showing an example of the change in core body temperature over time. As shown in FIG. 3, the way core body temperature changes varies depending on the amount of rise in core body temperature due to bathing. In the example of FIG. 3, at time A, the greater the amount of rise in core body temperature due to bathing, the higher the core body temperature. On the other hand, in the example of FIG. 3, at time B, the greater the amount of rise in core body temperature due to bathing, the lower the core body temperature. This confirms that in order to calculate air conditioning conditions suitable for sleep, it is important to consider not only the amount of rise in core body temperature but also the elapsed time after leaving the bath.

[0028] It is believed that the longer the time between a user getting out of the bath and going to bed, the greater the decrease in the user's core body temperature. Therefore, as an example, the air conditioning control unit 30 may set the temperature of the air conditioner 1 higher while the user is sleeping, the longer the time between a user getting out of the bath and going to bed. This prevents the user from feeling cold when going to bed and helps the user sleep comfortably.

[0029] A specific example of control of the air conditioner 1 by the air conditioning control system according to this embodiment will be described with further reference to the drawings. Fig. 4 is a table showing an example of control of the set temperature of the air conditioner 1 by the air conditioning control system according to embodiment 1. Note that the operation of the air conditioning control system according to the present disclosure is not limited to the example shown in the figure, and may include various modified examples.

[0030] For example, under the first condition that the time between when the user gets out of the bath and when they go to bed is longer than a standard, the set temperature of the air conditioner 1 may be increased as the increase in core body temperature due to bathing increases. In the example of FIG. 4, this first condition corresponds to the condition "long / 120 minutes or more" for "exit bath-start going to bed." If the time between when the user gets out of the bath and when they go to bed is longer than the standard, it is expected that the greater the increase in core body temperature due to bathing, the lower the core body temperature at the start of bedtime. In this example, the user can be prevented from feeling cold when going to bed, helping them to sleep more comfortably.

[0031] For example, under the second condition that the time between when the user gets out of the bath and when they go to bed is shorter than a standard, the set temperature of the air conditioner 1 may be lowered as the rise in core body temperature due to bathing increases. In the example of FIG. 4, this second condition corresponds to the condition "Short / less than 60 minutes" for "Taking out of the bath - starting to go to bed." If the time between when the user gets out of the bath and when they go to bed is shorter than the standard, it is expected that the user will feel hot at bedtime. In particular, the greater the rise in core body temperature due to bathing, the more likely the user will feel hot. In this example, lowering the set temperature can create a cool and comfortable environment for the user when they go to bed, thereby supporting comfortable sleep. It can also promote a decrease in body temperature and encourage them to fall asleep.

[0032] For example, under the third condition where the time from when the user gets out of the bath to when they go to bed is within a standard range, the set temperature of the air conditioner 1 may be set regardless of the amount of rise in core body temperature caused by bathing. In the example of Figure 4, the third condition corresponds to the condition where "getting out of the bath - starting to go to bed" is "medium / 60 to 120 minutes."

[0033] For example, under the fourth condition, where the parameter related to the amount of rise in core body temperature is greater than a reference value, the amount of rise in core body temperature due to bathing is greater than a reference value, the shorter the time between when the user leaves the bath and when they go to bed, the lower the set temperature of the air conditioner 1 may be. In the example of FIG. 4, this fourth condition corresponds to the condition where the "amount of rise in core body temperature" is "medium / 0.5°C to 1.0°C" or "large / 1.0°C or more." If the amount of rise in core body temperature due to bathing is large, if the user goes to bed immediately after leaving the bath, the heat may make it difficult to sleep comfortably. In this example, lowering the set temperature can create a cool and comfortable environment for the user when they go to bed, thereby supporting comfortable sleep. It can also promote a drop in body temperature and encourage them to fall asleep.

[0034] For example, in the fifth condition where the amount of rise in core body temperature due to bathing is smaller than the standard, the set temperature of the air conditioner 1 may be set regardless of the time from when the user gets out of the bath to when they go to bed. In the example of Figure 4, the fifth condition corresponds to the condition where the "amount of rise in core body temperature" is "small / less than 0.5°C."

[0035] FIG. 5 is a diagram showing an example of control of the set temperature of the air conditioner 1 by the air conditioning control system according to the first embodiment. The set temperature of the air conditioner 1 may be set to a first temperature during a first time period from when the user goes to bed indoors until a specified time has elapsed, and may be set to a second temperature lower than the first temperature during a second time period after the specified time has elapsed. The first time period corresponds to "bedtime (to falling asleep)" in the example of FIG. 4 and is set as a time period from when the user starts to go to sleep until they fall asleep. The second time period corresponds to "after falling asleep (to the end of the first half of sleep)" in the example of FIG. 4 and is set as a time period after the user falls asleep. The specified time is set to, for example, 30 minutes. Lowering the set temperature after falling asleep compared to before falling asleep can help the user fall into a deeper sleep.

[0036] The first temperature is determined based on information about the amount of rise in the user's core body temperature while bathing and information about the time from when the user leaves the bath until when the user goes to bed indoors, and the second temperature is determined based on information about the amount of rise in the user's core body temperature while bathing.

[0037] As shown in Fig. 4, the second temperature, which is the set temperature of the air conditioner 1 in the second time slot, may be set higher as the rise in the user's core body temperature during bathing increases. It is expected that the greater the warmth achieved during bathing, the lower the lower limit of body temperature during sleep, making the user more likely to feel cold than when the warmth achieved during bathing is small. Therefore, by raising the set temperature, the user will not feel cold and their sleep will not be disturbed.

[0038] As shown in Figures 4 and 5, the second time slot may be set as a time slot from when the user falls asleep until the end of the first half of sleep. For example, the second time slot may be set as a time slot until two sleep cycles are completed. For example, the second time slot may be set as a 180-minute time slot until two 90-minute cycles are completed. After the second time slot is completed, i.e., after the end of the first half of sleep, the set temperature of the air conditioner 1 may be set to the first temperature or a temperature higher than the first temperature. By setting the set temperature higher toward the time of wake-up, it is possible to help the user wake up comfortably.

[0039] 1, the air conditioning control system according to this embodiment may include a sleep state detection unit 40. The sleep state detection unit 40 detects the sleep state of the user and is capable of detecting when the user starts to go to sleep and when the user falls asleep.

[0040] For example, a smartwatch or a biosensor such as a Doppler sensor installed in a room can acquire biometric information of a sleeping user to detect the user's sleep state. Such biometric information includes pulse rate, body movement, respiratory rate, and brain activity. From the acquired biometric information, it is possible to estimate whether the user has started to fall asleep and whether they have started to fall asleep.

[0041] The time period from when the user starts going to sleep until when the user falls asleep may be set as the first time period, and the time period after the user falls asleep may be set as the second time period, depending on the detection result of the sleep state detection unit 40. By using the detection result of the sleep state detection unit 40, the actual state of the user can be reflected, and more accurate air conditioning control can be achieved.

[0042] The sleep state detection unit 40 may be configured to detect the user's sleep depth, sleep onset latency, sleep duration, sleep efficiency, etc. The sleep depth, sleep onset latency, sleep duration, sleep efficiency, etc. can be estimated from biological information acquired by, for example, a smart watch or a biological sensor such as a Doppler sensor installed in the room.

[0043] Generally, from the time a person falls asleep until they wake up again, they transition through sleep depths 1, 2, 3, and 4, then to sleep depths 3, 2, 1, and REM sleep, a sleep cycle that repeats approximately every 90 minutes. Generally, the deeper the sleep, the less body movement there is. Information about sleep state, such as sleep depth and sleep cycle, can be estimated from biological information such as body movement.

[0044] Depending on the sleep depth detection result by the sleep state detection unit 40, the time period from when the user falls asleep until the end of the second sleep cycle may be set as the second time period. By setting the end point of the second time period to reflect the actual state of the user, more accurate air conditioning control can be achieved.

[0045] The contents of tables such as those shown in Figures 2 and 4 may be changed, for example, according to the season. Alternatively, the coefficients of the formula for calculating the estimated amount of rise in core body temperature and the coefficients of the formula for calculating the air conditioning conditions suitable for sleep may be changed for each season. This allows for seasonal changes in the user's metabolic rate and thermal sensation to be accommodated. Seasonal information can be obtained, for example, by providing a separate means for acquiring outdoor air information and estimating the season based on the outdoor air information. The season can also be estimated from operating information of the air conditioner 1, for example, based on information on the operating mode, such as cooling or heating.

[0046] As described above, the air conditioning control unit 30 performs a predetermined calculation based on the information acquired by the bathing information acquisition unit 10 and the information acquired by the time information acquisition unit 20 to calculate air conditioning conditions suitable for sleep. The air conditioning control system according to this embodiment may be configured to be able to notify the user of the air conditioning conditions calculated by the air conditioning control unit 30. The notification of the air conditioning condition information is performed by an optional notification unit 50, such as a smartphone app, a bathroom remote control, or a remote control outside the bathroom. By notifying the user of the air conditioning conditions suitable for sleep, the user can voluntarily adjust the indoor environment to a state suitable for sleep.

[0047] When the air conditioning control unit 30 outputs the calculation results, known algorithms such as supervised learning, unsupervised learning, semi-supervised learning, and reinforcement learning can be used. FIG. 6 is a configuration diagram of a learning device 100 for the air conditioning control system according to embodiment 1. The learning device 100 can be used to realize some of the functions of the air conditioning control system according to this embodiment, particularly the functions of the air conditioning control unit 30. By using the learning device 100, it is possible to automatically perform more appropriate calculations and learning. The learning device 100 includes a data acquisition unit 101 and a model generation unit 102.

[0048] The data acquisition unit 101 acquires, as learning data, information regarding the amount of rise in core body temperature when the user takes a bath, acquired by the bathing information acquisition unit 10, information regarding the time from when the user leaves the bath until when the user goes to sleep indoors, acquired by the time information acquisition unit 20, and information regarding the operating status of the air conditioning device 1 when the user goes to sleep after taking a bath.

[0049] The model generation unit 102 learns air conditioning conditions, such as the set temperature, that are suitable for sleep, based on the learning data acquired by the data acquisition unit 101. That is, it generates a trained model that infers the optimal air conditioning conditions for sleep from information about the amount of rise in core body temperature when the user takes a bath and information about the time from when the user leaves the bath until when they go to sleep indoors.

[0050] The learning device 100 and the inference device 200 described below are used to learn air conditioning conditions such as the set temperature of the air conditioner 1, but may be separate devices connected to the air conditioner 1 via a network, for example. The learning device 100 and the inference device 200 may also be built into the air conditioner 1. Furthermore, the learning device 100 and the inference device 200 may reside on a cloud server.

[0051] Known algorithms such as supervised learning, unsupervised learning, reinforcement learning, etc. may be used as the learning algorithm used by the model generation unit 102. As an example, a case where reinforcement learning is applied will be described.

[0052] In reinforcement learning, an agent (acting subject) in a certain environment observes the current state (environmental parameters) and decides on the action to take. The environment changes dynamically depending on the agent's actions, and the agent is given a reward according to the changes in the environment. The agent repeats this process and learns the course of action that will obtain the most reward through a series of actions. Q-learning and TD-learning are known as representative reinforcement learning methods. For example, in the case of Q-learning, the general update formula for the action value function Q(s, a) is expressed as the following equation 1.

[0053]

number

[0054] In equation 1, s t represents the state of the environment at time t, and a t represents the action at time t. Action a t Therefore, the state is s t+1 Changes to r t+1 represents the reward that can be obtained depending on the change in state, γ represents the discount rate, and α represents the learning coefficient. Note that γ is in the range of 0<γ≦1, and α is in the range of 0<α≦1. When the user is sleeping after taking a bath, the operating state of the air conditioner 1 is action a t The amount of rise in the user's core body temperature during bathing and the time from when the user leaves the bath to when they go to bed indoors are expressed as the state s t and the state s at time t t Best Practices in a t Learn.

[0055] The update formula expressed by Equation 1 increases the action value Q if the action value Q of the action a with the highest Q value at time t+1 is greater than the action value Q of the action a executed at time t, and decreases the action value Q in the opposite case. In other words, the action value function Q(s, a) is updated so that the action value Q of the action a at time t approaches the best action value at time t+1. As a result, the best action value in a certain environment is propagated sequentially to the action value in the previous environment.

[0056] As described above, when a trained model is generated by reinforcement learning, the model generation unit 102 includes a reward calculation unit 102a and a function update unit 102b.

[0057] The reward calculation unit 102a calculates a reward based on the operating state of the air conditioner 1 when the user goes to bed after bathing, the amount of rise in the user's core body temperature while bathing, and the time from when the user leaves the bath until when the user goes to sleep indoors. The reward calculation unit 102a calculates a reward r based on, for example, the user's sleep state after bathing acquired by the sleep state detection unit 40. This sleep state represents the quality of sleep, such as sleep score, sleep efficiency, and time to fall asleep. For example, if the sleep state is good, the reward r is increased (for example, a reward of "1"), and on the other hand, if the sleep state is bad, the reward r is decreased (for example, a reward of "-1" is given).

[0058] The function update unit 102b updates the function for determining the air conditioning conditions suitable for sleep in accordance with the reward calculated by the reward calculation unit 102a, and outputs the updated function to the trained model storage unit 103. For example, in the case of Q-learning, the action value function Q(s t ,a t ) is used as a function to calculate the air conditioning conditions suitable for sleep.

[0059] The learning process is repeated as described above. The learned model storage unit 103 stores the action-value function Q(s t ,a t ), i.e., stores the trained model.

[0060] 7 is a flowchart of the learning process of the learning device 100. The learning process of the learning device will be described with reference to FIG.

[0061] In step S201, the data acquisition unit 101 acquires, as learning data, information regarding the amount of rise in core body temperature when the user is bathing, information regarding the time from when the user leaves the bath until when the user goes to sleep indoors, and information regarding the operating status of the air conditioning device 1 when the user goes to sleep after bathing.

[0062] In step S202, the model generation unit 102 calculates a reward based on the learning data acquired in step S201. Specifically, the reward calculation unit 102a acquires the learning data acquired by the data acquisition unit 101, and determines whether to increase the reward (step S203) or decrease the reward (step S204) based on the user's sleep state after bathing acquired by the sleep state detection unit 40.

[0063] If the reward calculation unit 102a determines that the reward should be increased, it increases the reward in step S203. On the other hand, if the reward calculation unit 102a determines that the reward should be decreased, it decreases the reward in step S204.

[0064] In step S205, the function update unit 102b updates the action value function Q(s t ,a t ) to update the

[0065] The learning device 100 repeatedly executes the above steps S201 to S205 to generate the action-value function Q(s t ,a t ) is stored as a trained model.

[0066] In the example shown in Figure 6, the learned model is stored in a learned model storage unit 103 provided outside the learning device 100, but the learned model storage unit 103 may also be provided inside the learning device 100.

[0067] 8 is a configuration diagram of an inference device 200 related to the air-conditioning control system according to Embodiment 1. The inference device 200 includes a data acquisition unit 201 and an inference unit 202.

[0068] The data acquiring unit 201 acquires information on the amount of rise in core body temperature while the user is bathing, which is acquired by the bathing information acquiring unit 10, and information on the time from when the user leaves the bath to when the user goes to sleep indoors, which is acquired by the time information acquiring unit 20. The data acquiring unit 201 may also acquire information on the user's sleep state after bathing, which is acquired by the sleep state detecting unit 40.

[0069] The inference unit 202 uses the trained model to infer the C output. That is, by inputting information acquired by the data acquisition unit 201 regarding the amount of rise in the user's core body temperature while bathing and information regarding the time from when the user leaves the bath until when they go to sleep indoors into this trained model, it is possible to infer air conditioning conditions suitable for sleep, such as the set temperature of the air conditioner 1.

[0070] In this embodiment, it has been described that air conditioning conditions suitable for sleep are output using a trained model trained by the model generation unit 102 of the learning device 100 for the air conditioning device 1 that constitutes the air conditioning control system, but it is also possible to obtain a trained model from another air conditioning device or system and output air conditioning conditions suitable for sleep based on this trained model.

[0071] The data used by the learning device 100 for learning may be switched depending on, for example, the user's individual sleep attributes. The air conditioning control unit 30 may control the operation of the air conditioner 1 depending on the user's individual sleep attributes. Sleep attributes refer to the sleep type of each individual user, such as light sleep or difficulty falling asleep. Information on the sleep attributes may be acquired by input by the user themselves, or may be acquired using the detection results of the sleep state detection unit 40.

[0072] For example, the sleep state, which is an example of an index used when the reward calculation unit 102a calculates the reward, may be switched depending on the sleep attributes of the individual user. For example, for a user who has difficulty falling asleep, the reward may be calculated based only on the sleep onset latency, or by weighting the sleep onset latency, among multiple sleep state indexes. For example, the criteria for increasing or decreasing the reward may be varied depending on the sleep attributes of the individual user.

[0073] FIG. 9 is a flowchart showing an example of the operation of an air-conditioning control system to which the inference device 200 according to the first embodiment is applied.

[0074] In step S301, the data acquisition unit 201 acquires information on the amount of rise in the user's core body temperature while bathing, and information on the time from when the user leaves the bath until when the user goes to bed indoors.

[0075] In step S302, the inference unit 202 inputs information about the amount of rise in core body temperature when the user bathes and information about the time from when the user leaves the bath to when the user goes to sleep indoors into the trained model stored in the trained model memory unit 103, and in step S303, obtains an output of the optimal air conditioning conditions for sleep.

[0076] The inference unit 202 outputs the obtained air conditioning conditions to the air conditioner 1 and controls the air conditioner 1 to operate under those air conditioning conditions. At this time, a determination is made in step S304 as to whether the current time has reached bedtime. If the current time has not reached bedtime, control under the output air conditioning conditions is suspended, and the determination in step S304 continues.

[0077] If the current time has reached bedtime, control of the air conditioner 1 begins under the calculated air conditioning conditions. Specifically, in step S305, control is performed with the set temperature of the air conditioner 1 set to the first temperature. Control with the set temperature set to the first temperature is performed only during the first time slot.

[0078] After the process of step S305, in step S306, it is determined whether the first time slot has ended and the second time slot has arrived. If the current time is not in the second time slot, control continues with the set temperature set to the first temperature. If the current time has arrived in the second time slot, control is performed with the set temperature of the air conditioner 1 set to the second temperature in step S307. Control with the set temperature set to the second temperature is performed only during the second time slot.

[0079] It should be noted that the flowchart in FIG. 9 merely shows one example of the operation, and the operation of the air-conditioning control system according to the present disclosure is not limited to this example.

[0080] Examples of various aspects of the present disclosure are summarized below as appendices. (Appendix 1) an air conditioning device that conditions the air in the room; a bathing information acquisition unit that acquires information about the amount of rise in deep body temperature when the user is bathing; a time information acquisition unit that acquires information about the time from when the user takes a bath until when the user goes to bed in the room; an air conditioning control unit that controls the operation of the air conditioner while the user is sleeping based on the information acquired by the bathing information acquisition unit and the information acquired by the time information acquisition unit; An air conditioning control system equipped with: (Appendix 2) The time information acquisition unit The air conditioning control system described in Appendix 1 is characterized in that, when information on the planned bedtime and information on the actual bedtime are obtained, the latter is used preferentially to obtain information on the time from when the user takes a bath to when they go to sleep in the room. (Appendix 3) The air conditioning control unit The air conditioning control system according to claim 1 or 2, characterized in that the longer the time between the user taking a bath and going to bed in the room, the higher the set temperature of the air conditioner while the user is sleeping. (Appendix 4) The air conditioning control unit An air conditioning control system as described in any one of Appendix 1 to Appendix 3, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is longer than a standard, the higher the water temperature when the user takes a bath, the higher the set temperature of the air conditioning device while the user is sleeping. (Appendix 5) The air conditioning control unit An air conditioning control system as described in any one of Appendix 1 to Appendix 4, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is longer than a standard, the more hot water the user uses when bathing, the higher the set temperature of the air conditioning device while the user is sleeping. (Appendix 6) The air conditioning control unit An air conditioning control system as described in any one of Appendix 1 to Appendix 5, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is longer than a standard, the longer the user's bathing time, the higher the set temperature of the air conditioner while the user is sleeping. (Appendix 7) The air conditioning control unit An air conditioning control system as described in any one of Appendix 1 to Appendix 6, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is shorter than a standard, the higher the water temperature when the user takes a bath, the lower the set temperature of the air conditioning device while the user is sleeping. (Appendix 8) The air conditioning control unit An air conditioning control system as described in any one of Appendix 1 to Appendix 7, characterized in that, under conditions in which the time between when the user takes a bath and when they go to bed in the room is shorter than a standard, the more hot water the user uses when bathing, the lower the set temperature of the air conditioning device while the user is sleeping. (Appendix 9) The air conditioning control unit An air conditioning control system as described in any one of Appendix 1 to Appendix 8, characterized in that, under conditions in which the time between when the user takes a bath and when they go to bed in the room is shorter than a standard, the longer the user's bathing time, the lower the set temperature of the air conditioning device while the user is sleeping. (Appendix 10) The air conditioning control unit An air conditioning control system as described in any one of Appendix 1 to Appendix 9, characterized in that, under conditions in which the water temperature when the user takes a bath is higher than a standard, the shorter the time between the user leaving the bath and going to bed in the room, the lower the set temperature of the air conditioning device while the user is sleeping. (Appendix 11) The air conditioning control unit An air conditioning control system as described in any one of Appendix 1 to Appendix 10, characterized in that, under conditions in which the amount of hot water when the user takes a bath is greater than a standard, the shorter the time between the user leaving the bath and going to bed in the room, the lower the set temperature of the air conditioning device while the user is sleeping. (Appendix 12) The air conditioning control unit An air conditioning control system as described in any one of Appendix 1 to Appendix 11, characterized in that, under conditions in which the user's bathing time is longer than a standard, the shorter the time between the user leaving the bath and going to bed in the room, the lower the set temperature of the air conditioner while the user is sleeping. (Appendix 13) The air conditioning control unit The air conditioning control system according to any one of claims 1 to 12, characterized in that the set temperature of the air conditioner is set to a first temperature during a first time period from the time the user goes to bed in the room until a specified time has elapsed, and the set temperature of the air conditioner is set to a second temperature lower than the first temperature during a second time period after the specified time has elapsed. (Appendix 14) The air conditioning control system according to claim 13, wherein the second temperature increases as the temperature of the water when the user takes a bath increases. (Appendix 15) The air conditioning control system according to claim 13 or 14, wherein the second temperature increases as the amount of hot water used by the user during bathing increases. (Appendix 16) 16. The air conditioning control system according to any one of claims 13 to 15, wherein the second temperature increases as the user takes a bath for a longer period of time. (Appendix 17) a sleep state detection unit that detects when the user starts to go to sleep and when the user falls asleep; The air conditioning control system according to any one of claims 13 to 16, characterized in that, depending on the detection result of the sleep state detection unit, the time period from when the user starts going to sleep until when the user falls asleep is set as the first time period, and the time period after the user falls asleep is set as the second time period. (Appendix 18) a sleep state detection unit that detects the depth of sleep of the user; An air conditioning control system as described in any one of appendices 13 to 17, characterized in that, depending on the detection result of the sleep state detection unit, the time period from when the user falls asleep to the end of the second sleep cycle is set as the second time period. (Appendix 19) An air conditioning control system described in any one of Appendix 1 to Appendix 18, characterized in that it is configured to be able to notify information on air conditioning conditions based on information acquired by the bathing information acquisition unit and information acquired by the time information acquisition unit. (Appendix 20) 20. The air conditioning control system according to any one of Supplementary Note 1 to Supplementary Note 19, wherein the air conditioning control unit controls the operation of the air conditioning device in accordance with the individual sleep attributes of the user. (Appendix 21) a data acquisition unit that acquires learning data including information on the amount of rise in core body temperature when the user is bathing, information on the time from when the user leaves the bath until when the user goes to bed, and information on the operating state of the air conditioner when the user goes to bed after bathing; a model generation unit that uses the learning data to generate a trained model for inferring air conditioning conditions of the air conditioner that are suitable for sleep, based on information regarding the amount of rise in deep body temperature during bathing of the user and information regarding the time from when the user leaves the bath to when the user goes to bed; and A learning device comprising: (Appendix 22) The learning device described in Appendix 21, characterized in that the trained model is generated according to the individual sleep attributes of the user. (Appendix 23) a data acquisition unit that acquires information about the amount of rise in deep body temperature when the user is bathing and information about the time from when the user leaves the bath until when the user goes to bed; an inference unit that uses a trained model for inferring operating conditions of an air conditioner from information about the amount of rise in deep body temperature of the user while bathing and information about the time from when the user gets out of the bath to when the user goes to bed, and outputs air conditioning conditions of the air conditioner that are suitable for sleep from information about the amount of rise in deep body temperature of the user while bathing and information about the time from when the user gets out of the bath to when the user goes to bed, which information is acquired by the data acquisition unit; An inference device comprising: [Explanation of symbols]

[0081] 1 Air conditioning device, 10 Bathing information acquisition unit, 20 Time information acquisition unit, 30 Air conditioning control unit, 40 Sleep state detection unit, 50 Notification unit, 100 Learning device, 101 Data acquisition unit, 102 Model generation unit, 102a Reward calculation unit, 102b Function update unit, 103 Learned model storage unit, 200 Inference device, 201 Data acquisition unit, 202 Inference unit

Claims

1. an air conditioning device that conditions the air in the room; a bathing information acquisition unit that acquires information about the amount of rise in deep body temperature when the user is bathing; a time information acquisition unit that acquires information about the time from when the user takes a bath until when the user goes to bed in the room; an air conditioning control unit that controls the operation of the air conditioner while the user is sleeping based on the information acquired by the bathing information acquisition unit and the information acquired by the time information acquisition unit; An air conditioning control system equipped with:

2. The time information acquisition unit The air conditioning control system of claim 1, characterized in that when information on the planned bedtime and information on the actual bedtime are obtained, the latter is used preferentially to obtain information on the time from when the user takes a bath to when the user goes to sleep in the room.

3. The air conditioning control unit 3. The air conditioning control system according to claim 1, wherein the longer the time between when the user takes a bath and when the user goes to bed in the room, the higher the set temperature of the air conditioner while the user is sleeping.

4. The air conditioning control unit The air conditioning control system of claim 1 or 2, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is longer than a standard, the higher the water temperature when the user takes a bath, the higher the set temperature of the air conditioning device while the user is sleeping.

5. The air conditioning control unit The air conditioning control system of claim 1 or 2, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is longer than a standard, the greater the amount of hot water used when the user takes a bath, the higher the set temperature of the air conditioning device while the user is sleeping.

6. The air conditioning control unit The air conditioning control system of claim 1 or 2, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is longer than a standard, the longer the user's bathing time, the higher the set temperature of the air conditioning device while the user is sleeping.

7. The air conditioning control unit The air conditioning control system of claim 1 or 2, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is shorter than a standard, the higher the water temperature when the user takes a bath, the lower the set temperature of the air conditioning device while the user is sleeping.

8. The air conditioning control unit The air conditioning control system of claim 1 or 2, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is shorter than a standard, the greater the amount of hot water used when the user takes a bath, the lower the set temperature of the air conditioning device while the user is sleeping.

9. The air conditioning control unit The air conditioning control system of claim 1 or 2, characterized in that, under conditions in which the time between when the user takes a bath and when they go to sleep in the room is shorter than a standard, the longer the user's bathing time, the lower the set temperature of the air conditioning device while the user is sleeping.

10. The air conditioning control unit The air conditioning control system of claim 1 or 2, characterized in that, under conditions in which the water temperature when the user takes a bath is higher than a standard, the shorter the time between the user leaving the bath and going to bed in the room, the lower the set temperature of the air conditioning device while the user is sleeping.

11. The air conditioning control unit The air conditioning control system of claim 1 or 2, characterized in that, under conditions where the amount of hot water used when the user takes a bath is greater than a standard, the shorter the time between the user leaving the bath and going to bed in the room, the lower the set temperature of the air conditioning device while the user is sleeping.

12. The air conditioning control unit The air conditioning control system according to claim 1 or 2, characterized in that, under conditions in which the user's bathing time is longer than a standard, the shorter the time between the user leaving the bath and going to bed in the room, the lower the set temperature of the air conditioning device while the user is sleeping.

13. The air conditioning control unit The air conditioning control system of claim 1 or 2, characterized in that the set temperature of the air conditioner is set to a first temperature during a first time period from the time the user goes to bed in the room until a specified time has elapsed, and the set temperature of the air conditioner is set to a second temperature lower than the first temperature during a second time period after the specified time has elapsed.

14. The air conditioning control system according to claim 13, wherein the second temperature increases as the temperature of the water when the user takes a bath increases.

15. The air conditioning control system according to claim 13, wherein the second temperature increases as the amount of hot water used by the user during bathing increases.

16. The air conditioning control system according to claim 13, wherein the second temperature increases as the user takes a bath for a longer period of time.

17. a sleep state detection unit that detects when the user starts to go to sleep and when the user falls asleep; The air conditioning control system according to claim 13, characterized in that, depending on the detection result of the sleep state detection unit, the time period from when the user starts going to sleep until when the user falls asleep is set as the first time period, and the time period after the user falls asleep is set as the second time period.

18. a sleep state detection unit that detects the depth of sleep of the user; The air conditioning control system according to claim 13, wherein the second time period is set to be a time period from when the user falls asleep until the end of a second sleep cycle, depending on the detection result of the sleep state detection unit.

19. The air conditioning control system according to claim 1 or 2, characterized in that it is configured to be able to notify information on air conditioning conditions based on information acquired by the bathing information acquisition unit and information acquired by the time information acquisition unit.

20. 3. The air conditioning control system according to claim 1, wherein the air conditioning control unit controls the operation of the air conditioner in accordance with individual sleep attributes of the user.

21. a data acquisition unit that acquires learning data including information on the amount of rise in core body temperature when the user is bathing, information on the time from when the user leaves the bath until when the user goes to bed, and information on the operating state of the air conditioner when the user goes to bed after bathing; a model generation unit that uses the learning data to generate a trained model for inferring air conditioning conditions of the air conditioner that are suitable for sleep, based on information regarding the amount of rise in deep body temperature during bathing of the user and information regarding the time from when the user leaves the bath to when the user goes to bed; and A learning device comprising:

22. The learning device according to claim 21, characterized in that the trained model is generated according to the individual sleep attributes of the user.

23. a data acquisition unit that acquires information about the amount of rise in deep body temperature when the user is bathing and information about the time from when the user leaves the bath until when the user goes to bed; an inference unit that uses a trained model for inferring operating conditions of an air conditioner from information about the amount of rise in deep body temperature of the user while bathing and information about the time from when the user gets out of the bath to when the user goes to bed, and outputs air conditioning conditions of the air conditioner that are suitable for sleep from information about the amount of rise in deep body temperature of the user while bathing and information about the time from when the user gets out of the bath to when the user goes to bed, which information is acquired by the data acquisition unit; An inference device comprising:

Images