Immersive sleep-aiding eyeshade and self-adaptive closed-loop control method thereof in perimenopausal period

Abstract

The invention discloses an immersive sleep-aiding eyeshade and a self-adaptive closed-loop control method of the immersive sleep-aiding eyeshade in a perimenopausal period. The sensing module is used for collecting signals of periorbital skin temperature, heart rate / heart rate variability, body movement and the like, and the sleep stage, hectic fever risk and awakening / anxiety state are constructed; the control module jointly adjusts the hot compress set temperature, the audio mode / volume and the aromatherapy dosage under the safety constraint, and automatically executes suppression strategies such as heat stopping / cooling when the hectic fever risk is increased, so that night awakening is reduced, and the sleep experience is improved.

Description

Technical Field This invention relates to the field of sleep aids technology, and in particular to a multimodal adaptive closed-loop control method for sleep disorders and hot flashes in perimenopausal women. Background Technology

[0001] Modern populations commonly experience difficulty falling asleep, shallow sleep, and frequent awakenings at night. Perimenopause / menopausal women often experience physiological and psychological reactions such as hot flashes, palpitations, and anxiety, leading to fragmented sleep and further exacerbating fatigue and mood swings.

[0002] Most existing sleep aids rely on single-sensory stimulation, such as simple white noise players, ordinary steam eye masks, or aromatherapy diffusers. Single stimulation often fails to simultaneously address the full range of needs: rapid sleep onset, stable sleep maintenance, and handling of hot flashes / wake-ups. Furthermore, in bed with a partner, external sound may cause interference. Aromatherapy diffusers are difficult to control in terms of dosage, resulting in issues such as overly strong odors, excessively long duration of sleep, or discomfort for sensitive individuals. Steam eye masks have a fixed temperature profile, making it impossible to safely and effectively dynamically adjust them based on individual skin temperature, body movement, and autonomic nervous system status.

[0003] Therefore, there is an urgent need for an immersive relaxation and sleep aid device and method that can integrate thermal, auditory, and olfactory modal stimulation without disturbing the partner, and can adaptively adjust based on physiological and behavioral signals, while also having safety constraints and closed-loop feedback. Summary of the Invention

[0004] I. Technical problems to be solved This invention aims to address the problems of existing sleep aid products, such as being single-modal, lacking closed-loop feedback, being unable to cope with perimenopausal hot flashes and awakening events, and having difficulty in finely controlling dosage and safety boundaries. It provides a wearable eye mask-shaped multi-sensory immersive relaxation sleep aid system, along with a corresponding adaptive closed-loop control method.

[0005] II. Technical Solution To achieve the above objectives, the present invention provides the following technical solution: (1) An immersive relaxation sleep aid eye mask, comprising: an eye mask body, a sensing module (101), a control module (102), a heat therapy module (103), a bone conduction sound module (104), and an aromatherapy module (105). The hot compress module (103) is located around the eye socket and forms at least two partitioned heating units (e.g., left 103a and right 103b); the bone conduction sound module (104) is located near the temples on both sides of the eye mask and forms left and right dual-channel bone conduction transducer units (104a, 104b); the aromatherapy module (105) includes a replaceable aromatherapy box (105b) and a dosage control mechanism (105c, 105d) and guides the aromatherapy gas to the local area near the nose through the air outlet (105a); the control module (102) is electrically connected to the sensing module (101) and is electrically connected to the hot compress module (103), the bone conduction sound module (104) and the aromatherapy module (105) respectively to output control commands.

[0006] (2) A multimodal adaptive closed-loop control method applicable to the above-mentioned eye mask, the method includes: collecting signals such as skin temperature, heart rate / heart rate variability, body movement (optional skin conductance, ambient temperature and humidity); preprocessing and extracting features from the signals; estimating sleep stage / wake risk and vasomotor (hot flash) risk status based on features; after passing the safety constraint layer verification, jointly outputting the hot compress setting temperature and temperature rise slope, bone conduction audio mode and volume, aromatherapy dosage and release rhythm; and adaptively updating the individual strategy based on the nighttime result indicators.

[0007] (3) A strategy for identifying and suppressing perimenopausal hot flashes: When the system detects that “rapid increase in skin temperature + increase in heart rate or decrease in HRV + increase in body movement” or a combination thereof meets the preset criteria, the system is switched from sleep maintenance mode to hot flash suppression mode. The system reduces or pulses the output of heat therapy, improves the stability of white noise / meditation guidance, and releases soothing aromatherapy (e.g., lavender) for a short time to relieve sympathetic excitation. After the risk is eliminated, the system enters the recovery transition mode and gradually returns to sleep maintenance mode.

[0008] (4) Optionally, the control module (102) communicates with the mobile terminal (106), which is used for parameter configuration, playback content management, and viewing of sleep and hot flash event records; the control module can complete real-time closed-loop calculation locally, avoiding reliance on network connection.

[0009] III. Beneficial Effects Compared with the prior art, the present invention has at least the following beneficial effects: 1) Multimodal synergy: Heat therapy, bone conduction sound and aromatherapy are delivered synergistically on the same wearable device to create a stronger sense of relaxation and immersion; 2) Partner-friendly: Bone conduction directional sound significantly reduces external interference in bed-sharing scenarios; 3) Closed-loop adaptive: Based on signals such as skin temperature, HRV and body movement, state estimation and real-time adjustment are performed to balance rapid sleep onset and sleep maintenance; 4) Specialized treatment for hot flashes: Introducing hot flash risk status and strategy switching, which can suppress and soothe hot flashes when they occur or are about to occur at night; 5) Safe and controllable: Multiple constraints are set, such as upper temperature limit, heating rate, abnormal contact and aromatherapy dosage, to reduce the risk of burns, excessive stimulation and discomfort. Attached Figure Description

[0010] Figure 1 This is a structural block diagram of the immersive relaxation sleep aid eye mask system provided in an embodiment of the present invention; Figure 2 A flowchart of the multimodal adaptive closed-loop control method provided in an embodiment of the present invention; Figure 3 This is a schematic diagram of the eye mask structure and module arrangement provided in an embodiment of the present invention; Figure 4 This is a schematic curve of temperature setting and heat suppression window provided in an embodiment of the present invention; Figure 5 This is a schematic diagram of the working state machine and mode switching provided in an embodiment of the present invention; Figure 6 This is a data flow diagram illustrating feature extraction and state estimation / joint decision-making provided in an embodiment of the present invention; Figure 7 This is a schematic diagram of the aromatherapy dosage control and gas path structure provided in an embodiment of the present invention. Detailed Implementation

[0011] The technical solution of the present invention will be further described below with reference to the accompanying drawings. It should be understood that the embodiments described are only for illustrating the present invention and are not intended to limit the scope of protection of the present invention; various modifications and substitutions can be made by those skilled in the art without departing from the concept of the present invention, and all such modifications and substitutions should fall within the scope of protection of the present invention.

[0012] I. Overall Structure (see) Figure 1 , Figure 3 ) The eye mask of the present invention can be designed as a flexible covering structure, including an outer light-blocking layer, an inner skin-friendly layer, and a middle functional layer. The outer light-blocking layer is used to block light and reduce external interference; the inner skin-friendly layer fits the skin around the eyes and can be made of skin-friendly fabric or medical-grade silicone pads; the middle functional layer integrates a heat therapy module (103), a bone conduction sound module (104), an aromatherapy module (105), and wiring and power components.

[0013] The sensing module (101) may include: a skin temperature sensor (101a), a photoplethysmography (PPG) sensor, and an inertial measurement unit (IMU) (101b), and optionally, skin electrodermal absorption (EDA) electrodes, an ambient temperature and humidity sensor, etc. The temperature sensor is preferably positioned in a non-ocular area between the eyebrows or above the bridge of the nose to reflect local skin temperature and reduce the impact of blinking; the PPG and IMU may be positioned on the forehead or temple to acquire pulse wave and body movement information.

[0014] The control module (102) includes a processor, memory, and interface circuitry. The processor can be a low-power MCU or SoC; the memory stores the control program, individual parameters, and nighttime recordings; the interface circuitry acquires analog / digital sensor signals and drives the heating unit, bone conduction transducer, and aromatherapy dosage control mechanism. The power supply can be a rechargeable lithium battery, coupled with a charging management chip; to enhance safety, a temperature fuse, overcurrent protection, and low-voltage shutdown strategy can be implemented.

[0015] II. Structure and Control of the Heating Module (103) The heating module (103) can use a flexible resistance heating film, carbon fiber heating element, or metal foil heating element, preferably arranged in two zones (103a, 103b) with a heat-conducting and temperature-equalizing layer and a heat-insulating layer between the heating layer and the skin. The temperature-equalizing layer can be made of aluminum foil composite film or thermally conductive silicone layer to reduce local hot spots; the heat-insulating layer can be made of aerogel or low thermal conductivity foam to reduce heat loss and energy consumption.

[0016] In terms of control, the control module (102) can achieve closed-loop temperature control based on feedback from the temperature sensor. Preferred settings include: target temperature T_set, upper temperature limit T_max, upper heating rate limit r_max, and zone temperature difference constraint ΔT_zone. For example, T_set can be adjusted within the range of 34℃ to 40℃, T_max should not exceed 42℃; r_max can be set to 0.5℃ / min to 2℃ / min; ΔT_zone can be limited to within 2℃ to maintain consistent comfort on both sides.

[0017] For perimenopausal women, the system can use a "slow temperature rise + plateau" temperature curve during the sleep induction phase to promote eye relaxation; reduce average heat output during the sleep maintenance phase to reduce nighttime awakenings; and when an increased risk of hot flashes is detected, reduce the T_set or pulsed output to alleviate the heat load (see [link to relevant documentation]). Figure 4 Avoid the combination of "external heat stimulation" and hot flashes, which can cause discomfort.

[0018] III. Structure and Control of Bone Conduction Sound Module (104) The bone conduction sound module (104) can consist of two bone conduction transducers (104a, 104b) positioned near the temples on both sides of the eye mask, maintaining stable contact pressure through an elastic structure. The transducers can play white noise, pink noise, natural sounds, or meditation guidance voices. Compared to external speakers, bone conduction can directionally transmit sound energy to the wearer, significantly reducing external interference to the partner.

[0019] The control module (102) can adjust the audio mode and volume based on the state estimation results, for example: using gradually decreasing white noise or guiding voice during the sleep induction stage; maintaining a low-volume stable sound during the sleep maintenance stage; and briefly increasing the low-frequency masking component to counteract sudden environmental noise when an increased risk of awakening is detected. Optionally, the system can introduce "leakage constraint", that is, using an environmental microphone to estimate the leakage sound pressure and limit the upper limit of the volume.

[0020] IV. Structure and Dosage Control of Aromatherapy Module (105) (See...) Figure 7 ) The aromatherapy module (105) includes a replaceable aromatherapy box (105b), a micropump / microvalve (105c), a mixing channel (105d), and an air outlet (105a). A porous carrier or microcapsule carrier containing volatile oils can be placed inside the aromatherapy box. The micropump / microvalve controls the airflow through the carrier according to the duty cycle, or controls the release of trace amounts of volatiles; the mixing channel mixes with ambient air and reduces irritation; the air outlet is positioned near the nose, allowing the fragrance to work locally and reducing its impact on the person sharing the bed.

[0021] Dosage control can be achieved using open-loop timing or closed-loop estimation. For example, the instantaneous release rate q_aroma can be estimated using "valve duty cycle D + channel flow resistance R + ambient temperature and humidity," and the cumulative dose Q_aroma can be constrained to not exceed the individual's tolerance threshold. The system can provide multiple aromatherapy rhythms: continuous low dose, intermittent pulses, or short releases after awakening / hot flashes. For individuals sensitive to fragrance, aromatherapy can be turned off or only a fragrance-free mode can be used.

[0022] V. Signal Processing, State Estimation, and Joint Decision Making (see...) Figure 2 , Figure 6 ) The control module (102) acquires sensor signals at a fixed sampling period Δt (e.g., 0.5–2 seconds). Preprocessing includes: low-pass filtering and drift compensation of the temperature signal; band-pass filtering of the PPG and detection of the pulse peak to obtain HR and HRV indices; calculation of body movement intensity and turning events from the IMU signal; and extraction of skin conductance response from the optional EDA signal. Feature extraction may include: skin temperature change rate dT / dt, temperature variance, RMSSD, SDNN, heart rate rise amplitude, turning rate, and short-term arousal probability, etc.

[0023] State estimation can employ rule-based models, lightweight classifiers, or temporal models. For example, sleep states S_sleep∈{awake / transitional sleep / light sleep / deep sleep}, vasodilation states S_vaso∈{low / medium / high}, and arousal risk S_arousal∈[0,1] can be constructed. S_vaso can be calculated based on a combination of dT / dt, HR changes, EDA bursts, and body movement; S_sleep can be estimated based on HRV levels and body movement stability.

[0024] Joint decision-making can adopt a hierarchical structure: the first layer is a safety constraint layer, ensuring that any output does not exceed the upper limits of temperature, heating rate, cumulative aromatherapy dosage, and battery and hardware safety thresholds; the second layer is an adaptive layer, which selects the control output U according to the objective function J (e.g., minimizing sleep onset time, minimizing the number of awakenings, minimizing the duration of hot flashes, and maximizing comfort scores). The output U can be represented as U={T_set,ramp,audio_mode,volume,aroma_dose}, and is adjusted at a certain update cycle (e.g., 10-60 seconds).

[0025] VI. Strategies for Identifying and Suppressing Hot Flashes During Perimenopause (See...) Figure 4 , Figure 5 ) Perimenopausal hot flashes are typically characterized by a short-term increase in skin temperature, heart rate, sympathetic excitation, and increased body movement. This invention proposes a hot flash risk index, R_vaso, which can be obtained by weighting the following components: R_vaso = w1·sigmoid(dT / dt) + w2·sigmoid(ΔHR) + w3·sigmoid(EDA_event) + w4·sigmoid(Motion). When R_vaso exceeds a threshold θ1, the system enters an "early warning" state, reducing the heat output, decreasing irritating aromatherapy, and maintaining stable white noise. When R_vaso exceeds a higher threshold θ2 or the duration reaches a threshold, the system enters an "inhibition" state, switching the heat temperature curve to... Figure 4 The heat suppression window shown employs methods such as reducing T_set, pulsed output, or short-term heating cessation; simultaneously, it maintains stable bone conduction sound and briefly releases soothing aromatherapy to aid in calming.

[0026] Once the risk resolution criterion is met (e.g., R_vaso remains below θ1 for τ seconds), the system enters a recovery transition mode and gradually returns to sleep maintenance mode to avoid a sudden change in control output that could cause a second awakening. Figure 5 The switching relationship between the various modes is shown.

[0027] VII. Personalized Adaptive Updates and Records Because individuals have significant differences in their preferences and tolerance for temperature, sound, and aromatherapy, this invention allows for individualized updates based on nighttime results. Results indicators may include: sleep latency, number of nighttime awakenings, subjective comfort score, number and duration of hot flashes, etc. The control module can use a sliding window to statistically update parameters such as thresholds θ1, θ2, the upper limit of aromatherapy dosage Q_max, and the initial value of T_set during the sleep onset stage, forming a long-term individualized strategy. Updates can be performed locally or visualized and manually corrected via a mobile terminal (106).

[0028] VIII. Safety and Troubleshooting This invention incorporates safety mechanisms at both the hardware and software levels: the hardware level includes a thermal fuse, overcurrent protection, and charging temperature protection; the software level includes abnormal temperature fluctuation detection, sensor detachment detection (e.g., PPG quality index being too low), and a watchdog reset mechanism. When an anomaly is detected, the system enters a safety degradation mode: heating and aromatherapy are stopped, the volume is reduced to a safe level or turned off, and the user is prompted to check the wearing status.

[0029] IX. Other Embodiments and Optional Modifications 1) The heating module can be replaced with a semiconductor thermoelectric cooling pad to achieve alternating hot and cold temperatures; 2) The bone conduction sound module can support dual-band directional strategies or be linked with an external sleep aid content library; 3) The aromatherapy module can adopt a pump-free structure with solid incense tablets and micro-heating; 4) The sensing module can be equipped with a breathing belt or microphone for respiratory rate estimation; 5) The control algorithm can be upgraded from a rule model to a lightweight neural network or reinforcement learning strategy, but it needs to run under a safety constraint layer.

[0030] For ease of understanding, the following is a comparison of the reference numerals in the attached figures: 101 Sensing module; 101a Skin temperature sensor; 101b PPG / IMU combined sensor; 102 Control module; 103 Hot compress module; 103a Left hot compress zone; 103b Right hot compress zone; 104 Bone conduction acoustic module; 104a Left bone conduction transducer; 104b Right bone conduction transducer; 105 Aromatherapy module; 105a Air outlet; 105b Aromatherapy box; 105c Micropump / microvalve; 105d Mixing channel; 106 Mobile terminal.

[0031] (a) Example of setting parameters and thresholds In an unrestricted example, the temperature control parameters for the sleep guidance mode can be set as follows: initial T_set0 = 34℃, increasing the temperature to 38℃ at r = 1℃ / min and maintaining it for 10–25 minutes; in sleep maintenance mode, maintaining T_set in the range of 35℃–37℃ and gradually decreasing the volume to V_min; when an increased risk of awakening is detected (e.g., S_arousal > 0.6 for 30 seconds), the low-frequency component of white noise is briefly amplified and the aromatherapy is released in a pulsed manner (e.g., activated for 5 seconds every 90 seconds).

[0032] The risk thresholds for hot flashes can be set to θ1=0.65 and θ2=0.80 (which can be updated individually). The weights w1 to w4 of the risk index R_vaso can be initially set during factory calibration and then fine-tuned based on nighttime feedback: if the user reports "significant hot flash interference", w1 and w2 are appropriately increased; if the user is sensitive to fragrance, the upper limit of the fragrance dosage Q_max is reduced and the stop threshold is increased.

[0033] (II) Signal quality assessment and artifact removal Considering that wearing the device before sleep and turning over may cause a decrease in PPG signal quality, this invention can calculate the PPG quality index (QI), for example, based on pulse peak consistency, baseline drift amplitude, and signal-to-noise ratio to obtain QI∈[0,1]. When QI is lower than the threshold QI_min, the system reduces the weight of HRV features and uses body movement and temperature change rate for state estimation, prompting the user to adjust the wearing position; when the temperature sensor shows a sudden change or the reading exceeds the physiologically reasonable range, the system determines that it has fallen off or has poor contact and immediately stops heating.

[0034] (III) Typical Rules of the Security Constraint Layer The safety constraint layer may include, but is not limited to: 1) Temperature upper limit constraint: 1) T_meas≤T_max; 2) Heating rate constraint: |T_meas(t)-T_meas(t-Δt)| / Δt≤r_max; 3) Cumulative heat constraint: Energy input E_W within any window W does not exceed the threshold; 4) Aromatherapy cumulative dose constraint: Σ q_aroma·Δt ≤ Q_max; 5) Continuous stimulation constraint: The continuous on time of aromatherapy does not exceed t_on_max, and there must be a minimum off interval t_off_min; 6) Battery safety constraint: High-power heating is prohibited when the battery power is lower than SOC_min; 7) Skin sensitivity protection: When the user selects the sensitive mode, T_set and aromatherapy dose are automatically reduced.

[0035] (iv) Examples of implementation methods for joint decision-making layers The joint decision-making layer can adopt a hybrid approach of "rules + optimization". The rule part provides a baseline value for the control output based on the pattern (sleep / maintenance / hot flashes / recovery / wakefulness); the optimization part makes small adjustments to the baseline value within safety constraints to minimize the objective function J. The objective function can be defined as: J = α·S_arousal + β·R_vaso + γ·|T_meas - T_comfort| + δ·Stim, where Stim represents the stimulus intensity penalty term, used to avoid excessively loud sounds or overly strong aromatherapy. α, β, γ, and δ can be configured differently depending on the population (perimenopause / general population).

[0036] (V) Example 1: Sleep Induction and Relief of Eye Fatigue Users wear the eye mask before bed, and the system enters sleep guidance mode after detecting stable wear. The heating module slowly heats up according to a preset temperature curve, bone conduction sounds play gradually fading white noise or meditation guidance, and the aromatherapy module intermittently releases lavender scent in low doses. The system monitors body movement and HRV in real time. When S_sleep transitions from "sleep transition" to "light sleep" and remains stable for more than the set time (e.g., 5 minutes), the system switches to sleep maintenance mode, reducing temperature and volume and extending the aromatherapy pulse interval to minimize interference with deep sleep.

[0037] (vi) Example 2: Suppression of nocturnal hot flashes After the user enters sleep maintenance mode, the system continuously monitors dT / dt, ΔHR, and body movement. If a rapid increase in dT / dt and heart rate is detected, and R_vaso exceeds θ2, the system enters a hot flash suppression mode: immediately reducing T_set and pausing continuous heating, switching to short pulse output to avoid heat accumulation; maintaining stable white noise through bone conduction to mask external stimuli; and briefly releasing a soothing aromatherapy scent, which is then turned off after reaching the upper dose limit. Once R_vaso decreases and stabilizes, the system enters a recovery transition mode, gradually restoring maintenance parameters. This strategy reduces the duration of hot flashes and lowers the probability of awakening caused by hot flashes.

[0038] (vii) Example 3: Leakage control in the context of bed partners In a bed-sharing setting, the system can be equipped with an ambient microphone or use a calibration model of transducer current and leakage sound pressure to estimate the leakage level. When leakage exceeds a preset threshold, the system prioritizes reducing the external sound output while maintaining the bone conduction component, or reduces the high-frequency portion to minimize audible leakage, while maintaining the wearer's subjective hearing. This allows for stable sleep-aiding sound stimulation without disturbing the partner.

[0039] (viii) Data recording and privacy protection The system can record only the statistics related to sleep assessment locally (such as sleep onset time, number of awakenings, hot flash event timestamps and durations, average temperature and stimulus intensity), without having to record the original physiological waveforms; if the user authorizes synchronization with the mobile terminal, the transmission process can use an encrypted channel and allow the user to delete the history at any time.

[0040] 10. Industrial Applicability The eye mask of this invention is easy to wear before bedtime, has a compact structure, can be mass-produced, and is suitable for home sleep assistance and perimenopausal nighttime hot flash intervention, and has good industrial application prospects.

Claims

1. An immersive sleep-aiding eye mask, characterized in that, include: Sensing module, control module, hot compress module, bone conduction sound module, and aromatherapy module; The sensing module is used to collect at least one physiological / behavioral signal, and the control module performs state estimation based on the physiological / behavioral signal and outputs multimodal control commands to drive the heat therapy module, the bone conduction sound module and the aromatherapy module to work together; wherein, the control module is configured to execute at least a suppression strategy of reducing or stopping the heat therapy output when an increased risk of hot flashes is detected.

2. The immersive sleep-aid eye mask according to claim 1, characterized in that, The physiological / behavioral signals include at least one of the following: periocular skin temperature (T_skin), heart rate (HR) and heart rate variability (HRV), and body movement signal (Motion).

3. The immersive sleep-aid eye mask according to claim 1, characterized in that, The sensing module also includes a skin conductance EDA sensor and / or an ambient temperature and humidity sensor to help determine the risk of sympathetic excitation and hot flashes.

4. The immersive sleep-aid eye mask according to claim 1, characterized in that, The hot compress module includes a flexible heating film and a temperature sensor, and the flexible heating film is divided into left and right sections and supports zoned heating control.

5. The immersive sleep-aid eye mask according to claim 1, characterized in that, The bone conduction sound module includes left and right bone conduction transducers and limits the leakage sound pressure or external sound energy to reduce interference to the bed partner.

6. The immersive sleep-aid eye mask according to claim 1, characterized in that, The aromatherapy module includes a replaceable aromatherapy carrier and a controllable release mechanism. The controllable release mechanism releases aromatherapy in pulses according to a duty cycle and sets a daily cumulative dose limit.

7. An immersive sleep-aid eye mask according to claim 1, characterized in that, The state estimation includes outputting at least two of the following: sleep stage state S_sleep, hot flash risk state S_vaso, and arousal / anxiety state S_arousal.

8. A multimodal adaptive closed-loop control method for an immersive sleep-aiding eye mask in a perimenopausal population, applied to the immersive relaxation sleep-aiding eye mask as described in any one of claims 1-7, characterized in that... include: Collect physiological / behavioral signals; Feature extraction; State estimation; outputting multimodal control quantities under safety constraints and driving heat therapy, bone conduction sound, and aromatherapy; And record the results metrics to update personalized parameters.

9. The multimodal adaptive closed-loop control method according to claim 8, characterized in that, The state estimation outputs a hot flash risk state S_vaso; when S_vaso reaches a preset level, a suppression strategy is executed, which includes at least reducing or stopping the heat therapy output and reducing or pausing the aromatherapy release.

10. The multimodal adaptive closed-loop control method according to claim 9, characterized in that, The personalized update employs a multi-armed slot machine algorithm or an equivalent exploration-exploitation strategy, selecting an update strategy based on a reward function that includes awakening duration, number of awakenings, cumulative hot flash risk value, and user rating.

Images