Whole house intelligent regulation and control method, device and equipment and computer readable storage medium

Abstract

The invention relates to the technical field of smart home, and discloses a whole house intelligent regulation and control method, device and equipment and a computer readable storage medium. The method comprises the steps that if it is detected that a human body exists in a room, indoor infrared radiation signals are continuously collected, and a human body heart rate value and a human body posture are determined based on the infrared radiation signals; determining human body state information based on the human body heart rate value and the human body posture; and according to the human body state information, indoor intelligent household appliances are regulated and controlled. According to the method, the human body heart rate value and the human body posture are determined by collecting the indoor infrared radiation signal, then the indoor intelligent household electrical appliances are regulated and controlled based on the human body heart rate value and the human body posture, regulation and control of the intelligent household electrical appliances in the whole house can be carried out actively according to the human body heart rate value and the human body posture of the user, and then the convenience of intelligent regulation and control of the whole house is improved.

Description

Technical Field

[0001] The present application relates to the field of smart home technology, and in particular to a whole-house smart control method, device, equipment, and computer-readable storage medium. Background Art

[0002] With the development of technology, smart home appliances have gradually entered thousands of households. Users can control various smart home appliances in their homes according to their own needs.

[0003] However, currently various smart home appliances are usually passively controlled based on voice commands or control commands actively issued by users, and cannot actively control according to the user's status. Therefore, the convenience of whole-house smart control needs to be improved. Summary of the Invention

[0004] In view of this, the purpose of this application is to overcome the deficiencies in the prior art and provide a whole-house intelligent control method, the method comprising:

[0005] If a human body is detected in the room, the infrared radiation signal in the room is continuously collected, and the heart rate value and posture of the human body are determined based on the infrared radiation signal;

[0006] Determining human body state information based on the human body heart rate value and the human body posture;

[0007] Indoor smart home appliances are regulated according to the human body status information.

[0008] In one embodiment, the step of determining human body state information based on the human body heart rate value and the human body posture includes:

[0009] The human heart rate values collected each time are sorted by time to obtain heart rate value time series data, and the human postures collected each time are sorted by time to obtain human posture time series data;

[0010] Align the heart rate time series data with the human body posture time series data, and count the changes in the heart rate value and the human body posture in the same time period;

[0011] The human body state information is determined according to the changes in the heart rate value and the changes in the human body posture.

[0012] In one embodiment, the step of regulating indoor smart appliances based on the human body status information includes:

[0013] If it is determined according to the human body state information that the human body is in a normal state, analyzing the human body posture to determine the human body activity type, and regulating the indoor smart home appliances according to the activity type and a first preset regulation rule;

[0014] If it is determined that the human body is in an abnormal state according to the human body state information, the indoor smart home appliances are regulated according to the second preset regulation rule, and an abnormality alarm is issued.

[0015] In one embodiment, the method further comprises:

[0016] Get the current time information and query the historical human body status information and historical control parameters for the same time period;

[0017] If the current human body state information is the same as the historical human body state information, the indoor smart home appliances are regulated based on the historical regulation parameters.

[0018] In one embodiment, regulating indoor smart appliances further includes:

[0019] Send out prompt information on whether to control indoor smart appliances;

[0020] When receiving the user's confirmation instruction, the control operation of the indoor smart appliances is executed.

[0021] In one embodiment, the step of detecting the presence of a human body in a room includes:

[0022] Collecting infrared radiation signals in the room and extracting heart rate values from the infrared radiation signals;

[0023] If the heart rate value is within a preset heart rate range, generating a thermal image based on the infrared radiation signal;

[0024] If a human body region is detected based on the thermal image, it is determined that a human body exists in the room.

[0025] In one embodiment, the step of detecting a human body region based on the thermal image includes:

[0026] Segmenting the thermal image to obtain a foreground thermal image;

[0027] extracting temperature distribution features and geometric features of each heat concentration area in the foreground thermal image;

[0028] Based on the temperature distribution characteristics, determining the temperature mean corresponding to the heat concentration area;

[0029] If the temperature mean is within the preset human body temperature range, comparing the geometric feature with the preset human body geometric feature;

[0030] If the geometric features are the same as the preset human body geometric features, the heat concentration area is determined to be a human body area.

[0031] The present application also provides a whole-house intelligent control device, which includes:

[0032] The acquisition module is used to continuously acquire infrared radiation signals in the room if a human body is detected in the room, and determine the human heart rate value and human posture based on the infrared radiation signals;

[0033] A determination module, configured to determine human body state information based on the human body heart rate value and the human body posture;

[0034] The control module is used to control indoor smart appliances according to the human body status information.

[0035] The present application also provides a computer device, which includes a processor and a memory, the memory storing a computer program, and the processor being used to execute the computer program to implement the above-mentioned whole-house intelligent control method.

[0036] The present application also provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, it executes the above-mentioned whole-house intelligent control method.

[0037] The embodiments of the present application have the following beneficial effects:

[0038] The whole-house smart control method of the present application: if the presence of a human body is detected indoors, the infrared radiation signals in the room are continuously collected, and the human heart rate and posture are determined based on the infrared radiation signals; based on the human heart rate and posture, the human state information is determined; and based on the human state information, the smart home appliances in the room are controlled. This method determines the human heart rate and posture by collecting infrared radiation signals in the room, and then controls the smart home appliances in the room based on the human heart rate and posture. This method can actively control the smart home appliances in the whole house according to the user's heart rate and posture, thereby improving the convenience of whole-house smart control. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] To more clearly illustrate the technical solution of this application, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the following drawings only illustrate certain embodiments of this application and should not be considered as limiting the scope of protection of this application. Those skilled in the art can also derive other relevant drawings based on these drawings without inventive effort.

[0040] Figure 1 This is a flow chart of the first embodiment of the whole-house intelligent control method provided by this application;

[0041] Figure 2This is a flow chart of the second embodiment of the whole-house intelligent control method provided by this application;

[0042] Figure 3 This is a flow chart of the third embodiment of the whole-house intelligent control method provided by this application;

[0043] Figure 4 This is a flow chart of the fourth embodiment of the whole-house intelligent control method provided by this application;

[0044] Figure 5 This is a flow chart of the fifth embodiment of the whole-house intelligent control method provided by this application;

[0045] Figure 6 This is a flow chart of the sixth embodiment of the whole-house intelligent control method provided by this application;

[0046] Figure 7 This is a flow chart of the seventh embodiment of the whole-house intelligent control method provided by this application;

[0047] Figure 8 This is a schematic diagram of the structure of the whole-house intelligent control device provided in this application. DETAILED DESCRIPTION

[0048] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0049] The components of the embodiments of the present application generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the claimed application, but rather merely represents selected embodiments of the present application. All other embodiments obtained by those skilled in the art based on the embodiments of the present application without creative effort are within the scope of protection of the present application.

[0050] Hereinafter, the terms "including", "having" and their cognates, which may be used in various embodiments of the present application, are intended only to indicate specific features, numbers, steps, operations, elements, components or combinations of the foregoing items, and should not be understood as first excluding the existence of one or more other features, numbers, steps, operations, elements, components or combinations of the foregoing items or the possibility of adding one or more features, numbers, steps, operations, elements, components or combinations of the foregoing items.

[0051] Furthermore, the terms “first,” “second,” “third,” etc., are merely used for distinguishing descriptions and are not to be understood as indicating or implying relative importance.

[0052] Unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by those skilled in the art to which the various embodiments of the present application belong. The terms (such as those defined in generally used dictionaries) will be interpreted as having the same meaning as in the context of the relevant technical field and will not be interpreted as having an idealized meaning or an overly formal meaning unless clearly defined in the various embodiments of the present application.

[0053] It can be understood that the method of the present application is applied to a whole-house intelligent control system, which includes infrared sensors, central processors and other equipment to execute the whole-house intelligent control method.

[0054] The following describes some embodiments of the present application in detail with reference to the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments may be combined with each other.

[0055] Please refer to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the whole-house intelligent control method provided by this application, which includes:

[0056] Step S101: If a human body is detected in the room, infrared radiation signals in the room are continuously collected, and the heart rate value and posture of the human body are determined based on the infrared radiation signals.

[0057] In this embodiment, the whole-house intelligent control system collects infrared radiation signals in the room through infrared sensors installed in advance in the room, determines the heart rate value and thermal image based on the collected infrared radiation signals, detects the presence of a human body in the room based on the heart rate value and thermal image, continuously collects infrared radiation signals in the room through infrared sensors in the room, determines the heart rate value and thermal image of the human body based on the infrared radiation signals, and determines the human body posture based on the thermal image.

[0058] Step S102: determining human body state information based on the human body heart rate value and the human body posture.

[0059] In this embodiment, the whole-house intelligent control system determines the human state information based on the human heart rate value and human posture. In one embodiment, the whole-house intelligent control system determines the human state information based on the collected human heart rate value and human posture, combined with a pre-created heart rate-posture-state mapping relationship table.

[0060] It should be noted that the normal human heart rate range is as follows: Resting state: 60-100 beats / minute for adults (ideal range 50-90 beats / minute). Exercise state: increases with intensity (maximum heart rate ≈ 220-age), but needs to be combined with the individual's basic level. Heart rate variability (HRV): reflects the regulatory ability of the autonomic nervous system. Under normal circumstances, HRV is high (such as SDNN ≥ 50ms), and HRV decreases under stress or pathological conditions. Human posture includes: static normal posture: upright or sitting with an upright spine and symmetrical limbs (such as arms hanging naturally and legs lying flat); no abnormal twisting (such as hunching over, body tilting) or abnormal fixed posture (such as rigidity). Dynamic normal posture: coordinated movements (such as natural arm swing and even stride when walking); flexible reactions (such as avoiding stimuli and quick grasping). Human body state information includes: normal state, abnormal state, etc.

[0061] Step S103: regulating indoor smart home appliances according to the human body status information.

[0062] In this embodiment, the whole-house intelligent control system controls indoor smart appliances based on human body status information. Optionally, the whole-house intelligent control system determines the control parameters for the indoor smart appliances based on the human body status and a pre-created state-control parameter mapping table. Based on the control parameters, the indoor smart appliances are controlled so that the current operation of the smart appliances is consistent with the current human body status. Optionally, the whole-house intelligent control system determines that an emergency situation has occurred in the room based on the human body status and controls the indoor smart alarm devices to sound an alarm, including notifying relevant personnel through sound, lights, text messages, phone calls, etc., to ensure a timely response.

[0063] The whole-house smart control system of this embodiment continuously collects infrared radiation signals from the room if a human presence is detected, and determines the human heart rate and posture based on the infrared radiation signals; determines human status information based on the human heart rate and posture; and controls the smart home appliances in the room based on the human status information. This method determines the human heart rate and posture by collecting infrared radiation signals from the room, and then controls the smart home appliances based on the human heart rate and posture. This method can proactively control the smart home appliances in the room based on the user's heart rate and posture, thereby improving the convenience of whole-house smart control.

[0064] Please refer to Figure 2 , Figure 2 This is a flow chart of a second embodiment of the whole-house intelligent control method provided by this application. The difference between the second embodiment and the first embodiment is that the step of determining the human body state information based on the human heart rate value and the human body posture includes:

[0065] Step S201 , sorting the human heart rate values collected each time by time to obtain heart rate value time series data, and sorting the human postures collected each time by time to obtain human posture time series data.

[0066] In this embodiment, the whole-house intelligent control system time-sorts the human heart rate values collected each time to obtain heart rate value time series data, and time-sorts the human postures collected each time to obtain human posture time series data. For example, the whole-house intelligent control system collects a human heart rate value every 0.5 seconds, and time-sorts the human heart rate values collected within 5 seconds, and the obtained heart rate value time series data includes 10 human heart rate values. The whole-house intelligent control system collects a human posture every 0.5 seconds, and time-sorts the human postures collected within 5 seconds, and the obtained human posture time series data includes 10 human postures.

[0067] Step S202: align the heart rate time series data and the human body posture time series data, and collect statistics on changes in heart rate values and human body posture in the same time period.

[0068] In this embodiment, the whole-house intelligent control system aligns the obtained heart rate value time series data with the human body posture time series data, and then calculates the changes in heart rate value and human body posture in the same time period. For example, within the same 5-second period, the whole-house intelligent control system aligns the obtained heart rate value time series data with the human body posture time series data. Then, each human body posture will correspond to a human heart rate value, and the changes in human body posture within these five seconds will correspond to the changes in heart rate value within these five seconds.

[0069] Step S203: determining the human body state information according to the change of the heart rate value and the change of the human body posture.

[0070] In this embodiment, the whole-house intelligent control system determines the human body status information based on the changes in heart rate values and human body posture. For example, the whole-house intelligent control system identifies the human body status information by analyzing the correlation, consistency, and mutation between the changes in heart rate values and human body posture. The following are several possible examples:

[0071] 1. When the whole-house intelligent control system determines that the human body has been in a sitting position based on changes in human body posture, determines the heart rate value range of the human body in the sitting position, and compares the heart rate value change with the heart rate value range, if the heart rate value change is within the heart rate value range of the human body in the sitting position, it is determined that the human body state information is a normal sitting position.

[0072] 2. When the whole-house intelligent control system determines that the human body has been in a sitting position based on changes in human posture, determines the heart rate value range of the human body in the sitting position, and compares the heart rate value change with the heart rate value range, if the heart rate value change is not within the heart rate value range, it is determined that the human body state information is an abnormal sitting posture state.

[0073] 3. If the whole-house intelligent control system determines that a person has suddenly changed from a standing position to a lying position, and the heart rate changes show an increase in stress, the person's state information is determined to be abnormal, and the person may fall or have an accident. If the whole-house intelligent control system determines that a person has limb twitching or limb rigidity, and the heart rate changes show a sudden increase or decrease, the person's state information is determined to be abnormal, and the person may have an epileptic seizure or an accident.

[0074] The whole-house intelligent control system of this embodiment sorts the human heart rate values collected each time by time to obtain heart rate value time series data, sorts the human posture collected each time by time to obtain human posture time series data, aligns the heart rate value time series data and the human posture time series data, and counts the changes in heart rate values and human postures in the same time period. This can make the heart rate values and human postures correspond one-to-one, avoid recognition errors caused by confusion in the correspondence between heart rate values and human postures, and improve the accuracy of the determined human state information.

[0075] Please refer to Figure 3 , Figure 3 This is a flow chart of the third embodiment of the whole-house intelligent control method provided by this application. The difference between the third embodiment and the first to second embodiments is that the step of controlling the indoor smart appliances based on the human body state information includes:

[0076] Step S301: If it is determined that the human body is in a normal state according to the human body state information, the human body posture is analyzed to determine the human body activity type, and the indoor smart appliances are regulated according to the activity type and a first preset regulation rule.

[0077] In this embodiment, if the whole-house intelligent control system determines that the human body is in a normal state based on the human body state information, it analyzes the human body posture to determine the human body's activity type, and controls the indoor smart appliances according to the activity type and the first preset control rules.

[0078] For example, when the whole-house intelligent control system determines that the human body has been in a sitting position based on the changes in the human body posture, determines the heart rate value range of the human body in the sitting position, and compares the heart rate value change with the heart rate value range of the human body in the sitting position, if the heart rate value change is within the heart rate value range of the human body in the sitting position, then it is determined that the human body state information is a normal sitting position state; further, the whole-house intelligent control system analyzes the human body posture, if the human body posture is to maintain a sitting position continuously and the limbs are also continuously in the same position, then it is determined that the human body activity type is sitting still, and further the whole-house intelligent control system analyzes the heart rate value of the human body when sitting still. When the heart rate value is within the preset heart rate range of human meditation, it is further determined that the human activity type is meditation. At this time, the whole-house intelligent control system finds the smart home appliance control parameters corresponding to meditation within the first preset control rule according to the activity type of meditation, and then controls the indoor smart home appliances based on the smart home appliance control parameters. For example, when a human is meditating, the whole-house intelligent control system controls the indoor air conditioner to be set to 26 degrees Celsius, the wind speed is reduced to the minimum, and the air conditioner is prevented from blowing directly on the human body. At the same time, the indoor music player is controlled to play music corresponding to meditation.

[0079] For example, when the whole-house intelligent control system determines that the human body has been in a lying position based on the changes in the human body posture, and determines that the changes in the heart rate value are within the heart rate value range of the lying position, then it is determined that the human body state information is a normal lying position state; further, the whole-house intelligent control system analyzes the human body posture, if the human body posture is to maintain a lying position continuously, and analyzes the heart rate value of the human body when sitting still, when the heart rate value is within the preset heart rate range of human sleep, then it is determined that the human body activity type is sleep; at this time, the whole-house intelligent control system finds the smart home appliance control parameters corresponding to sleep in the first preset control rule according to the activity type of sleep, and then controls the indoor smart home appliances based on the smart home appliance control parameters; for example: when the human body is sleeping, the whole-house intelligent control system controls the air conditioner in the room to be set to 26 degrees Celsius, the wind speed is reduced to the minimum and the air conditioner is prevented from blowing directly on the human body, and at the same time controls the indoor music player to play white noise that helps sleep, and controls the curtains in the room to be closed for light blocking, etc.

[0080] Step S302: If it is determined that the human body is in an abnormal state according to the human body state information, the indoor smart home appliances are regulated according to a second preset regulation rule, and an abnormality alarm is issued.

[0081] In this embodiment, if the whole-house intelligent control system determines that the human body is in an abnormal state based on the human body state information, it controls the indoor smart appliances according to the second preset control rule and issues an abnormality alarm. In one embodiment, the abnormal state includes fatigue, non-emergency, and emergency.

[0082] For example, when the whole-house intelligent control system determines that the human body posture changes are: hunched over after sitting for a long time (spinal curvature angle > 20°), head tilted forward (cervical angle < 80°); the heart rate value changes are: resting heart rate increases by 10% to 15% compared to the baseline, and HRV decreases (SDNN < 50ms); it can be determined that the human body state information is in a state of fatigue. The whole-house intelligent control system finds the smart home appliance control parameters corresponding to the fatigue state in the second preset control rule, and then controls the smart home appliances in the room based on the smart home appliance control parameters. For example: seat / massager: adjust the seat back angle (recline 15°) and start lumbar massage; lighting: switch to warm yellow light (3000K), reduce the brightness to 50% to reduce visual fatigue; air conditioning: increase the temperature by 2°C (to avoid muscle stiffness caused by low temperature) and turn on the negative ion mode; voice reminder: trigger the "get up and move reminder", link the smart speaker to play guidance audio, etc.

[0083] For example, when the whole-house intelligent control system determines that the changes in human posture are: unstable gait (stride standard deviation > 20%), one-handed wall support and other balance abnormalities; the changes in heart rate value are: resting heart rate > 100 beats / minute or < 50 beats / minute, and last for more than 5 minutes; it can be determined that the human body status information is in a state of sudden dizziness, which is a non-emergency state. The whole-house intelligent control system finds the smart home appliance control parameters corresponding to the non-emergency state in the second preset control rule, and then controls the indoor smart home appliances based on the smart home appliance control parameters. For example: lighting system: automatically turns on the emergency lighting of the whole house (brightness 100% to avoid falls); door and window system: unlocks the entrance door (to facilitate the entry of emergency personnel) and closes the balcony floor-to-ceiling windows; environmental monitoring: links the air detector to detect carbon monoxide / formaldehyde concentrations to eliminate discomfort caused by environmental factors; alarm pre-trigger: sends an "abnormal state reminder" to family members, attached with a video clip of the current heart rate and posture, etc.

[0084] For example, when the whole-house intelligent control system determines that the changes in human posture are: posture: sudden change in acceleration (>6g) and body position from upright to lying down (pitch angle>60°), and there is no posture recovery within 30 seconds; the heart rate value changes are: heart rate suddenly rises>130 times / minute or suddenly drops<40 times / minute, HRV<20ms (indicating autonomic nervous system disorder); it can be determined that the human body status information is that the human body is in a state of falling / sudden illness, which is an emergency state. The whole-house intelligent control system finds the smart home appliance control parameters corresponding to the emergency state in the second preset control rules, and then controls the indoor smart home appliances based on the smart home appliance control parameters. For example: forced alarm: triggering the sound and light alarm (home terminal) + SMS push to emergency contacts (including GPS positioning); emergency linkage: automatically dialing the emergency number and playing voice guidance (such as "An ambulance has been called for you, please keep breathing steady"); environmental optimization: turning on all channel lights and turning off equipment that may cause obstacles (such as sweeping robots); data synchronization: transmitting recent heart rate and posture data to medical institutions (to assist in rapid diagnosis), etc.

[0085] The whole-house intelligent control system in this embodiment, based on the human body status information, determines that the human body is in a normal state, analyzes the human body posture to determine the human activity type, and controls the smart home appliances in the room according to the activity type and a first preset control rule. If the human body status information determines that the human body is in an abnormal state, the smart home appliances in the room are controlled according to a second preset control rule and an abnormality alarm is issued. By determining whether the human body is in a normal state or an abnormal state and regulating the smart home appliances respectively, the control of the smart home appliances is tailored to the human body's needs. At the same time, an alarm can be issued in the event of an emergency, thereby ensuring the safety of people in the room.

[0086] Please refer to Figure 4 , Figure 4 This is a flow chart of the fourth embodiment of the whole-house intelligent control method provided by this application. The fourth embodiment differs from the first to third embodiments in that the method further includes:

[0087] Step S401: obtain current time information, and query historical human body state information and historical control parameters in the same time period.

[0088] In this embodiment, the whole-house intelligent control system obtains the current time information and queries the historical human body state information and historical control parameters for the same time period. It is understandable that sudden abnormal human body states are usually rare, while situations often occur when the human body performs specific activities at specific times. Therefore, the whole-house intelligent control system can obtain historical human body state information and historical control parameters of the whole-house smart appliances at historical times corresponding to the current time. Among them, the historical control parameters can be set by the user at the historical time, or they can be determined by the whole-house intelligent control system at the historical time and adjusted accordingly by the user.

[0089] Step S402: If the current human body state information is the same as the historical human body state information, the indoor smart home appliances are regulated based on the historical regulation parameters.

[0090] In this embodiment, the whole-house intelligent control system obtains and compares the detected current human body state information with the historical human body state information. If the detected current human body state information is the same as the historical human body state information, the indoor smart appliances are controlled based on the historical control parameters.

[0091] Exemplarily, the whole-house intelligent control system obtains the detected human body state information as the human body is in a sitting meditation state, and the historical human body state information is also a sitting meditation state. The corresponding historical control parameters include: air conditioning 26 degrees, air conditioning wind speed is the lowest and does not blow directly on the human body, curtains are closed, indoor lights are reduced to 50% brightness, and the music player plays music corresponding to sitting meditation, etc.; at this time, the whole-house intelligent control system controls the indoor smart appliances according to the historical control parameters.

[0092] The whole-house smart control system of this embodiment obtains current time information, and based on the current time information, obtains historical human state information and historical control parameters. If the human state information and the historical human state information are the same, the smart home appliances in the room are controlled based on the historical control parameters. When the detected human state information and the historical human state information are the same, the smart home appliances in the room are controlled based on the historical control parameters. Because the historical control parameters are set or adjusted by the user, they are more in line with the user's usage habits, thereby improving the accuracy of the whole-house smart control.

[0093] Please refer to Figure 5 , Figure 5 This is a flow chart of the fifth embodiment of the whole-house intelligent control method provided by this application. The difference between the fifth embodiment and the first to fourth embodiments is that the control of indoor smart appliances also includes:

[0094] Step S501: issuing a prompt message asking whether to control the indoor smart home appliances;

[0095] Step S502: upon receiving the user's confirmation instruction, executing the control operation on the indoor smart home appliances.

[0096] In this embodiment, when the whole-house intelligent control system determines that it needs to control the indoor smart appliances, it first sends a prompt message to the user asking whether to control the indoor smart appliances. Upon receiving the user's confirmation instruction, the control operation of the indoor smart appliances is executed, thereby improving the interaction between the whole-house intelligent control system and the user. Optionally, the whole-house intelligent control system can detect whether the user is in an unresponsive state, such as being asleep, making a phone call, or fainting. If the user is in an unresponsive state, the whole-house intelligent control system directly controls the indoor smart appliances, thereby improving the convenience of the whole-house intelligent control system in controlling the indoor smart appliances.

[0097] Please refer to Figure 6 , Figure 6 This is a flow chart of the sixth embodiment of the whole-house intelligent control method provided by this application. The sixth embodiment differs from the first to fifth embodiments in that the step of detecting the presence of a human body in the room includes:

[0098] Step S601: Collect indoor infrared radiation signals and extract heart rate values from the infrared radiation signals.

[0099] In this embodiment, the whole-home intelligent control system uses infrared sensors installed indoors to collect infrared radiation signals. These signals include both the indoor environment's infrared radiation signals and those of living organisms. The system preprocesses the infrared radiation signals collected by the infrared sensors to filter out the biological infrared radiation signals. Based on these signals, the system then determines the heart rate.

[0100] It is understandable that the infrared radiation signal of a biological body may be the infrared radiation signal of a human body and / or the infrared radiation signal of a pet, and the whole-house intelligent control system can measure the corresponding heart rate value of the biological body based on the infrared radiation signal of the biological body.

[0101] It should be noted that the collection of indoor infrared radiation signals can adopt a single-transmit single-receive mode or a multiple-transmit multiple-receive mode. The single-transmit single-receive mode collects indoor infrared radiation signals through one infrared sensor, but this will result in low accuracy of the collected infrared radiation signals. Therefore, it is preferably adopted a multiple-transmit multiple-receive mode. The multiple-transmit multiple-receive mode collects indoor infrared radiation signals through multiple infrared sensors synchronously, and then fuses the indoor infrared radiation signals synchronously collected by each infrared sensor to obtain the final infrared radiation signal, which can avoid omissions in collection and thereby improve the accuracy of the collected infrared radiation signals.

[0102] Step S602: If it is determined that the heart rate value is within the preset heart rate range, a thermal image is generated based on the infrared radiation signal.

[0103] In this embodiment, the whole-house intelligent control system measures the corresponding heart rate of the organism based on the organism's infrared radiation signal and compares the heart rate value with a preset heart rate range. If the heart rate value is determined to be within the preset heart rate range, a thermal image is generated based on the infrared radiation signal. It will be understood that the preset heart rate range is the heart rate range of the human body. When the heart rate value is within the preset heart rate range, the whole-house intelligent control system can determine that a human body may be present in the room, and further generate a thermal image based on the infrared radiation signal to further determine whether a human body is present in the room based on the thermal image.

[0104] Step S603: If a human body area is detected based on the thermal image, it is determined that there is a human body in the room.

[0105] In this embodiment, after the whole-house intelligent control system generates a thermal image based on the infrared radiation signal, the thermal image is processed to determine whether a human body area is detected in the thermal image. If a human body area is detected in the thermal image, it is determined that there is a human body in the room.

[0106] The whole-home intelligent control system of this embodiment collects infrared radiation signals from indoor spaces and determines a heart rate based on these signals. If the heart rate is determined to be within a preset range, a thermal image is generated based on the infrared radiation signal. If a human body area is detected based on the thermal image, the presence of a human body is determined to be indoors. This method uses infrared radiation signals to determine the heart rate and thermal image, and then uses these two methods to jointly detect the presence of a human body in the room. This method can avoid interference from indoor heat sources and improve the accuracy of indoor human detection.

[0107] In one embodiment, the step of extracting the heart rate value from the infrared radiation signal includes:

[0108] Step S6011: filter the infrared radiation signal to obtain a reference infrared signal.

[0109] In this embodiment, the whole-house intelligent control system collects indoor infrared radiation signals through a pre-installed indoor infrared sensor and then filters the infrared radiation signals to obtain a reference infrared signal. It is understood that the infrared radiation signals collected by the infrared sensor may contain electromagnetic interference signals generated by indoor electronic devices and smart appliances. In this case, the infrared radiation signals need to be filtered to remove the electromagnetic interference signals and obtain the reference infrared signal.

[0110] For example, the frequency range of the electromagnetic interference signal is usually lower than the frequency range of the infrared radiation signal. Therefore, the electromagnetic interference signal with a frequency lower than the infrared signal can be filtered out by a high-pass filter, and a band-pass filter can be used to only allow signals in the frequency range of the infrared radiation signal to pass through, and the electromagnetic interference signals with frequency ranges lower and higher than the frequency range of the infrared radiation signal can be filtered out at the same time.

[0111] Step S6012: Acquire the indoor temperature, and obtain a target infrared signal based on the indoor temperature and the reference infrared signal.

[0112] In this embodiment, after filtering out the electromagnetic interference signal and obtaining the reference infrared signal, the whole-house intelligent control system collects the indoor temperature through a temperature sensor pre-installed in the room, and obtains the target infrared signal based on the indoor temperature and the reference infrared signal. It should be noted that the reference infrared signal is the infrared radiation signal after filtering out the electromagnetic interference signal, which also includes the ambient infrared radiation signal, the ambient reflected infrared signal, and the biological infrared radiation signal. At this time, the whole-house intelligent control system needs to calculate the ambient infrared radiation signal and the ambient reflected infrared signal based on the indoor temperature, so as to remove the ambient infrared radiation signal and the ambient reflected infrared signal from the reference infrared signal. What remains is the biological infrared radiation signal, that is, the target infrared signal. In this way, the whole-house intelligent control system can subsequently determine the heart rate value based on the target infrared signal.

[0113] It should be noted that to improve the accuracy of the indoor temperature, multiple temperature sensors are installed indoors. The indoor temperature values collected by these sensors are averaged to obtain the indoor temperature. The ambient infrared radiation signal is the infrared signal radiated by different objects in the indoor environment, while the ambient reflected infrared signal is the infrared signal generated by objects in the indoor environment reflecting the infrared signals emitted by other objects.

[0114] It can be understood that by calculating the ambient infrared radiation signal and the ambient reflected infrared signal based on the indoor temperature, and removing the ambient infrared radiation signal and the ambient reflected infrared signal from the reference infrared signal to obtain the infrared radiation signal of the biological body, the interference of the ambient infrared radiation signal and the ambient reflected infrared signal in the infrared radiation signal used to calculate the heart rate value can be avoided, and the accuracy of the heart rate measurement can be improved.

[0115] Step S6013: Determine the heart rate value based on the target infrared signal.

[0116] In this embodiment, after obtaining the target infrared signal, the whole-house intelligent control system performs operations such as feature extraction and power spectrum density calculation on the target infrared signal to determine the heart rate value.

[0117] The whole-house intelligent control system of this embodiment first filters out the environmental electromagnetic interference signal from the collected infrared radiation signal, then eliminates the environmental infrared radiation signal and the environmental reflected infrared signal to obtain the target infrared signal, and finally determines the heart rate value based on the target infrared signal, which can avoid interference from various environments and improve the accuracy of heart rate measurement.

[0118] In one embodiment, the step of obtaining a target infrared signal based on the indoor temperature and the reference infrared signal includes:

[0119] Step S60121: Determine the ambient infrared radiation signal based on the indoor temperature and the preset indoor environmental emissivity.

[0120] In this embodiment, after the whole-house intelligent control system collects the indoor temperature, it calculates the ambient infrared radiation signal based on the indoor temperature and the preset indoor environmental emissivity. It should be noted that the preset indoor environmental emissivity includes the emissivity of objects such as walls and floors (e.g., approximately 0.92 for concrete and approximately 0.90 for wood), and the ambient infrared radiation signal includes the wall infrared radiation signal, the floor infrared radiation signal, etc. The whole-house intelligent control system calculates the wall infrared radiation signal based on the indoor temperature and the wall emissivity, and calculates the floor infrared radiation signal based on the indoor temperature and the floor emissivity.

[0121] Specifically, the formula for calculating the ambient infrared radiation signal is:

[0122] M env =ε env σT 4 ;

[0123] Among them, M env is the ambient infrared radiation signal, ε env is the indoor environment emissivity (wall emissivity, floor emissivity, etc.), σ is the Stefan-Boltzmann constant, and T is the indoor temperature.

[0124] Step S60122: Determine the environment reflected infrared signal based on the indoor temperature, the preset indoor environment emissivity, and the preset indoor environment reflectivity.

[0125] In this embodiment, the whole-house intelligent control system determines the environment reflected infrared signal based on the indoor temperature, the preset indoor environment emissivity and the preset indoor environment reflectivity. It should be noted that the preset indoor environment reflectivity includes the reflectivity of objects such as walls and floors (reflectivity = 1-emissivity, such as concrete is about 0.08, wood is about 0.10). The environment reflected infrared signal includes the wall reflected infrared signal, the floor reflected infrared signal, etc. The whole-house intelligent control system calculates the wall infrared radiation signal based on the indoor temperature, wall emissivity and wall reflectivity, and calculates the floor infrared radiation signal based on the indoor temperature, floor emissivity and floor reflectivity.

[0126] Specifically, the formula for calculating the infrared signal reflected by the environment is:

[0127] M envr =ε envr ε env σT 4 ;

[0128] Among them, M envr is the infrared signal reflected by the environment, ε envr is the indoor environment emissivity (wall reflectivity, floor reflectivity, etc.), ε env is the indoor environment emissivity (wall emissivity, floor emissivity, etc.), σ is the Stefan-Boltzmann constant, and T is the indoor temperature.

[0129] Step S60123: Determine the target infrared signal based on the reference infrared signal, the ambient infrared radiation signal, and the ambient reflected infrared signal.

[0130] In this embodiment, after determining the ambient infrared radiation signal and the ambient reflected infrared signal, the whole-house intelligent control system subtracts the ambient infrared radiation signal and the ambient reflected infrared signal from the reference infrared signal to obtain the target infrared signal, which is the infrared radiation signal of the biological body in the room.

[0131] Specifically, the formula for calculating the target infrared signal is:

[0132] M org =MM envr -M env ;

[0133] Among them, M org is the target infrared signal, M is the reference infrared signal, and M env is the ambient infrared radiation signal, M envr It is the infrared signal reflected by the environment.

[0134] The whole-house intelligent control system of this embodiment calculates the ambient infrared radiation signal and the ambient reflected infrared signal based on the indoor temperature, removes the ambient infrared radiation signal and the ambient reflected infrared signal from the reference infrared signal, and obtains the infrared radiation signal of the biological body. This can avoid the interference of the ambient infrared radiation signal and the ambient reflected infrared signal in the infrared radiation signal used to calculate the heart rate value, and can improve the accuracy of the heart rate measurement.

[0135] In one embodiment, the step of determining the heart rate value based on the target infrared signal includes:

[0136] Step S60131: Perform spectrum analysis on the target infrared signal and extract heart rate frequency domain features from the target infrared signal.

[0137] In this embodiment, after obtaining the target infrared signal, the whole-house intelligent control system performs a Fourier transform on the target infrared signal, converting the target infrared signal from the time domain to the frequency domain to obtain a frequency-domain target infrared signal. The whole-house intelligent control system then performs spectral analysis on the frequency-domain target infrared signal to extract heart rate frequency-domain features from the frequency domain. Heart rate frequency-domain features are the frequency and amplitude components associated with heart rate.

[0138] Step S60132: Calculate the power spectrum density based on the heart rate frequency domain characteristics, and determine the heart rate wave frequency according to the peak value of the power spectrum density.

[0139] In this embodiment, the whole-house intelligent control system calculates the power spectrum density based on the heart rate frequency domain characteristics and determines the heart rate wave frequency based on the peak value of the power spectrum density. Specifically, the main frequency peak of the power spectrum density corresponds to the heart rate wave frequency, and the secondary peak of the power spectrum density may correspond to the respiratory rate or motion artifact. Therefore, after obtaining the power spectrum density, the whole-house intelligent control system extracts the main frequency peak of the power spectrum density for analysis to determine the heart rate wave frequency.

[0140] Step S60133, calculate the heart rate value according to the heart rate wave frequency.

[0141] In this embodiment, after obtaining the heart rate wave frequency, the whole-house intelligent control system calculates the heart rate value based on the heart rate wave frequency. The heart rate value calculation formula is: heart rate value = (signal sampling frequency / heart rate wave period) * 60. The whole-house intelligent control system calculates the heart rate wave period based on the heart rate wave frequency, and then calculates the heart rate value based on the preset signal sampling frequency and heart rate wave period combined with the above formula.

[0142] The whole-house intelligent control system in this embodiment performs spectrum analysis on the target infrared signal, extracting heart rate frequency domain features from the target infrared signal. Based on the heart rate frequency domain features, the power spectrum density is calculated, and the heart rate wave frequency is determined based on the peak value of the power spectrum density. The heart rate value is then calculated based on the heart rate wave frequency. Analyzing and determining the heart rate value based on the infrared radiation signal of the organism, which has been freed of interference from ambient infrared radiation signals and reflected infrared signals, can improve the accuracy of heart rate measurement.

[0143] Please refer to Figure 7 , Figure 7 This is a flow chart of the fifth embodiment of the whole-house intelligent control method provided by this application. The difference between the seventh embodiment and the first to sixth embodiments is that the step of detecting the human body area based on the thermal image includes:

[0144] Step S701 : Segment the thermal image to obtain a foreground thermal image.

[0145] In this embodiment, the whole-house intelligent control system generates a thermal image based on the collected infrared radiation signal, and segments the thermal image to obtain a foreground thermal image.

[0146] Specifically, the whole-house intelligent control system first binarizes the thermal image to obtain a binary image, and then dilates (fills foreground holes) and erodes (removes background noise points) the binary image to obtain a target binary image; the whole-house intelligent control system divides the target binary image into multiple sub-areas, calculates the temperature threshold for each sub-area, and calculates the average value based on the temperature threshold of each sub-area to obtain the target temperature threshold; the whole-house intelligent control system obtains the temperature value corresponding to each pixel in the thermal image, determines the pixel whose temperature value is greater than the target temperature threshold as the foreground pixel, and then forms a foreground thermal image based on all foreground pixels.

[0147] Step S702 : extracting temperature distribution features and geometric features of each heat concentration area in the foreground thermal image.

[0148] In this embodiment, the whole-house intelligent control system extracts the temperature distribution and geometric features of each heat concentration area in the foreground thermal image. The foreground thermal image includes multiple heat concentration areas with temperatures greater than a target temperature threshold, each representing an object. For each heat concentration area, the whole-house intelligent control system extracts the corresponding temperature distribution and geometric features.

[0149] Specifically, the whole-house intelligent control system obtains the outline of the heat concentration area through threshold segmentation or edge detection (such as Canny), and then uses connected domain analysis (such as OpenCV's findContours) to identify each heat concentration area in the foreground thermal image, and then extracts the temperature distribution characteristics and geometric characteristics corresponding to each heat concentration area. The temperature distribution characteristics include: average temperature, temperature range, thermal center position, isotherm distribution, etc.; the geometric characteristics include height, width, area, etc.

[0150] Step S703: determining the temperature mean corresponding to the heat concentration area based on the temperature distribution characteristics.

[0151] In this embodiment, the whole-house intelligent control system determines the temperature mean corresponding to the heat concentration area based on the temperature distribution characteristics of the heat concentration area.

[0152] Step S704: If the temperature mean is within the preset human body temperature range, the geometric feature is compared with the preset human body geometric feature.

[0153] In this embodiment, the whole-house intelligent control system compares the average temperature value to the preset human body temperature range. If the average temperature value is within the preset human body temperature range, the geometric features corresponding to the heat concentration area are further compared with the preset human body geometric features. It should be noted that the preset human body geometric features include the geometric features of the human body standing, lying, sitting, squatting, etc. The whole-house intelligent control system needs to compare the geometric features corresponding to the heat concentration area with the above multiple preset human body geometric features. This can identify human body areas in different postures indoors, which helps to improve the accuracy of indoor human body detection.

[0154] Step S705: If the geometric features are the same as the preset human body geometric features, the heat concentration area is determined to be a human body area.

[0155] In this embodiment, if the whole-house intelligent control system determines that the geometric characteristics of the heat-concentrated area are identical to the preset human body geometric characteristics, then the heat-concentrated area is determined to be a human body area. Specifically, if the average temperature of the heat-concentrated area is within the preset human body temperature range, and the geometric characteristics of the heat-concentrated area are identical to the preset human body geometric characteristics, then the heat-concentrated area is determined to be a human body area. Furthermore, if the average temperature of the heat-concentrated area is within the preset human body temperature range, and the geometric characteristics of the heat-concentrated area are identical to the preset human body geometric characteristics, then the heat-concentrated area is determined to be a human body area.

[0156] The whole-house intelligent control system of this embodiment, when determining that a human body may be present indoors based on the measured heart rate value, further obtains a thermal image based on the infrared radiation signal, extracts the foreground thermal image of the thermal image, and then analyzes the temperature distribution characteristics and geometric characteristics of each heat concentration area in the foreground thermal image to determine whether the heat concentration area is a human body area. When determining that a human body may be present indoors based on the measured heart rate value, the human body area can be identified through multiple features of the thermal image, thereby avoiding interference from indoor heat sources and improving the accuracy of indoor human body detection. At the same time, the human body area is identified based on the temperature mean and geometric characteristics corresponding to the heat concentration area. The human body area can be identified using multiple features, avoiding false alarms caused by single feature judgment and improving the accuracy of indoor human body detection.

[0157] refer to Figure 8 , Figure 8 This is a schematic diagram of the structure of the whole-house intelligent control device provided by this application. The whole-house intelligent control device includes:

[0158] The acquisition module 10 is configured to continuously acquire infrared radiation signals from the room if a human body is detected in the room, and determine the human heart rate and posture based on the infrared radiation signals;

[0159] A determination module 20 is used to determine human body state information based on the human body heart rate value and the human body posture;

[0160] The control module 30 is used to control indoor smart appliances according to the human body status information.

[0161] It can be understood that the whole-house intelligent control device of this embodiment corresponds to the whole-house intelligent control method of the above embodiment, and the optional options in the above embodiment are also applicable to this embodiment, so they will not be repeated here.

[0162] The present application also provides a computer device. Exemplarily, the computer device includes a processor and a memory, wherein the memory stores a computer program, and the processor runs the computer program to enable the computer device to execute the functions of the various modules in the above-mentioned whole-house intelligent control method or the above-mentioned whole-house intelligent control device.

[0163] Among them, the processor can be an integrated circuit chip with signal processing capabilities. The processor can be a general-purpose processor, including a central processing unit (CPU), a graphics processing unit (GPU) and a network processor (NP), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or at least one of other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc., which can implement or execute the disclosed methods, steps and logic block diagrams in the embodiments of the present application.

[0164] The memory may be, but is not limited to, a random access memory (RAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), etc. The memory is used to store a computer program, and the processor may execute the computer program accordingly after receiving an execution instruction.

[0165] The present application also provides a computer storage medium for storing the computer program used in the above-mentioned computer device. The computer storage medium may be a readable storage medium, a non-volatile storage medium, or a volatile storage medium. For example, the computer storage medium may include, but is not limited to, various media that can store program code, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0166] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and structure diagrams in the accompanying drawings show the possible architectures, functions and operations of the devices, methods and computer program products according to the multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, program segment or a part of the code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in an alternative implementation, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the structure diagram and / or flowchart, and the combination of boxes in the structure diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or can be implemented using a combination of dedicated hardware and computer instructions.

[0167] In addition, the functional modules or units in the various embodiments of the present application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0168] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a smart phone, personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application.

[0169] The above is only a specific implementation method of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed in this application, which should be covered by the scope of protection of the present application.

Claims

1. A whole-house intelligent control method, characterized in that: The method comprises: If a human body is detected in the room, the infrared radiation signal in the room is continuously collected, and the heart rate value and posture of the human body are determined based on the infrared radiation signal; Determining human body state information based on the human body heart rate value and the human body posture; Indoor smart home appliances are regulated according to the human body status information.

2. The whole-house intelligent control method according to claim 1, characterized in that: The step of determining human body state information based on the human body heart rate value and the human body posture includes: The human heart rate values collected each time are sorted by time to obtain heart rate value time series data, and the human postures collected each time are sorted by time to obtain human posture time series data; Align the heart rate time series data with the human body posture time series data, and count the changes in the heart rate value and the human body posture in the same time period; The human body state information is determined according to the changes in the heart rate value and the changes in the human body posture.

3. The whole-house intelligent control method according to claim 1, characterized in that: The step of regulating indoor smart appliances according to the human body status information includes: If it is determined according to the human body state information that the human body is in a normal state, analyzing the human body posture to determine the human body activity type, and regulating the indoor smart home appliances according to the activity type and a first preset regulation rule; If it is determined that the human body is in an abnormal state according to the human body state information, the indoor smart home appliances are regulated according to the second preset regulation rule, and an abnormality alarm is issued.

4. The whole-house intelligent control method according to claim 1, characterized in that: The method further comprises: Get the current time information and query the historical human body status information and historical control parameters for the same time period; If the current human body state information is the same as the historical human body state information, the indoor smart home appliances are regulated based on the historical regulation parameters.

5. The whole-house intelligent control method according to any one of claims 1 to 4, characterized in that: The control of indoor smart appliances previously also includes: Send out prompt information on whether to control indoor smart appliances; When receiving the user's confirmation instruction, the control operation of the indoor smart appliances is executed.

6. The whole-house intelligent control method according to claim 1, characterized in that: The step of detecting the presence of a human body in the room comprises: Collecting infrared radiation signals in the room and extracting heart rate values from the infrared radiation signals; If the heart rate value is within a preset heart rate range, generating a thermal image based on the infrared radiation signal; If a human body region is detected based on the thermal image, it is determined that a human body exists in the room.

7. The whole-house intelligent control method according to claim 6, characterized in that: The step of detecting a human body area based on the thermal image comprises: Segmenting the thermal image to obtain a foreground thermal image; extracting temperature distribution features and geometric features of each heat concentration area in the foreground thermal image; Based on the temperature distribution characteristics, determining the temperature mean corresponding to the heat concentration area; If the temperature mean is within the preset human body temperature range, comparing the geometric feature with the preset human body geometric feature; If the geometric features are the same as the preset human body geometric features, the heat concentration area is determined to be a human body area.

8. A whole-house intelligent control device, characterized in that: The whole-house intelligent control device includes: The acquisition module is used to continuously acquire infrared radiation signals in the room if a human body is detected in the room, and determine the human heart rate value and human posture based on the infrared radiation signals; A determination module, configured to determine human body state information based on the human body heart rate value and the human body posture; The control module is used to control indoor smart appliances according to the human body status information.

9. A computer device, characterized in that: The computer device includes a processor and a memory, the memory stores a computer program, and the processor is used to execute the computer program to implement the whole-house intelligent control method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is run on a processor, the whole-house intelligent control method according to any one of claims 1 to 7 is executed.

Images