Human body induction energy threshold determination method, main control unit, human body induction module, refrigerator and storage medium
By collecting and analyzing the energy value data of the human sensing module, a personalized human sensing energy threshold is determined, which solves the problem of poor adaptability of traditional human sensing solutions in complex environments and improves the accuracy of human sensing and user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-26
- Publication Date
- 2026-03-27
AI Technical Summary
Traditional human body sensing solutions are based on fixed energy thresholds, which cannot adapt to complex and ever-changing application environments, resulting in a decline in user experience.
By collecting multiple sets of energy value data when the human sensing module senses a human body, the human sensing energy threshold corresponding to at least one sensing object is determined based on the characteristics of the energy value data, and the target human sensing energy threshold is determined based on the identity for human body sensing, combined with the self-learning model for optimization and updating.
It achieves differentiation of human sensing energy threshold during human body sensing, thereby improving the accuracy of human body sensing and user experience.
Smart Images
Figure CN121739697A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of human sensing, and in particular to a human sensing energy threshold determination method, a master control unit, a human sensing module, a refrigerator and a computer readable storage medium. BACKGROUND
[0002] The human sensing function currently used on refrigerators is mainly realized through millimeter wave human sensing, pyroelectric human sensing and infrared human sensing and the like. The above schemes all adopt data in the form of received energy values, and determine whether to trigger human sensing according to a preset energy threshold after a certain data smoothing and filtering on the received energy values. In the process of configuring the energy threshold, the test results of different directions and different body types of test personnel in the test environment are tested and then used as a benchmark to configure the responsive energy threshold.
[0003] However, the above energy threshold configuration method is only determined by laboratory data, and in actual application scenarios, different scenarios and different individuals may have obvious differences in the distance of triggering human sensing, resulting in a decline in user experience. As can be seen, the traditional human sensing scheme based on a fixed energy threshold has poor environmental adaptability and cannot adapt to complex and variable application environments.
[0004] The above information disclosed in the background section of this document merely to understand the background of the present application concepts, and therefore, it can contain information that does not constitute prior art. SUMMARY
[0005] The main purpose of the present application is to provide a human sensing energy threshold determination method, a master control unit, a human sensing module, a refrigerator and a computer readable storage medium, which aims to solve the technical problem of poor environmental adaptability of the human sensing scheme based on a fixed energy threshold and the inability to adapt to complex and variable application environments.
[0006] To achieve the above purpose, the present application provides a human sensing energy threshold determination method applied to a master control unit, wherein the master control unit is connected with a human sensing module, and the human sensing energy threshold determination method comprises:
[0007] Collecting a plurality of sets of energy value data of the human sensing module when a human body is sensed;
[0008] According to the characteristics of each energy value data, determining a human energy threshold corresponding to at least one sensing object;
[0009] send the human energy threshold value corresponding to the sensing object to the human sensing module, so that the human sensing module determines the target human energy threshold value based on the identity of the sensing object after determining the identity of the sensing object according to the obtained energy value data, and performs human sensing according to the target human energy threshold value and the energy value data to obtain a human sensing result.
[0010] In an embodiment, the master control unit is connected with a voice module and / or a camera module, and the step of collecting the multiple sets of energy value data when the human sensing module senses a human body includes:
[0011] When the voice module is woken up by a preset wake-up word or the image information collected by the camera module recognizes a human body, the human sensing module is requested to provide the current energy value data;
[0012] The energy value data sent by the human sensing module is received.
[0013] In an embodiment, the step of collecting the multiple sets of energy value data when the human sensing module senses a human body includes:
[0014] The human energy value data sent by the human sensing module is received based on a preset period, wherein the human energy value data is the energy value data when the human sensing module triggers human sensing based on a preset human energy threshold value.
[0015] In an embodiment, after the step of determining the human energy threshold value corresponding to at least one sensing object according to the characteristics of each energy value data, the method further includes:
[0016] Each energy value data is input into a preset self-learning model to obtain the sensing object corresponding to each energy value data and the human energy threshold value of each sensing object output by the self-learning model;
[0017] The self-learning model is a local model or a cloud large model, and the human energy threshold value is used to represent the critical value of the energy value of the corresponding sensing object when triggering human sensing.
[0018] In addition, the present application also provides a human energy threshold value determination method for human sensing, which is applied to a human sensing module connected with a master control unit, and includes:
[0019] Each human energy threshold value corresponding to each sensing object sent by the master control unit is received, wherein each human energy threshold value corresponding to each sensing object is determined by the master control unit according to the characteristics of the multiple sets of energy value data when the human sensing module senses a human body;
[0020] acquiring current energy value data, determining whether there is a sensing object according to the energy value data;
[0021] when there is a sensing object, determining the identity of the sensing object according to the energy value data;
[0022] querying a target human energy threshold corresponding to the identity of the sensing object in the human energy threshold corresponding to each of the sensing objects respectively;
[0023] performing human sensing according to the target human energy threshold and the energy value data to obtain a human sensing result.
[0024] In an embodiment, the energy threshold determination method for human sensing includes:
[0025] if the request of the master unit about the current energy value data is received, sending the current acquired energy value data to the master unit;
[0026] when human sensing is triggered based on a preset human energy threshold, recording the current acquired energy value data;
[0027] based on a preset period, sending the recorded energy value data to the master unit.
[0028] In an embodiment, after the step of receiving the human energy threshold corresponding to each of the sensing objects respectively sent by the master unit, the method further includes:
[0029] inputting the human energy threshold corresponding to each of the sensing objects respectively into a local human sensing trigger algorithm to optimize and update the human sensing trigger algorithm to obtain an updated human sensing trigger algorithm;
[0030] wherein, the human sensing trigger algorithm is used to perform human sensing according to the current human energy threshold corresponding to the sensing object and the energy value data to obtain a human sensing result.
[0031] In addition, the present application also provides a master unit, the master unit is connected with a human sensing module, a voice module and a camera module respectively, the master unit at least includes: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program is configured to realize the steps of the energy threshold determination method for human sensing applied to the master unit as described above.
[0032] In addition, the present application also provides a human sensing module, the human sensing module is connected with a master unit, the human sensing module at least includes: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program is configured to realize the steps of the energy threshold determination method for human sensing applied to the human sensing module as described above.
[0033] In addition, the application further provides a refrigerator, which comprises at least a master control unit and a human sensing module connected with each other, wherein the master control unit is used to execute the steps of the energy threshold value determination method for human sensing applied to the master control unit, and the human sensing module is used to execute the steps of the energy threshold value determination method for human sensing applied to the human sensing module.
[0034] In addition, to achieve the above-mentioned purpose, the application further provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to realize the steps of the energy threshold value determination method for human sensing.
[0035] In addition, to achieve the above-mentioned purpose, the application further provides a computer program product, which comprises a computer program, and the computer program is executed by a processor to realize the steps of the energy threshold value determination method for human sensing.
[0036] The application provides an energy threshold value determination method for human sensing, which is applied to a master control unit connected with a human sensing module, and the energy threshold value determination method for human sensing comprises the following steps: collecting a plurality of sets of energy value data of the human sensing module when the human sensing module senses a human body, determining at least one corresponding human energy threshold value of a sensing object according to the characteristics of the energy value data, and then sending the human energy threshold value corresponding to the sensing object to the human sensing module, so that the human sensing module determines a target human energy threshold value corresponding to the sensing object based on the identity of the sensing object after determining the identity of the sensing object according to the obtained energy value data, and performs human sensing according to the target human energy threshold value and the energy value data to obtain a human sensing result. In the application, the human energy threshold value of the sensing object is determined by the master control unit according to the characteristics of the plurality of sets of energy value data corresponding to the human body actually sensed by the human sensing module, which is more close to the use habits of users compared with the traditional strategy of determining the energy threshold value in the laboratory. In addition, the human energy threshold value corresponding to different sensing objects is determined respectively in the technical solution of the application, and the human energy threshold value corresponding to each sensing object is further obtained for the human sensing module to adopt the target human energy threshold value corresponding to the identity of the sensing object in the process of human sensing, so that the differentiation of the human energy threshold value in the process of human sensing is realized, and the accuracy of human sensing and the user experience are improved. BRIEF DESCRIPTION OF DRAWINGS
[0037] The accompanying drawings, which are incorporated herein and constitute part of the specification, illustrate embodiments consistent with the application and, together with the description, serve to explain the principles of the application.
[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.
[0039] Figure 1 A flowchart of the energy threshold determination method for human body sensing applied to the master control unit in the embodiments of the present application is shown.
[0040] Figure 2 A communication connection diagram between the master control unit, the human sensing module, the WiFi module, the voice module, the camera module and the cloud service in the embodiments of the present application is shown.
[0041] Figure 3 A flowchart of the energy threshold determination method for human body sensing applied to the human sensing module in the embodiments of the present application is shown.
[0042] Figure 4 A device structure diagram of the hardware running environment of the master control unit involved in the energy threshold determination method for human body sensing in the embodiments of the present application is shown.
[0043] Figure 5 A device structure diagram of the hardware running environment of the human sensing module involved in the energy threshold determination method for human body sensing in the embodiments of the present application is shown.
[0044] The purposes, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION
[0045] In order to make the above purposes, features and advantages of the present application more apparent and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without any creative effort belong to the scope of protection of the present application.
[0046] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application, and are not used to limit the present application.
[0047] In order to better understand the technical solutions of the present application, the following will be described in detail with reference to the drawings in the specification and the specific embodiments.
[0048] The human body sensing module currently used on the refrigerator is mainly realized by millimeter wave human sensing, pyroelectric human sensing and infrared human sensing and the like. The above scheme adopts the idea of first receiving an energy value (such as a millimeter wave signal, an infrared signal lamp), and then performing certain data smoothing and filtering on the received energy value, and determining whether to trigger based on a preset energy threshold. Therefore, in the process of implementing the energy threshold of the human sensing trigger, different directions and different body types of test personnel need to be tested in the test environment to obtain the results, and then the data is used as a reference for parameter configuration. However, when the refrigerator is installed in a house, different users may have obvious differences in triggering the human sensing distance due to individual differences, resulting in a decrease in user experience. Moreover, the laboratory data has fewer options and cannot provide users with different options, and the fixed energy threshold leads to poor environmental adaptability of the human body sensing scheme.
[0049] To achieve the above purpose, the embodiments of the present application provide a human body sensing energy threshold determination method applied to a master control unit, which is a device for determining the energy threshold of human body sensing and controlling the human sensing module to perform human body sensing. The master control unit and the human sensing module can be arranged on the same electrical appliance (such as a refrigerator) to enable the electrical appliance to have a human sensing function and improve the user's experience.
[0050] Reference Figure 1 , Figure 1 is a flowchart of the human body sensing energy threshold determination method embodiment of the present application, which comprises:
[0051] Step S10, a plurality of sets of energy value data of the human sensing module when sensing a human body are collected;
[0052] In the embodiments of the present application, before determining the energy threshold of human body sensing, the master control unit needs to use the plurality of sets of energy value data of the human sensing module when sensing a human body as the data basis. The energy value data of the human sensing module when sensing a human body refers to the energy value data received by the human sensing module when a person is present. The energy value data at this time can truly reflect the characteristic situation when a person is present, which facilitates the determination of a more accurate energy threshold.
[0053] In addition, a plurality of energy value data of the human sensing module in a plurality of cases is required to be collected, and increasing the data quantity can avoid the influence of accidental errors on the accuracy of determining the human energy threshold. Moreover, collecting a plurality of energy value data in different cases can also obtain different energy value data corresponding to different identities of the human sensing module, so as to facilitate the establishment of a dedicated human energy threshold for each person, and realize the differentiation of different users in human sensing triggering. The fixed human energy threshold in the prior art cannot overcome the defect of insufficient accuracy in triggering human sensing when different individuals approach.
[0054] Step S20, determining the human energy threshold corresponding to at least one sensing object according to the characteristics of each energy value data;
[0055] After a certain amount of energy value data is collected, the distribution characteristics of the energy value data can be learned to determine the energy value data of how many sensing objects. For example, when different sensing objects (such as human bodies) trigger human sensing, the corresponding energy value data is in a relatively stable range, and the energy value data of different human bodies is quite different due to different reasons such as height, body shape, and action habits. Therefore, after a plurality of energy value data of the human sensing module in sensing a human body is collected, the energy value data of different sensing objects can be distinguished first. Then the characteristics of the energy value data corresponding to each sensing object are further learned, which can include the fluctuation range, average value, mode, standard deviation, variance, etc. of the energy value. Based on the foregoing characteristics, a critical value that can fully reflect the sensing object in triggering human sensing is analyzed and obtained as a human energy threshold, which is used to represent that when the energy value received by the human sensing module is greater than the human energy threshold, human sensing of the sensing object is triggered.
[0056] For example, after the master control unit determines the human energy threshold corresponding to each sensing object, an identity is given to each sensing object, for example, the ID (Identity document) of different sensing objects is different, and each identity corresponds to a human energy threshold. The data of the human energy threshold of each sensing object can be stored in the form of a two-dimensional mapping table.
[0057] Step S30, sending the human energy threshold corresponding to each sensing object to the human sensing module, so that the human sensing module determines the corresponding target human energy threshold based on the identity of the sensing object after determining the identity of the sensing object according to the obtained energy value data, and performs human sensing according to the target human energy threshold and the energy value data to obtain a human sensing result.
[0058] The main control unit determines the human energy threshold value corresponding to each sensing object in the human sensing module, and sends the human energy threshold value to the human sensing module for storage and subsequent human sensing. Specifically, in the human sensing process, the human sensing module first analyzes the identity of the sensing object when a human is sensed, then queries the target human energy threshold value from the stored human energy threshold values of the sensing objects based on the identity, and then determines whether to trigger human sensing based on the target human energy threshold value and the energy value data of the energy reflected by the sensing object. When the received energy value is greater than the target human energy threshold value, it is determined that human sensing of the sensing object is triggered (the human sensing result at this time is that a human exists).
[0059] The energy threshold value determination method for human sensing provided in the embodiments of the present application is applied to a main control unit connected with a human sensing module. The energy threshold value determination method for human sensing comprises the following steps: collecting multiple sets of energy value data of the human sensing module when a human body is sensed, determining the human energy threshold value corresponding to at least one sensing object according to the characteristics of each energy value data, and then sending the human energy threshold value corresponding to each sensing object to the human sensing module, so that the human sensing module determines the target human energy threshold value corresponding to the sensing object based on the identity of the sensing object after determining the identity of the sensing object according to the obtained energy value data, and performs human sensing according to the target human energy threshold value and the energy value data to obtain a human sensing result. In the embodiments of the present application, the human energy threshold value of the sensing object is determined by the main control unit according to the characteristics of the multiple sets of energy value data corresponding to the human body actually sensed by the human sensing module, which is more in line with the user's usage habits compared with the traditional strategy of determining the energy threshold value in the laboratory. In addition, the human energy threshold value corresponding to different sensing objects is determined in the technical scheme of the embodiments of the present application, and the human energy threshold value corresponding to each sensing object is further obtained for the human sensing module to use the target human energy threshold value corresponding to the identity of the sensing object in the human sensing process, thereby realizing the differentiation of the human energy threshold value in the human sensing process and improving the accuracy of human sensing and user experience.
[0060] Further, in a feasible embodiment, the main control unit is connected with a voice module and / or a camera module, and the step of collecting multiple sets of energy value data of the human sensing module when a human body is sensed comprises the following steps:
[0061] Step S11, when the voice module is woken up by a preset wake-up word or the image information collected by the camera module recognizes a human body, the human sensing module is requested to send the current energy value data;
[0062] Step S12, receiving the energy value data sent by the human sensing module.
[0063] In the embodiments of the present application, the voice module and the camera module connected with the main control unit are used as the wake-up module to collect the current energy value data when a human body appears in the sensing area of the human sensing module. The energy value data at this time can truly represent the energy value data characteristics of the energy reflected by the human body received by the human sensing module in the case of the appearance of the human body, and can be used to determine a more accurate human energy threshold.
[0064] The voice module can be awakened by a preset wake-up word. For example, when the voice module connected with the main control unit receives a voice issued by a user, if the preset wake-up word is captured, the voice module is awakened and sends a wake-up instruction to the main control unit, and the main control unit sends a request instruction about the current energy value data to the human sensing module. In addition, the camera module can continuously collect images in the sensing area of the human sensing module, and perform human body recognition on the collected images. When it is identified that the image information includes a human body, it is determined that a human body exists and a wake-up instruction is sent to the main control unit, and the main control unit sends a request instruction about the current energy value data to the human sensing module.
[0065] In the embodiments of the present application, the voice module and / or the camera module are used to determine the wake-up condition, to ensure that the current energy value data of the human sensing module is collected in the case that a human body exists in the sensing area, and to provide a real and accurate data basis for determining the human energy data corresponding to different sensing objects.
[0066] In another possible embodiment, the step of collecting the plurality of sets of energy value data of the human sensing module when the human body is sensed includes:
[0067] Step S13, based on a preset period, receiving human energy value data sent by the human sensing module, wherein the human energy value data is the energy value data of the human sensing module when the human body sensing is triggered based on the preset human energy threshold.
[0068] It should be noted that step S13 and steps S11 to S12 are in parallel relationship. Step S11 to step S12 can be executed alone, step S13 can be executed alone, or step S11 to step S12 or step S13 can be executed respectively under the condition of meeting, and the two do not interfere with each other.
[0069] It can be understood that step S13 provides another way for the human sensing module to provide the main control unit with energy value data when a real human exists. In this way, the main control unit can also be provided with a reliable data basis in the case that the appliance is not equipped with a voice module or a camera module.
[0070] Specifically, the human sensing module determines a fixed human energy threshold value through a traditional test and test method before leaving the factory. Before determining the human energy threshold value of the human sensing module in the current application scenario, the fixed human energy threshold value is used for human sensing, and the corresponding real-time energy value data when triggering human sensing is stored and sent to the master control unit according to a preset period (which can be set according to actual needs) to provide a data basis for the master control unit to determine the human energy threshold value of different sensing objects.
[0071] It should be noted that in the case where the human sensing module preliminarily determines the human energy threshold value of one or more sensing objects involved in its corresponding scene, the latest human energy value data can also be continuously transmitted to the master control unit in the manner described in step S13, so that the master control unit iteratively updates the existing human energy threshold value corresponding to each sensing object according to the new human energy value data, so that the human sensing of the human sensing module adapts to changes in the environment or sensing objects, and maintains strong environmental adaptability and high precision.
[0072] In a feasible embodiment, after the step of determining the human energy threshold value corresponding to at least one sensing object according to the characteristics of each energy value data, the method further comprises:
[0073] Step S21, inputting each energy value data into a preset self-learning model to obtain the sensing object corresponding to each energy value data output by the self-learning model and the human energy threshold value of each sensing object;
[0074] The self-learning model is a local model or a cloud large model, and the human energy threshold value is used to represent the critical value of the energy value of the corresponding sensing object when triggering human sensing.
[0075] The embodiments of the present application provide a method for learning the characteristics of multiple groups of energy value data of the human sensing module when sensing a human body by using a pre-trained self-learning model to determine the human energy threshold value of each sensing object.
[0076] The self-learning model can be a local small model carried by the master control unit itself or a large model deployed in the cloud. The storage space and computing resources of the master control unit itself are relatively small, and a local model with small parameter quantity, data quantity and computing power demand can be pre-trained to meet the demand for learning characteristics and determining the human energy threshold value of each sensing object. The advantage of the local model is simple structure, low cost and low requirement for hardware devices.
[0077] If the electrical appliance to which the master control unit is applied is provided with a WiFi module, communication between the master control unit and the cloud can be established through the connection between the master control unit and the WiFi module. The WiFi module can upload the energy value data received by the master control unit from the human sensing module to the cloud, and can also download the human energy threshold values corresponding to each sensing processed by the cloud to the master control unit and the human sensing module. The way of deploying a large model in the cloud in the embodiment of the application makes the self-learning model not limited by the computing power of the hardware device, and can more deeply and thoroughly learn the features of the energy value data uploaded by the human sensing module, and obtain more accurate human energy threshold values of each sensing object. The cloud model requires more computing resources than the local model, and can be deployed separately on a server, which has higher requirements for the cost of hardware devices and is suitable for scenarios where a cloud large model corresponds to multiple edge master control units.
[0078] Exemplarily, in combination with the hardware device composition features involved in the foregoing embodiments, a system structure composed of a master control unit, a human sensing module, a WiFi module, a voice module, a camera, and a cloud service, etc. is shown in Figure 2 The master control unit is connected with the human sensing module, the WiFi module, the voice module, and the camera module, respectively, and the WiFi module is connected with the cloud to determine the multiple sensing objects in the scene where the master control unit is located and the human energy threshold values of each of the sensing objects by using the large model deployed in the cloud.
[0079] Specifically, in the process of learning the energy value data by the self-learning model, each group of energy value data can be classified first to determine to which sensing object each group of energy value data belongs, and an identity corresponding to each sensing object can be assigned. Then, each group of energy value data corresponding to each sensing object can be analyzed and processed to output the exclusive human energy threshold value corresponding to each sensing object, wherein the human energy threshold value can represent the critical value of the energy value received by the human sensing module when the human body corresponding to the sensing is triggered (for example, triggering when the critical value is higher, and not triggering when the critical value is lower). Finally, the identity of each sensing object and the corresponding human energy threshold value are associated and stored for sending to the human sensing module to update the fixed human energy threshold value in the human sensing module.
[0080] The embodiment of the application proposes a method of using the energy value data returned by the human sensing module as training data when the device is awakened by the voice module or the camera module, and using the large model deployed in the cloud or the local small model to learn the user behavior to obtain the corresponding human energy threshold value and use it as the human sensing trigger criterion, which can solve the problem of poor human sensing experience caused by individual differences in the traditional human body sensing scheme, and the defect of being unable to provide personalized configuration of the human energy threshold value.
[0081] Further, the application also provides a human body sensing energy threshold value determination method applied to a human sensing module, wherein the human sensing module is connected with a master control unit, and the human body sensing energy threshold value determination method comprises Figure 3 , and the human body sensing energy threshold value determination method comprises:
[0082] Step A10, receiving the human energy threshold value corresponding to each sensing object respectively sent by the master control unit, wherein the human energy threshold value corresponding to each sensing object respectively is determined by the master control unit according to the characteristics of the multiple groups of energy value data when the human sensing module senses the human body;
[0083] In the foregoing embodiment, after the master control unit determines the human energy threshold value corresponding to each sensing object in step S20, the master control unit sends the human energy threshold value corresponding to each sensing object to the human sensing module as a basis for human body sensing in the subsequent process.
[0084] Step A20, obtaining the current energy value data, and determining whether there is a sensing object according to the energy value data;
[0085] In the process of human body sensing of the human sensing module, the energy value data of the energy reflected back by the external environment is continuously detected. It can be understood that when there is no human body in the detection range of the human sensing module, the energy value data received by the human sensing module remains relatively stable, and when the change amplitude of the energy value data exceeds the preset amplitude, for example, the increase of the infrared signal intensity exceeds the preset amplitude, it can be determined that there is a human body in the sensing area.
[0086] It should be noted that the presence of a human body in the sensing area does not mean that the human body sensing is triggered, because the application scenarios of each human sensing module are different. In some scenarios, the user does not have the demand to use the electric appliance applied with the human sensing module, and the detection range of the human sensing module is also passed at this time, so the human body sensing does not need to be triggered, and therefore it is further necessary to judge the relationship between the energy value data and the human energy threshold value.
[0087] Step A30, when there is a sensing object, determining the identity of the sensing object according to the energy value data;
[0088] In a case where it is determined that the sensing object exists in the detection range of the human sensing module, a feature of the energy value data received at this time is analyzed, and the feature of each sensing object stored is compared to determine the identity (ID) of the sensing object. The feature of each sensing object stored can be determined by the master control unit according to the energy value data of each sensing object sent by the human sensing module, because in the process of determining the human energy threshold of each sensing object by the master control unit, it is necessary to distinguish which energy value data each sensing object corresponds to, so in the process of determining the identity of the sensing object in step A30, the identity (ID) of the sensing object corresponding to the current energy value data can be determined according to the feature of each sensing object stored determined by the master control unit.
[0089] Step A40, querying the target human energy threshold corresponding to the identity of the sensing object in the human energy threshold corresponding to each sensing object respectively;
[0090] After the identity (ID) of the sensing object is determined, the sensing object is queried based on the ID in the human energy threshold of each sensing object received and stored in step A10, so as to obtain the target human energy threshold corresponding to the sensing object.
[0091] Step A50, human sensing is performed according to the target human energy threshold and the energy value data to obtain a human sensing result.
[0092] After the target human energy threshold is determined, the human sensing is performed on the sensing object based on the target human energy threshold. Specifically, the human sensing module can determine whether the target human energy threshold is exceeded according to the energy reflected by the energy value data.
[0093] Before the human sensing is performed, the received energy value needs to be subjected to certain data smoothing and filtering processing based on a preset algorithm, and then the corresponding human sensing result is determined, wherein the human sensing result can be existence or nonexistence. After the human sensing result is determined, the electrical appliance carrying the human sensing module can select whether to trigger the function linked with the human sensing. For example, when the human sensing module is carried on the refrigerator, in a case where the human sensing result output by the human sensing module is existence, the display screen and the atmosphere lamp can be automatically turned on.
[0094] In a feasible embodiment, the energy threshold determination method of the human sensing includes:
[0095] Step B10, if the master control unit requests the current energy value data, the current collected energy value data is sent to the master control unit;
[0096] Step B20, when the human sensing is triggered based on the preset human energy threshold, the current collected energy value data is recorded;
[0097] Step B30, based on a preset period, sending the recorded energy value data to the master control unit.
[0098] In the embodiments of the present application, step B10 and steps B20 to B30 are two different ways of sending the collected energy value data to the master control unit, so as to provide the master control unit with real energy value data in the case of triggering human sensing, and facilitate the master control unit to determine a human energy threshold that is more suitable for the scene requirement according to the real energy value data in the actual application scenario.
[0099] Among them, step B10 is a method of sending the current collected energy value data to the master control unit by responding to the request of the master control unit. It should be noted that when the master control unit determines that there is a human body in the sensing area through the wake-up module (such as a voice module or a camera module), it sends a request for the current energy value data to the human sensing module. At this time, the energy value data collected by the human sensing module can reflect the energy value situation when the human body is actually triggered to sense in the actual scene. Therefore, when the human sensing module receives the request for the current energy value data sent by the master control unit, it immediately feeds back the current collected energy value data to the master control unit.
[0100] In addition, steps B20 to B30 are a method of the human sensing module actively sending the energy value data triggered by the preset human energy threshold of the human sensing module to the master control unit. Among them, the preset human energy threshold is a fixed energy threshold preset by the human sensing module when it leaves the factory. Before the human sensing module receives a new human energy threshold for each sensing object, it can determine whether to trigger human sensing (triggering human sensing means that the human sensing result is positive) according to the existing fixed energy threshold, and record and store the energy value data collected at that time. Based on a preset period (for example, once a week or once a month), the recorded energy value data is sent to the master control unit to provide the master control unit with real energy value data in the case of triggering human sensing as training data, so as to facilitate the master control unit to determine the human energy threshold of each sensing object that is suitable for the current scene.
[0101] In a feasible embodiment, after the step of receiving the human energy threshold corresponding to each sensing object sent by the master control unit, the method further comprises:
[0102] Step C10, inputting the human energy threshold corresponding to each sensing object into the local human sensing trigger algorithm respectively, so as to optimize and update the human sensing trigger algorithm, and obtain the updated human sensing trigger algorithm;
[0103] Among them, the human sensing trigger algorithm is used to perform human sensing according to the current human energy threshold corresponding to the sensing object and the energy value data, and obtain a human sensing result.
[0104] It should be noted that after the energy threshold of human body sensing is determined by the embodiment of the present application to determine the human energy threshold of each sensing object of the human sensing module in the current scene, the human energy threshold of the sensing object can be used as the iterative input of the human sensing trigger algorithm to optimize and update the human sensing trigger algorithm, so as to optimize the human sensing trigger algorithm closer to the real habits of the user.
[0105] For example, the human sensing trigger algorithm includes the formula and parameters of the smoothing and filtering processing of the collected original energy value. After the human energy threshold of each sensing object is input into the human sensing trigger algorithm, the accuracy of the human body sensing result can be used as the optimization target, and the formula and parameters of the smoothing and filtering processing can be iteratively optimized until the accuracy of the human body sensing result output by the human sensing trigger algorithm reaches the relatively highest.
[0106] The technical scheme of the embodiment of the present application performs human body sensing by using the collected human energy threshold of different sensing objects (users), which is more suitable for the habits of the user in the current application scene of the human sensing module. The human sensing trigger algorithm is optimized and updated by using the more personalized human energy threshold, the difference of the human sensing trigger algorithm is realized, the individualization and difference of the human body sensing function of the user are met, and the user experience is improved.
[0107] The energy threshold determination method for human body sensing applied to the human sensing module provided by the embodiment of the present application can solve the technical problem that the environment adaptability of the human body sensing scheme based on the fixed energy threshold is poor and cannot adapt to the complex and changeable application environment. Compared with the prior art, the beneficial effects of the energy threshold determination method for human body sensing applied to the human sensing module provided by the embodiment of the present application are the same as those of the energy threshold determination method for human body sensing provided by the above-mentioned embodiment, and other technical features of the energy threshold determination method for human body sensing applied to the human sensing module in the embodiment of the present application are the same as those disclosed in the above-mentioned embodiment method. Here, no further description is made.
[0108] It should be noted that the present example is only used to assist in understanding the present application and does not constitute a limitation on the energy threshold determination method for human body sensing of the present application. More forms of simple transformation based on this technical concept are within the protection scope of the present application.
[0109] The embodiment of the present application also provides a master control unit, which is connected with a human sensing module, a voice module and a camera module respectively. The master control unit at least includes: at least one processor; and a memory in communication connection with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the energy threshold determination method for human body sensing in the above-mentioned embodiment.
[0110] Reference will now be made to the following description Figure 4 which shows a structural schematic diagram of a master control unit suitable for being used to implement embodiments of the present application. Figure 4 The master control unit shown is merely an example and should not bring any limitation to the functions and use range of embodiments of the present application.
[0111] As shown in Figure 4 , the master control unit can include a processing device 101 (e.g. a central processing unit, a graphic processing unit, etc.) which can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 102 or loaded from a storage device 103 into a random access memory (RAM) 104. In the RAM 104, various programs and data required for the operation of the master control unit are also stored. The processing device 101, the ROM 102 and the RAM 104 are connected to each other through a bus 105. An input / output (I / O) interface 106 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 106: input devices 107 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 108 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; the storage device 103 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 109. The communication device 109 can allow the master control unit to communicate with other devices wirelessly or by wire to exchange data. Although the master control unit with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be alternatively implemented or provided.
[0112] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing program code for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication device, or installed from the storage device 103, or installed from the ROM 102. When the computer program is executed by the processing device 101, the above-mentioned functions defined in the methods of embodiments of the present application are performed.
[0113] The master control unit provided by the embodiments of the present application adopts the energy threshold determination method for human body sensing in the above embodiments, and can solve the technical problem that the environment adaptation capability of the human body sensing scheme based on a fixed energy threshold is poor and cannot adapt to complex and changeable application environments. Compared with the prior art, the master control unit provided by the embodiments of the present application has the same beneficial effects as the energy threshold determination method for human body sensing provided by the above embodiments, and other technical features in the master control unit are the same as the features disclosed in the above embodiment method, which will not be described here.
[0114] It should be understood that parts of the embodiments of the present application can be realized by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.
[0115] The above describes only specific implementation of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto, any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered in the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application should be subject to the protection scope of the above claims.
[0116] The embodiments of the present application also provide a human sensing module, which is connected with the master control unit, and at least includes: at least one processor; and a memory in communication connection with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the energy threshold determination method for human body sensing in the above embodiments.
[0117] Reference will be made to the following description of the embodiments of the present application Figure 5 which shows a structural schematic diagram of the human sensing module suitable for being used to implement the embodiments of the present application. Figure 5 The human sensing module shown is only an example, and should not bring any limitation to the functions and use range of the embodiments of the present application.
[0118] As Figure 5As shown, the human sensing module can include a processing device 201 (e.g., a central processing unit, a graphics processing unit, etc.) that can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 202 or loaded from the storage device 203 into a random access memory (RAM) 204. In the RAM 204, various programs and data required for operation of the human sensing module are also stored. The processing device 201, the ROM 202, and the RAM 204 are connected to each other through a bus 205. An input / output (I / O) interface 206 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 206: input devices 207 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 208 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; the storage device 203 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 209. The communication device 209 can allow the human sensing module to communicate with other devices wirelessly or by wire to exchange data. Although the human sensing module with various systems is shown in the figure, it should be understood that all the shown systems are not required to be implemented or possessed. More or less systems can be alternatively implemented or possessed.
[0119] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network by the communication device, or installed from the storage device 203, or installed from the ROM 202. When the computer program is executed by the processing device 201, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are performed.
[0120] The human sensing module provided by the embodiments of the present disclosure adopts the energy threshold determination method for human sensing in the above embodiments, and can solve the technical problem that the environment adaptation capability of the human sensing scheme based on a fixed energy threshold is poor and cannot adapt to complex and changeable application environments. Compared with the prior art, the human sensing module provided by the embodiments of the present disclosure has the same beneficial effects as the energy threshold determination method for human sensing provided by the above embodiments, and other technical features in the human sensing module are the same as the features disclosed in the above embodiments, which will not be repeated here.
[0121] It should be understood that each part of the embodiments of the present application can be realized by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.
[0122] The above describes only specific implementation of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto, any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered in the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application should be subject to the protection scope of the above claims.
[0123] The embodiments of the present application also provide a refrigerator, which comprises a main control unit and a human sensing module connected with each other, wherein the main control unit is used to execute the steps of the energy threshold value determination method for human sensing applied to the main control unit as described in the above embodiments, and the human sensing module is used to execute the steps of the energy threshold value determination method for human sensing applied to the human sensing module as described in the above embodiments.
[0124] The refrigerator provided by the embodiments of the present application adopts the energy threshold value determination method for human sensing applied to the main control unit and the human sensing module in the above embodiments, which can solve the technical problem that the environment adaptation ability of the human sensing scheme based on a fixed energy threshold value is poor and cannot adapt to complex and changeable application environments. Compared with the prior art, the refrigerator provided by the embodiments of the present application has the same beneficial effects as the energy threshold value determination method for human sensing provided by the above embodiments, and other technical features in the refrigerator are the same as the features disclosed in the above embodiments, which will not be described here.
[0125] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program capable of running on a processor, and the computer program is used to execute the energy threshold value determination method for human sensing in the above embodiments.
[0126] The computer readable storage medium provided by the embodiments of the present application may, for example, be a U disk, but is not limited to an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system or device, or any combination thereof. More specific examples of the computer readable storage medium may include, but are not limited to, an electric connection with one or more conductive wires, a portable computer disk, a hard disk, a random access memory (RAM), a read only memory (ROM), an erasable programmable read only memory (EPROM or flash memory), an optical fiber, a portable compact disk read only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the embodiments, the computer readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer readable storage medium can be transmitted by any suitable medium, including but not limited to an electric wire, an optical cable, an RF (Radio Frequency), and the like, or any suitable combination thereof.
[0127] The computer readable storage medium described above may be contained in the master control unit or the human sensing module, or may exist separately without being assembled into the master control unit or the human sensing module.
[0128] The computer readable storage medium described above carries one or more programs, which, when executed by the master control unit, cause the master control unit to: collect a plurality of sets of energy value data of the human sensing module when the human sensing module senses a human body; determine a human energy threshold corresponding to at least one sensing object according to a characteristic of each of the energy value data; and send the human energy threshold corresponding to the sensing object to the human sensing module, so that the human sensing module determines a target human energy threshold corresponding to the sensing object based on the identity of the sensing object after determining the identity of the sensing object according to the acquired energy value data, and performs human sensing based on the target human energy threshold and the energy value data to obtain a human sensing result.
[0129] Or, the computer readable storage medium carries one or more programs, when the one or more programs are executed by the human sensing module, the human sensing module: receives the human energy threshold corresponding to each sensing object respectively sent by the master control unit, wherein the human energy threshold corresponding to each sensing object respectively is determined by the master control unit according to the characteristics of the plurality of energy value data when the human sensing module senses the human body; obtain the current energy value data, and determine whether there is a sensing object according to the energy value data; when there is a sensing object, determine the identity of the sensing object according to the energy value data; query the target human energy threshold corresponding to the identity of the sensing object in each human energy threshold corresponding to the sensing object respectively; and perform human sensing according to the target human energy threshold and the energy value data to obtain a human sensing result.
[0130] Computer program code for carrying out operations of the present disclosure can be written in any of one or more programming languages or combinations of languages including object or visual programming languages such as Java, Smalltalk, C++ or conventional procedural programming languages such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).
[0131] The flow diagrams and the block diagrams in the drawings are illustrations of architectures, functionalities, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a procedure, or a part of code, which comprises one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in a different order than that noted in the figures. For example, two blocks noted in succession can in fact be executed substantially concurrently or in the opposite order, depending on the functionality involved. It is also noted that each block in the block diagrams and / or flow diagrams, and combinations of blocks in the block diagrams and / or flow diagrams, can be implemented by dedicated hardware-based systems that perform the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.
[0132] The modules described in the embodiments of the present application can be implemented in the form of software or in the form of hardware. In some cases, the name of the module does not constitute a limitation on the module itself.
[0133] The computer readable storage medium provided by the embodiments of the present application stores computer readable program instructions for executing the human body sensing energy threshold determination method described above, and can solve the technical problem of poor environmental adaptability of the human body sensing scheme based on a fixed energy threshold and the inability to adapt to complex and changeable application environments. Compared with the prior art, the beneficial effects of the computer readable storage medium provided by the embodiments of the present application are the same as those of the human body sensing energy threshold determination method provided by the above embodiments, and are not described here.
[0134] The embodiments of the present application further provide a computer program product, comprising a computer program, and the computer program is executed by a processor to implement the steps of the human body sensing energy threshold determination method as described above.
[0135] The computer program product provided by the embodiments of the present application can solve the technical problem of poor environmental adaptability of the human body sensing scheme based on a fixed energy threshold and the inability to adapt to complex and changeable application environments. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiments of the present application are the same as those of the human body sensing energy threshold determination method provided by the above embodiments, and are not described here.
[0136] The above is only the preferred embodiments of the present application, and does not limit the patent scope of the present application, and any equivalent structure or equivalent flow transformation using the content of the specification and drawings of the present application, or direct or indirect application in other related technical fields, are also included in the patent processing scope of the present application.
Claims
1. A method for determining an energy threshold for human perception, characterized in that, The method is applied to a master control unit connected with a human sensing module, and comprises the following steps: Collecting multiple sets of energy value data of the human sensing module when the human sensing module senses a human body; Determining human energy threshold values corresponding to at least one sensing object according to characteristics of the energy value data; Sending the human energy threshold values corresponding to the sensing objects to the human sensing module, so that the human sensing module determines a target human energy threshold value corresponding to the sensing object based on the identity of the sensing object after determining the identity of the sensing object according to the acquired energy value data, and performs human sensing according to the target human energy threshold value and the energy value data to obtain a human sensing result.
2. The method of claim 1, wherein the step of determining the energy threshold value is performed by a processor of the electronic device. The master control unit is connected with a voice module and / or a camera module, and the step of collecting multiple sets of energy value data of the human sensing module when the human sensing module senses a human body comprises the following steps: When the voice module is woken up by a preset wake-up word or the camera module recognizes a human body from image information collected by the camera module, requesting the human sensing module for current energy value data; Receiving the energy value data sent by the human sensing module.
3. The method of claim 1, wherein the step of determining the energy threshold value is performed by a processor of the electronic device. The step of collecting multiple sets of energy value data of the human sensing module when the human sensing module senses a human body comprises the following steps: Receiving human energy value data sent by the human sensing module based on a preset period, wherein the human energy value data is energy value data when the human sensing module triggers human sensing based on a preset human energy threshold value.
4. The method of claim 1, wherein the step of determining the energy threshold value is performed by a processor of the electronic device. After the step of determining human energy threshold values corresponding to at least one sensing object according to characteristics of the energy value data, the method further comprises the following steps: Inputting each energy value data into a preset self-learning model to obtain a sensing object corresponding to each energy value data output by the self-learning model and a human energy threshold value of each sensing object; The self-learning model is a local model or a cloud model, and the human energy threshold value is used to represent a critical value of the energy value of the corresponding sensing object when triggering human sensing.
5. A method of determining an energy threshold for human perception, characterized by, The method is applied to a human sensing module connected with a master control unit, and comprises the following steps: Receiving human energy threshold values corresponding to each sensing object sent by the master control unit, wherein the human energy threshold values corresponding to each sensing object are determined by the master control unit according to characteristics of multiple sets of energy value data of the human sensing module when the human sensing module senses a human body; Acquiring current energy value data and determining whether there is a sensing object according to the energy value data; When there is a sensing object, determining the identity of the sensing object according to the energy value data; Querying a target human energy threshold value corresponding to the identity of the sensing object from the human energy threshold values corresponding to each sensing object; Performing human sensing according to the target human energy threshold value and the energy value data to obtain a human sensing result.
6. The human-induced energy threshold determination method of claim 5, wherein, The method comprises the following steps: If a request about current energy value data is received from the master control unit, sending the current acquired energy value data to the master control unit; When human sensing is triggered based on a preset human energy threshold value, recording the current acquired energy value data; Based on a preset period, the main control unit sends the recorded energy value data.
7. The human-induced energy threshold determination method of claim 5, wherein, After the step of receiving the human energy threshold corresponding to each sensing object sent by the main control unit, the method further comprises: Inputting the human energy threshold corresponding to each sensing object into a local human sensing trigger algorithm respectively to optimize and update the human sensing trigger algorithm, and obtaining an updated human sensing trigger algorithm. The human sensing trigger algorithm is used to perform human sensing according to the current human energy threshold corresponding to the sensing object and the energy value data, and obtain a human sensing result.
8. A master unit, characterized by The main control unit is connected with a human sensing module, a voice module and a camera module respectively, and at least includes a memory, a processor and a computer program stored on the memory and executable on the processor, and the computer program is configured to implement the steps of the human sensing energy threshold determination method according to any one of claims 1 to 5.
9. A human sensing module, comprising: The human sensing module is connected with the main control unit, and at least includes a memory, a processor and a computer program stored on the memory and executable on the processor, and the computer program is configured to implement the steps of the human sensing energy threshold determination method according to any one of claims 6 to 7.
10. A refrigerator characterized by comprising: The refrigerator at least includes a main control unit and a human sensing module connected with each other, wherein the main control unit is used to execute the steps of the human sensing energy threshold determination method according to any one of claims 1 to 5, and the human sensing module is used to execute the steps of the human sensing energy threshold determination method according to any one of claims 6 to 7.
11. A storage medium, characterized by The storage medium is a computer readable storage medium, and the computer readable storage medium stores a human sensing energy threshold determination method program, and the human sensing energy threshold determination method program is executed by the processor to implement the steps of the human sensing energy threshold determination method according to any one of claims 1 to 5 or claims 6 to 7.