Refrigerator control method, refrigerator and storage medium

Abstract

The invention discloses a control method of a refrigerator, the refrigerator and a storage medium, and relates to the technical field of intelligent household appliances, the refrigerator is provided with a human body induction sensor and a voice device, and the method comprises the steps that if human body data detected by the human body induction sensor meets a voice activation condition, the voice device is activated; activating the voice device and resetting a timing value of a timer; executing a voice task based on the voice device; and if the timing value of the timer is greater than or equal to a preset threshold value, controlling the voice device to enter a dormant state. The human body induction sensor is arranged on the refrigerator, the voice device of the refrigerator is activated on the basis of the inducted human body data, and therefore the interaction effect of the refrigerator is improved on the basis of the human body data inducted in real time.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent household appliances, in particular to a control method of a refrigerator, the refrigerator and a storage medium. BACKGROUND

[0002] Most intelligent voice refrigerators require users to use a specific wake-up word such as "Xiaobing Xiaobing" first to enable the voice recognition system to enter a wake-up state, and then receive subsequent voice control instructions. However, if the user forgets to use the correct wake-up word, or misuses other similar words, the system may not respond correctly, thereby affecting the user experience and resulting in poor interaction effect of the refrigerator.

[0003] The above content is only used to assist in understanding the technical solutions of the present application and does not represent the acknowledgement of the above content as prior art. SUMMARY

[0004] The main purpose of the present application is to provide a control method of a refrigerator, the refrigerator and a storage medium, aiming to solve the technical problem of poor interaction effect of the refrigerator when the refrigerator is woken up based on a wake-up word.

[0005] To achieve the above-mentioned purpose, the present application provides a control method of a refrigerator, wherein a human body sensing sensor and a voice device are arranged on the refrigerator, and the method comprises:

[0006] If the human body data detected by the human body sensing sensor meets a voice activation condition, the voice device is activated and the timing value of a timer is reset;

[0007] A voice task is executed based on the voice device;

[0008] If the timing value of the timer is greater than or equal to a preset threshold, the voice device is controlled to enter a dormant state.

[0009] In an embodiment, the refrigerator is provided with a prompt device, and after the step of activating the voice device and resetting the timer if the human body data detected by the human body sensing sensor meets the voice activation condition, the method further comprises:

[0010] When the timing value of the timer is less than the preset threshold, a prompt action of the voice device being in a wake-up state is executed based on the prompt device.

[0011] In an embodiment, after the step of executing a voice task based on the voice device, the method further comprises:

[0012] When the timing value of the timer is less than the preset threshold, if the target human body data detected by the human body sensing sensor or the voice signal received by the voice device, the timing value of the timer is reset.

[0013] In an embodiment, the step of executing the voice task based on the voice device comprises:

[0014] parsing the voice signal received by the voice device, and generating a control instruction based on the parsed voice signal;

[0015] generating a voice task for a broadcast process and / or a voice task for a refrigerator control process according to the control instruction;

[0016] executing an information broadcast action and / or a refrigerator control action corresponding to the voice task.

[0017] In an embodiment, before the step of executing the information broadcast action and / or the refrigerator control action corresponding to the voice task, the method further comprises:

[0018] determining a current time period if the voice signal is not detected by the voice device within a preset time period;

[0019] generating a voice broadcast task based on the current time period, and executing an information broadcast action corresponding to the voice broadcast task.

[0020] In an embodiment, the step of executing the voice task based on the voice device comprises:

[0021] determining a historical voice task generated by the voice device, and generating a target voice task for a broadcast process based on the historical voice task and current goods information;

[0022] executing an information broadcast action corresponding to the target voice task.

[0023] In an embodiment, before the step of activating the voice device and resetting the timing value of the timer, the method further comprises:

[0024] determining a stop position corresponding to the human body data, and obtaining a voice wake-up area determined according to the location of the refrigerator;

[0025] determining that the human body data satisfies the voice activation condition when the stop position is in the voice wake-up area.

[0026] In an embodiment, before the step of determining the stop position corresponding to the human body data, and obtaining the voice wake-up area determined according to the location of the refrigerator, the method further comprises:

[0027] determining a moving direction of a target human body according to the human body data;

[0028] when the moving direction points to an area corresponding to the location of the refrigerator, executing the step of determining the stop position corresponding to the human body data, and obtaining the voice wake-up area determined according to the location of the refrigerator.

[0029] In addition, to achieve the above object, the present application also provides a refrigerator, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the computer program is configured to implement the steps of the control method of the refrigerator.

[0030] In addition, to achieve the above object, the present application also provides a storage medium, which is a computer readable storage medium, and the storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the control method of the refrigerator.

[0031] The one or more technical solutions provided by the present application have at least the following technical effects:

[0032] Since the human body sensing sensor is arranged on the refrigerator, the voice activation processing of the refrigerator can be performed based on the detected human body data, so as to avoid voice wake-up processing only through a voice wake-up word, and after the voice device is woken up, the corresponding voice task is executed based on the voice device, so as to avoid the need for a wake-up word to wake up and then perform voice interaction or execute corresponding processing actions with the refrigerator, thereby improving the interaction effect when performing voice interaction with the intelligent voice refrigerator. BRIEF DESCRIPTION OF DRAWINGS

[0033] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present application and, together with the specification, serve to explain the principles of the application.

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, for those skilled in the art, other drawings can also be obtained based on these drawings without creative labor.

[0035] Figure 1 It is a schematic diagram of the function module of the refrigerator of the present application;

[0036] Figure 2 It is a schematic diagram of the system architecture of the control method of the refrigerator of the present application;

[0037] Figure 3 It is a flowchart provided by the first embodiment of the control method of the refrigerator of the present application;

[0038] Figure 4 It is a flowchart provided by the second embodiment of the control method of the refrigerator of the present application;

[0039] Figure 5 It is a flowchart of the implementation of the optional implementation of the control method of the refrigerator of the present application;

[0040] Figure 6 The device structure diagram of the hardware running environment involved in the control method of the refrigerator in the embodiments of the present application.

[0041] The purposes, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0042] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application, and are not used to limit the present application.

[0043] In the present embodiment, for the sake of description, the following is described with the central processing unit of the refrigerator as the execution subject.

[0044] Since most of the existing intelligent voice refrigerators need the user to use a specific wake-up word first to make the voice recognition system enter the wake-up state, and then receive the subsequent voice control instructions. However, if the user forgets to use the correct wake-up word, or misuses other similar words, the system may not respond correctly, thereby affecting the user experience, resulting in poor interaction effect of the refrigerator.

[0045] The present application provides a solution, by setting a human body sensor on the intelligent voice refrigerator, based on the human body data detected by the human body sensor, judging whether the user has the demand to use the refrigerator, at the same time, when the human body data meets the voice activation condition, activating the voice device and charging the timer value, so that the voice device executes the corresponding voice task, and when the timer value reaches the voice threshold, controlling the voice device to enter the dormant state. Based on this, the wake-up state of the voice device can be flexibly controlled through the human body sensor, thereby improving the interaction effect of the user and the refrigerator.

[0046] In order to better understand the technical solutions of the present application, the following will be described in detail in conjunction with the drawings and specific embodiments of the specification.

[0047] In the present embodiment, the functional module layout diagram of the intelligent voice refrigerator of the present application is as shown in Figure 1As shown, the human body information is collected by the human body sensing sensor, including but not limited to collecting the distance information, angle information and moving direction information of the user and the refrigerator, so as to determine whether to trigger the wake-up instruction of the voice device and the light display device based on the collected information such as whether the distance between the user and the refrigerator meets the preset condition, whether the moving direction of the user meets the preset condition and / or whether the position of the user meets the preset condition. The voice device includes the intelligent voice recognition and processing system of the refrigerator, which realizes the interaction with the user through the integrated voice recognition chip, supports multiple languages and can accurately recognize the voice instruction of the user. After the voice device is woken up, the received voice instruction of the user can be responded to and the corresponding broadcast action such as broadcasting the food information, recipe suggestion or recommended food material of the current refrigerator can be performed, or the refrigerator control action including but not limited to turning on the refrigerator, turning off the refrigerator, adjusting the refrigeration parameter of the refrigerator, etc. The light display device is used to wake up the current voice device, for example, when the light display device is turned on, it indicates that the current voice device is in the wake-up state, which facilitates the user to determine whether the voice device is in the wake-up state by observing the light display device and enhances the user's perception.

[0048] Further, please refer to Figure 2 , Figure 2 The system architecture diagram of the control method of the refrigerator of the present application is provided, wherein the refrigerator includes a central processing unit, a human body sensing device, a voice device and a light display device. The human body sensing device sends the detected human body data to the central processing unit for analysis and judgment. When the human body data meets the wake-up condition of the voice device, the central processing unit sends a wake-up instruction to the voice device to wake up the voice device, so that the refrigerator voice device can be in the interactive state without voice wake-up, thereby improving the interactive effect of the refrigerator. Meanwhile, the wake-up instruction can also be sent to the light display device to turn on the prompt light of the light display device, so that the user can perceive that the current voice device is in the wake-up state.

[0049] Optionally, the voice device, the human body sensing sensor and the light display device can be installed in Figure 1 the area of the top of the refrigerator as shown, and can also be installed in various places of the refrigerator such as the front, side and back of the refrigerator or the inside of the refrigerator. In addition, the voice device can also be installed on the human body sensing sensor to reduce the complexity of the system.

[0050] Optionally, the human body sensing sensor includes but is not limited to infrared, millimeter wave, ultrasonic and other distance sensors, visual sensors for face recognition, gesture recognition and image sensors.

[0051] Optionally, the light display device can be an LED indicator light indicating different states of the voice device by different colors, or an LCD display screen displaying text, icons or simple animations based on the display screen to represent different states of the voice device. In addition, other display methods can also be used for display, which are not limited in the present application.

[0052] Optionally, after the voice device is woken up, a wake-up time is usually set, which is usually set to 10-60 seconds or more. When the human body data detected by the human body sensor meets the voice activation condition within the wake-up time, the voice device is activated and the timer value is reset. If the human body data meeting the voice activation condition is repeatedly detected within the wake-up period, the countdown of the wake-up period will be repeatedly refreshed. In addition, after the user inputs the voice instruction, the timer value will also be reset.

[0053] It should be noted that the above parameters are only used for explanation and are not limited to the present application.

[0054] The present application provides a control method of a refrigerator, which is described with reference to Figure 3 , Figure 3 The present application provides a control method of a refrigerator, which is described with reference to

[0055] In the present embodiment, a human body sensor and a voice device are arranged on the refrigerator, and the control method of the refrigerator comprises steps S10-S30:

[0056] Step S10, if the human body data detected by the human body sensor meets the voice activation condition, the voice device is activated and the timer value is reset.

[0057] It should be noted that the human body sensor includes but is not limited to infrared, millimeter wave, ultrasonic distance sensor, visual sensor for face recognition, gesture recognition, image sensor, etc. The human body sensor and the voice device can be installed simultaneously on the top area of the refrigerator, or can be installed dispersedly on the refrigerator, such as the front, side, back of the refrigerator or the inside of the refrigerator. Optionally, the voice device can also be installed on the human body sensor, and the two are coupled to improve the intelligence of the refrigerator. The voice activation condition includes but is not limited to that the distance between the user and the refrigerator in the detected human body data is within a preset distance range, the user's direction of travel points to the area where the refrigerator is located, the user's current position stays in the voice wake-up area of the refrigerator, the user's identity information such as face, fingerprint, gesture, etc. is accurately identified, etc.

[0058] In the embodiment, when the human body data detected by the human body sensing sensor satisfies the voice activation condition, for example, the human body sensing sensor is an ultrasonic sensor, based on the human body data detected by the sensor, the distance between the user and the refrigerator is within 2-5 meters, at this time, it is judged that the human body data satisfies the voice activation condition, then the voice device is activated and the timing value of the timer is reset, so that the voice device responds to the voice instruction of the user or performs the corresponding voice task based on the current environmental information within the countdown time of the timer, that is, the voice wake-up period.

[0059] In another optional embodiment for judging whether the human body data satisfies the voice activation condition, the refrigerator can determine a voice wake-up area according to the current location, and if the user is in the voice wake-up area, it is judged that the human body data satisfies the voice activation condition. Specifically, the stop position corresponding to the human body data can be determined, and the voice wake-up area determined according to the location of the refrigerator is obtained, and then when the stop position is in the wake-up area, it is determined that the human body data satisfies the voice activation condition. Based on this, the actual stopping position of the user in the human body data is detected by the human body sensing sensor, so that the voice activation judgment is accurately performed, and the voice wake-up false triggering caused by the user walking near the refrigerator is avoided.

[0060] Optionally, the human body sensing sensor can also calculate the moving direction of the target human body, that is, the user, based on the angle information of the detected human body data, and then perform the action of determining the stop position corresponding to the human body data when the moving direction points to the area where the refrigerator is located, thereby avoiding the false triggering of voice wake-up. Specifically, the moving direction of the target human body can be determined according to the human body data, and when the moving direction points to the area corresponding to the location of the refrigerator, the steps of determining the stop position corresponding to the human body data and obtaining the voice wake-up area determined according to the location of the refrigerator are performed.

[0061] Based on this, the human body data detected by the human body sensing sensor is analyzed and processed, and then the voice state of the refrigerator is woken up when the human body data satisfies the voice wake-up condition, thereby avoiding the need for a wake-up word to wake up the processing, improving the user experience, and improving the interaction effect of the refrigerator based on the processing of the detected human body data.

[0062] Step S20, the voice device performs a voice task;

[0063] It should be noted that the voice task refers to the task performed by the voice device, and not the task performed in response to the voice instruction input by the user.

[0064] Based on this, in the embodiment, after the voice device is woken up, in addition to responding to the voice instruction input by the user to perform the related action, if the voice signal input by the user is not received within a period of time after being woken up, that is, the voice signal is empty, a corresponding voice task can also be generated according to the current environmental information.

[0065] Specifically, the voice task can be generated according to the voice signal received by the voice device, and then the information broadcast action and / or the refrigerator control action corresponding to the voice task are performed, or if no voice signal is detected within a preset period of time, a voice task for the refrigerator to perform the information broadcast action is generated based on the current environmental information such as the current period and the current temperature, or the current historical use information and the goods information of the refrigerator. The information broadcast action includes but is not limited to recipe query and recipe suggestion, shopping list management, food shelf life, inventory or maintenance reminder, weather broadcast, and seasonal fruit and vegetable information broadcast. The refrigerator control action includes but is not limited to adjusting the operating parameters of the refrigerator, such as reducing the refrigeration temperature, adjusting the light brightness inside the refrigerator, opening the refrigerator door, entering the energy-saving mode, or limiting the child to open the freezer, etc.

[0066] After the voice device is activated, the corresponding voice task is performed through the voice device, thereby improving the interaction effect between the user and the refrigerator.

[0067] In step S30, if the timing value of the timer is greater than or equal to a preset threshold value, the voice device is controlled to enter a sleep state.

[0068] In the embodiment, the timing value of the timer is the wake-up time of the voice device when the voice device is woken up, and when the timing value is greater than or equal to the preset threshold value, it means that the wake-up period of the voice device has arrived, and the voice device needs to be controlled to enter a sleep state, thereby reducing the energy consumption of the refrigerator and optimizing the use of resources. The length of the preset threshold value can be set based on actual needs, which is not limited here.

[0069] The embodiment provides a control method of a refrigerator. A human body sensing sensor and a voice device are arranged on the refrigerator. The human body data of a user is detected through the human body sensing sensor, and the distance, direction, and position of the human body data are accurately judged. When the human body data meets the voice activation condition, the voice device is activated and the timing value of the timer is reset. Based on this, the intelligent voice refrigerator is woken up without sensing, the user interacts with the refrigerator more naturally, the voice task is executed based on the voice device, and when the voice wake-up time is reached, the voice device is controlled to enter a sleep state. Based on this, the interaction effect between the user and the refrigerator is improved.

[0070] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as the above first embodiment can be referred to the above introduction, and the subsequent will not be described. On this basis, the refrigerator is also provided with a prompting device, which can be a light display device such as a prompt light, a display screen, etc., or a voice prompting device. Based on this, please refer to Figure 4 , after step S10, the control method of the refrigerator further comprises step S40:

[0071] Step S40, when the timer value is less than the preset threshold, the prompting device is executed based on the voice device in the wake-up state of the prompting action.

[0072] In this embodiment, the timer value represents the wake-up time of the voice device, and when the timer value is less than the preset threshold, the voice device is still in the wake-up state. Based on this, in order to further improve the user's perception effect, and further improve the user's interaction effect with the refrigerator, at this time, the prompting action of the voice device in the wake-up state can be executed based on the prompting device, for example, when the prompting device is an indicator light, the indicator light can be controlled to be turned on to prompt the user that the voice device is currently in the wake-up state.

[0073] Alternatively, if the prompting device is a display screen, the display screen can display text information that the voice device is in the wake-up state.

[0074] In another optional embodiment, after the timer value is greater than or equal to the preset threshold and the voice device is controlled to enter the sleep state, the prompting device also needs to be controlled to enter the sleep state to prompt the user that the current voice device is in the un-wake-up state.

[0075] Further, after the voice device executes the voice task, if the human body sensor detects human body data again within the voice wake-up period, or the user continuously inputs the voice signal within the voice wake-up period, the timer value needs to be reset. Specifically, when the timer value is less than the preset threshold, if the target human body data detected by the human body sensor or the voice signal received by the voice device, the timer value is reset.

[0076] Exemplarily, in order to help understand the implementation process of the control method of the refrigerator obtained after the above first embodiment, wherein the prompting device is a prompt light, the voice device includes a voice module, the detection device judges the voice wake-up by detecting the distance between the user and the refrigerator, and the timer value is 30 seconds.

[0077] Based on this, please refer to Figure 5 , Figure 5A brief flowchart of a control method of a refrigerator is provided, specifically: when the voice device is in a voice sleep state, the light of the prompt lamp is turned off, then when it is detected that the user is close to the refrigerator, i.e., the distance between the user and the refrigerator is less than a preset distance, a voice wake-up action is performed and the voice device is woken up, at the same time the light of the indicator lamp is turned on and kept for 30 seconds, within the 30 seconds, when the voice module of the voice device receives a voice instruction, a corresponding voice task is generated. When the light display time of the indicator lamp exceeds 30 seconds, the voice device needs to be controlled to enter the sleep state, and the light of the indicator lamp is turned off. Within the 30 seconds of the voice wake-up period, if the human body sensing data is triggered again, the timing value of the timer needs to be updated and reset, i.e., the light of the indicator lamp starts to count 30 seconds again.

[0078] It should be noted that the parameters of the above examples are only used to understand the present application and do not constitute a limitation on the control method of the refrigerator of the present application. More forms of simple transformation based on this technical concept are within the protection scope of the present application.

[0079] In the present embodiment, the prompt when the voice device is woken up by the prompt device allows the user to know that the voice is in a wake-up state, enhances user perception, and further improves the interaction effect between the user and the refrigerator.

[0080] Based on the first embodiment of the present application, in the third embodiment of the present application, the same or similar contents as the above first embodiment can be referred to the above introduction, and will not be described in detail hereinafter.

[0081] On this basis, as an optional implementation of executing a voice task based on a voice device, when the voice signal is not empty, i.e., the voice device receives a voice signal input by the user, including the user directly talking to the refrigerator or sending a voice signal to the refrigerator through a remote device, the voice signal needs to be parsed, and then a control instruction is generated based on the parsed voice signal, wherein the parsing process includes operations such as pre-processing, feature extraction and analysis, and instruction output of the voice signal, which are not limited here. After obtaining the control instruction, a voice task for broadcast processing and / or a voice task for refrigerator control processing are generated based on the control instruction. For example, the input voice information is "today's weather, if it is lower than 5 degrees Celsius, enter energy-saving mode", and the current environmental temperature is 3 degrees Celsius. After parsing the sentence, the voice device generates a control instruction for weather information broadcast and a control instruction for entering energy-saving mode according to the current detected environmental temperature information, and then generates a voice task for broadcasting weather information and a voice task for controlling the refrigerator to enter energy-saving mode based on the instruction, i.e., encapsulating the control instruction into the voice task, so as to make the refrigerator execute the broadcast action of the voice task corresponding to the weather information and the control action of the refrigerator entering energy-saving mode.

[0082] Optionally, if the input voice information is "what food is placed in the refrigerator for a long time", the voice device generates a voice task of broadcasting information of all foods placed in the refrigerator for more than 3 days after analyzing the sentence. Optionally, if the input voice information is "open the refrigerator door", a voice task of the refrigerator control process of opening the refrigerator door is generated. Based on this, the voice instruction input by the user can be effectively responded, and the corresponding voice task can be generated to control the refrigerator, thereby improving the interaction effect of the refrigerator.

[0083] In another optional implementation of the voice task executed by the voice device, when the voice signal is empty, that is, after triggering the voice activation condition, if the voice device does not detect the voice signal within a preset time period, in order to improve the interaction effect of the refrigerator, the voice device can usually automatically perform a voice task of information broadcasting based on the current environmental information.

[0084] Specifically, if the voice device does not detect the voice signal within the preset time period, the current time period can be determined first, and then a voice broadcasting task is generated based on the current time period, and an information broadcasting action corresponding to the voice broadcasting task is performed. For example, when the current time period is the morning time period such as 7-9 am, a voice task of morning news, music playing or weather broadcasting can be generated; when the current time period is the cooking time period such as 11-13 pm, the storage information of the refrigerator needs to be obtained, and then a voice task corresponding to the recipe suggestion is generated based on the storage information; in addition, if the current time period is the purchasing time period such as 15-17 pm, a voice task corresponding to the item purchasing information can be generated based on the storage information of the refrigerator. Based on this, when no voice signal is received within the preset time period, a voice task of information broadcasting action is generated based on the real-time environmental information, so that the refrigerator executes the corresponding information based on the voice task, thereby improving the interaction effect of the refrigerator. The preset time period is usually less than the timing value of the timer.

[0085] In another optional implementation of the voice task executed by the voice device, the historical voice tasks generated by the voice device can also be determined, and then a target voice task for broadcasting processing is generated based on the historical voice tasks and the current goods information of the refrigerator. For example, among the generated historical voice tasks, 80% of the historical voice tasks are broadcasting the recipe suggestion of today. Based on this, the voice device is woken up, and a target voice task meeting the user's demand is generated based on the task processing amount or the task repetition degree of the historical voice task and the current obtained information, so that the refrigerator executes the information broadcasting action corresponding to the target voice task.

[0086] Optionally, in addition to obtaining the time period information, the current weather information can also be obtained in real time, and a voice task corresponding to the broadcasting information of the corresponding food purchase suggestion or food use suggestion is generated based on the weather information.

[0087] Optionally, historical usage information of the refrigerator can also be obtained, and corresponding voice tasks for information broadcasting can be generated based on this information. Furthermore, corresponding voice tasks for information broadcasting processing can be generated at other times, which will not be elaborated upon here.

[0088] It should be noted that the above parameters are for illustrative purposes only and are not intended to limit this application.

[0089] This application provides a refrigerator, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the refrigerator control method of the first embodiment described above.

[0090] The following is for reference. Figure 6 It shows a structural schematic diagram of a refrigerator suitable for implementing the embodiments of this application. Figure 6 The refrigerator shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of this application.

[0091] like Figure 6 As shown, the refrigerator may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.) that can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for refrigerator operation. The processing device 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1003 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. The communication device 1009 allows the refrigerator to communicate wirelessly or wiredly with other devices to exchange data. Although refrigerators with various systems are shown in the figures, it should be understood that implementation or possession of all the systems shown is not required. More or fewer systems may be implemented alternatively.

[0092] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing program codes for executing the method shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiments disclosed in the present application are executed.

[0093] The refrigerator provided by the present application adopts the control method of the refrigerator in the above-mentioned embodiments, and can solve the technical problem that the interaction effect of the refrigerator is poor when the refrigerator is woken up based on the wake-up word. Compared with the prior art, the refrigerator provided by the present application has the same beneficial effects as the control method of the refrigerator provided by the above-mentioned embodiments, and other technical features in the refrigerator are the same as the features disclosed in the above-mentioned embodiments, which will not be repeated here.

[0094] It should be understood that various parts of the present application can be realized by hardware, software, firmware or a combination thereof. In the description of the above-mentioned embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0095] The above is merely specific embodiments of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0096] The present application provides a computer readable storage medium having stored thereon computer readable program instructions (i.e. computer program) for executing the control method of the refrigerator in the above-mentioned embodiments.

[0097] The computer readable storage medium provided in the present application may, for example, be a U disk, but is not limited to an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, system, or device, or any combination thereof. More specific examples of the computer readable storage medium may include, but are not limited to, an electric connection with one or more conductive wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present embodiment, the computer readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer readable storage medium can be transmitted by any suitable medium, including but not limited to an electric wire, an optical cable, an RF (Radio Frequency), and the like, or any suitable combination thereof.

[0098] The above computer readable storage medium may be contained in the refrigerator, or may exist separately without being assembled into the refrigerator.

[0099] The above computer readable storage medium carries one or more programs, which, when executed by the refrigerator, cause the central processing unit of the refrigerator to:

[0100] If the human body data detected by the human body sensing sensor meets the voice activation condition, the voice device is activated and the timing value of the timer is reset;

[0101] Based on the voice device performing a voice task;

[0102] If the timing value of the timer is greater than or equal to a preset threshold, the voice device is controlled to enter a sleep state.

[0103] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0104] The flow diagrams and the block diagrams in the drawings are illustrations of architectures, functionalities, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of present application. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0105] The modules involved in the embodiments of the present application can be implemented in the form of software or in the form of hardware. In some cases, the name of the module does not constitute a limitation on the module itself.

[0106] The readable storage medium provided by the present application is a computer readable storage medium, which stores computer readable program instructions (i.e. computer programs) for executing the control method of the refrigerator, and can solve the technical problem of poor interaction effect of the refrigerator when the refrigerator is woken up based on the wake-up word. Compared with the prior art, the computer readable storage medium provided by the present application has the same beneficial effects as the control method of the refrigerator provided by the above-mentioned embodiments, and will not be described here.

[0107] The above merely describes some embodiments of the present application, and does not limit the patent scope of the present application. Any equivalent structural transformation, direct / indirect application in other related technical fields, or the like, which is made based on the technical concept of the present application and the content of the specification and drawings, is included in the patent protection scope of the present application.

Claims

1. A control method of a refrigerator, characterized by, The refrigerator is provided with a human body sensing sensor and a voice device, and the method comprises: If the human body data detected by the human body sensing sensor meets the voice activation condition, the voice device is activated and the timing value of the timer is reset; Based on the voice device, a voice task is executed; If the timing value of the timer is greater than or equal to a preset threshold, the voice device is controlled to enter a dormant state.

2. The method of claim 1, wherein, The refrigerator is provided with a prompt device, and after the step of activating the voice device and resetting the timer if the human body data detected by the human body sensing sensor meets the voice activation condition, the method further comprises: When the timing value of the timer is less than the preset threshold, the prompt device is used to execute a prompt action for the voice device in an awake state.

3. The method of claim 1, wherein, After the step of executing a voice task based on the voice device, the method further comprises: When the timing value of the timer is less than the preset threshold, if the target human body data detected by the human body sensing sensor or the voice signal received by the voice device, the timing value of the timer is reset.

4. The method of claim 1, wherein, The step of executing a voice task based on the voice device comprises: Analyzing the voice signal received by the voice device, and generating a control instruction based on the analyzed voice signal; Generating a voice task for broadcast processing and / or a voice task for refrigerator control processing according to the control instruction; Executing an information broadcast action and / or a refrigerator control action corresponding to the voice task.

5. The method of claim 4, wherein, Before the step of executing an information broadcast action and / or a refrigerator control action corresponding to the voice task, the method further comprises: If the voice device does not detect the voice signal within a preset period, a current period is determined; Based on the current period, a voice broadcast task is generated, and an information broadcast action corresponding to the voice broadcast task is executed.

6. The method of claim 1, wherein, The step of executing a voice task based on the voice device comprises: Determining a historical voice task generated by the voice device, and generating a target voice task for broadcast processing based on the historical voice task and current cargo information; Executing an information broadcast action corresponding to the target voice task.

7. The method of claim 1, wherein, Before the step of activating the voice device and resetting the timing value of the timer, the method further comprises: Determining a stop position corresponding to the human body data, and obtaining a voice wake-up area determined according to the location of the refrigerator; When the stop position is in the voice wake-up area, it is determined that the human body data meets the voice activation condition.

8. The method of claim 7, wherein, Before the step of determining the stop position corresponding to the human body data and obtaining the voice wake-up area determined according to the location of the refrigerator, the method further comprises: Determining the moving direction of the target human body according to the human body data; When the moving direction points to the area corresponding to the location of the refrigerator, the step of determining the stop position corresponding to the human body data and obtaining the voice wake-up area determined according to the location of the refrigerator is executed.

9. A refrigerator characterized by comprising: The refrigerator comprises a memory, a processor, and a computer program stored on the memory and executable on the processor, and the computer program is configured to implement the steps of the control method of the refrigerator according to any one of claims 1 to 8.

10. A storage medium, characterized by The storage medium is a computer readable storage medium, and the storage medium stores a computer program. The computer program is executed by the processor to implement the steps of the control method of the refrigerator according to any one of claims 1 to 8.

Images