Refrigeration equipment, interaction methods and interaction systems

Abstract

This application discloses a refrigeration device, an interaction method, and an interaction system, relating to the field of refrigeration device technology. It can improve the intelligence level of refrigeration devices and enhance the user experience. The refrigeration device includes multiple refrigeration compartments, multiple image acquisition sensors, and a main control board. The main control board is configured to: upon receiving a current image of the refrigeration compartment acquired by the image acquisition sensors, determine a target food type based on the current image and the previous image, and determine a target cooking mode based on the target food type; determine a target cooking device from candidate cooking devices based on the target food type and the target cooking mode, and determine first interaction information and second interaction information; send a first control command carrying the first interaction information to the target cooking device, instructing the target cooking device to start operation based on the first interaction information; and send a second control command carrying the second interaction information to a cleaning device, instructing the cleaning device to start operation based on the second interaction information.

Description

Technical Field

[0001] This application relates to the field of refrigeration equipment technology, and in particular to a refrigeration device, an interaction method, and an interaction system. Background Technology

[0002] Currently, artificial intelligence and automation technologies are being widely applied in home kitchens, making kitchen equipment more versatile. Taking refrigeration equipment as an example, existing refrigeration equipment (refrigerators, freezers, etc.) can have multimedia functions, such as playing audio and video based on user selections, and can also have recommendation functions, such as recommending recipes to users.

[0003] However, existing refrigeration equipment can only achieve independent intelligence, meaning it cannot intelligently interact with other kitchen equipment, which affects the user experience. Summary of the Invention

[0004] This application provides a refrigeration device, an interaction method, and an interaction system, which can improve the intelligence level of the refrigeration device and enhance the user experience.

[0005] To achieve the above objectives, this application adopts the following technical solution:

[0006] In a first aspect, this application provides a refrigeration device, which includes at least one refrigeration chamber for forming a low-temperature storage space, at least one image acquisition sensor, and a main control board; the image acquisition sensor is used to acquire a current image of the refrigeration chamber upon detecting an image acquisition command, and send the acquired current image to the main control board; the main control board is configured to: upon receiving the current image, determine at least one target food type based on the current image and the previous image, and determine a target cooking mode based on the at least one target food type; determine a target cooking device from candidate cooking devices based on the at least one target food type and the target cooking mode, and determine first interaction information and second interaction information; send a first control command carrying the first interaction information to the target cooking device, and send a second control command carrying the second interaction information to a cleaning device; the first control command is used to instruct the target cooking device to start operation based on the first interaction information, and the second control command is used to instruct the cleaning device to start operation based on the second interaction information.

[0007] The technical solution provided in this application includes a refrigeration device that can include at least one refrigerator compartment, at least one image acquisition sensor, and a main control board. The main control board can determine at least one target food type based on the current and previous images of the refrigerator compartment acquired by the image acquisition sensor, determine a target cooking mode based on the target food type, and determine a target cooking device, first interactive information, and second interactive information based on the target food type and target cooking mode. The main control board can also send a first control command to the target cooking device, instructing it to start operation based on the first interactive information, and can send a second control command to the cleaning device, instructing it to start operation based on the second interactive information. Since the current and previous images acquired by the image acquisition sensor can reflect the target food type taken out by the user, and the target food type taken out by the user can represent the user's current needs, the target cooking device and interactive information determined by the image acquisition sensor in this application are based on the user's current needs, thus improving the user experience. It can be seen that compared with existing refrigeration devices, the refrigeration device provided in this application can interact with other kitchen devices (including candidate cooking devices and cleaning devices) based on the user's current needs, exhibiting a higher level of intelligence and thus improving the user experience.

[0008] Alternatively, in another possible design, the main control board is specifically configured as follows:

[0009] After identifying at least one target food type, a target cooking mode is determined from the global cooking modes based on the at least one target food type; the global cooking modes include at least: stewing mode, frying mode, pan-frying mode, and baking mode.

[0010] The second interactive information is determined based on the target cooking mode, and the target cooking device is determined from the candidate cooking devices based on the target cooking mode; the candidate cooking devices include at least a range hood and a baking device;

[0011] When the target cooking device is a range hood, the first interaction information is determined based on the target cooking mode; when the target cooking device is a baking device, the first interaction information is determined based on at least one target food type.

[0012] Alternatively, in another possible design, the main control board is specifically configured as follows:

[0013] After determining the target cooking mode, if the target cooking mode is a baking mode, then the target cooking device is determined to be a baking device, and the first interactive information is determined to include at least the operating mode of the baking device.

[0014] If the target cooking mode is not baking mode, then the target cooking device is determined to be a range hood, and the first interactive information is determined to include at least the operating mode of the range hood, the fan speed setting of the range hood, and the operating status of the smoke collection chamber of the range hood.

[0015] Alternatively, in another possible design, the main control board is specifically configured as follows:

[0016] After determining the target cooking mode, if the target cooking mode is stewing mode, then the operating mode of the range hood is determined to be air curtain mode, the fan speed setting is determined to be low, and the operating status of the smoke collection chamber is determined to be closed.

[0017] If the target cooking mode is deep-frying, then the operating mode of the range hood is set to range hood mode, the fan speed setting is set to medium, and the operating state of the smoke collection chamber is set to semi-open.

[0018] If the target cooking mode is frying or stir-frying, then the operating mode of the range hood is set to range hood mode, the fan speed is set to high, and the smoke collection chamber opening is set to fully open.

[0019] Optionally, in another possible design, the second interactive information includes at least the operating mode of the cleaning equipment, which includes at least a light cleaning mode and a deep cleaning mode. The cleaning parameters for the deep cleaning mode differ from those for the light cleaning mode. These cleaning parameters include at least one of the following: detergent dosage, rinsing time, number of rinsing cycles, and water pump operating pressure. The main control board is specifically configured as follows:

[0020] After determining the target cooking mode, if the target cooking mode is stewing, then the operating mode of the cleaning equipment is determined to be light cleaning mode.

[0021] If the target cooking mode is not stewing, then the operating mode of the cleaning equipment is set to deep cleaning mode.

[0022] Alternatively, in another possible design, the refrigeration unit also includes a display screen, and the main control board is specifically configured as follows:

[0023] After identifying at least one target food type, candidate cooking modes are determined from the global cooking modes based on at least one target food type;

[0024] The control display shows the candidate cooking modes;

[0025] Obtain the user's first selection operation on the display screen, and determine the target cooking mode from the candidate cooking modes based on the first selection operation.

[0026] Optionally, in another possible design, the refrigeration unit also includes a display screen, and the first and second interactive information also include a target cooking time. The main control board is further configured to:

[0027] After determining the target cooking mode, a recommended cooking time is determined based on at least one target food type and the target cooking mode;

[0028] The control display shows the recommended cooking time;

[0029] Obtain the user's second selection or adjustment operation on the display screen, and determine the target cooking time based on the second selection or adjustment operation.

[0030] Alternatively, in another possible design, the main control board is specifically configured as follows:

[0031] Upon receiving the current image, feature extraction processing is performed on the current image to determine at least one first food type;

[0032] At least one first food type is compared with at least one second food type to determine at least one target food type; the at least one second food type is obtained by feature extraction processing of the previous image.

[0033] Secondly, this application provides an interaction method that can be applied to the refrigeration equipment provided in the first aspect, the method comprising:

[0034] Upon receiving the current image, determine at least one target food type based on the current image and the previous image, and determine a target cooking mode based on the at least one target food type;

[0035] Based on at least one target food type and a target cooking mode, a target cooking device is determined from candidate cooking devices, and first interaction information and second interaction information are determined.

[0036] A first control command carrying first interactive information is sent to the target cooking device, and a second control command carrying second interactive information is sent to the cleaning device; the first control command is used to instruct the target cooking device to start operation based on the first interactive information, and the second control command is used to instruct the cleaning device to start operation based on the second interactive information.

[0037] Optionally, in one possible design approach, the aforementioned "determining a target cooking device from candidate cooking devices based on at least one target food type and a target cooking mode, and determining first interaction information and second interaction information" may include:

[0038] The target cooking mode is determined from the global cooking modes based on at least one target food type; the global cooking modes include at least: stewing mode, frying mode, sautéing mode, and baking mode;

[0039] The second interactive information is determined based on the target cooking mode, and the target cooking device is determined from the candidate cooking devices based on the target cooking mode; the candidate cooking devices include at least a range hood and a baking device;

[0040] When the target cooking device is a range hood, the first interaction information is determined based on the target cooking mode; when the target cooking device is a baking device, the first interaction information is determined based on at least one target food type.

[0041] Optionally, in another possible design, the above-mentioned "determining the target cooking device from candidate cooking devices based on the target cooking mode" may include:

[0042] If the target cooking mode is baking mode, then the target cooking device is determined to be baking device; if the target cooking mode is not baking mode, then the target cooking device is determined to be range hood device.

[0043] The aforementioned "determining the first interactive information based on the target cooking mode" may include: determining the operating mode of the range hood, the fan speed setting of the range hood, and the operating status of the smoke collection chamber of the range hood based on the target cooking mode;

[0044] The aforementioned "determining the first interactive information based on at least one target food type" may include: determining the operating mode of the baking equipment based on at least one target food type.

[0045] Optionally, in another possible design, the aforementioned "determining the operating mode of the range hood, the fan speed setting of the range hood, and the operating status of the smoke collection chamber of the range hood according to the target cooking mode" may include:

[0046] If the target cooking mode is stewing mode, then the operating mode of the range hood is set to air curtain mode, the fan speed setting is set to low, and the operating status of the smoke collection chamber is set to closed.

[0047] If the target cooking mode is deep-frying, then the operating mode of the range hood is set to range hood mode, the fan speed setting is set to medium, and the operating state of the smoke collection chamber is set to semi-open.

[0048] If the target cooking mode is frying or stir-frying, then the operating mode of the range hood is set to range hood mode, the fan speed is set to high, and the smoke collection chamber opening is set to fully open.

[0049] Optionally, in another possible design, the second interactive information includes at least the operating mode of the cleaning equipment, which includes at least a light cleaning mode and a deep cleaning mode. The cleaning parameters for the deep cleaning mode differ from those for the light cleaning mode. These cleaning parameters include at least one of the following: detergent dosage, rinsing time, number of rinsing cycles, and water pump operating pressure. The aforementioned "determining the second interactive information based on the target cooking mode" may include:

[0050] If the target cooking mode is stewing, then the operating mode of the cleaning equipment is set to light cleaning mode.

[0051] If the target cooking mode is not stewing, then the operating mode of the cleaning equipment is set to deep cleaning mode.

[0052] Optionally, in another possible design approach, the above-mentioned "determining the target cooking mode from the global cooking mode based on at least one target food type" may include:

[0053] Candidate cooking modes are determined from the global cooking modes based on at least one target food type;

[0054] The control display shows the candidate cooking modes;

[0055] Obtain the user's first selection operation on the display screen, and determine the target cooking mode from the candidate cooking modes based on the first selection operation.

[0056] Optionally, in another possible design, the first and second interactive information also include a target cooking time. After determining the target cooking mode based on at least one target food type, the interactive method provided in this application may further include:

[0057] Determine the recommended cooking time based on at least one target food type and target cooking mode;

[0058] The control display shows the recommended cooking time;

[0059] Obtain the user's second selection or adjustment operation on the display screen, and determine the target cooking time based on the second selection or adjustment operation.

[0060] Optionally, in another possible design approach, the above-mentioned "determining at least one target food type based on the current image and the previous image" may include:

[0061] Perform feature extraction processing on the current image to determine at least one first food type;

[0062] At least one first food type is compared with at least one second food type to determine at least one target food type; the at least one second food type is obtained by feature extraction processing of the previous image.

[0063] Thirdly, this application provides a main control board, including a memory, a processor, a bus, and a communication interface; the memory is used to store computer execution instructions, and the processor is connected to the memory via the bus; when the main control board is running, the processor executes the computer execution instructions stored in the memory, so that the main control board performs the interaction method provided in the second aspect above.

[0064] Fourthly, this application provides a computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to perform the interaction method provided in the second aspect.

[0065] Fifthly, this application provides a computer program product including computer instructions that, when executed on a computer, cause the computer to perform the interactive method as provided in the second aspect.

[0066] In a sixth aspect, this application provides an interactive system comprising: a cleaning device, a candidate cooking device, and a refrigeration device as provided in the first aspect, wherein the refrigeration device is wirelessly connected to both the cleaning device and the candidate cooking device.

[0067] It should be noted that the aforementioned computer instructions may be stored, in whole or in part, on a computer-readable storage medium. This computer-readable storage medium may be packaged together with the processor of the refrigeration device, or it may be packaged separately from the processor of the refrigeration device; this application does not impose any limitations on this.

[0068] The descriptions of the second, third, fourth, fifth, and sixth aspects in this application can be referenced to the detailed description of the first aspect; and the beneficial effects of the descriptions of the second, third, fourth, fifth, and sixth aspects can be referenced to the analysis of the beneficial effects of the first aspect, which will not be repeated here.

[0069] In this application, the names of the aforementioned devices or functional modules are not limited, and in actual implementation, these devices or functional modules may appear under other names. As long as the function of each device or functional module is similar to that of this application, they all fall within the scope of the claims of this application and their equivalents.

[0070] These or other aspects of this application will become more readily apparent in the following description. Attached Figure Description

[0071] Figure 1This application provides a schematic diagram of the structure of an interactive system.

[0072] Figure 2 This is a schematic diagram of the structure of a refrigeration device provided in an embodiment of this application;

[0073] Figure 3 This is a schematic diagram of the structure of another interactive system provided in an embodiment of this application;

[0074] Figure 4 This is a schematic diagram of the structure of a smoke machine provided in an embodiment of this application;

[0075] Figure 5 A flowchart illustrating an interaction method provided in an embodiment of this application;

[0076] Figure 6 This is a schematic diagram of the structure of a main control board provided in an embodiment of this application. Detailed Implementation

[0077] The refrigeration equipment, interaction method, and interaction system provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0078] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.

[0079] The terms "first" and "second," etc., used in the specification and drawings of this application are used to distinguish different objects or to distinguish different treatments of the same object, rather than to describe a specific order of objects.

[0080] Furthermore, the terms "comprising" and "having," and any variations thereof, used in the description of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to such process, method, product, or apparatus.

[0081] It should be noted that in the embodiments of this application, the words "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the words "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0082] In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0083] Furthermore, the acquisition, storage, use, and processing of data in this application's technical solution all comply with relevant national laws and regulations.

[0084] Existing refrigeration equipment can only achieve independent intelligence, meaning it cannot intelligently interact with other kitchen appliances, thus affecting the user experience. To address the problems of the prior art, this application provides a refrigeration device including at least one refrigerator compartment for creating a low-temperature storage space, at least one image acquisition sensor, and a main control board. The main control board can determine the target cooking equipment and interaction information based on images of the refrigerator compartment acquired by the image acquisition sensor, and interact with the target cooking equipment and cleaning equipment based on the interaction information. Therefore, the refrigeration device provided in this application has a higher level of intelligence and can improve the user experience.

[0085] The refrigeration equipment provided in this application embodiment can be applied to... Figure 1 The interactive system shown. (Refer to...) Figure 1 The interactive system may include a refrigeration device 01, multiple candidate cooking devices 02, and a cleaning device 03, wherein the refrigeration device 01 is wirelessly connected to the cleaning device 03 and each candidate cooking device 02.

[0086] It is understood that in practical applications, the interactive system may also include other devices, and this application embodiment does not limit this. For example, the interactive system may also include a gateway device, through which the refrigeration device 01 can achieve wireless connection with the cleaning device 03 and each candidate cooking device 02.

[0087] The following is in conjunction with the above. Figure 1 The interactive system shown provides a detailed description of the refrigeration equipment 01 provided in the embodiments of this application.

[0088] Reference Figure 2 This application provides a possible structural schematic diagram of a refrigeration device 01. For example... Figure 2 As shown, the refrigeration equipment 01 may include multiple refrigeration chambers 11 for forming a low-temperature storage space, multiple image acquisition sensors 12, and a main control board 13. The main control board 13 can be wirelessly connected to multiple candidate cooking devices 02 and cleaning devices 03.

[0089] The image acquisition sensor 12 is used to acquire the current image of the refrigerator compartment 11 when an image acquisition command is detected, and send the acquired current image to the main control board 13.

[0090] In one possible implementation, the refrigeration unit 01 may include a switch detection sensor for detecting the open / closed state of the cabinet door. For example, when the switch detection sensor detects that the cabinet door has switched from an open state to a closed state, it can send an image acquisition command to the image acquisition sensor 12.

[0091] In another possible implementation, the refrigeration device 01 may include a pressure detection sensor for detecting the weight of items placed in the refrigeration compartment 11. For example, when the pressure detection sensor detects a decrease in the weight of the items placed in the refrigeration compartment 11, it can send an image acquisition command to the image acquisition sensor 12.

[0092] The main control board 13 is configured to: upon receiving a current image, determine at least one target food type based on the current image and the previous image, and determine a target cooking mode based on the at least one target food type; determine a target cooking device from candidate cooking devices 02 based on the at least one target food type and the target cooking mode, and determine first interaction information and second interaction information; send a first control command carrying the first interaction information to the target cooking device, and send a second control command carrying the second interaction information to the cleaning device 03; the first control command is used to instruct the target cooking device to start operation based on the first interaction information, and the second control command is used to instruct the cleaning device 03 to start operation based on the second interaction information.

[0093] The previous image can be the image previously received by the main control board 13. In this embodiment, after receiving the current image, the main control board 13 can also replace the stored previous image with the current image, so as to perform the next interaction task with other kitchen equipment after receiving the image again.

[0094] Optionally, the main control board 13 is specifically configured to: upon receiving a current image, perform feature extraction processing on the current image to determine at least one first food type; compare the at least one first food type with at least one second food type to determine at least one target food type. The at least one second food type is obtained by performing feature extraction processing on the previous image.

[0095] In one possible implementation, the main control board 13 stores a pre-trained food type recognition model. The main control board 13 can perform feature extraction processing on the current image based on this food type recognition model to determine at least one first food type. For example, if at least one second food type includes types A, B, C, D, and E, and at least one first food type includes types A and B, then at least one target food type can be determined to include types C, D, and E. That is, the user took food of types C, D, and E during the opening of the refrigeration device 01.

[0096] Optionally, in order to more accurately determine the type of target food that the user takes away each time the refrigeration device 01 is opened, in this embodiment of the application, a corresponding image acquisition sensor 12 can be deployed for each refrigeration compartment 11.

[0097] Optional, Figure 1 Candidate cooking equipment 02 can be a range hood or a baking device. (See reference...) Figure 3 This application embodiment also provides an interactive system, which may include a refrigeration device 01, a range hood device 22, a baking device 21, and a cleaning device 03. The main control board 13 is specifically configured to: after determining at least one target food type, determine a target cooking mode from global cooking modes based on the at least one target food type; determine second interactive information based on the target cooking mode, and determine a target cooking device from candidate cooking devices 02 based on the target cooking mode; if the target cooking device is the range hood device 22, determine first interactive information according to the target cooking mode; if the target cooking device is the baking device 21, determine the first interactive information according to at least one target food type.

[0098] The global cooking modes include at least the following: stewing mode, frying mode, sautéing mode, and baking mode. Of course, in practical applications, the global cooking modes can also be other cooking modes, and this application embodiment does not limit this.

[0099] Since the cooking equipment used by the user differs during the cooking process under different cooking modes, in this embodiment, the target cooking device can be determined from the candidate cooking devices 02 based on the target cooking mode. Furthermore, the operating parameters of the range hood device 22 generally differ under different cooking modes; therefore, in this embodiment, the main control board 13 can determine the first interaction information with the range hood device 22 based on the target cooking mode. Additionally, the operating parameters of the baking device 21 generally differ when cooking different types of food; therefore, in this embodiment, the main control board 13 can determine the first interaction information with the baking device 21 based on at least one target food type.

[0100] Optionally, the main control board 13 is specifically configured as follows: after determining the target cooking mode, if the target cooking mode is a baking mode, then the target cooking device is determined to be a baking device 21, and the first interactive information is determined to include at least the operating mode of the baking device 21; if the target cooking mode is not a baking mode, then the target cooking device is determined to be a range hood device 22, and the first interactive information is determined to include at least the operating mode of the range hood device 22, the fan speed setting of the range hood device 22, and the operating status of the smoke collection chamber of the range hood device 22.

[0101] Among them, the operating mode of the baking equipment 21 is the operating parameter of the baking equipment 21, and the operating mode of the smoke machine 22, the fan speed level of the smoke machine 22, and the operating status of the smoke collection chamber of the smoke machine 22 are the operating parameters of the smoke machine 22.

[0102] Taking the baking device 21 as an oven as an example, the oven's operating modes can include a baking mode, a broil mode, and a convection roast mode. In the baking mode, the oven only activates the bottom heating element, and the heating temperature is 150°C. In the broil mode, the oven activates both the top and bottom heating elements, and the heating temperature is 200°C. In the convection roast mode, the oven activates the top, bottom, and rear heating elements simultaneously, and the heating temperature is 250°C, and the rear convection fan operates. This makes the temperature field inside the oven more uniform and improves the heat exchange effect inside the food. For example, when the target food type is a first food type, such as bread or egg tarts, the main control board 13 can determine that the first interaction information includes: the oven's operating mode is baking mode. When the target food type is a second food type, such as easily cooked meat products like beef, the main control board 13 can determine that the first interaction information includes: the oven's operating mode is broil mode. When the target food type is a third food type, such as a meat product with thicker meat like turkey, the main control board 13 can determine that the first interaction information includes: the oven's operating mode is Convection roast mode.

[0103] Optionally, the main control board 13 is specifically configured as follows: after determining the target cooking mode, if the target cooking mode is stewing mode, the operating mode of the range hood device 22 is determined to be air curtain mode, the fan speed is determined to be low, and the operating state of the smoke collection chamber is determined to be closed; if the target cooking mode is frying mode, the operating mode of the range hood device 22 is determined to be range hood mode, the fan speed is determined to be medium, and the operating state of the smoke collection chamber is determined to be semi-open; if the target cooking mode is frying mode, the operating mode of the range hood device 22 is determined to be range hood mode, the fan speed is determined to be high, and the operating state of the smoke collection chamber is determined to be fully open.

[0104] For example, refer to Figure 4 A schematic diagram of the structure of a smoke machine device 22 is provided, as shown below. Figure 4 As shown, the range hood 22 is equipped with a smoke collection chamber. When the target cooking mode is stewing, the range hood 22 can operate in air curtain mode, that is, the side of the range hood 22 closest to the user (i.e., Figure 4 The side forming the air curtain can blow air downwards perpendicularly to the stovetop, effectively blocking the overflow of water vapor generated during boiling and preventing water vapor from hitting the user's face. When the target cooking mode is frying, less oil smoke is generated during cooking, so the operating mode of the range hood device 22 can be determined as range hood mode, the fan speed setting is determined to be medium, and the operating state of the smoke collection chamber opening is determined to be semi-open. When the target cooking mode is stir-frying, more oil smoke is generated during cooking, so the operating mode of the range hood device 22 can be determined as range hood mode, the fan speed setting is determined to be high, and the operating state of the smoke collection chamber opening is determined to be fully open. It can be seen that in this embodiment, the operating parameters of the range hood device 22 can be determined according to different cooking modes, thus improving the user experience.

[0105] Optionally, the second interactive information includes at least the operating mode of the cleaning device 03. The operating mode of the cleaning device 03 includes at least a light cleaning mode and a deep cleaning mode. The cleaning parameters of the deep cleaning mode are different from those of the light cleaning mode. The cleaning parameters include at least one of detergent dosage, rinsing time, rinsing times, and water pump operating pressure. The main control board 13 is specifically configured to: after determining the target cooking mode, if the target cooking mode is stewing mode, then determine the operating mode of the cleaning device 03 as light cleaning mode; if the target cooking mode is not stewing mode, then determine the operating mode of the cleaning device 03 as deep cleaning mode.

[0106] Since the amount of oil residue produced on tableware and kitchen utensils varies under different cooking modes, the operating mode of the cleaning device 03 can be determined according to the target cooking mode in this embodiment. This allows the cleaning device 03 to operate in different modes based on the amount of oil residue, improving the user experience.

[0107] Optionally, the refrigeration device 01 also includes a display screen, and the main control board 13 is specifically configured to: after determining at least one target food type, determine candidate cooking modes from the global cooking modes based on at least one target food type; control the display screen to display the candidate cooking modes; obtain the user's first selection operation on the display screen, and determine the target cooking mode from the candidate cooking modes based on the first selection operation.

[0108] In one possible implementation, the main control board 13 can store a list of correspondences between food types and cooking modes. The main control board 13 can determine the cooking mode corresponding to the target food type based on this list. In practical applications, the same food type may have multiple cooking methods. Therefore, in this embodiment, these multiple cooking methods (i.e., candidate cooking modes) can be displayed on the display screen of the refrigeration device 01 for the user to select, which can further improve the user experience.

[0109] Optionally, the refrigeration device 01 also includes a display screen, and the first interactive information and the second interactive information also include a target cooking time. The main control board 13 is further configured to: determine a recommended cooking time based on at least one target food type and the target cooking mode after determining the target cooking mode; control the display screen to display the recommended cooking time; obtain a second selection operation or adjustment operation by the user on the display screen, and determine the target cooking time based on the second selection operation or adjustment operation.

[0110] Different cooking modes and different food types may correspond to different cooking times. In this embodiment, to further improve the user experience, the main control board 13 can also send the determined target cooking time to the target cooking device and the cleaning device 03. For example, when the target cooking device is the baking device 21, the baking device 21 can automatically execute the cooking task based on the target cooking time upon receiving it, without requiring the user to make a selection on the baking device 21, thus improving the user experience. Similarly, when the cleaning device 03 receives the target cooking time, it can determine the time to execute the cleaning task based on the target cooking time, without requiring the user to make a selection on the cleaning device 03, thus improving the user experience.

[0111] In summary, the refrigeration equipment provided in this application embodiment may include at least one refrigerator compartment, at least one image acquisition sensor, and a main control board. The main control board can determine at least one target food type based on the current image and the previous image of the refrigerator compartment acquired by the image acquisition sensor, and determine a target cooking mode based on the target food type. It can also determine a target cooking device, first interactive information, and second interactive information based on the target food type and the target cooking mode. The main control board can also send a first control command to the target cooking device, instructing it to start operation based on the first interactive information, and can send a second control command to the cleaning device, instructing it to start operation based on the second interactive information. Since the current image and the previous image acquired by the image acquisition sensor can reflect the target food type taken out by the user, and the target food type taken out by the user can represent the user's current needs, the target cooking device and interactive information determined by the image acquired by the image acquisition sensor in this application embodiment are based on the user's current needs, thus improving the user experience. As can be seen, compared with existing refrigeration equipment, the refrigeration equipment provided in this application embodiment can interact with other kitchen equipment (including candidate cooking equipment and cleaning equipment) based on the user's current needs, and has a higher degree of intelligence, thus improving the user experience.

[0112] Reference Figure 5 This application also provides an interaction method, which can be applied to... Figure 1 The refrigeration device 01 in the interactive system shown can also be applied to Figure 2 The refrigeration equipment 01 shown includes the following interaction method: S501-S503:

[0113] S501. Upon receiving the current image, determine at least one target food type based on the current image and the previous image, and determine a target cooking mode based on the at least one target food type.

[0114] S502. Based on at least one target food type and a target cooking mode, determine the target cooking device from the candidate cooking devices, and determine the first interaction information and the second interaction information.

[0115] S503, send a first control command carrying first interactive information to the target cooking device, and send a second control command carrying second interactive information to the cleaning device.

[0116] Optionally, step S502 may include: determining a target cooking mode from global cooking modes based on at least one target food type; determining second interaction information based on the target cooking mode, and determining a target cooking device from candidate cooking devices based on the target cooking mode; if the target cooking device is a range hood, determining first interaction information based on the target cooking mode; if the target cooking device is a baking device, determining first interaction information based on at least one target food type.

[0117] Optionally, the above-mentioned "determining the target cooking device from candidate cooking devices based on the target cooking mode" may include: if the target cooking mode is a baking mode, then the target cooking device is determined to be a baking device; if the target cooking mode is not a baking mode, then the target cooking device is determined to be a range hood device; the above-mentioned "determining the first interactive information according to the target cooking mode" may include: determining the operating mode of the range hood device, the fan speed level of the range hood device, and the operating status of the smoke collection chamber of the range hood device according to the target cooking mode; the above-mentioned "determining the first interactive information according to at least one target food type" may include: determining the operating mode of the baking device according to at least one target food type.

[0118] Optionally, the above-mentioned "determining the operating mode of the range hood, the fan speed setting of the range hood, and the operating status of the smoke collection chamber opening of the range hood according to the target cooking mode" may include: if the target cooking mode is stewing mode, then the operating mode of the range hood is determined to be air curtain mode, the fan speed setting is determined to be low, and the operating status of the smoke collection chamber opening is determined to be closed; if the target cooking mode is frying mode, then the operating mode of the range hood is determined to be range hood mode, the fan speed setting is determined to be medium, and the operating status of the smoke collection chamber opening is determined to be semi-open; if the target cooking mode is stir-frying mode, then the operating mode of the range hood is determined to be range hood mode, the fan speed setting is determined to be high, and the operating status of the smoke collection chamber opening is determined to be fully open.

[0119] Optionally, the above "determining the second interactive information based on the target cooking mode" may include: determining the operating mode of the cleaning equipment based on the target cooking mode; if the target cooking mode is stewing mode, then determining the operating mode of the cleaning equipment as light cleaning mode; if the target cooking mode is not stewing mode, then determining the operating mode of the cleaning equipment as deep cleaning mode.

[0120] Optionally, the above-mentioned "determining a target cooking mode from the global cooking modes based on at least one target food type" may include: determining candidate cooking modes from the global cooking modes based on at least one target food type; controlling the display screen to display the candidate cooking modes; obtaining the user's first selection operation on the display screen, and determining the target cooking mode from the candidate cooking modes based on the first selection operation.

[0121] Optionally, after step S501, the interactive method provided in this application may further include: determining a recommended cooking time based on at least one target food type and a target cooking mode; controlling the display screen to display the recommended cooking time; obtaining a second selection operation or adjustment operation by the user on the display screen, and determining the target cooking time based on the second selection operation or adjustment operation.

[0122] Optionally, the above "determining at least one target food type based on the current image and the previous image" may include: performing feature extraction processing on the current image to determine at least one first food type; comparing the at least one first food type with at least one second food type to determine at least one target food type.

[0123] like Figure 6 As shown in the figure, this application embodiment also provides a main control board for a refrigeration device, including a memory 41, a processor 42 (42-1 and 42-2), a bus 43 and a communication interface 44; the memory 41 is used to store computer execution instructions, and the processor 42 is connected to the memory 41 through the bus 43; when the main control board is running, the processor 42 executes the computer execution instructions stored in the memory 41 to make the main control board perform the interaction method provided in the above embodiment.

[0124] In a specific implementation, as one example, processor 42 may include one or more central processing units (CPUs), for example... Figure 6 CPU0 and CPU1 are shown in the diagram. As one embodiment, the main control board may include multiple processors 42, for example... Figure 6 The processors 42-1 and 42-2 are shown. Each of these processors 42 can be a single-core processor or a multi-core processor. Here, processor 42 can refer to one or more devices, circuits, and / or processing cores used to process data (e.g., computer program instructions).

[0125] The memory 41 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. The memory 41 may exist independently and be connected to the processor 42 via bus 43. The memory 41 may also be integrated with the processor 42.

[0126] In a specific implementation, memory 41 is used to store data from this application and computer execution instructions corresponding to the software program of this application. Processor 42 can run or execute the software program stored in memory 41 and call the data stored in memory 41 to perform various functions of the main control board.

[0127] Communication interface 44 uses any transceiver-like device for communicating with other devices or communication networks, such as control systems, radio access networks (RAN), wireless local area networks (WLANs), etc. Communication interface 44 may include a receiving unit to implement receiving functions and a transmitting unit to implement transmitting functions.

[0128] Bus 43 can be an industry standard architecture (ISA) bus, a peripheral component interconnect (PCI) bus, or an extended industry standard architecture (EISA) bus, etc. This bus 43 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0129] The explanation of the relevant content in this embodiment can be found in the above method embodiment, and will not be repeated here.

[0130] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0131] This application also provides a computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to perform the interactive method provided in the above embodiments.

[0132] The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, RAM, ROM, an erasable programmable read-only memory (EPROM), a register, a hard disk, an optical fiber, a CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination thereof, or any other form of computer-readable storage medium known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can reside in an application-specific integrated circuit (ASIC). In embodiments of this application, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0133] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A refrigeration device, characterized in that, The refrigeration equipment includes at least one cold storage chamber for forming a low-temperature storage space, at least one image acquisition sensor, and a main control board; The image acquisition sensor is used to acquire a current image of the refrigerator compartment when an image acquisition command is detected, and to send the acquired current image to the main control board; The main control board is configured to: upon receiving the current image, determine at least one target food type based on the current image and the previous image, and determine a target cooking mode based on the at least one target food type; Based on the at least one target food type and the target cooking mode, a target cooking device is determined from the candidate cooking devices, and first interaction information and second interaction information are determined; Send a first control command carrying the first interaction information to the target cooking device, and send a second control command carrying the second interaction information to the cleaning device; The first control command is used to instruct the target cooking device to start operation based on the first interaction information, and the second control command is used to instruct the cleaning device to start operation based on the second interaction information.

2. The refrigeration equipment according to claim 1, characterized in that, The main control board is specifically configured as follows: After determining the at least one target food type, the target cooking mode is determined from the global cooking mode based on the at least one target food type; The global cooking modes include at least: stewing mode, deep-frying mode, pan-frying mode, and baking mode; The second interactive information is determined based on the target cooking mode, and the target cooking device is determined from the candidate cooking devices based on the target cooking mode; the candidate cooking devices include at least a range hood and a baking device; When the target cooking device is the range hood, the first interaction information is determined according to the target cooking mode; when the target cooking device is the baking device, the first interaction information is determined according to the at least one target food type.

3. The refrigeration equipment according to claim 2, characterized in that, The main control board is specifically configured as follows: After determining the target cooking mode, if the target cooking mode is the baking mode, then the target cooking device is determined to be the baking device, and the first interaction information is determined to include at least the operating mode of the baking device; If the target cooking mode is not the baking mode, then the target cooking device is determined to be the range hood, and the first interactive information is determined to include at least the operating mode of the range hood, the fan speed setting of the range hood, and the operating status of the smoke collection chamber of the range hood.

4. The refrigeration equipment according to claim 3, characterized in that, The main control board is specifically configured as follows: After determining the target cooking mode, if the target cooking mode is the stewing mode, then the operating mode of the range hood is determined to be the air curtain mode, the fan speed setting is determined to be the low setting, and the operating state of the smoke collection chamber is determined to be the closed state. If the target cooking mode is the frying mode, then the operating mode of the range hood is determined to be the range hood mode, the fan speed setting is determined to be the medium setting, and the operating state of the smoke collection chamber is determined to be the semi-open state. If the target cooking mode is the frying / stir-frying mode, then the operating mode of the range hood is determined to be the range hood mode, the fan speed setting is determined to be high, and the operating state of the smoke collection chamber is determined to be fully open.

5. The refrigeration equipment according to claim 2, characterized in that, The second interactive information includes at least the operating mode of the cleaning equipment, which includes at least a light cleaning mode and a deep cleaning mode. The deep cleaning mode has different cleaning parameters than the light cleaning mode. The cleaning parameters include at least one of the following: detergent dosage, rinsing time, number of rinsing cycles, and water pump operating pressure. The main control board is specifically configured as follows: After determining the target cooking mode, if the target cooking mode is the stewing mode, then the operating mode of the cleaning device is determined to be the light cleaning mode. If the target cooking mode is not the stewing mode, then the operating mode of the cleaning device is determined to be the deep cleaning mode.

6. The refrigeration equipment according to claim 2, characterized in that, The refrigeration equipment also includes a display screen, and the main control board is specifically configured as follows: After determining the at least one target food type, candidate cooking modes are determined from the global cooking modes based on the at least one target food type; Control the display screen to show the candidate cooking modes; The system acquires a user's first selection operation on the display screen and determines the target cooking mode from the candidate cooking modes based on the first selection operation.

7. The refrigeration equipment according to claim 1, characterized in that, The refrigeration device also includes a display screen, and the first interactive information and the second interactive information further include a target cooking time. The main control board is also configured to: After determining the target cooking mode, a recommended cooking time is determined based on the at least one target food type and the target cooking mode; Control the display screen to show the recommended cooking time; Obtain a second selection or adjustment operation from the user on the display screen, and determine the target cooking time based on the second selection or adjustment operation.

8. The refrigeration equipment according to any one of claims 1-7, characterized in that, The main control board is specifically configured as follows: Upon receiving the current image, feature extraction processing is performed on the current image to determine at least one first food type; The at least one first food type is compared with at least one second food type to determine the at least one target food type; The at least one second food type is obtained by performing feature extraction processing on the previous image.

9. An interaction method applied to the refrigeration equipment as described in any one of claims 1-8, characterized in that, include: Upon receiving the current image, at least one target food type is determined based on the current image and the previous image, and a target cooking mode is determined based on the at least one target food type; Based on the at least one target food type and the target cooking mode, a target cooking device is determined from the candidate cooking devices, and first interaction information and second interaction information are determined; Send a first control command carrying the first interaction information to the target cooking device, and send a second control command carrying the second interaction information to the cleaning device; The first control command is used to instruct the target cooking device to start operation based on the first interaction information, and the second control command is used to instruct the cleaning device to start operation based on the second interaction information.

10. An interactive system, characterized in that, include: The cleaning device, the candidate cooking device, and the refrigeration device as described in any one of claims 1-8, wherein the refrigeration device is wirelessly connected to the cleaning device and the candidate cooking device, respectively.

Images