Intelligent refrigerator, server and interface display method

Abstract

The application provides a smart refrigerator, a server and an interface display method. The interface display method is applied to the smart refrigerator and includes the following steps. A selected operation of a recipe control is received. A recipe information acquisition request is sent to a server. The recipe information acquisition request includes a recipe identifier corresponding to the recipe control and an account identifier. A recipe information set fed back by the server in response to the recipe information acquisition request is received. The recipe information set includes first recipe information corresponding to the recipe identifier and second recipe information. The first recipe information corresponds to a first smart cooking device, and the second recipe information corresponds to a second smart cooking device. The first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier. When a user selects a recipe, the user experience can be improved by comprehensively comparing a plurality of different smart cooking devices and the recipe information corresponding to each smart cooking device.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, in particular to a smart refrigerator, a server and an interface display method. BACKGROUND

[0002] With the popularization of AIOT (Artificial Intelligence of Things), the smart refrigerator has multiple functions such as providing intelligent management of food materials, intelligent storage, recommending recipes, and multifunctional cooking for users. Meanwhile, the smart refrigerator can cooperate with other smart terminal devices. For example, the smart refrigerator establishes a communication connection with multiple smart cooking devices, the user selects a recipe in the smart refrigerator, and controls one of the smart cooking devices to cook according to the selected recipe. During the selection of the recipe by the user, the multiple smart cooking devices all support cooking according to the recipe. However, the device information and recipe information corresponding to each smart cooking device are different. For example, a smart rice cooker, a smart oven and a smart air fryer can all make cakes according to a cake recipe, but the operation convenience, the amount of food materials, the cooking power consumption and the cooking time of the three devices are different.

[0003] However, when making a certain dish, the user will only select one smart cooking device and use the corresponding recipe supported by the device. In the case where multiple smart cooking devices exist, the user needs to select the smart cooking devices one by one and query the corresponding recipes, so as to select the smart cooking device and the corresponding recipe suitable for the current needs. For example, when making a cake, the user needs to first select a smart rice cooker to query a cake recipe, then select a smart oven to query a cake recipe, and then determine which device's cake recipe to use to make a cake through comparison, which is a complicated operation process. SUMMARY

[0004] The present application provides a smart refrigerator, a server and an interface display method. To solve the problem that the user cannot simultaneously compare recipes between multiple smart cooking devices.

[0005] In a first aspect, the present application provides a smart refrigerator, comprising:

[0006] a display;

[0007] a communicator configured to communicate with a smart cooking device;

[0008] a controller connected with the display and the communicator, and configured to:

[0009] receive an input selection operation on a recipe control, and send a recipe information acquisition request to a server, wherein the recipe information acquisition request comprises a recipe identifier and an account identifier corresponding to the recipe control;

[0010] receive a recipe information set fed back by the server in response to the recipe information acquisition request, wherein the recipe information set comprises first recipe information and second recipe information corresponding to the recipe identifier, the first recipe information corresponds to the first intelligent cooking device, the second recipe information corresponds to the second intelligent cooking device, and the first intelligent cooking device and the second intelligent cooking device are both intelligent cooking devices corresponding to the account identifier;

[0011] display the first recipe information and the second recipe information in different regions of the recipe detail page respectively, and display a first cooking control corresponding to the first recipe information and a second cooking control corresponding to the second recipe information, wherein the first cooking control is used to control the first intelligent cooking device to execute a cooking thread corresponding to the first recipe information after receiving a selection operation of a user, and the second cooking control is used to control the second intelligent cooking device to execute a cooking thread corresponding to the second recipe information after receiving a selection operation of a user.

[0012] In a second aspect, the present application provides a server, comprising a memory and a processor, the memory stores program instructions, and the processor executes the following steps by running the program instructions:

[0013] receive a recipe information acquisition request sent by the intelligent refrigerator, wherein the recipe information acquisition request comprises a recipe identifier corresponding to a recipe control and an account identifier;

[0014] find first recipe information and second recipe information corresponding to the recipe identifier according to the recipe identifier and the account identifier, wherein the first recipe information corresponds to the first intelligent cooking device, the second recipe information corresponds to the second intelligent cooking device, and the first intelligent cooking device and the second intelligent cooking device are both intelligent cooking devices corresponding to the account identifier;

[0015] send the first recipe information, the second recipe information, the first intelligent cooking device and the second intelligent cooking device to the intelligent refrigerator as a recipe information set.

[0016] In a third aspect, the present application provides an interface display method applied to an intelligent refrigerator, comprising:

[0017] receive a selection operation of a recipe control input by a user, and send a recipe information acquisition request to a server, wherein the recipe information acquisition request comprises a recipe identifier corresponding to the recipe control and an account identifier;

[0018] receive a recipe information set fed back by the server in response to the recipe information acquisition request, wherein the recipe information set comprises first recipe information and second recipe information corresponding to the recipe identifier, the first recipe information corresponds to the first intelligent cooking device, the second recipe information corresponds to the second intelligent cooking device, and the first intelligent cooking device and the second intelligent cooking device are both intelligent cooking devices corresponding to the account identifier;

[0019] The first recipe information and the second recipe information are respectively displayed in different areas of the recipe details page, and a first cooking control corresponding to the first recipe information and a second cooking control corresponding to the second recipe information are displayed, wherein the first cooking control is used to control the first intelligent cooking device to execute a cooking thread corresponding to the first recipe information after receiving a selection operation of a user, and the second cooking control is used to control the second intelligent cooking device to execute a cooking thread corresponding to the second recipe information after receiving a selection operation of the user.

[0020] In a fourth aspect, the present application provides an interface display method applied to a server, comprising:

[0021] receiving a recipe information acquisition request sent by the intelligent refrigerator, the recipe information acquisition request comprising a recipe identifier and an account identifier corresponding to a recipe control;

[0022] According to the recipe identifier and the account identifier, the first recipe information and the second recipe information corresponding to the recipe identifier are found, wherein the first recipe information corresponds to the first intelligent cooking device, the second recipe information corresponds to the second intelligent cooking device, and the first intelligent cooking device and the second intelligent cooking device are both intelligent cooking devices corresponding to the account identifier;

[0023] The first recipe information, the second recipe information, the first intelligent cooking device and the second intelligent cooking device are sent to the intelligent refrigerator to form a recipe information set.

[0024] As can be seen from the above technical solutions, the present application provides an intelligent refrigerator, a server and an interface display method. Based on the provided interface display method, when a user selects a desired recipe in an intelligent user interface, the user can intuitively select by comprehensively comparing a plurality of different intelligent cooking devices and the recipe information corresponding to each intelligent cooking device. The user can interact with the intelligent refrigerator to control the selected intelligent cooking device to automatically start a cooking program, thereby realizing an intelligent process from automatic matching of recipes, synchronization of recipes to intelligent cooking devices and one-key starting of a cooking program, without the need to select intelligent cooking devices one by one and query corresponding recipes, thereby improving the user experience while facilitating operation. BRIEF DESCRIPTION OF DRAWINGS

[0025] In order to more clearly illustrate the technical solutions of the present application, the following will briefly introduce the drawings needed in the embodiments. Obviously, for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0026] Figure 1 A use scenario of an intelligent refrigerator according to an exemplary embodiment is shown;

[0027] Figure 2A A perspective view of a smart refrigerator according to an exemplary embodiment of the present application;

[0028] Figure 2B A schematic view of an appearance of a smart refrigerator according to an exemplary embodiment of the present application;

[0029] Figure 3 A schematic view of a hardware configuration of a smart refrigerator according to an exemplary embodiment of the present application;

[0030] Figure 4 A schematic view of a refrigerator screen user interface according to an exemplary embodiment of the present application;

[0031] Figure 5 A schematic view of an account management detail page according to an exemplary embodiment of the present application;

[0032] Figure 6 A schematic view of a search device page according to an exemplary embodiment of the present application;

[0033] Figure 7 A schematic view of a device to be bound according to an exemplary embodiment of the present application;

[0034] Figure 8 A schematic view of a device state page according to an exemplary embodiment of the present application;

[0035] Figure 9 A schematic view of a refrigerator screen user interface according to an exemplary embodiment of the present application;

[0036] Figure 10 A schematic view of a recipe resource page according to an exemplary embodiment of the present application;

[0037] Figure 11 A schematic view of a recipe detail page according to an exemplary embodiment of the present application;

[0038] Figure 12 A schematic view of a food material management interface according to an exemplary embodiment of the present application;

[0039] Figure 13 A schematic view of a cooking reminder message interface according to an exemplary embodiment of the present application;

[0040] Figure 14 A schematic view of an interaction between a smart refrigerator and a server according to an exemplary embodiment of the present application;

[0041] Figure 15 A schematic view of an interaction between a smart refrigerator and a server according to an exemplary embodiment of the present application;

[0042] Figure 16 Fig. 1 is a schematic diagram of interaction between a smart refrigerator and a server according to an example embodiment of the present application;

[0043] Figure 17 Fig. 2 is a schematic diagram of interaction between a smart refrigerator, a server and a smart cooking device according to an example embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to enable persons skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by persons skilled in the art without creative work should fall within the protection scope of the present application.

[0045] In the description of the present application, it should be understood that the terms "center", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer" and the like indicate the orientation or positional relationship shown in the drawings based on the orientation or positional relationship shown in the drawings, and are only for the purpose of facilitating the description of the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation of the present application.

[0046] The terms "first", "second" are only for descriptive purpose, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more of the features. In the description of the present application, unless otherwise specified, the meaning of "a plurality of" is two or more.

[0047] In the description of the present application, it should be noted that, unless otherwise explicitly specified and limited, the terms "mounting", "connecting", "connection" should be understood broadly, for example, it can be fixed connection, or detachable connection, or integrally connected; it can be directly connected, or indirectly connected through an intermediate medium, or the communication inside two elements. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0048] Figure 1 Fig. 1 is a schematic diagram of interaction between a smart refrigerator and a server according to an example embodiment of the present application; Figure 1As shown in the figure, the user can operate the smart refrigerator 3 through the terminal device 2 and the control device 1. Meanwhile, the user can operate the smart refrigerator 3 to control the electronic device 4.

[0049] The specific type of the control device 1, the terminal device 2 or the electronic device 4 is not limited in the embodiments of the present application.

[0050] In some embodiments, the control device 1 can be a remote controller, and the communication between the remote controller and the smart refrigerator includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication modes, etc. The smart refrigerator 3 is controlled by wireless or other wired ways. The wireless way can be direct connection and non-direct connection, and can be routed or not. The user can input user instructions through the keys on the remote controller, voice input, control panel input, etc. to control the smart refrigerator 3. For example, the user can input corresponding control instructions through the volume up and down keys, channel control keys, up / down / left / right movement keys, voice input keys, menu keys, power on / off keys, etc. on the remote controller to realize the function of controlling the smart refrigerator 3.

[0051] In some embodiments, the terminal device 2 such as a mobile phone, a tablet computer, a computer, a notebook computer and other smart devices can also be used to control the smart refrigerator 3. The terminal device 2 can be connected and communicated with the smart refrigerator 3 through a network communication protocol to realize one-to-one control operation and data communication purposes.

[0052] In some embodiments, the smart refrigerator can communicate with the electronic device 4 associated therewith. The electronic device 4 associated with the smart refrigerator includes electronic devices in the same local area network or the same network group as the smart refrigerator, such as display devices, portable mobile terminal devices, PC devices, smart cooking devices, etc. in a home.

[0053] The communication mode between the devices is not limited in the embodiments of the present application.

[0054] The smart refrigerator 3 and the electronic device 4 also communicate with the server 5 through various communication modes. The smart refrigerator 3 and the electronic device 4 can be connected and communicated through a local area network (LAN), a wireless local area network (WLAN) and other networks. The server 5 can provide various contents and interactions to the smart refrigerator 3 and the electronic device 4. For example, the user can select food materials to be cooked and a recipe corresponding to the food materials on the smart refrigerator 3, and the smart refrigerator 3 and the electronic device 4 control the electronic device 4 to automatically cook the food materials according to the selected recipe by sending and receiving information.

[0055] In some embodiments, the server 5 can be a cluster, or multiple clusters, and can include one or more types of servers. The server 5 provides popular recipes and cooking services and other network service contents.

[0056] The intelligent refrigerator according to the embodiments of the present application will be described below with reference to the accompanying drawings.

[0057] Figure 2A For the perspective view of the intelligent refrigerator according to the exemplary embodiments of the present application, the intelligent refrigerator according to the embodiments of the present application has a shape similar to a cuboid. The intelligent refrigerator is defined by a storage compartment 110 providing a limited storage space and a box door 120 provided at an opening of the storage compartment. The storage compartment 110 is a box body having an opening. In the exemplary embodiments of the present application, the storage compartment 110 includes a freezing compartment 111 located at a lower portion and a refrigerating compartment 112 located at an upper portion. The freezing compartment 111 and the refrigerating compartment 112 each have one or more independent storage spaces, such as a drawer-type compartment 111A included in the freezing compartment 111 and a plurality of storage shelves 1121-1123 included in the refrigerating compartment 112. A top illuminating lamp 140 is located inside the storage shelf 1121. Figure 2A

[0058] In the exemplary embodiments of the present application, the plurality of drawer-type compartments 111A are capped by drawer-type box doors 111B. The refrigerating compartment 112 is divided into a left side and a right side, and the left side and the right side are respectively capped by box doors 112B pivotally installed on the box body. Figure 2A

[0059] It should be noted that, Figure 2A As an example of the embodiments of the present application, the intelligent refrigerator shown does not constitute a limitation on the refrigerator provided by the present application. For example, in another embodiment of the present application, the intelligent refrigerator box body is divided into a left side and a right side, the left side box body is defined as a freezing compartment, and the right side box body is defined as a refrigerating compartment. Both the freezing compartment and the refrigerating compartment are capped by box doors pivotally installed on the box body. For another example, in another embodiment of the present application, the storage compartment includes a refrigerating compartment, a freezing compartment, and a variable-temperature compartment.

[0060] Based on the intelligent refrigerator provided in the above embodiments, by providing a display on the outside of the intelligent refrigerator box body, the refrigerator can have a display function.

[0061] Figure 2B For the appearance schematic view of the intelligent refrigerator according to the exemplary embodiments of the present application, as shown in Figure 2B As shown, a display is provided on the refrigerating compartment door, and the display is embedded in the door body. A tag reading area is provided at a position below the display on the refrigerating compartment door, and an antenna for reading an RFID tag is built in the tag reading area to identify an RFID tag in a close range.

[0062] In some embodiments, the plane on which the screen of the display is located is flush with the outer surface of the box door.

[0063] Figure 3 ​​As shown in the refrigerator hardware configuration diagram according to the exemplary embodiments of the present application, the smart refrigerator 3 can include a display 210, a controller 220, a plurality of antennas 230 for detecting an RFID tag, a detector 240, a memory 250, and a plurality of user input interfaces. The display 210, the antennas 230, the detector 240, and the memory 250 are coupled to the controller 220 through a communication interface. The display 210 is a component for receiving an image signal output from the controller 220, displaying video content and images, and displaying a menu manipulation interface, and displays a user manipulation UI interface for controlling the refrigerator 200.

[0064] The controller 220 can include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microcontroller (MCU), a memory controller, etc. The different processing units can be independent devices or can be integrated into one or more processors.

[0065] In some embodiments, the controller 220 communicates with the antennas 230 through a serial port.

[0066] In some embodiments, the controller 220 includes an RFID module, and the RFID module, the antennas 230, and the RFID tag form an RFID read-write system. The antennas 230 are used to transmit radio frequency signals between the RFID module and the RFID tag, and the RFID module performs read and write operations on the RFID tag through the antennas 230.

[0067] In some embodiments, the RFID module communicates with the antennas through a serial port.

[0068] The memory 250 can include one or more memory units, such as volatile memory, such as dynamic random access memory (DRAM), static random access memory (SRAM), etc., and non-volatile memory, such as read-only memory (ROM), flash memory, etc. The different memory units can be independent devices or can be integrated or packaged into one or more processors or communication interfaces as part of the processors or communication interfaces.

[0069] The memory 250 stores program instructions and applications, such as a voice application. The controller 220 can invoke the program instructions or run the applications in the memory 250 to cause the refrigerator to perform a relevant method, such as the scanning method of the food material label provided in the embodiments of the present application.

[0070] The detector 240, which at least includes a sound collector such as a microphone, can be used to receive the sound of the user. For example, a voice signal including a control instruction of the refrigerator 200 controlled by the user. The detector 240 can further include a door switch state sensor, such as a magnetic sensitive switch or a mechanical switch, for detecting the opening and closing signals of each door, and recording the opening and closing states of the doors according to the detected opening and closing signals, and sending the opening and closing state information to the controller 220. For example, when the detector detects the opening signal or the closing signal of any one of the doors, the latest opening and closing state information is sent to the controller 220.

[0071] The user input interface includes at least one of a microphone, a touchpad, a sensor, a key, and other input interfaces. For example, the user can input a user instruction by voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding instruction signal, and sends the instruction signal to the controller 220.

[0072] The communicator 260 is configured to communicate with the server or the electronic device 4 in the local area network.

[0073] In some embodiments, the controller 220 can include a voice recognition module, which further includes a voice analysis unit and a voice instruction database, so that the refrigerator can independently complete the voice recognition of the voice data input by the user, and the process of matching the recognized voice content with the voice instructions in the voice instruction database.

[0074] The number of the antennas 230 is not limited in the present application. For example, the antennas 230 can include antennas arranged in each storage compartment and antennas arranged in the label reading area, wherein the antennas arranged in each storage compartment are mainly used to scan the RFID labels in the storage compartment to read the label information of the RFID labels, and the antennas arranged in the label reading area are mainly used to scan the RFID labels in the label reading area to read the label information of the RFID labels.

[0075] In some embodiments, the power of the antennas arranged in different storage compartments can be different. The power of the antennas of each storage compartment can be ensured to be able to identify the food materials included in the compartment itself, so as to avoid increasing the misidentification rate when the power is too large, and to avoid not being able to identify all the food materials in the compartment itself when the power is too small. In a specific implementation, the power of the antennas can be determined in advance according to the space size of each storage compartment, and the power of each antenna is set in the refrigerator. The larger the space, the greater the power.

[0076] In some embodiments, the antenna arranged under the tag reading area is referred to as a first antenna, and the antenna arranged in the storage compartment is referred to as a second antenna.

[0077] Based on the refrigerator provided by the embodiments of the present application, the food materials in the storage compartment can be identified using the RFID tag, and the tag information (such as the tag identifier) of the RFID tag has a corresponding relationship with the food materials and the food material information identified by the RFID tag, so as to realize the virtual association between the RFID tag and the food material information. In actual application, the food material with the RFID tag attached is stored in the intelligent refrigerator, the RFID tag in the storage compartment is detected by the second antenna to obtain the tag information, and the food material identified by the tag is determined according to the association relationship between the tag information and the food material information.

[0078] In some embodiments, the tag information includes a tag code, and a specific code segment in the tag code is a tag identifier. Establishing the corresponding relationship between the identification information of the RFID tag and the food material information can realize the virtual association between the RFID tag and the food material. Further, after the tag identifier of the RFID tag in the storage compartment is obtained, the food material corresponding to the RFID tag can be determined according to the tag identifier and the corresponding relationship established in advance.

[0079] In some embodiments, the controller 220 realizes the food material management function by running the food material management application, and the application interface provided by the food material management application includes: a food material management interface that can be used as an application main interface, a tag editing interface for establishing the association relationship between the RFID tag and the food material information, a menu display interface for displaying recommended menu information, and the like.

[0080] In some embodiments, the controller 220 starts the food material management application in response to a power-on or a user input food material management application starting instruction. After the food material management application is started, the user can input a label editing instruction in the food material management application. In response to the label editing instruction, the food material management application scans the RFID tag placed on the label reading area by the first antenna to obtain the label information of the RFID tag, such as "A", and displays a label editing interface. The user can input food material information in the label editing interface for association with "A". The food material management application receives the user input food material information and establishes an association between the food material information and "A". When the food material management application detects the RFID tag "A" in the storage compartment through the second antenna, the real food material in the storage compartment can be determined according to the food material information associated with "A", thereby realizing intelligent management of the food material. It should be understood that when the food material management application detects the RFID tag "A" in the storage compartment through the second antenna, the food material associated with "A" is the existing food material in the storage compartment.

[0081] In some embodiments, the food material information includes one or more of a food material ID, a food material name, a storage location identifier, a food material quantity, a food material shelf life, a start time, etc. The storage location identifier can be used to determine the storage compartment where the food material is stored. For example, if the storage location identifier in the food material information "apple" is "1", it is determined that the "apple" is stored in the refrigeration compartment, and if the storage location identifier in the food material information "apple" is "2", it is determined that the "apple" is stored in the freezer. The freshness of the food material can be determined according to the current time, the shelf life of the food material, and the start time. The start time can be the actual production date of the food material input by the user, such as the production date of the bread on May 1, 2021, or the time when the food material is placed in the storage compartment.

[0082] In some embodiments, the food material information corresponding to the existing food material in the storage compartment is saved in the local food material information set. The existing food material refers to the food material currently stored in the refrigerator.

[0083] In other embodiments, the food material information corresponding to the historical food material can also be saved in the above-mentioned local food material information set. The historical food material refers to the food material that was stored in the refrigerator in the past and has been removed from the refrigerator at present. In specific implementation, the existing food material and the historical food material can be distinguished by a storage state marker, for example, the food material information of the historical food material is marked as a removed state, and the food material information of the existing food material is marked as a placed state.

[0084] In other embodiments, the food material information of the existing food material and the food material information of the historical food material are saved in different food material information sets.

[0085] In some embodiments, after the food material management application is started, the food material information of the existing food material is read from the local food material information set, for example, the food material information with the storage state as the put-in state is read. Then the food material management interface is displayed according to the food material information of the existing food material, the food material management interface includes the food material icons drawn according to the food material information, so that the existing food materials in the refrigerator are displayed in the form of icons, pictures and texts. In addition, various function controls such as the RFID tag editing control, the food material adding control, the recipe recommendation control and the like can be displayed in the food material management interface for the user to operate to trigger the controller 220 to implement the corresponding functions.

[0086] The user interface of the intelligent refrigerator of the present application is described below in combination with the drawings, Figure 4 The user interface of the present application according to the exemplary embodiments is specifically an exemplary refrigerator screen user interface. Referring to Figure 4 The refrigerator screen user interface includes the food material management control 401, the recipe control 402, the food material adding control 403 and the account management control 404, and further includes the temperature display area 405 corresponding to each storage compartment, the temperature increasing control and the temperature decreasing control for adjusting the temperature, and a plurality of mode controls 406, such as the temperature of the refrigeration compartment +6℃ and the temperature of the freezer -21℃. Among them, the food material management control 401 displays various food materials stored in each storage compartment of the intelligent refrigerator in response to the user's selection operation, so as to realize the intelligent management and intelligent storage functions of the food materials. The recipe control 402 provides a plurality of recipe information to the user in response to the user's selection operation, so as to realize the intelligent recipe function. The food material adding control 403 manages the unrecorded food materials in response to the user's selection operation. The account management control 404 controls the intelligent refrigerator to establish a communication connection with a plurality of electronic devices in response to the user's selection operation, and performs interaction and cooperation.

[0087] In some embodiments, after the recipe control is selected, the recipe recommendation is performed according to the food materials stored in the refrigerator and the online intelligent cooking equipment. For example, the refrigerator uploads the operation of the user triggering the recipe recommendation to the server, the server determines the food materials under the refrigerator and the intelligent cooking equipment corresponding to the user identifier according to the user identifier and / or the refrigerator identifier contained in the request, and then filters and screens the recipes in the recipe database, so that the finally recommended recipes can be implemented on the intelligent cooking equipment bound to the user identifier, and the food materials used are all contained in the refrigerator. Avoid the embarrassment that the recipe is recommended, but the user does not have the corresponding intelligent cooking equipment or the corresponding food materials.

[0088] In some embodiments, the account management control 404 in the refrigerator screen user interface is operated, referring to Figure 5The account management details page is displayed, and the preset area in the account management details page displays a navigation bar and a content county area below the navigation bar. The content display area changes with the change of the selected control in the navigation bar. The navigation bar includes an account login control, a search device control, a device binding control, and a device status control. When a user actually uses the smart refrigerator, the user needs to first perform account login, and after successful login, the user needs to bind the device that establishes a communication connection to the account. After the search and binding of the device are sequentially performed, the user can perform joint cooperation and mutual linkage control.

[0089] In some embodiments, the smart refrigerator can communicate with electronic devices associated therewith. The electronic devices associated with the smart refrigerator include terminal devices in the same local area network or the same network group as the refrigerator, such as display devices, portable mobile terminal devices, PC devices, and smart cooking devices in a home. The devices associated with the smart refrigerator can also be terminal devices associated with the smart refrigerator based on identity information. The smart cooking device can be, for example, a smart rice cooker, a smart oven, a smart induction cooker, or a smart microwave oven. In addition, the identity information can be device information, account information, and the like. For example, the account logged in by the food management application on the smart refrigerator is also the account logged in above.

[0090] For example, the account logged in by the food management application on the smart refrigerator is referred to as a main business account. Then, the terminal device associated with the smart refrigerator can be another terminal device logged in the main business account. For example, when a user installs a food management application on a smart oven and logs in the food management application on the smart oven using a main business account, the smart oven is referred to as a terminal device associated with the smart refrigerator. The terminal device associated with the smart refrigerator can be a terminal device logged in a sub-business account bound to the main business account. For example, when a user installs a food management application on a smart induction cooker and logs in the food management application on the smart induction cooker using a sub-business account bound to the main business account, the smart oven is referred to as a terminal device associated with the smart refrigerator.

[0091] For another example, the terminal device associated with the smart refrigerator can be a device bound by device information. For example, by binding the device information of the smart cooking device described above to the device of the smart refrigerator, the smart cooking device becomes a terminal device associated with the smart refrigerator. It should be understood that the smart cooking device refers to a cooking device with a built-in smart terminal having basic electronic components such as a processor and a memory. The smart terminal enables the cooking device to have functions such as data transmission and data processing. Based on these functions, the smart cooking device generally has the function of receiving remote operation instructions for automatic cooking. As described above, the smart refrigerator can communicate with the smart cooking device associated therewith and a server. For ease of description, the smart cooking device associated with the smart refrigerator is referred to as a bound smart cooking device.

[0092] It should be noted that most intelligent cooking equipment is limited by structure and placement position, and it is difficult to set a larger screen, and the food to be cooked is stored in the intelligent refrigerator. Viewing the stored food on the screen of the intelligent refrigerator and selecting the corresponding recipe of the food, starting one-key cooking function, is more convenient for user operation.

[0093] The intelligent refrigerator and other intelligent cooking equipment are bound in the embodiments of the present application, which are further described below with reference to the accompanying drawings.

[0094] Referring to Figure 5 , the user selects the account login control, and an account login page is displayed. The user inputs the account and password, and the user needs to operate the login control to complete the account login in order to perform the subsequent search device task. Further, Figure 6 The search device page diagram according to the exemplary embodiments of the present application is shown, which is specifically a page displayed after the user completes the account login.

[0095] For example, the intelligent refrigerator searches for the intelligent cooking equipment that can be connected in the local area network, or searches for the intelligent cooking equipment that can be connected according to the identity information, such as device information and account identifier corresponding to the account information. The search device interface is displayed as shown in Figure 6 The search device interface prompts the user that the device is being searched, and the search device interface can also set a cancel control. The user clicks “cancel” in Figure 6 , and the search for the device is stopped, and the search initiated this time is invalid.

[0096] In some embodiments, when the intelligent refrigerator searches for the intelligent cooking equipment, some abnormal situations may occur: for example, the intelligent cooking equipment is not searched within a threshold time (such as 20 seconds), that is, timeout. At this time, the user needs to be prompted that the intelligent cooking equipment is not found. The interface can set a retry control and a cancel control. The user clicks the retry control to search for the intelligent cooking equipment again. The user clicks the cancel control in the interface to cancel the retry, and the search initiated this time is invalid. The actual situation is specifically used as a reference.

[0097] For example, the intelligent refrigerator and the intelligent cooking equipment as the connection object need to be connected to the same WiFi. The intelligent refrigerator can search for multiple intelligent cooking equipment in the same WiFi network environment, and list the searched intelligent cooking equipment that can be connected in the interface. When there is no abnormal situation in the search device, that is, the intelligent cooking equipment can be searched in the local area network, the device list can be displayed on the interface of the device to be bound. As shown in Figure 7 Figure 7 ​The to-be-bound device page according to the exemplary embodiments of the present application is a page displayed after the user completes the device search. Five smart cooking devices are displayed in the to-be-bound device page as connection objects, and the device information corresponding to each smart cooking device is also displayed, including the device ID, device model, device name, online status, location, and power consumption index. The smart cooking device IDs are smart rice cooker, smart oven 1, smart oven 2, air fryer 1, and air fryer 2, respectively. The user selects at least one of the displayed devices as the binding object according to the actual needs and the displayed device information, for example, the user selects the binding controls corresponding to the smart rice cooker, smart oven 1, and smart oven 2, and then the smart cooking devices, i.e., the smart rice cooker, smart oven 1, and smart oven 2, become the bound smart cooking devices.

[0098] It should be noted that the wireless communication technology provided by the present application includes but is not limited to Wi-Fi (Wireless Local Area Network) technology, and can also be ZigBee (ZigBee protocol) technology and Bluetooth (Bluetooth) technology, etc.

[0099] In the specific implementation, reference can be made to Figure 14 , Figure 14 The interaction schematic diagram between the smart refrigerator and the server according to the exemplary embodiments of the present application is shown. In S1401, the smart refrigerator responds to the account input by the user. In S1402, a binding query request is sent to the server, and the binding query request carries the account identifier corresponding to the account. In S1403, the server finds the device information set according to the account identifier corresponding to the account, and the device information set includes the device information of at least one smart cooking device to be bound with the account identifier. In S1404, the device information set is returned to the smart refrigerator. In S1405, the smart refrigerator receives the device information set returned by the server, and the device information set includes the device information of at least one smart cooking device to be bound with the account identifier. In S1406, a to-be-bound device page is displayed, and the to-be-bound device page includes the control for displaying the device information and the corresponding plurality of binding controls. After receiving the selection operation of the user, the binding control controls the smart cooking device corresponding to the binding control to establish a binding relationship with the account information.

[0100] For example, after the user selects the binding controls corresponding to the smart rice cooker, smart oven 1, and smart oven 2, the smart cooking devices are bound with the account identifier. As shown in Figure 8 Figure 8 ​Fig. 1 shows a device state page according to an example embodiment of the present application, which is a page displayed after a user clicks a binding control. The device state page displays a device information control 801 corresponding to each smart cooking device and a control 802 showing a binding success message. If the binding is successful, the control 802 is a cancel binding control. If the binding fails, the control 802 is an unbinding control. If the user wants to continue binding other devices or retry binding the failed device, the user can return to the to-be-bound device page at any time to perform a binding operation. Figure 7 It should be noted that the first page in the above page is an example, and the above page can include multiple pages.

[0101] In a specific implementation, reference can be made to Figure 15 , Figure 15 Fig. 1 shows an interaction between a smart refrigerator and a server according to an example embodiment of the present application. In S1501, the smart refrigerator receives an input selection operation on a binding control. In S1502, the smart refrigerator sends a binding request to the server, where the binding request includes device information corresponding to the binding control; the binding request is used to request the server to establish a binding relationship between at least one smart cooking device bound to the account identifier. In S1503, the server establishes a binding relationship between the smart refrigerator and at least one smart cooking device bound to the account identifier according to the device information corresponding to the binding control. In S1504, after the server establishes a binding relationship between the smart refrigerator and at least one smart cooking device, the server returns a binding success message to the smart refrigerator. In S1505, the binding success message returned by the server is received, and the binding success message is used to indicate that a binding relationship between the account corresponding to the account identifier and the smart cooking device has been successfully established. In S1506, a device state page is displayed, and the device state page includes a control for displaying device information and a control for displaying a binding success message.

[0102] In some embodiments, the above actions of logging in an account and binding with a smart cooking device can also be performed in an APP in a terminal device such as a mobile phone. By logging in an account in the APP in the mobile phone, a smart cooking device that needs to establish a communication connection is bound.

[0103] In some embodiments, the smart refrigerator receives the latest running state of each smart cooking device sent by the server. An interface prompt including the latest running state is generated, the interface prompt is used to prompt the latest running state of each smart cooking device, and the interface prompt is displayed on a user interface presented by a display.

[0104] For example, after the user successfully binds multiple smart cooking devices with the account logged in the smart refrigerator, the device states of all the smart cooking devices are changed. For example, one of the smart cooking devices is offline because the connection with the local area network fails. For another example, the user moves one of the smart cooking devices, so that the location of the smart cooking device changes. Then, the device states of all the smart cooking devices need to be updated according to the preset time interval or periodic timing. The purpose of updating the bound smart cooking devices is to make the subsequent cooking task more smoothly executed. The purpose of updating the unbound smart cooking devices is to make the subsequent binding selection of the user more clear. The server sends the latest running state of each smart cooking device to the smart refrigerator according to the preset time interval or periodic timing. The smart refrigerator generates an interface prompt including the latest running state, for example, updates the device information in the device state page and the device to be bound page. The user can click any one of the two pages to obtain the latest device state of all the smart cooking devices.

[0105] In some embodiments, the server obtains the state information of all the smart cooking devices; detects whether the current state information corresponding to the state of all the smart cooking devices is consistent with the historical state information every first time interval. The historical state information is the state information of all the smart cooking devices obtained by the server last time. When it is determined that the current state information is consistent with the historical state information, the detection is continued according to the interval time. When it is determined that the current state information is inconsistent with the historical state information, the current state information of all the smart cooking devices is obtained and sent to the smart refrigerator. The smart refrigerator displays the current state information to update the historical state information.

[0106] In some embodiments, the smart refrigerator can also poll the states of the smart cooking devices when the user queries the recipe.

[0107] It should be noted that the smart cooking devices bound with the account of the smart refrigerator can also send their own state information to the server according to the preset time interval or periodic timing, so as to subsequently synchronize the device states of all the smart cooking devices. Further, the user can manually update or edit the device information in the device to be bound page and the device state page, such as editing the ID and the location of the bound device.

[0108] The above description is made in combination with the accompanying drawings. Figure 9 to the accompanying drawings. Figure 12 The smart recipe function implemented on the side of the smart refrigerator is further described.

[0109] Figure 16Fig. 16 is a schematic diagram of interaction between the smart refrigerator and the server according to an example embodiment. In 1601, the smart refrigerator receives an input selection operation on a recipe control. In 1602, a recipe information acquisition request is sent to the server, where the recipe information acquisition request includes a recipe identifier corresponding to the recipe control and an account identifier. In 1603, the server finds first recipe information and second recipe information corresponding to the recipe identifier according to the recipe identifier and the account identifier, where the first recipe information corresponds to a first smart cooking device and the second recipe information corresponds to a second smart cooking device, and the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier. The first recipe information, the second recipe information, the first smart cooking device, and the second smart cooking device form a recipe information set. In 1604, the server returns the recipe information set to the smart refrigerator. In 1605, the smart refrigerator receives the recipe information set fed back by the server in response to the recipe information acquisition request, where the recipe information set includes the first recipe information and the second recipe information corresponding to the recipe identifier, the first recipe information corresponds to the first smart cooking device, the second recipe information corresponds to the second smart cooking device, and the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier. In 1606, the smart refrigerator displays a recipe detail page, where the first recipe information and the second recipe information are respectively displayed in different areas of the recipe detail page, the first cooking control corresponding to the first recipe information is displayed, and the second cooking control corresponding to the second recipe information is displayed, where the first cooking control is used to control the first smart cooking device to execute a cooking thread corresponding to the first recipe information after receiving a selection operation of a user, and the second cooking control is used to control the second smart cooking device to execute a cooking thread corresponding to the second recipe information after receiving a selection operation of a user.

[0110] It should be noted that each recipe corresponds to a unique recipe identifier, for example, the recipe blueberry cake sets "blueberry cake" as the recipe identifier. One recipe identifier can correspond to multiple recipe information, for example, the blueberry cake can be cooked by multiple smart cooking devices. Each recipe information corresponds to a device information. For example, the blueberry cake can be cooked by two smart cooking devices, where the recipe information corresponding to the two smart cooking devices is different. The two smart cooking devices are both smart cooking devices corresponding to the above-mentioned account identifier.

[0111] In some embodiments, when the user logs in the smart refrigerator account and completes the binding with at least one smart cooking device using the account identifier, the recipe selection is performed to facilitate subsequent execution of the food material cooking task. Referring to Fig. 16, the smart refrigerator receives an input selection operation on a recipe control in 1601. In 1602, a recipe information acquisition request is sent to the server, where the recipe information acquisition request includes a recipe identifier corresponding to the recipe control and an account identifier. In 1603, the server finds first recipe information and second recipe information corresponding to the recipe identifier according to the recipe identifier and the account identifier, where the first recipe information corresponds to a first smart cooking device and the second recipe information corresponds to a second smart cooking device, and the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier. The first recipe information, the second recipe information, the first smart cooking device, and the second smart cooking device form a recipe information set. In 1604, the server returns the recipe information set to the smart refrigerator. In 1605, the smart refrigerator receives the recipe information set fed back by the server in response to the recipe information acquisition request, where the recipe information set includes the first recipe information and the second recipe information corresponding to the recipe identifier, the first recipe information corresponds to the first smart cooking device, the second recipe information corresponds to the second smart cooking device, and the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier. In 1606, the smart refrigerator displays a recipe detail page, where the first recipe information and the second recipe information are respectively displayed in different areas of the recipe detail page, the first cooking control corresponding to the first recipe information is displayed, and the second cooking control corresponding to the second recipe information is displayed, where the first cooking control is used to control the first smart cooking device to execute a cooking thread corresponding to the first recipe information after receiving a selection operation of a user, and the second cooking control is used to control the second smart cooking device to execute a cooking thread corresponding to the second recipe information after receiving a selection operation of a user,. Figure 9, return to the refrigerator screen user interface, after the user selects the recipe control 402, the intelligent refrigerator enters the recipe resource page corresponding to the recipe resource. The recipe resource page includes a search bar 1001, a navigation bar 1002, and a content display area 1003 located below the navigation bar. The content display area 1003 includes a plurality of recipe controls 1004, such as "cake", "cookie", "European bread", and "puff". The content displayed in the content display area 1003 will change with the change of the selected control in the navigation bar 1002. Among them, the navigation bar 1002 includes a plurality of navigation controls, such as "recommended recipe", "intelligent dish", "recipe allocation" and "intelligent recipe". Each navigation control classifies the recipe resources, and each corresponds to different forms of recipe resources. When displaying the recipe resource page, the user can search for the target recipe in the search bar 1001 according to the actual needs by clicking any one of the recipe controls, or input the recipe detail page display instruction for the target recipe to trigger the corresponding recipe detail page.

[0112] For example, the user can click the "cake" control in Figure 10 to input the recipe detail page display instruction for the "cake" recipe to trigger the corresponding recipe detail page. See Figure 11 , Figure 11 is a schematic diagram of the recipe detail page according to the exemplary embodiment of the present application. The recipe detail page includes controls for displaying recipe information and corresponding device information, and a plurality of cooking controls 1107. Among them, the sub-area (for example, the row area) corresponding to the specific step control 1103 is used to display the operation step information of a plurality of recipes, the sub-area (for example, the row area) corresponding to the ingredient control 1104 is used to display the required ingredient information of a plurality of recipes, and the sub-area (for example, the row area) corresponding to the cooking time control 1105 is used to display the cooking time information of a plurality of recipes. The sub-area (for example, the row area) corresponding to the intelligent cooking device ID control 1101 is used to display a plurality of device information controls corresponding to a plurality of recipes, the sub-area (for example, the row area) corresponding to the device location control 1102 is used to display the location information of a plurality of devices corresponding to a plurality of recipes, and the sub-area (for example, the row area) corresponding to the device power consumption control 1106 is used to display the power consumption information of each of a plurality of devices corresponding to a plurality of recipes. Among them, the device information corresponding to each recipe information is the device information of different intelligent cooking devices, and the recipe information corresponding to each device information is also different.

[0113] As shown in Figure 11As shown, the first recipe information, the second recipe information and the third recipe information corresponding to the three smart cooking devices of the smart rice cooker, the smart oven 1 and the smart oven 2 are sequentially displayed from left to right. Each recipe occupies a display area (exemplarily, a column area). The smart rice cooker corresponding to the first recipe information is the first smart cooking device. The smart oven 1 corresponding to the second recipe information is the second smart cooking device. The smart oven 2 corresponding to the third recipe information is the third smart cooking device. The first smart cooking device, the second smart cooking device and the third smart cooking device are all the smart cooking devices corresponding to the account identifier of the account logged in the smart refrigerator.

[0114] In some embodiments, the information is displayed in the form of a list, each area corresponds to a column of data, and each area can further include multiple row entries, such as Figure 11 As shown, from top to bottom, the row where the device location control 1102 is located is used to display the locations of the smart rice cooker, the smart oven 1 and the smart oven 2. The row where the specific step control 1103 is located is used to display the specific operation steps and the corresponding operation pictures in the recipe information corresponding to the three smart cooking devices, so as to facilitate the user to perform the subsequent cooking task. The row where the ingredient control 1104 is located is used to display the specific types of ingredients and the corresponding quantities of each ingredient in the recipe information corresponding to the three smart cooking devices. The row where the cooking time control 1105 is located is used to display the cooking time in the recipe information corresponding to the three smart cooking devices, so that the user can intuitively know the cooking time required during cooking. The cooking time is determined according to the cooking curve corresponding to each recipe information. The row where the device power consumption control 1106 is located is used to display the power consumption parameters corresponding to the three smart cooking devices.

[0115] It should be noted that the multiple recipe information is displayed in different areas of the recipe detail page, and the multiple cooking controls are displayed corresponding to the multiple recipe information. When the user selects and operates any one of the cooking controls, the smart refrigerator will control the smart cooking device corresponding to the cooking control to perform the cooking work according to the corresponding recipe information.

[0116] From the above embodiments, when the user has multiple different types and models of smart cooking devices at home, multiple smart cooking devices may support cooking when making a certain dish, but the placement distance of each smart cooking device, the capacity of the food that can be held, the cooking time, and the energy consumption of cooking may be different. Through the recipe detail page provided by the present application, the user can compare multiple smart cooking devices and the corresponding recipe information of each smart cooking device in the recipe detail page, so as to accurately select the smart cooking device and the corresponding recipe according to the actual needs, and control the smart cooking device to complete the cooking work according to the corresponding recipe. It should be noted that the embodiments of the present application only control one smart cooking device to start the one-key cooking program, and multiple smart cooking devices can also be started. The specific settings can be made according to the actual situation.

[0117] In some embodiments, the device information corresponding to the recipe information in the recipe information set includes device status, and the smart refrigerator sorts each recipe information and the device information corresponding to the recipe information according to the device status, and displays the sorted recipe information and the device information corresponding to the recipe information in order in the recipe detail page.

[0118] For example, the first recipe information and the second recipe information are sorted according to the first smart cooking device status and the second smart cooking device status, and the online smart cooking device corresponding recipe information is arranged in front of the offline smart cooking device corresponding recipe information; according to the sorting, the first recipe information and the second recipe information are respectively displayed in different areas of the recipe detail page in order. The offline smart cooking device includes an offline state and an unbound device.

[0119] The smart refrigerator sorts and sorts according to the unique state identifier of each device status after receiving the recipe information set. In order, the online state, the offline state, and the order of the unbound device from front to back, such as the recipe corresponding to the smart cooking device in the current online state is arranged in front; second is the recipe corresponding to the user offline state smart cooking device; finally is the recipe corresponding to the smart cooking device which the user has not bound. Referring to Figure 11 The devices in the offline state in the device status are specially marked to generate a state prompt identifier 1114, so that the user can more intuitively understand the device status of each device. Then, after classifying and sorting the smart cooking devices in different states, the user can compare and select each smart cooking device according to the device status, and preferentially select the online state smart cooking device to avoid the situation that the selected smart cooking device is in the offline state and cannot perform the cooking task.

[0120] In some embodiments, the recipe detail page displays recipe information in a list, different recipe information is located in different columns in the list, and each row in the same recipe information displays different content parameters. Each recipe information includes a material parameter and a cooking time parameter. In the Mth row, the material parameters in each recipe information are compared, and a material evaluation identifier is generated at the position corresponding to the Nth column in the Mth row. The material evaluation identifier is used to prompt the user to select the recipe information in the Nth column according to the material evaluation identifier. The Mth row is used to display the material parameters of each recipe. Or in the Ath row, the cooking time parameters in each recipe information are compared, and a time length evaluation identifier is generated at the position corresponding to the Bth column in the Ath row. The time length evaluation identifier is used to prompt the user to select the recipe information corresponding to the Bth column according to the time length evaluation identifier.

[0121] For example, referring to Figure 11 In the 4th row, the material parameters in the recipe information corresponding to each smart cooking device are displayed by the material control 1104. Specifically, the material parameters include the used materials and the corresponding quantities of the materials. The material parameters of the smart rice cooker are “2 eggs, 120g refined sugar, 100g low-gluten flour, 12g butter, and 12ml milk”. The material parameters of the smart oven 1 are “3 eggs, 150g refined sugar, 120g low-gluten flour, 15g butter, and 15ml milk”. The material parameters of the smart oven 2 are “5 eggs, 240g refined sugar, 3000g low-gluten flour, 40g butter, and 40ml milk”. The smart refrigerator compares the identifiers of each material quantity in the material parameters of each recipe, and obtains the quantity size order between each recipe. The material parameter with the largest quantity is specially marked, and a material evaluation identifier 1111 is generated at the position corresponding to the 3rd column in the 4th row, so that the user can more intuitively compare the material parameters in each recipe information horizontally.

[0122] For example, the recipe information in the recipe information set also includes the cooking curve corresponding to each recipe. The cooking curve is a curve that measures the temperature change of the material with time during the cooking process. The cooking time parameter corresponding to each recipe can be obtained through the cooking curve corresponding to each recipe. Specifically, in the 5th row, the cooking time in the recipe information corresponding to each smart cooking device is displayed by the cooking time control 1105. The cooking time parameter of the smart cooking device is “2 hours and 30 minutes”. The cooking time parameter of the smart oven 1 is “1 hour and 20 minutes”. The cooking time parameter of the smart oven 2 is “50 minutes”. The smart refrigerator compares the time identifiers in the cooking time parameters of each recipe, and obtains the cooking time length order between each recipe. The cooking time parameter with the shortest cooking time is specially marked, and a time length evaluation identifier 1112 is generated at the position corresponding to the 3rd column in the 5th row, so that the user can more intuitively compare the cooking time in each recipe information horizontally.

[0123] In some embodiments, the recipe detail page also displays the corresponding device information of the smart cooking device in a list, including the location parameter and the power consumption parameter. In the E row, the smart refrigerator compares the location parameter in each device information, and generates a location evaluation identifier in the E row corresponding to the F column. The location evaluation identifier is used to prompt the user to select the corresponding smart cooking device according to the location evaluation identifier. Meanwhile, in the H row, the smart refrigerator compares the power consumption parameter in each device information, and generates a power consumption evaluation identifier in the H row corresponding to the I column. The power consumption evaluation identifier is used to prompt the user to select the corresponding smart cooking device according to the power consumption evaluation identifier. The location evaluation identifier and the power consumption evaluation identifier are displayed synchronously in the recipe detail page. It should be noted that the power consumption parameter is calculated from the cooking curve in the recipe information and the power consumption index of the corresponding smart cooking device of the recipe.

[0124] For example, the location parameter corresponding to each smart cooking device is displayed by the location control 1102, as shown in Figure 11 The location parameter of the smart rice cooker is "dining room-dining table". The location parameter of the smart oven 1 is "kitchen-operation table". The location parameter of the smart oven 2 is "kitchen-embedded cabinet". The smart refrigerator compares the distance identifiers in the location parameters corresponding to each smart cooking device, and obtains the length order of the distance between each smart cooking device. The shortest distance parameter is specially marked, and a location evaluation identifier 1110 is generated in the 2nd row corresponding to the 1st column, so that the user can more intuitively compare the locations of each smart cooking device horizontally.

[0125] For example, the power consumption parameter corresponding to each smart cooking device is displayed by the device power consumption control 1106, as shown in Figure 12 The power consumption parameter of the smart rice cooker is "~1.9 degrees". The power consumption parameter of the smart oven 1 is "~1.68 degrees". The power consumption parameter of the smart oven 2 is "~2.6 degrees". The smart refrigerator compares the power identifiers in the power consumption parameters corresponding to each smart cooking device, and obtains the size order of the power consumption between each smart cooking device. The lowest power consumption parameter is specially marked, and a power consumption evaluation identifier 1113 is generated in the 6th row corresponding to the 2nd column, so that the user can more intuitively compare the power consumption of each smart cooking device horizontally.

[0126] In some embodiments, the user can pre-select the ingredients, and then select the recipe after completing the ingredient selection. Figure 4 The application shows an ingredient management interface according to an exemplary embodiment, which is specifically the interface entered after clicking the ingredient management control 401 in Figure 12 . See Figure 17The food management interface includes an RFID tag editing control 1201, an add food control 1202, and a recipe recommendation control 1203, and further includes food display areas corresponding to respective storage compartments, such as a food display area corresponding to a refrigeration compartment, a food display area corresponding to a variable-temperature compartment, and a food display area corresponding to a cold-temperature compartment. Each food display area displays food icons of respective foods in the corresponding storage compartment, such as mutton and pork in the food display area, sausages and fish cakes in the food display area, and lettuce, eggs, and carrots in the food display area. Each food icon includes a food picture and a food name.

[0127] In some embodiments, the user can input the above tag editing instruction by operating the RFID tag editing control 301 in the food management interface. The user can also perform food entry by operating the add food control 1202 in the food management interface. The user can also input a recipe recommendation instruction and trigger entry into the above recipe resource page by operating the recipe recommendation control 1203 in the food management interface. After selecting a recipe in the recipe resource page, the user enters the above recipe detail page, and the specific operations of the user on the smart refrigerator and the specific interactions between the smart refrigerator and the server are as described in the above embodiments, and will not be described again here.

[0128] In some embodiments, after displaying the recipe detail page, the smart refrigerator receives the selected operation of the cooking control, sends a cooking instruction to the smart cooking device corresponding to the cooking control, and the cooking instruction is used to instruct the smart cooking device to perform a cooking task according to the recipe information.

[0129] For example, after the user selects the cooking control corresponding to the smart oven 1 in the recipe detail page, a cooking reminder message of “one-key cooking” is triggered. The cooking reminder message is displayed at a preset position on the recipe detail page, and the display interface of the cooking reminder message is provided with a confirmation control 1301 and a cancel control 1302. The user needs to operate the confirmation control 1301 to confirm the cooking reminder message, so that the subsequent smart cooking device can perform cooking. If the user does not want to continue the subsequent cooking work, the cancel control 1302 can be operated to close the cooking reminder message. The cooking reminder message can also be automatically disappeared after a threshold time (such as 10 seconds). Therefore, in other embodiments of the present application, the above reminder message manner is not the only limitation, and the reminder message manner includes but is not limited to the above manner, which can be in the form of voice notification, or in the form of a ringing bell, or in the form of vibration, or in other forms.

[0130] In some embodiments, the user inputs an instruction indicating that a cooking task is performed according to the recipe information by clicking the confirmation control in the one-key cooking interface. ​An interaction diagram among the smart refrigerator, the server and the smart cooking device according to the exemplary embodiments is shown in the present application. In S1701, the smart refrigerator receives an input operation on a cooking control. In S1702, in response to the operation, a cooking request is sent to the server, the cooking request including recipe information corresponding to the cooking control, the cooking request being used to request the server to send the recipe information to the corresponding smart cooking device. In S1703, the server sends the recipe information to the smart cooking device, wherein the recipe information includes a cooking curve to control the smart cooking device to cook according to the cooking curve.

[0131] In some embodiments, the user can control the smart refrigerator to send the recipe information to the smart cooking device corresponding thereto by clicking the confirmation control. In implementation, the smart refrigerator determines the smart cooking device corresponding to the recipe information according to the device information corresponding to the recipe information in response to the clicking operation of the user on the confirmation control, and sends the recipe information to the smart cooking device.

[0132] In some embodiments, after sending the first cooking instruction to the first smart cooking device corresponding to the first cooking control, the smart refrigerator detects the food material putting state of the first smart cooking device and the second smart cooking device, the food material putting state being a state of putting the target food material into the smart cooking device. If the food material putting state of the first smart cooking device is not detected within a preset time and the food material putting state of the second smart cooking device is detected, a prompt page including corresponding prompt information is generated, a preset area of the prompt page displaying a switching control, the switching control being used to switch the cooking instruction to the second smart cooking device to control the second smart cooking device to execute the corresponding cooking thread after receiving the selection operation of the user.

[0133] In some embodiments, in response to the selection operation on the switching control, a cooking revocation instruction is sent to the first smart cooking device, and a second cooking instruction is sent to the second smart cooking device, the second cooking instruction being used to instruct the second smart cooking device to execute the corresponding cooking thread according to the second recipe information.

[0134] For example, after the user selects the first cooking control corresponding to the smart oven 1 and clicks the confirmation control, the smart refrigerator detects the device states of the plurality of smart cooking devices, and the device states include a food material placing state. In a scenario where the user does not place the target food material into the first smart cooking device within a preset time, but places the target food material into a second smart cooking device, after the smart refrigerator detects the food material placing state of the second smart cooking device, the smart refrigerator controls the display to present a prompt page including corresponding prompt information. The page displays a switching control, and after the user selects the switching control, the smart refrigerator sends a cooking cancellation instruction to the first smart cooking device and a second cooking instruction to the second smart cooking device in response to the selection operation of the user, to control the second smart cooking device to perform a subsequent cooking task. By switching the cooking instructions, the user can make any changes and switching according to the finally selected smart cooking device, without worrying about clicking errors. At the same time, the use scenarios are increased, and the user operation is more convenient. It should be noted that the recipe information in the present application includes but is not limited to the first recipe information and the second recipe information, and for the same reason, the smart cooking device includes but is not limited to the first smart cooking device and the second smart cooking device, which can be set according to actual conditions.

[0135] In some embodiments, after sending the first cooking instruction to the first smart cooking device corresponding to the first cooking control, the smart refrigerator detects the food material placing state of the first smart cooking device and the second smart cooking device. The food material placing state is a state in which the target food material is placed in the smart cooking device. If the food material placing state of the first smart cooking device is not detected within a preset time, a prompt page including corresponding prompt information is generated, and a prompt control is displayed in a preset area of the prompt page. The prompt control is used to remind the user to confirm whether to continue cooking.

[0136] In some embodiments, the first smart cooking device detects the placement of the target food material and feeds back an identification indicating that the placement is successful, so that the smart refrigerator exits the recipe detail page. In some embodiments, the target food material is the food material corresponding to the selected recipe.

[0137] In some embodiments, the placement of the target food material can be represented by the opening and closing action of the door cover of the smart cooking device, or by comparing the food material taken out of the refrigerator by the image sensor / weight sensor.

[0138] From the above technical solutions, the user can interact with the interface object displayed on the screen of the smart refrigerator to search, view, or select a recipe and start cooking. After starting cooking, the smart oven automatically controls the time, temperature, and other parameters according to the recipe information included in the user-selected recipe, thereby realizing the one-key cooking function.

[0139] The above UI takes a smart refrigerator as an example, and the interaction content takes a smart refrigerator, a server and a smart cooking device as an example. The UI of the smart refrigerator of other categories is basically similar to the above UI in terms of interface display, which will not be listed one by one here. The UI interface provided in the present application is only exemplary, and the actual application and design are the final.

[0140] According to the above embodiments, the embodiments of the present application also provide a server, comprising a memory and a processor, the memory stores program instructions, and the processor executes the following steps by running the program instructions:

[0141] Receiving a recipe information acquisition request sent by the smart refrigerator, the recipe information acquisition request comprising a recipe identifier corresponding to the recipe control and an account identifier. According to the recipe identifier and the account identifier, the first recipe information corresponding to the recipe identifier and the second recipe information are found, wherein the first recipe information corresponds to the first smart cooking device, and the second recipe information corresponds to the second smart cooking device, and the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier. The first recipe information, the second recipe information, the first smart cooking device and the second smart cooking device are sent to the smart refrigerator to form a recipe information set.

[0142] The embodiments of the present application also provide an interface display method, which can be executed on the side of a smart refrigerator, and the execution subject of the method is a controller in the smart refrigerator. The method comprises: receiving an input selection operation on a recipe control, and sending a recipe information acquisition request to a server, wherein the recipe information acquisition request comprises a recipe identifier corresponding to the recipe control and an account identifier. Receiving a recipe information set fed back by the server in response to the recipe information acquisition request, wherein the recipe information set comprises first recipe information corresponding to the recipe identifier and second recipe information, wherein the first recipe information corresponds to the first smart cooking device, and the second recipe information corresponds to the second smart cooking device, and the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier. The first recipe information and the second recipe information are respectively displayed in different regions of a recipe detail page, and the first cooking control corresponding to the first recipe information and the second cooking control corresponding to the second recipe information are displayed, wherein the first cooking control is used to control the first smart cooking device to execute a cooking thread corresponding to the first recipe information after receiving a selection operation of a user, and the second cooking control is used to control the second smart cooking device to execute a cooking thread corresponding to the second recipe information after receiving a selection operation of a user.

[0143] The embodiment of the application further provides an interface display method, which can be executed on the server side, and the execution subject of the method is a processor in the server. The method comprises the following steps: receiving a recipe information acquisition request sent by a smart refrigerator, wherein the recipe information acquisition request comprises a recipe identifier corresponding to a recipe control and an account identifier; searching for first recipe information and second recipe information corresponding to the recipe identifier according to the recipe identifier and the account identifier, wherein the first recipe information corresponds to a first smart cooking device, the second recipe information corresponds to a second smart cooking device, and the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier; and sending a recipe information set comprising the first recipe information, the second recipe information, the first smart cooking device and the second smart cooking device to the smart refrigerator.

[0144] According to the above technical solution, based on the provided interface display method, when a user selects a recipe in the user interface of the smart refrigerator, a plurality of recipe information and device information corresponding to the recipe information are displayed in the user interface, and the device information corresponding to each recipe information is device information of different smart cooking devices. In this way, the user can comprehensively compare the plurality of smart cooking devices, and does not need to select the smart cooking devices one by one and then query the corresponding recipes. In this way, the user can simultaneously compare recipes between the plurality of smart cooking devices.

[0145] In a specific implementation, the application further provides a storage medium, wherein the storage medium can store a program, and the program can include part or all steps of each embodiment of the media asset playing time reporting method provided by the application when executed. The storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0146] For the convenience of explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific form disclosed. Various modifications and variations can be derived from the above teachings. The selection and description of the above embodiments are for better explanation of principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A smart refrigerator, characterized by, The method comprises the following steps: a display; a communicator configured to communicate with a smart cooking device; a controller connected with the display and the communicator, configured to: receive an input selection operation on a recipe control, and send a recipe information acquisition request to a server, wherein the recipe information acquisition request comprises a recipe identifier corresponding to the recipe control and an account identifier; receive a recipe information set fed back by the server in response to the recipe information acquisition request, wherein the recipe information set comprises first recipe information corresponding to the recipe identifier and second recipe information, wherein the first recipe information corresponds to a first smart cooking device, and the second recipe information corresponds to a second smart cooking device, and the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier; display the first recipe information and the second recipe information in different areas of a recipe detail page respectively, and display a first cooking control corresponding to the first recipe information and a second cooking control corresponding to the second recipe information; receive an input selection operation on the first cooking control, and send a first cooking instruction to the first smart cooking device corresponding to the first cooking control, wherein the first cooking instruction is used to instruct the first smart cooking device to execute a cooking task according to the first recipe information; detect a food material putting state of the first smart cooking device and the second smart cooking device, wherein the food material putting state is a state in which a target food material is put into the smart cooking device; if the food material putting state of the first smart cooking device is not detected within a preset time, and the food material putting state of the second smart cooking device is detected, generate a prompt page comprising corresponding prompt information, and a preset area of the prompt page displays a switching control, wherein the switching control is used to switch the cooking instruction to the second smart cooking device to control the second smart cooking device to execute a corresponding cooking thread after receiving a selection operation of a user. 2.The smart refrigerator according to claim 1, characterized in that, The recipe information set further comprises a first smart cooking device state and a second smart cooking device state, and the controller is further configured to: sort the first recipe information and the second recipe information according to the first smart cooking device state and the second smart cooking device state, wherein the recipe information corresponding to an online smart cooking device is arranged in front of the recipe information corresponding to an offline smart cooking device; display the first recipe information and the second recipe information in different areas of the recipe detail page in sequence according to the sorting. 3.The smart refrigerator according to claim 2, characterized in that, The method comprises the following steps: display recipe information in a list, different recipe information is located in different columns in the list, the content parameters displayed in each row of the same recipe information are different, and each of the recipe information comprises a food material parameter and a cooking time parameter; and the controller is further configured to: In the Mth row, the cooking material parameters in each of the recipe information are compared, and a cooking material evaluation mark is generated at the position of the Mth row corresponding to the Nth column, the cooking material evaluation mark being used to prompt a user to select the recipe information of the Nth column according to the cooking material evaluation mark, wherein the Mth row is used to display the cooking material parameters of each recipe; or In the A th row, the cooking time parameters in each of the recipe information are compared, and a time evaluation mark is generated at the position of the A th row corresponding to the B th column, the time evaluation mark being used to prompt a user to select the recipe information of the B th column according to the time evaluation mark. 4.The smart refrigerator according to claim 1, characterized in that, Before receiving the input selected operation of the recipe control, the method further comprises: In response to the input account information, a binding query request is sent to a server, the binding query request carrying an account identifier corresponding to the account information; Receiving a device information set returned by the server, the device information set including device information of at least one of the smart cooking devices to be bound with the account identifier; Displaying a to-be-bound device page, the to-be-bound device page including a control for displaying the device information and a plurality of binding controls corresponding thereto, the binding controls being used to, after receiving a selected operation of a user, control the smart cooking devices corresponding to the binding controls to establish a binding relationship with the account information. 5.The smart refrigerator according to claim 1, characterized in that, The controller is further configured to: In response to the selected operation of the switching control, a cooking cancellation instruction is sent to the first smart cooking device, and a second cooking instruction is sent to the second smart cooking device, the second cooking instruction being used to instruct the second smart cooking device to execute a corresponding cooking thread according to the second recipe information.

6. A server, characterized by Comprise: A memory and a processor, the memory storing program instructions, and the processor executing the following steps by running the program instructions: Receiving a recipe information acquisition request sent by a smart refrigerator, the recipe information acquisition request including a recipe identifier corresponding to a recipe control and an account identifier; According to the recipe identifier and the account identifier, a first recipe information and a second recipe information corresponding to the recipe identifier are found, wherein the first recipe information corresponds to a first smart cooking device, and the second recipe information corresponds to a second smart cooking device, the first smart cooking device and the second smart cooking device both being smart cooking devices corresponding to the account identifier, the first recipe information displaying a first cooking control, and the second recipe information displaying a second cooking control; The first recipe information, the second recipe information, the first smart cooking device, and the second smart cooking device are sent to the smart refrigerator to form a recipe information set; Receiving an input selected operation of the first cooking control, sending a first cooking instruction to the first smart cooking device corresponding to the first cooking control, the first cooking instruction being used to instruct the first smart cooking device to execute a cooking task according to the first recipe information; Detecting a cooking material putting state of the first smart cooking device and the second smart cooking device, the cooking material putting state being a state of putting a target cooking material into the smart cooking device; If the food material putting state of the first smart cooking device is not detected within a preset time, and the food material putting state of the second smart cooking device is detected, a prompt page including corresponding prompt information is generated, a preset area of the prompt page displays a switching control, and the switching control is used to switch the cooking instruction to the second smart cooking device to control the second smart cooking device to execute a corresponding cooking thread after receiving a selection operation of a user.

7. An interface display method applied to a smart refrigerator, characterized by, The method comprises: receiving an input selection operation on a recipe control, and sending a recipe information acquisition request to a server, wherein the recipe information acquisition request includes a recipe identifier corresponding to the recipe control and an account identifier; receiving a recipe information set fed back by the server in response to the recipe information acquisition request, wherein the recipe information set includes first recipe information and second recipe information corresponding to the recipe identifier, the first recipe information corresponds to a first smart cooking device, the second recipe information corresponds to a second smart cooking device, the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier, the first recipe information and the second recipe information are respectively displayed in different areas of a recipe detail page, a first cooking control corresponding to the first recipe information is displayed, and a second cooking control corresponding to the second recipe information is displayed; receiving an input selection operation on the first cooking control, and sending a first cooking instruction to the first smart cooking device corresponding to the first cooking control, the first cooking instruction being used to instruct the first smart cooking device to execute a cooking task according to the first recipe information; detecting food material putting states of the first smart cooking device and the second smart cooking device, the food material putting state being a state in which a target food material is put into the smart cooking device; if the food material putting state of the first smart cooking device is not detected within a preset time, and the food material putting state of the second smart cooking device is detected, a prompt page including corresponding prompt information is generated, a preset area of the prompt page displays a switching control, and the switching control is used to switch the cooking instruction to the second smart cooking device to control the second smart cooking device to execute a corresponding cooking thread after receiving a selection operation of a user.

8. An interface display method applied to a server, characterized by, The method comprises: receiving a recipe information acquisition request sent by a smart refrigerator, the recipe information acquisition request including a recipe identifier corresponding to a recipe control and an account identifier; finding first recipe information and second recipe information corresponding to the recipe identifier according to the recipe identifier and the account identifier, wherein the first recipe information corresponds to a first smart cooking device, the second recipe information corresponds to a second smart cooking device, the first smart cooking device and the second smart cooking device are both smart cooking devices corresponding to the account identifier, the first recipe information displays a first cooking control, and the second recipe information displays a second cooking control; send the first recipe information, the second recipe information, the first intelligent cooking device and the second intelligent cooking device to a smart refrigerator as a recipe information set; receive an input selection operation on the first cooking control, and send a first cooking instruction to the first intelligent cooking device corresponding to the first cooking control, the first cooking instruction being used to instruct the first intelligent cooking device to perform a cooking task according to the first recipe information; detect a food material putting state of the first intelligent cooking device and the second intelligent cooking device, the food material putting state being a state of putting a target food material into the intelligent cooking device; if the food material putting state of the first intelligent cooking device is not detected within a preset time, and the food material putting state of the second intelligent cooking device is detected, generate a prompt page including corresponding prompt information, and a switching control is displayed in a preset area of the prompt page, the switching control being used to switch the cooking instruction to the second intelligent cooking device to control the second intelligent cooking device to perform a corresponding cooking thread after receiving a selection operation of a user.

Images