Food material identification method and device and refrigerator

Abstract

The invention discloses a food material identification method and device and a refrigerator, the method is applied to a communication gateway of the refrigerator, the refrigerator further comprises a food material storage device, the communication gateway is used for being in communication connection with the food material storage device and a user terminal, and the food material storage device is used for containing food materials. The method comprises the following steps: receiving food material data sent by food material storage equipment, and determining the content of a food material type label corresponding to the food material storage equipment as an initial food material type of the food material data; sending the food material data and the initial food material type to a user terminal; receiving a target instruction returned by the user terminal based on the food material data and the initial food material type; and if the target instruction is the type correction instruction, updating the initial food material type according to the type correction instruction, obtaining the target food material type, and determining the working parameters of the food material storage device according to the target food material type, thereby reducing the cost of food material identification.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of household appliances, and more particularly, to a food material identification method and device and a refrigerator. BACKGROUND

[0002] With the development of science and technology, electronic devices are increasingly used and have more and more functions. For example, a refrigerator can manage food materials by identifying the food materials placed therein. However, in the related art, image recognition technology is used to identify food materials, which limits the food material identification to the image recognition rate and requires high cost investment in image recognition hardware devices and software systems. Therefore, in the related art, the identification of food materials by a refrigerator has a high cost. SUMMARY

[0003] Therefore, embodiments of the present application provide a food material identification method and device and a refrigerator to improve the above problems.

[0004] In a first aspect, embodiments of the present application provide a food material identification method applied to a communication gateway of a refrigerator. The refrigerator further includes a food material storage device. The communication gateway is configured to be communicatively connected to the food material storage device and a user terminal. The food material storage device is configured to store food materials. The method includes: receiving food material data sent by the food material storage device when the food material storage device stores food materials, and determining content of a food material type label corresponding to the food material storage device as an initial food material type of the food material data; sending the food material data and the initial food material type to the user terminal; receiving a target instruction returned by the user terminal based on the food material data and the initial food material type, wherein the target instruction is a type confirmation instruction or a type correction instruction. The type confirmation instruction is used to indicate that the initial food material type is correct, and the type correction instruction is used to indicate that the food material type of the food material data is to be corrected; and if the target instruction is the type correction instruction, updating the initial food material type according to the type correction instruction to obtain a target food material type, and determining a working parameter of the food material storage device according to the target food material type.

[0005] In a second aspect, the embodiments of the present application provide a food material recognition device, which is applied to a communication gateway of a refrigerator. The refrigerator further comprises a food material storage device. The communication gateway is used to be communicatively connected with the food material storage device and a user terminal respectively. The food material storage device is used to place food materials. The device comprises a food material data receiving module, a food material data sending module, a target instruction receiving module, a target food material type obtaining module and a working parameter determining module. The food material data receiving module is used to receive food material data sent by the food material storage device when the food material storage device places food materials, and determine the content of a food material type label corresponding to the food material storage device as an initial food material type of the food material data. The food material data sending module is used to send the food material data and the initial food material type to the user terminal. The target instruction receiving module is used to receive a target instruction returned by the user terminal based on the food material data and the initial food material type. The target instruction is a type confirmation instruction or a type correction instruction. The type confirmation instruction is used to indicate that the initial food material type is correct. The type correction instruction is used to indicate to correct the food material type of the food material data. The target food material type obtaining module is used to update the initial food material type according to the type correction instruction to obtain a target food material type if the target instruction is the type correction instruction. The working parameter determining module is used to determine a working parameter of the food material storage device according to the target food material type.

[0006] In a third aspect, the embodiments of the present application provide a refrigerator, which comprises a food material storage device, a communication gateway, a memory and a processor. The food material storage device is used to place food materials. The communication gateway is used to be communicatively connected with the food material storage device and a user terminal respectively. The memory is coupled to the processor. The memory stores instructions. When the instructions are executed by the processor, the processor executes the above method.

[0007] In a fourth aspect, the embodiments of the present application provide a computer readable storage medium, which stores program codes. The program codes can be called and executed by a processor to execute the above method.

[0008] In the scheme of the present application, the type of the food material is preliminarily identified according to the label of the food material storage device by receiving the food material data sent by the food material storage device and determining the content of the food material type label corresponding to the food material storage device as the initial food material type of the food material data when the food material storage device has food material placed therein, thereby reducing the cost of food material identification; and the food material data and the initial food material type are sent to the user terminal, and a target instruction returned by the user terminal based on the food material data and the initial food material type is received, wherein the target instruction is a type confirmation instruction or a type correction instruction, the type confirmation instruction is used to indicate that the initial food material type is correct, and the type correction instruction is used to indicate that the food material type of the food material data is corrected; if the target instruction is the type correction instruction, the initial food material type is updated according to the type correction instruction to obtain a target food material type, and the working parameter of the food material storage device is determined according to the target food material type, so as to confirm whether the preliminary identification of the food material is correct according to the instruction returned by the user terminal, thereby ensuring the accuracy of the food material type identification and reducing the cost of the food material identification. BRIEF DESCRIPTION OF DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0010] Figure 1 A schematic diagram of an application environment provided by an embodiment of the present application is shown;

[0011] Figure 2 A flowchart of a food material identification method provided by an embodiment of the present application is shown;

[0012] Figure 3 A structural schematic diagram of a MESH networking provided by an embodiment of the present application is shown;

[0013] Figure 4 A structural schematic diagram of a MESH networking provided by an embodiment of the present application is shown;

[0014] Figure 5 A structural schematic diagram of a communication gateway provided by an embodiment of the present application is shown;

[0015] Figure 6 A structural schematic diagram of a user terminal provided by an embodiment of the present application is shown;

[0016] Figure 7 A structural schematic diagram of a food material identification management system provided by an embodiment of the present application is shown;

[0017] Figure 8A flowchart illustrating an embodiment of the food ingredient identification method provided in this application is shown.

[0018] Figure 9 A flowchart illustrating an embodiment of the food ingredient identification method provided in this application is shown.

[0019] Figure 10 A flowchart illustrating an embodiment of the food ingredient identification method provided in this application is shown.

[0020] Figure 11 A flowchart illustrating an embodiment of the food ingredient identification method provided in this application is shown.

[0021] Figure 12 A flowchart illustrating an embodiment of the food ingredient identification method provided in this application is shown.

[0022] Figure 13 A block diagram of a food identification device according to an embodiment of this application is shown;

[0023] Figure 14 A block diagram of a refrigerator for implementing the food identification method according to an embodiment of this application is shown;

[0024] Figure 15 A storage unit for storing or carrying program code implementing the food ingredient identification method according to an embodiment of this application is shown. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

[0026] As people's living standards improve, their demands for intelligent home living are increasing. Among related technologies, the application of refrigerator food identification and management technology improves the efficiency and accuracy of food management, optimizes food preservation and nutrient retention, enhances food quality and nutritional value, and provides personalized nutrition and dietary advice, promoting a healthy eating lifestyle.

[0027] Currently, food identification methods often rely on food images, weight, and odor to determine food type, but these methods require significant investment in both hardware and software systems. Therefore, reducing the cost of food identification remains a challenge in related technologies.

[0028] To address the aforementioned problems, the inventors, through extensive research, have developed a food identification method, device, and refrigerator as described in this application. This method preliminarily identifies the type of food stored in the food storage device based on its label, and then verifies the accuracy of the preliminarily identified food type based on instructions returned from the user terminal. This ensures the accuracy of food type identification and reduces the cost of food identification. The specific food identification method will be described in detail in subsequent embodiments.

[0029] To better understand the solutions of the embodiments of this application, the technical terms used in the embodiments of this application will be explained below.

[0030] MESH network, or "wireless mesh network," is a "multi-hop" network. Wireless MESH can communicate with other networks and is a dynamic and continuously expandable network architecture, where any two devices can maintain wireless interconnection.

[0031] A mesh network (WMN) is a network architecture with self-organizing, self-configuring, and self-healing capabilities. It allows nodes (devices) in the network to not only act as access points for end users but also as routers forwarding data packets to other nodes, thus building a dynamic, multi-hop, decentralized communication network.

[0032] A MESH gateway is a special type of communication gateway based on MESH technology. It has the ability to automatically select the optimal path and signal strength to forward data, thereby improving network reliability and performance. A MESH gateway typically consists of multiple nodes that can communicate with each other and work collaboratively to achieve wider coverage and higher bandwidth.

[0033] BLE (Bluetooth Low Energy, or Bluetooth LE) is a personal area network (PAN) technology designed and marketed by the Bluetooth Special Interest Group (SIG).

[0034] LTE-4G modules are a general term for LTE network standards such as TD-LTE and FDD-LTE, characterized by high communication speeds, wide network spectrum, and flexible communication. A 4G module refers to a product with highly integrated hardware and software modules, where the hardware is loaded onto a specified frequency band and the software supports the standard LTE protocol. The hardware integrates radio frequency and baseband signals onto a small PCB board, performing wireless reception, transmission, and baseband signal processing functions. The software supports functions such as voice dialing, SMS sending and receiving, and dial-up internet access.

[0035] NFC (Near Field Communication) is a short-range, high-frequency radio technology that allows electronic devices to exchange data over very short distances.

[0036] An NFC gateway is a device that uses NFC technology, allowing devices to identify each other and exchange data over short distances via electromagnetic induction coupling.

[0037] The implementation details of the technical solutions in the embodiments of this application are described in detail below:

[0038] Figure 1 This is a schematic diagram illustrating an application scenario according to an embodiment of this application, such as... Figure 1 As shown, this application scenario includes a refrigerator 100 and a user terminal 101 that communicates with the refrigerator 100 via a network. The network can be a wide area network (WAN), a local area network (LAN), or a combination of both. The refrigerator 100 can be a refrigerated refrigerator, a freezer, or a refrigerated-frozen refrigerator, etc., including a communication gateway and food storage devices. The user terminal 101 can be a server, a mobile phone, a refrigerator, or other devices with data processing capabilities. Figure 1 Only a schematic diagram of user terminal 101 as a smartphone is shown.

[0039] The communication gateway included in the refrigerator 100 can be used to communicate with the food storage device and the user terminal 101 respectively. When food is placed in the food storage device, it can receive food data sent by the food storage device, determine the content of the food type tag corresponding to the food storage device as the initial food type of the food data, and send the food data and the initial food type to the user terminal 101. It can also receive the target instruction returned by the user terminal 101 based on the food data and the initial food type. The target instruction is either a type confirmation instruction or a type correction instruction. The type confirmation instruction is used to indicate that the initial food type is correct, and the type correction instruction is used to indicate the correction of the food type in the food data. If the target instruction is a type correction instruction, the initial food type can be updated according to the type correction instruction to obtain the target food type, and the operating parameters of the food storage device can be determined according to the target food type.

[0040] It should be understood that after the communication gateway receives the food data and determines the initial food type of the food data, the refrigerator 100 can also perform the subsequent steps of receiving the target instruction based on the food data and the initial food type and returning to the communication gateway. That is, the refrigerator 100 can perform the steps of receiving the target instruction based on the food data and the initial food type in the user terminal 101 mentioned above.

[0041] Please see Figure 2 , Figure 2A flowchart illustrating an embodiment of the food ingredient identification method provided in this application is shown. In a specific embodiment, this food ingredient identification method can be applied to, for example... Figure 13 The food identification device 200 and the refrigerator 100 equipped with the food identification device 200 are shown. Figure 14 The following will use a refrigerator as an example to illustrate the specific process of this embodiment. Of course, it is understood that the refrigerator used in this embodiment may include a refrigerated refrigerator, a frozen refrigerator, or a refrigerator that combines freezing and refrigeration. The refrigerator may include a communication gateway and a food storage device. The communication gateway can be used to communicate with the food storage device and the user terminal respectively. The food storage device can be used to place food. This embodiment can be applied to the communication gateway of a refrigerator. The following will focus on... Figure 1 The process shown will be explained in detail. The food identification method may specifically include the following steps:

[0042] Step S110: If food is placed in the food storage device, receive the food data sent by the food storage device, and determine the content of the food type tag corresponding to the food storage device as the initial food type of the food data.

[0043] In some implementations, the communication gateway may include a wireless communication module and a gateway unit, the gateway unit may be communicatively connected to the wireless communication module and the food storage device respectively, and the wireless communication module may be used to communicate with a user terminal.

[0044] The gateway unit may include at least one of a MESH gateway and an NFC gateway. Optionally, when the gateway unit includes a MESH gateway, the MESH gateway can communicate with the food storage device, thereby enabling food identification and management based on a BLE-based MESH self-organizing network; when the gateway unit includes an NFC gateway, the NFC gateway can communicate with the food storage device, thereby enabling food identification and management based on NFC. A MESH self-organizing network unit can be formed by the MESH gateway and the food storage device; the MESH self-organizing network can be implemented using BLE low-power Bluetooth. An NFC self-organizing network unit can be formed by the NFC gateway and the food storage device. The number of food storage devices can be one or more, and is not limited here.

[0045] The content of the food type labels corresponding to the food storage devices can be pre-stored in the communication gateway. This can be set by the user or determined through third-party experimental data. The content of the food type labels corresponding to different food storage devices can be the same or different; this is not limited here. Accordingly, after receiving food data sent by the food storage devices, the communication gateway can determine the content of the food type labels corresponding to the food storage devices as the initial food type for that data. This allows for preliminary identification of the food type through the labels on the food storage devices, reducing the cost of food identification.

[0046] In some implementations, the food storage device may include multiple storage spaces, each capable of storing different foods. When foods are pre-placed in the food storage device, the content of the food type label can be the type of food with the largest quantity stored in the multiple storage spaces, or the most expensive type of food stored in the multiple storage spaces. When no foods are pre-placed in the food storage device, the content of the food type label can be set by the user, or it can be the food type corresponding to the most energy-efficient operating mode of the food storage device; no limitation is imposed here.

[0047] For example, please refer to Figure 3 This illustration shows a schematic diagram of a MESH self-organizing network unit provided in an embodiment of this application. The MESH self-organizing network unit can consist of a MESH gateway and food storage devices. Multiple food storage devices are communicatively connected to the MESH gateway, including food storage devices with addresses MAC1, MAC2, MAC3, and MAC4. The multiple food storage devices included in the MESH self-organizing network unit can also communicate with each other.

[0048] The MESH gateway can pre-store food type tags corresponding to each food storage device. For example, the food storage device at address MAC1 is labeled as "vegetables," the food storage device at address MAC2 is labeled as "seafood," the food storage device at address MAC3 is labeled as "fruit," and the food storage device at address MAC4 is labeled as "meat." Accordingly, please refer to... Figure 4The illustration shows a schematic diagram of a MESH self-organizing network unit provided in an embodiment of this application. The MESH gateway of the MESH self-organizing network unit can identify the food storage device with address MAC1 as a vegetable device, the food storage device with address MAC2 as a seafood device, the food storage device with address MAC3 as a fruit device, and the food storage device with address MAC4 as a meat device.

[0049] In some implementations, the wireless communication module may include an LTE-4G module, a Bluetooth module, a 5G module, a WiFi module, a cellular communication module, etc. For example, the wireless communication module is an LTE-4G module; wherein the 4G module has BLE low-power Bluetooth, and correspondingly, the BLE low-power Bluetooth on the 4G module can act as a MESH gateway.

[0050] For example, please refer to Figure 5 The illustration shows a schematic diagram of a communication gateway provided in an embodiment of this application. The communication gateway may consist of an LTE-4G module and a Bluetooth MESH gateway; the LTE-4G module is used for communication connection with a user terminal, and the Bluetooth MESH gateway is used for communication connection with a food storage device. The LTE-4G module can interface with the user terminal and receive target instructions returned by the user terminal; the Bluetooth MESH gateway can collect food data and operating parameters of the food storage device determined according to the target instructions from the food storage device connected to the Bluetooth MESH gateway, and distribute these data to the food storage device.

[0051] In some embodiments, the food storage device included in the refrigerator may be equipped with a visual sensor. Optionally, the food storage device can use the visual sensor to acquire an image of the storage space of the food storage device, and can determine whether food is placed in the food storage device based on the image. If food is detected in the food storage device, the image can be sent as food data to a communication gateway that is communicatively connected to the food storage device.

[0052] In some implementations, the food storage device may also be equipped with a weight sensor and a vision sensor. Optionally, the food storage device can use the weight sensor to detect whether food is placed in the food storage device, and if it is determined that food is placed in the food storage device, it can use the vision sensor to capture an image of the storage space of the food storage device, and send the image as food data to the communication gateway.

[0053] The process of detecting whether there is food in the food storage device using a weight sensor can be as follows: if the load-bearing capacity of the storage space of the food storage device is detected to be greater than the weight threshold, it can be determined that there is food in the food storage device; if the load-bearing capacity of the storage space of the food storage device is detected to be less than or equal to the weight threshold, it can be determined that there is no food in the food storage device.

[0054] In some implementations, the food storage device can also send the food data corresponding to the current food storage space to the communication gateway when it detects an update to the placed food. Optionally, the food storage device can include multiple storage spaces, and correspondingly, when it detects an update to the food placed in one storage space, it can also send the food data corresponding to that storage space to the communication gateway. The method for detecting whether an updated food is placed in a storage space can be to detect whether the load-bearing capacity of the storage space has changed, and if a change in load-bearing capacity is detected, determine that the food has been updated; alternatively, it can use an infrared sensor to detect whether an object is moving in the storage space, and if movement is detected, determine that the food has been updated.

[0055] In some implementations, the communication gateway can receive food data sent by the food storage device when food is placed in the food storage device, and can determine the content of the food type tag corresponding to the food storage device as the initial food type of the food data.

[0056] Step S120: Send the ingredient data and the initial ingredient type to the user terminal.

[0057] In some implementations, after the communication gateway obtains the food data and the output food type of the food data, it can package the food data and the initial food type and send them to the user terminal so as to notify the user of the information of the food currently placed in the food storage device through the user terminal.

[0058] In some implementations, the user terminal may consist of a backend cloud platform and a user application software (APP). For an example, please refer to [link to relevant documentation]. Figure 6 , Figure 6A schematic diagram of a user terminal provided in an embodiment of this application is shown. The user terminal consists of a backend cloud and a user app. The backend cloud can communicate with both the communication gateway and the user app. The backend cloud can receive and save food data and initial food types sent by the communication gateway, and can send the food data and initial food types to the user app to notify the user of the preliminary food identification results. The user app can output prompts or interface information based on the food data and initial food types, obtain control commands input by the user based on the food data and initial food types, generate target commands based on the control commands, and return the target commands to the communication gateway through the backend cloud. The backend cloud then sends the target commands, including food control logic, to the communication gateway, allowing the communication gateway to determine the operating parameters of the food storage device based on the target commands.

[0059] After receiving the food data and the initial food type, the user terminal can generate a prompt message to indicate the initial food type of the food data corresponding to the food storage device. Accordingly, the user terminal can receive control commands input by the user based on this prompt message.

[0060] This control command can be used to confirm whether the food type of the food data corresponding to the current food storage device is the initial food type, or it can be used to instruct the correction of the food type of the initially identified food data. Accordingly, the user terminal can generate a target command based on this control command and send the target command to the communication gateway.

[0061] Optionally, after receiving the food data and the initial food type, the user terminal can generate and display a prompt interface, which may include the food data and the initial food type. Optionally, the user terminal can respond to the user's touch operation on the prompt interface and obtain the user-inputted control command. This control command can be used to confirm that the initial food identification is correct, that is, the food type in the food data is the initial food type. The control command may also carry a food type for correcting the initial food type. The control command may also carry control parameters, which can be set by the user and can serve as parameters for controlling the operation of the food storage device, such as temperature, light intensity, fan speed, compressor speed, and cooling time, etc., without limitation. The user terminal can generate a target command based on the control command. This target command can be used to confirm the initial food identification is correct, and may also carry a food type for correcting the initial food type, as well as control parameters. Based on this, it can be understood that the communication gateway can determine the control logic of the food storage device based on the target command.

[0062] Step S130: Receive a target instruction returned by the user terminal based on the ingredient data and the initial ingredient type, wherein the target instruction is a type confirmation instruction or a type correction instruction, the type confirmation instruction is used to indicate that the initial ingredient type is correct, and the type correction instruction is used to indicate the correction of the ingredient type in the ingredient data.

[0063] In some implementations, the user terminal can return a target instruction to the communication gateway based on the ingredient data and the initial ingredient type. Correspondingly, the communication gateway can receive the target instruction returned by the user terminal based on the ingredient data and the initial ingredient type. The target instruction can be a type confirmation instruction or a type correction instruction; the type confirmation instruction can be used to indicate that the initial ingredient type is correct, and the type correction instruction can be used to indicate the correction of the ingredient type in the initially identified ingredient data. The type confirmation instruction and the type correction instruction can include different tags. Accordingly, the communication gateway can determine whether the target instruction is labeled as a type confirmation instruction or a type correction instruction by detecting the tag of the target instruction.

[0064] Step S140: If the target instruction is the type correction instruction, then update the initial ingredient type according to the type correction instruction to obtain the target ingredient type.

[0065] In some implementations, if the communication gateway determines that the target instruction is a type correction instruction, it can update the initial ingredient type according to the type correction instruction to obtain the target ingredient type. Specifically, the type correction instruction may carry an ingredient type used to correct the initial ingredient type; correspondingly, the communication gateway can update the initial ingredient type based on this ingredient type to obtain the target ingredient type. That is, the communication gateway can determine the ingredient type carried in the type correction instruction used to correct the initial ingredient type as the target ingredient type.

[0066] Step S150: Determine the operating parameters of the food storage device according to the target food type.

[0067] In some implementations, the communication gateway may pre-store control parameters corresponding to multiple food types. The control parameters corresponding to different food types may be the same or different, and this is not limited here.

[0068] In some implementations, after the communication gateway determines the target food type of the food data of the food storage device, it can determine the control parameters of the target food type from the control parameters corresponding to each of the pre-stored multiple food types, and determine the operating parameters of the food storage device based on the control parameters. In this way, the food in the food storage device is managed by determining the operating parameters of the food storage device based on the target food type, so as to reduce the cost of food management while ensuring the accuracy of food identification.

[0069] In some implementations, the target instruction may carry control parameters. Optionally, the communication gateway can determine these control parameters as control parameters for the target food type, and can determine the operating parameters of the food storage device based on the control parameters for the target food type. Specifically, the communication gateway can update similar parameters in the pre-stored control parameters corresponding to the target food type based on the control parameters carried in the target instruction (e.g., replacing the temperature control parameter in the pre-stored control parameters for the target food type with the temperature control parameter, replacing the illumination control parameter in the pre-stored control parameters for the target food type with the illumination control parameter, etc.), and determine the updated control parameters corresponding to the target food type as the operating parameters of the food storage device.

[0070] In some implementations, the communication gateway can determine the operating parameters of the food storage device based on the target food type and the content of the food type label corresponding to the food storage device. For example, the communication gateway can obtain the control parameters of the target food type as the first control parameter, or it can obtain the control parameters of the content of the food type label corresponding to the food storage device as the second control parameter. The communication gateway can update the second control parameter based on the first control parameter to determine the operating parameters of the food storage device. Optionally, the communication gateway can identify similar parameters in the first and second control parameters, such as temperature-related parameters and light-related parameters, and during the process of updating the second control parameter based on the first control parameter, it can replace the corresponding similar parameter in the second control parameter with the average, minimum, maximum, or arithmetic mean of each similar parameter in the first and second control parameters.

[0071] In some implementations, the food storage device contains multiple food items of different types. After determining the target food type for each food item, the communication gateway can acquire the control parameters for each target food type and determine the union of the control parameters for multiple target food types as the operating parameters of the food storage device. Specifically, when multiple target food types have multiple values ​​for the same type of parameter, the communication gateway can determine the average, minimum, maximum, or arithmetic mean of the same type of parameter across multiple target food types as the control values ​​for that type of parameter during the operation of the food storage device. This improves the intelligence and accuracy of food management and controls the device's operation based on the control parameters for each food type, reducing the cost and increasing the efficiency of food management.

[0072] For example, please refer to Figure 7 This document illustrates a schematic diagram of a food ingredient identification management system according to an embodiment of this application. The system comprises food ingredient storage devices, a communication gateway, and user terminals. The number of food ingredient storage devices can be one or more. The communication gateway can consist of a wireless communication module and a gateway unit. The user terminal can consist of a user app and a backend cloud platform. The wireless communication module can be an LTE-4G module, and the BLE low-power Bluetooth on the 4G module can serve as a MESH gateway included in the gateway unit. The MESH gateway communicates with one or more food ingredient storage devices. The backend cloud platform can communicate with the LTE-4G module and the user app, thereby enabling MESH self-organizing network communication via BLE low-power Bluetooth, communication with the management platform via the LTE-4G module, and management of food ingredients via the backend management platform.

[0073] The MESH gateway and one or more food storage devices can form a MESH self-organizing network via Bluetooth Low Energy (BLE). The food storage devices communicating with the MESH gateway can be understood as MESH network sub-devices. The MESH gateway can package the food data sent by the food storage devices along with the content of the corresponding food type tags and send it to the upper-layer device (user terminal). It can also obtain the target instructions returned by the user terminal based on the food data and the initially identified food type, determine the operating parameters of the food storage devices according to the target instructions, and distribute these parameters to the corresponding food storage devices. The food storage devices then operate based on these parameters, ensuring accurate food identification while reducing the cost of food identification and management, and improving the user experience.

[0074] One embodiment of this application provides a food identification method that, when food is placed in a food storage device, receives food data sent by the food storage device and determines the content of the food type label corresponding to the food storage device as the initial food type of the food data. This allows for preliminary identification of the food type based on the label of the food storage device, reducing the cost of food identification. Furthermore, the food data and the initial food type are sent to a user terminal, and a target instruction returned by the user terminal based on the food data and the initial food type is received. The target instruction can be a type confirmation instruction or a type correction instruction. The type confirmation instruction indicates that the initial food type is correct, while the type correction instruction indicates that the food type in the food data needs correction. If the target instruction is a type correction instruction, the initial food type is updated according to the type correction instruction to obtain the target food type. This allows for confirmation of the correctness of food identification based on the instruction returned by the user terminal, improving the accuracy of food type identification. Moreover, determining the operating parameters of the food storage device based on the target food type reduces the cost of food management and improves the accuracy of food management.

[0075] Please see Figure 8 , Figure 8 A flowchart illustrating a food identification method according to an embodiment of this application is shown. This method is applied to the aforementioned refrigerator, and will be discussed below. Figure 8 The process shown will be explained in detail. The food identification method may specifically include the following steps:

[0076] Step S210: If food is placed in the food storage device, receive the food data sent by the food storage device, and determine the content of the food type tag corresponding to the food storage device as the initial food type of the food data.

[0077] Step S220: Send the ingredient data and the initial ingredient type to the user terminal.

[0078] Step S230: Receive a target instruction returned by the user terminal based on the ingredient data and the initial ingredient type, wherein the target instruction is a type confirmation instruction or a type correction instruction, the type confirmation instruction is used to indicate that the initial ingredient type is correct, and the type correction instruction is used to indicate the correction of the ingredient type in the ingredient data.

[0079] For a detailed description of steps S210-S230, please refer to the previous description of steps S110-S130, which will not be repeated here.

[0080] Step S240: If the target instruction is the type confirmation instruction, then the initial ingredient type is determined as the target ingredient type.

[0081] In some implementations, if the communication gateway determines that the target instruction is a type confirmation instruction, the initial ingredient type can be determined as the target ingredient type, that is, the initially identified ingredient type can be determined as the ingredient type corresponding to the ingredient data.

[0082] Step S250: Determine the operating parameters of the food storage device according to the target food type.

[0083] For a detailed description of step S250, please refer to the previous description of step S150, which will not be repeated here.

[0084] The food ingredient identification method provided in one embodiment of this application is compared to... Figure 2 The food identification method shown in this embodiment can also determine the initial food type as the target food type if the target instruction is a type confirmation instruction. Thus, if the initial food identification is confirmed to be correct based on the target instruction returned by the user terminal, the initially identified food type is determined as the type of food data, and food management is carried out according to the type of the initially identified food data. This ensures the accuracy of food identification, reduces the cost of food identification and management, and improves the user experience.

[0085] Please see Figure 9 , Figure 9 A flowchart illustrating a food identification method according to an embodiment of this application is shown. This method is applied to the aforementioned refrigerator, and will be discussed below. Figure 9 The process shown will be explained in detail. The food identification method may specifically include the following steps:

[0086] Step S310: If food is placed in the food storage device, receive the food data sent by the food storage device, and determine the content of the food type tag corresponding to the food storage device as the initial food type of the food data.

[0087] Step S320: Send the ingredient data and the initial ingredient type to the user terminal.

[0088] Step S330: Receive a target instruction returned by the user terminal based on the ingredient data and the initial ingredient type, wherein the target instruction is a type confirmation instruction or a type correction instruction, the type confirmation instruction is used to indicate that the initial ingredient type is correct, and the type correction instruction is used to indicate the correction of the ingredient type in the ingredient data.

[0089] Step S340: If the target instruction is the type correction instruction, then update the initial ingredient type according to the type correction instruction to obtain the target ingredient type.

[0090] For a detailed description of steps S310-S340, please refer to the previous description of steps S110-S140, which will not be repeated here.

[0091] Step S350: Determine the priority of the target ingredient type and the priority of the content of the ingredient type label corresponding to the ingredient storage device.

[0092] In some implementations, the communication gateway may pre-store the priorities corresponding to multiple food types, and the communication gateway may also obtain the priorities corresponding to multiple food types from associated cloud or electronic devices. Optionally, the priorities corresponding to food types can be set by the user or obtained through third-party experimental data. For example, the priority of a food type can be positively correlated with its economic value; for instance, seafood is more expensive than eggs, so seafood may have a higher priority than eggs. Accordingly, after obtaining the target food type, the communication gateway can determine the priority of the target food type from the priorities corresponding to the multiple food types, and can also determine the priority of the content of the food type tag corresponding to the food storage device from the priorities corresponding to the multiple food types.

[0093] Step S360: If the priority of the target ingredient type is lower than or equal to the priority of the ingredient type label content corresponding to the ingredient storage device, then the control parameter corresponding to the content of the ingredient type label corresponding to the ingredient storage device is determined as the working parameter of the ingredient storage device.

[0094] In some implementations, after the communication gateway determines the priority of the target food type and the priority of the content of the food type label corresponding to the food storage device, it can compare the priority of the target food type with the priority of the content of the food type label corresponding to the food storage device, and determine the operating parameters of the food storage device based on the comparison result.

[0095] For example, considering that the content of the food type label corresponding to the food storage device can be updated in real time according to the types of food placed in the food storage device, and the target food type may only correspond to the types of food in a portion of the storage space in the food storage device, in this embodiment, the communication gateway can determine the control parameters corresponding to the content of the food type label corresponding to the food storage device as the operating parameters of the food storage device if the priority of the target food type is lower than or equal to the priority of the content of the food type label corresponding to the food storage device. This is to optimize the preservation and nutrient retention of the food in the food storage device while correctly identifying the food, thereby improving the user experience.

[0096] Step S350: If the priority of the target ingredient type is higher than the priority of the ingredient type label content corresponding to the ingredient storage device, then the control parameter corresponding to the target ingredient type is determined as the working parameter of the ingredient storage device.

[0097] In some implementations, if the communication gateway determines that the priority of the target food type is higher than the priority of the content of the food type label corresponding to the food storage device, then the control parameters corresponding to the target food type can be determined as the operating parameters of the food storage device.

[0098] The food ingredient identification method provided in one embodiment of this application is compared to... Figure 2 The food identification method shown in this embodiment can further determine the priority of the target food type and the priority of the content of the food type label corresponding to the food storage device. If the priority of the target food type is lower than or equal to the priority of the content of the food type label corresponding to the food storage device, the control parameter corresponding to the content of the food type label corresponding to the food storage device is determined as the operating parameter of the food storage device. Alternatively, if the priority of the target food type is higher than the priority of the content of the food type label corresponding to the food storage device, the control parameter corresponding to the target food type is determined as the operating parameter of the food storage device. This allows for accurate identification of food and reduced cost of food identification, while optimizing the preservation and nutrient retention of food in the food storage device, improving the accuracy of food management, and enhancing the user experience.

[0099] Please see Figure 10 , Figure 10 A flowchart illustrating a food identification method according to an embodiment of this application is shown. This method is applied to the aforementioned refrigerator, and will be discussed below. Figure 10 The process shown will be explained in detail. The food identification method may specifically include the following steps:

[0100] Step S410: If food is placed in the food storage device, receive the food data sent by the food storage device, and determine the content of the food type tag corresponding to the food storage device as the initial food type of the food data.

[0101] Step S420: Send the ingredient data and the initial ingredient type to the user terminal.

[0102] Step S430: Receive a target instruction returned by the user terminal based on the ingredient data and the initial ingredient type, wherein the target instruction is a type confirmation instruction or a type correction instruction, the type confirmation instruction is used to indicate that the initial ingredient type is correct, and the type correction instruction is used to indicate the correction of the ingredient type in the ingredient data.

[0103] Step S440: If the target instruction is the type correction instruction, then update the initial ingredient type according to the type correction instruction to obtain the target ingredient type.

[0104] Step S450: Determine the operating parameters of the food storage device according to the target food type.

[0105] For a detailed description of steps S410-S450, please refer to the previous description of steps S110-S150, which will not be repeated here.

[0106] Step S460: If the priority of the target ingredient type is higher than the priority of the ingredient type tag content corresponding to the ingredient storage device, then update the content of the ingredient type tag corresponding to the ingredient storage device to the target ingredient type.

[0107] In some implementations, after obtaining the target ingredient type, the communication gateway can obtain the priority of the target ingredient type and the priority of the content of the ingredient type tag corresponding to the ingredient storage device, and can compare the priority of the target ingredient type with the priority of the content of the ingredient type tag corresponding to the ingredient storage device, thereby determining whether to update the content of the ingredient type tag corresponding to the ingredient storage device based on the comparison result.

[0108] For example, if the priority of the target ingredient type is determined to be higher than the priority of the ingredient type label content corresponding to the ingredient storage device, the content of the ingredient type label corresponding to the ingredient storage device can be updated to the target ingredient type, thereby updating the content of the ingredient type label corresponding to the ingredient storage device in real time and optimizing the preservation and nutrient retention of ingredients in the ingredient storage device.

[0109] The food ingredient identification method provided in one embodiment of this application is compared to... Figure 2 The food identification method shown in this embodiment can also, after determining the working parameters of the food storage device based on the target food type, update the content of the food type label corresponding to the food storage device to the target food type if the priority of the target food type is higher than the priority of the content of the food type label corresponding to the food storage device. This allows for the correct identification of food and the reduction of the cost of identifying and managing food, while simultaneously updating the content of the food type label corresponding to the food storage device in real time, thus optimizing the preservation and nutrient retention of food in the food storage device.

[0110] Please see Figure 11 , Figure 11 A flowchart illustrating a food identification method according to an embodiment of this application is shown. This method is applied to the aforementioned refrigerator, and will be discussed below. Figure 11 The process shown will be explained in detail. The food identification method may specifically include the following steps:

[0111] Step S510: When food is placed in the food storage device, receive food data sent by the food storage device, and determine the content of the food type tag corresponding to the food storage device as the initial food type of the food data. The food storage device contains multiple food items, and the food types of the multiple food items are different.

[0112] In some implementations, the food storage device can hold multiple food items, which can be of different or the same type. The food storage device may include a vision sensor, which can collect food data corresponding to each of the multiple food items in its storage space. Optionally, the food storage device can send the food data corresponding to each of the multiple food items to a communication gateway one by one; alternatively, it can send the food data corresponding to each of the multiple food items to the communication gateway simultaneously. Accordingly, when food items are present in the food storage device, the communication gateway can receive the food data sent by the food storage device, determine the content of the food type tag corresponding to the food storage device as the initial food type for each food item, and send the food data and the initial food type to the user terminal, so that the user terminal can return the target instructions corresponding to each of the multiple food items one by one.

[0113] Step S520: Send the ingredient data and the initial ingredient type to the user terminal.

[0114] For a detailed description of step S520, please refer to the previous description of step S120, which will not be repeated here.

[0115] Step S530: Receive the target instruction returned by the user terminal based on the ingredient data and the initial ingredient type, wherein the target instruction is a type confirmation instruction or a type correction instruction. The type confirmation instruction is used to indicate that the initial ingredient type is correct, and the type correction instruction is used to indicate the ingredient type of the ingredient data to be corrected. The target instructions corresponding to each of the multiple ingredients are returned by the user terminal one by one.

[0116] In some implementations, the user terminal can display or prompt the ingredient data and initial ingredient type of each ingredient one by one, so that the user can input control commands for each ingredient one by one; the user terminal can also display or prompt the ingredient data and initial ingredient type of multiple ingredients together, so that the user can input control commands for each ingredient one by one, or input control commands for multiple ingredients together.

[0117] In some implementations, after receiving control commands corresponding to each ingredient, the user terminal can generate target commands corresponding to each ingredient and return the target commands corresponding to multiple ingredients one by one. Correspondingly, the communication gateway can receive the target commands corresponding to each ingredient returned by the user terminal one by one. The target command may carry control parameters, ingredient type, or be used to confirm that the initial identification of the ingredient is correct.

[0118] Step S540: If the target instruction is the type correction instruction, then update the initial ingredient type according to the type correction instruction to obtain the target ingredient type.

[0119] For a detailed description of step S540, please refer to the previous description of step S140, which will not be repeated here.

[0120] Step S550: From the target ingredient types corresponding to the multiple ingredients, obtain the target ingredient type corresponding to the latest received target instruction as the first parameter setting type.

[0121] In some implementations, the communication gateway can, during the process of receiving target instructions corresponding to each ingredient one by one and determining the target ingredient type corresponding to each ingredient one by one, obtain the target ingredient type corresponding to the latest received target instruction from the target ingredient types corresponding to multiple ingredients as the first parameter setting type, thereby controlling the operation of the ingredient storage device according to the target ingredient type corresponding to the latest received target instruction, thus improving the real-time performance of ingredient management.

[0122] Step S560: Determine the operating parameters of the food storage device according to the first parameter setting type.

[0123] In some implementations, after the communication gateway determines the first parameter setting type, it can determine the operating parameters of the food storage device based on the first parameter setting type. For example, the control parameters corresponding to the first parameter setting type can be determined as the operating parameters of the food storage device; alternatively, the control parameters corresponding to the first parameter setting type can be determined as the operating parameters of the food storage device, and the determined operating parameters of the food storage device can be updated according to the control parameters carried in the target instruction corresponding to the first parameter setting type, thereby improving the accuracy of the food storage device control.

[0124] The food ingredient identification method provided in one embodiment of this application is compared to... Figure 2The food identification method shown in this embodiment involves a food storage device containing multiple foods of different types. The target instructions corresponding to each of the multiple foods are returned sequentially by the user terminal. This embodiment can also obtain the target food type corresponding to the latest received target instruction from the target food types corresponding to each of the multiple foods as a first parameter setting type. The operating parameters of the food storage device are determined based on the first parameter setting type. Therefore, even when multiple foods of different types are placed in the food storage device, and the target instructions corresponding to each of the multiple foods are returned sequentially by the user terminal, the operation control of the food storage device is performed based on the target food type corresponding to the latest received target instruction. This reduces the cost of food identification while improving the real-time performance of food management.

[0125] Please see Figure 12 , Figure 12 A flowchart illustrating a food identification method according to an embodiment of this application is shown. This method is applied to the aforementioned refrigerator, and will be discussed below. Figure 12 The process shown will be explained in detail. The food identification method may specifically include the following steps:

[0126] Step S610: When food is placed in the food storage device, receive food data sent by the food storage device, and determine the content of the food type tag corresponding to the food storage device as the initial food type of the food data. The food storage device contains multiple food items, and the food types of the multiple food items are different.

[0127] For a detailed description of step S610, please refer to the previous description of step S510, which will not be repeated here.

[0128] Step S620: Send the ingredient data and the initial ingredient type to the user terminal.

[0129] Step S630: Receive a target instruction returned by the user terminal based on the ingredient data and the initial ingredient type, wherein the target instruction is a type confirmation instruction or a type correction instruction, the type confirmation instruction is used to indicate that the initial ingredient type is correct, and the type correction instruction is used to indicate the correction of the ingredient type in the ingredient data.

[0130] Step S640: If the target instruction is the type correction instruction, then update the initial ingredient type according to the type correction instruction to obtain the target ingredient type.

[0131] For a detailed description of steps S620-S640, please refer to the previous description of steps S120-S140, which will not be repeated here.

[0132] Step S650: Obtain the priority of the target ingredient type corresponding to each of the multiple ingredients.

[0133] In some implementations, the communication gateway can determine the priority of the target food type corresponding to each of the multiple food items placed in the food storage device after determining the target food type corresponding to each of the multiple food items.

[0134] Optionally, the communication gateway can be pre-configured with priorities corresponding to multiple food types; the communication gateway can also obtain the priorities corresponding to multiple food types from associated cloud or electronic devices. The priorities corresponding to the multiple food types can be set by the user or obtained through third-party experimental data. Accordingly, the communication gateway can determine the priority of the target food type corresponding to each of the multiple food types based on these priorities.

[0135] Step S660: From the target ingredient types corresponding to each of the multiple ingredients, obtain the target ingredient type with the highest priority as the second parameter setting type.

[0136] In some implementations, after obtaining the priority of the target ingredient type corresponding to each of the multiple ingredients, the communication gateway can select the target ingredient type with the highest priority from the target ingredient types corresponding to each of the multiple ingredients as the second parameter setting type, thereby setting the parameters of the ingredient storage device according to the priority of the ingredient type, so as to ensure the preservation and nutrient retention of the highest priority ingredient in the ingredient storage device. This reduces the cost of ingredient identification, improves the intelligence of ingredient management, and enhances the user experience.

[0137] Step S670: Determine the operating parameters of the food storage device according to the second parameter setting type.

[0138] In some implementations, after the communication gateway determines the second parameter setting type, it can determine the operating parameters of the food storage device based on this second parameter setting type. For example, the control parameters corresponding to the second parameter setting type can be determined as the operating parameters of the food storage device; alternatively, the control parameters corresponding to the second parameter setting type can be determined as the operating parameters of the food storage device, and the determined operating parameters of the food storage device can be updated according to the control parameters carried in the target instruction corresponding to the second parameter setting type, thereby improving the accuracy of the food storage device control.

[0139] The food ingredient identification method provided in one embodiment of this application is compared to... Figure 2The food identification method shown in this embodiment contains multiple food items in the food storage device. These food items have different types. This embodiment can also obtain the priority of the target food type corresponding to each of the multiple food items. From the target food types corresponding to each of the multiple food items, the target food type with the highest priority is obtained as the second parameter setting type. The working parameters of the food storage device are determined according to the second parameter setting type. This reduces the cost of food identification while ensuring the preservation and nutrient retention of the highest priority food item in the food storage device, improving the intelligence of food management and enhancing the user experience.

[0140] Please see Figure 13 , Figure 13 A block diagram of a food identification device according to an embodiment of this application is shown. The food identification device 200 is applied to the communication gateway of the aforementioned refrigerator, which also includes a food storage device. The communication gateway is used to communicate with both the food storage device and a user terminal, and the food storage device is used to hold food. The following will focus on... Figure 13 The process shown is described in detail. The food ingredient identification device 200 may include: a food ingredient data receiving module 210, a food ingredient data sending module 220, a target instruction receiving module 230, a target food ingredient type obtaining module 240, and a working parameter determining module 250, wherein:

[0141] The food ingredient data receiving module 210 is used to receive food ingredient data sent by the food ingredient storage device when food ingredients are placed in the food ingredient storage device, and to determine the content of the food ingredient type tag corresponding to the food ingredient storage device as the initial food ingredient type of the food ingredient data.

[0142] The ingredient data sending module 220 is used to send the ingredient data and the initial ingredient type to the user terminal.

[0143] The target instruction receiving module 230 is used to receive a target instruction returned by the user terminal based on the ingredient data and the initial ingredient type. The target instruction is a type confirmation instruction or a type correction instruction. The type confirmation instruction is used to indicate that the initial ingredient type is correct, and the type correction instruction is used to indicate the ingredient type of the ingredient data to be corrected.

[0144] The target ingredient type acquisition module 240 is used to update the initial ingredient type according to the type correction instruction if the target instruction is the type correction instruction, and obtain the target ingredient type.

[0145] The working parameter determination module 250 is used to determine the working parameters of the food storage device according to the target food type.

[0146] Furthermore, the food ingredient identification device 200 may further include: a target food ingredient type acquisition subunit, wherein:

[0147] The target ingredient type acquisition subunit is used to determine the initial ingredient type as the target ingredient type if the target instruction is the type confirmation instruction.

[0148] Furthermore, the working parameter determination module 250 may include: a priority determination first unit, a working parameter determination first unit, and a working parameter determination second unit, wherein:

[0149] The priority determination first unit is used to determine the priority of the target ingredient type and the priority of the content of the ingredient type label corresponding to the ingredient storage device.

[0150] The first unit for determining operating parameters is used to determine the control parameters corresponding to the content of the food type label corresponding to the food storage device as the operating parameters of the food storage device if the priority of the target food type is lower than or equal to the priority of the content of the food type label corresponding to the food storage device.

[0151] The second unit for determining operating parameters is used to determine the control parameters corresponding to the target ingredient type as the operating parameters of the ingredient storage device if the priority of the target ingredient type is higher than the priority of the content of the ingredient type label corresponding to the ingredient storage device.

[0152] Furthermore, after determining the operating parameters of the food storage device based on the target food type, the food identification device 200 may further include: a tag content updating unit, wherein:

[0153] The tag content update unit is used to update the content of the food type tag corresponding to the food storage device to the target food type if the priority of the target food type is higher than the priority of the content of the food type tag corresponding to the food storage device.

[0154] Furthermore, the food storage device contains multiple food items of different types. The target instructions corresponding to each of the multiple food items are returned sequentially by the user terminal. The working parameter determination module 250 may include: a first parameter setting type acquisition unit and a working parameter determination third unit, wherein:

[0155] The first parameter setting type acquisition unit is used to acquire the target ingredient type corresponding to the latest received target instruction from the target ingredient types corresponding to the multiple ingredients as the first parameter setting type.

[0156] The third unit for determining operating parameters is used to determine the operating parameters of the food storage device based on the first parameter setting type.

[0157] Furthermore, the food storage device contains multiple food ingredients of different types. The working parameter determination module 250 may include: a priority determination second unit, a second parameter setting type acquisition unit, and a working parameter determination fourth unit, wherein:

[0158] The priority determination second unit is used to obtain the priority of the target ingredient type corresponding to each of the multiple ingredients.

[0159] The second parameter setting type acquisition unit is used to acquire the target ingredient type with the highest priority from the target ingredient types corresponding to the multiple ingredients as the second parameter setting type.

[0160] The fourth unit for determining operating parameters is used to determine the operating parameters of the food storage device based on the second parameter setting type.

[0161] Furthermore, the operating parameters include at least one of temperature, light intensity, and wind speed.

[0162] Furthermore, the communication gateway includes a wireless communication module and a gateway unit. The gateway unit is communicatively connected to the wireless communication module and the food storage device, respectively. The wireless communication module is used to communicate with the user terminal. The gateway unit includes at least one of a MESH gateway and an NFC gateway.

[0163] Furthermore, the wireless communication module includes an LTE-4G module.

[0164] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device and module can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0165] In the several embodiments provided in this application, the coupling between modules can be electrical, mechanical, or other forms of coupling.

[0166] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0167] Please see Figure 14This document illustrates a structural block diagram of a refrigerator according to an embodiment of this application. The refrigerator 100 can be a refrigerated refrigerator, a frozen refrigerator, a refrigerated-frozen refrigerator, or other refrigerators with processing capabilities. The refrigerator 100 in this application may include one or more of the following components: a food storage device 11, a communication gateway 12, a processor 110, a memory 120, and one or more application programs. The one or more application programs may be stored in the memory 120 and configured to be executed by one or more processors 110. The one or more programs are configured to perform the methods described in the foregoing method embodiments.

[0168] The food storage device 11 can be used to place food. The number of food storage devices 12 can be one or more, and can include drawers, bottle racks, etc. in a refrigerator, or different refrigerator cabinets, freezers, etc.

[0169] The communication gateway 12 can be used to communicate with the food storage device 11 and the user terminal respectively; it can include a wireless communication module and a gateway unit. The gateway unit can communicate with both the wireless communication module and the food storage device 11, and the wireless communication module can communicate with the user terminal. The gateway unit can include at least one of a MESH gateway and an NFC gateway; the wireless communication module can include an LTE-4G module, a Bluetooth module, a 5G module, a WiFi module, a cellular communication module, etc., and is not limited thereto.

[0170] The processor 110 may include one or more processing cores. The processor 110 connects to various parts within the refrigerator 100 using various interfaces and lines, and performs various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and by calling data stored in the memory 120. Optionally, the processor 110 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 110 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content to be displayed; and the modem handles wireless communication. It is understood that the modem may also not be integrated into the processor 110 and may be implemented separately using a communication chip.

[0171] The memory 120 may include random access memory (RAM) or read-only memory (ROM). The memory 120 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as touch functionality, sound playback functionality, image playback functionality, etc.), and instructions for implementing the various method embodiments described below. The data storage area may also store data generated during the use of the refrigerator 100 (such as temperature, light intensity, compressor speed, etc.).

[0172] Please see Figure 15 This diagram illustrates a structural block diagram of a computer-readable storage medium provided in an embodiment of this application. The computer-readable medium 300 stores program code that can be invoked by a processor to execute the methods described in the above method embodiments.

[0173] The computer-readable storage medium 300 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 300 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 300 has storage space for program code 310 that performs any of the method steps described above. This program code can be read from or written to one or more computer program products. The program code 310 may be compressed, for example, in a suitable form.

[0174] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for identifying food ingredients, characterized in that, A communication gateway is used in a refrigerator, the refrigerator also including a food storage device. The communication gateway is used to communicate with the food storage device and a user terminal respectively. The food storage device is used to store food. The method includes: When food is placed in the food storage device, the food data sent by the food storage device is received, and the content of the food type tag corresponding to the food storage device is determined as the initial food type of the food data; The ingredient data and the initial ingredient type are sent to the user terminal; The system receives a target instruction returned by the user terminal based on the food data and the initial food type, wherein the target instruction is a type confirmation instruction or a type correction instruction, the type confirmation instruction is used to indicate that the initial food type is correct, and the type correction instruction is used to indicate the food type to be corrected in the food data; If the target instruction is the type correction instruction, then the initial ingredient type is updated according to the type correction instruction to obtain the target ingredient type; The operating parameters of the food storage device are determined based on the target food type.

2. The method according to claim 1, characterized in that, The method further includes: If the target instruction is the type confirmation instruction, then the initial ingredient type is determined as the target ingredient type.

3. The method according to claim 1, characterized in that, Determining the operating parameters of the food storage device based on the target food type includes: Determine the priority of the target ingredient type and the priority of the content of the ingredient type label corresponding to the ingredient storage device; If the priority of the target ingredient type is lower than or equal to the priority of the ingredient type label content corresponding to the ingredient storage device, then the control parameter corresponding to the content of the ingredient type label corresponding to the ingredient storage device is determined as the operating parameter of the ingredient storage device; or If the priority of the target ingredient type is higher than the priority of the ingredient type label content corresponding to the ingredient storage device, then the control parameter corresponding to the target ingredient type is determined as the working parameter of the ingredient storage device.

4. The method according to claim 1, characterized in that, After determining the operating parameters of the food storage device based on the target food type, the method further includes: If the priority of the target ingredient type is higher than the priority of the ingredient type tag content corresponding to the ingredient storage device, then the content of the ingredient type tag corresponding to the ingredient storage device is updated to the target ingredient type.

5. The method according to any one of claims 1-4, characterized in that, The food storage device contains multiple food items of different types. The target instructions corresponding to each of the multiple food items are returned sequentially by the user terminal. Determining the operating parameters of the food storage device based on the target food item type includes: From the target ingredient types corresponding to each of the multiple ingredients, obtain the target ingredient type corresponding to the latest received target instruction as the first parameter setting type; The operating parameters of the food storage device are determined based on the first parameter setting type.

6. The method according to any one of claims 1-4, characterized in that, The food storage device contains multiple food items of different types. Determining the operating parameters of the food storage device based on the target food item type includes: Obtain the priority of the target ingredient type corresponding to each of the multiple ingredients; From the target ingredient types corresponding to each of the multiple ingredients, the target ingredient type with the highest priority is selected as the second parameter setting type; The operating parameters of the food storage device are determined according to the second parameter setting type.

7. The method according to any one of claims 1-4, characterized in that, The operating parameters include at least one of temperature, light intensity, and wind speed.

8. The method according to any one of claims 1-4, characterized in that, The communication gateway includes a wireless communication module and a gateway unit. The gateway unit is communicatively connected to the wireless communication module and the food storage device, respectively. The wireless communication module is used to communicate with the user terminal. The gateway unit includes at least one of a MESH gateway and an NFC gateway.

9. The method according to claim 8, characterized in that, The wireless communication module includes an LTE-4G module.

10. A food ingredient identification device, characterized in that, A communication gateway for use in a refrigerator, the refrigerator also including a food storage device, the communication gateway being used to communicate with both the food storage device and a user terminal, the food storage device being used to hold food, the device comprising: The food ingredient data receiving module is used to receive food ingredient data sent by the food ingredient storage device when food ingredients are placed in the food ingredient storage device, and to determine the content of the food ingredient type tag corresponding to the food ingredient storage device as the initial food ingredient type of the food ingredient data; The ingredient data sending module is used to send the ingredient data and the initial ingredient type to the user terminal; The target instruction receiving module is used to receive a target instruction returned by the user terminal based on the food data and the initial food type, wherein the target instruction is a type confirmation instruction or a type correction instruction, the type confirmation instruction is used to indicate that the initial food type is correct, and the type correction instruction is used to indicate the food type to be corrected in the food data; The target ingredient type acquisition module is used to update the initial ingredient type according to the type correction instruction if the target instruction is the type correction instruction, and obtain the target ingredient type. The working parameter determination module is used to determine the working parameters of the food storage device based on the target food type.

11. A refrigerator, characterized in that, include: Food storage equipment for storing food; A communication gateway is used to communicate with the food storage device and the user terminal respectively. One or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications being configured to perform the method as described in any one of claims 1-9.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium contains program code that can be invoked by a processor to execute the method as described in any one of claims 1-9.

Images