Recipe recommendation method, device, server, readable storage medium and system

Abstract

The present disclosure relates to the technical field of recipe recommendation, and in particular to a recipe recommendation method, device, server, readable storage medium and system, the method comprising: obtaining current ingredients in a refrigerator; responding to a user's selection operation of the current ingredients, determining the current ingredients selected by the user as target ingredients; recommending recipes to the user based on the target ingredients; thereby limiting the user's ingredient selection range to the refrigerator, and on this basis, recommending recipes to the user based on the target ingredients selected by the user from the refrigerator, thereby solving the problem of the recipe recommendation method in the prior art that the user does not have corresponding ingredients to make the recommended recipes.

Description

Technical Field

[0001] The present disclosure relates to the field of information interaction technology, and in particular to a recipe recommendation method, device, server, readable storage medium and system. Background Art

[0002] For recipe recommendation, a series of recipes are usually displayed to the user, and the recommended recipe is determined through the user's continuous selection. However, this recipe recommendation method does not consider the feasibility of making the dish corresponding to the recipe, that is, it does not consider whether the ingredients owned by the user match the recipe. Therefore, this recommendation method causes the problem that the user does not have the corresponding ingredients to make the recommended recipe.

[0003] Therefore, there is an urgent need in the art for a recipe recommendation solution to solve the problem that users do not have corresponding ingredients to make the recommended recipes caused by the existing recommendation methods. Summary of the invention

[0004] The present disclosure provides a recipe recommendation method, device, server, readable storage medium and system, which solve the problem in the prior art that users do not have corresponding ingredients to make recommended recipes caused by the recipe recommendation method.

[0005] In a first aspect, the present disclosure provides a recipe recommendation method, which is applied to a server and includes:

[0006] Get the current ingredients in the refrigerator;

[0007] In response to a user's selection operation on a current ingredient, determining the current ingredient selected by the user as a target ingredient;

[0008] Recommend recipes to users based on target ingredients.

[0009] In some embodiments, obtaining the current food in the refrigerator includes:

[0010] Get the image of the food in the refrigerator and identify the current food in the food image.

[0011] In some embodiments, after acquiring the food image in the refrigerator and identifying the current food in the food image, the method further includes:

[0012] Acquire a first image of an operation of taking or putting in food;

[0013] Identify the food in the first image, and identify the first food to be taken or put in;

[0014] Delete the first ingredient from the current ingredients or add it to the current ingredients.

[0015] In some embodiments, after acquiring the food image in the refrigerator and identifying the current food in the food image, the method further includes:

[0016] Compare the currently acquired image of the food in the refrigerator with the previously acquired image of the food in the refrigerator to identify the first food to be taken out or put in;

[0017] Delete the first ingredient from the current ingredients or add it to the current ingredients.

[0018] In some embodiments, after the step of identifying the first food to be taken or put in, the method further includes:

[0019] Sending a prompt message to the user to confirm whether the first food material taken or put in is correct;

[0020] Obtaining a user's response to the prompt information;

[0021] If the response is to confirm that the identified first ingredient taken or put in is correct, the step of deleting the first ingredient from the current ingredients or adding the first ingredient to the current ingredients is performed.

[0022] In some embodiments, if the response is to confirm that the first ingredient taken or put in is incorrect, the user's modification operation on the first ingredient is obtained, and the steps of deleting the first ingredient from the current ingredient or adding the first ingredient to the current ingredient are performed.

[0023] In some embodiments, the step of recommending a recipe to a user based on the target ingredients includes:

[0024] Acquire input user information, wherein the user information includes at least one of a geographic location, a dietary preference, and health information;

[0025] At least one target recipe is recommended to the user based on the user information and the target ingredients.

[0026] In a second aspect, the present disclosure provides a recipe recommendation device, comprising:

[0027] The acquisition module is used to obtain the current ingredients in the refrigerator;

[0028] A response module, used to respond to the user's selection operation on the current ingredient and determine the current ingredient selected by the user as the target ingredient;

[0029] The recommendation module is used to recommend recipes to users based on target ingredients.

[0030] In a third aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method described in the first aspect.

[0031] In a fourth aspect, the present disclosure provides a server, including a processor and a memory, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method described in the first aspect is implemented.

[0032] In a fifth aspect, the present disclosure provides a recipe recommendation system, comprising:

[0033] The server as described in the fourth aspect; and

[0034] The refrigerator comprises at least one storage chamber, each of which comprises at least one storage layer, and a storage layer camera is installed on each of the storage layers. The storage layer camera is used to capture images of food in the refrigerator so that the server can identify the current food in the refrigerator.

[0035] In some embodiments, the refrigerator further includes: a top camera installed on the top of each storage chamber, for collecting a first image of a taking or putting operation on a first food ingredient.

[0036] The present invention obtains the current ingredients in the refrigerator; responds to the user's selection operation on the current ingredients, determines the current ingredients selected by the user as target ingredients; recommends recipes to the user based on the target ingredients; thereby limiting the user's ingredient selection range to the refrigerator, and on this basis, recommends recipes to the user based on the target ingredients selected by the user from the refrigerator, thereby solving the problem of the recipe recommendation method in the prior art that the user does not have corresponding ingredients to make the recommended recipes. Recipes are recommended by the user's selection of the existing ingredients in the refrigerator, which not only fully utilizes the existing ingredients, but also meets the user's personalized needs, and avoids the situation where the user cannot make or does not like the recommended recipes. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The present disclosure will be described in more detail below based on embodiments and with reference to the accompanying drawings:

[0038] Figure 1 A schematic diagram of a recipe recommendation method provided in an embodiment of the present disclosure;

[0039] Figure 2 A structural block diagram of a recipe recommendation device provided by an embodiment of the present disclosure;

[0040] Figure 3 A schematic diagram of a process flow of another recipe recommendation method provided by an embodiment of the present disclosure;

[0041] Figure 4 A structural block diagram of a refrigerator provided by an embodiment of the present disclosure is shown;

[0042] Figure 5 A structural block diagram of a server provided in an embodiment of the present disclosure.

[0043] In the drawings, the same reference numerals are used for the same components, and the drawings are not drawn to scale. DETAILED DESCRIPTION

[0044] In order to enable those skilled in the art to better understand the scheme of the present disclosure, and to fully understand and implement how the present disclosure applies technical means to solve technical problems and achieve the corresponding technical effects, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only embodiments of a part of the present disclosure, not all of the embodiments. The embodiments of the present disclosure and the various features in the embodiments can be combined with each other without conflict, and the technical schemes formed are all within the scope of protection of the present disclosure. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative work should fall within the scope of protection of the present disclosure.

[0045] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0046] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0047] Embodiment 1

[0048] Figure 1 The following is a flow chart of a recipe recommendation method provided by an embodiment of the present disclosure. Figure 1 As shown, a recipe recommendation method is applied to a server, comprising:

[0049] Get the current ingredients in the refrigerator;

[0050] In response to a user's selection operation on a current ingredient, determining the current ingredient selected by the user as a target ingredient;

[0051] Recommend recipes to users based on target ingredients.

[0052] This embodiment obtains the current ingredients in the refrigerator; responds to the user's selection operation on the current ingredients, determines the current ingredients selected by the user as target ingredients; recommends recipes to the user based on the target ingredients; thereby limiting the user's ingredient selection range to the refrigerator, and on this basis, recommends recipes to the user based on the target ingredients selected by the user from the refrigerator, thereby solving the problem in the prior art that the user does not have corresponding ingredients to make the recommended recipes caused by the recipe recommendation method, and avoiding the trouble of the user thinking about the recipe combination by himself.

[0053] In this embodiment, when a user wishes to obtain a recommended recipe, the user selects the current ingredients included in the refrigerator through a terminal such as a mobile phone, and a target ingredient is formed based on the ingredients selected by the user from the current ingredients. On this basis, a recipe is recommended to the user based on the target ingredient. The recommended recipes may be one or more recipes related to the target ingredient. The recipes related to the target ingredient in the database may be sorted according to preset rules (e.g., from high to low in number of recommendations, from high to low in collections / favorites), and then all displayed to the user. Alternatively, the top ranking recipes may be displayed to the user after being sorted according to preset rules for the user to select.

[0054] This embodiment recommends suitable recipes by intelligently matching the current ingredients in the refrigerator, thereby maximizing the value of the current ingredients and achieving the technical effect of saving food.

[0055] In addition, while obtaining the current ingredients in the refrigerator, this embodiment can also obtain relevant information of the current ingredients, including the name of the ingredients, the number of days they remain fresh, and their nutritional value, etc., so as to organize the detailed information of the remaining ingredients (current ingredients) in the refrigerator for the user, eliminating the need for the user to open the refrigerator door to check the ingredients one by one, thereby reducing the user's tedious food management work.

[0056] Embodiment 2

[0057] Based on the above embodiment, the step of obtaining the current food in the refrigerator includes:

[0058] Get the image of the food in the refrigerator and identify the current food in the food image.

[0059] Specifically, the server uses an image recognition algorithm to compare the feature points of the food image with the food images pre-stored in the database, identify the food, and give the food name result. The feature points of the food images pre-stored in the database are obtained through training on a large number of food images, so the recognition accuracy is high and the quantity of the food can be accurately identified.

[0060] In a preferred embodiment, after acquiring the food image in the refrigerator and identifying the current food in the food image, the method further includes:

[0061] Acquire a first image of an operation of taking or putting in food;

[0062] Identify the food in the first image, and identify the first food to be taken or put in;

[0063] Delete the first ingredient from the current ingredients or add it to the current ingredients.

[0064] Specifically, by collecting images of the user's operation of taking or putting in food and identifying the first food taken or put in, the food taken or put in each time can be accurately identified to update the current food.

[0065] In this embodiment, the refrigerator includes at least one storage chamber, each storage chamber includes at least one storage layer, a storage layer camera is installed on each storage layer, and a top camera is installed on the top of each storage chamber. The top camera can be used to capture the user's action (operation) of taking / putting in food, and intercept a first image containing the food taken or put in. For example, when the food is exposed by more than 50% and the intercepted image is clear, the first food information can be directly identified through the screenshot of the video recorded by the top camera. On this basis, the information of the first food is deleted from the current food or added to the current food.

[0066] This embodiment can accurately identify which storage layer in the refrigerator has added / reduced ingredients, as well as information such as the type and quantity of ingredients through an image recognition algorithm. It can automatically help users organize detailed information about the remaining ingredients (current ingredients) in the refrigerator through image recognition technology, including the type of ingredients, their location in the refrigerator (including which storage room and which storage layer), quantity, shelf life, nutritional value, compatibility and other ingredient information. This eliminates the need for users to open the refrigerator door to check the ingredients one by one, thereby reducing the user's tedious food management work.

[0067] Embodiment 3

[0068] Based on the above embodiment, the step of obtaining the current food in the refrigerator includes:

[0069] Get the image of the food in the refrigerator and identify the current food in the food image.

[0070] In a preferred embodiment, after acquiring the food image in the refrigerator and identifying the current food in the food image, the method further includes:

[0071] Compare the currently acquired image of the food in the refrigerator with the previously acquired image of the food in the refrigerator to identify the first food to be taken out or put in;

[0072] Delete the first ingredient from the current ingredients or add it to the current ingredients.

[0073] In practical applications, an image of the food in the refrigerator can be taken each time the refrigerator door is closed. Therefore, by comparing the images of the food in the refrigerator taken twice after the door is closed, the first food taken out or put in can be identified.

[0074] In some cases, the refrigerator includes at least one storage chamber, each storage chamber includes at least one storage layer, a storage layer camera is installed on each storage layer, and a top camera is installed on the top of each storage chamber. The top camera can be used to take a video of the user's action (operation) of taking / putting in food, and intercept the first image of the food taken or put in. For example, when the food is exposed by more than 50% and the intercepted image is clear, the first food information can be directly identified by the screenshot of the video recorded by the top camera. On this basis, the information of the first food is deleted from the current food or added to the current food. When the food is exposed by more than 50% but the intercepted first image is not clear or the food taken or put in cannot be identified based on the first image, this embodiment can also be used to compare the food image currently obtained in the refrigerator with the food image obtained in the refrigerator last time, so as to identify the information of the first food taken or put in. On this basis, the information of the first food is deleted from the current food or added to the current food.

[0075] In order to further improve the comparison efficiency and the accuracy of the recognition results, when more than 50% of the food is exposed but the first image is not clear or the food to be taken or put in cannot be identified based on the first image, the color information of the first food can be identified based on the first image, and the information of the first food to be taken or put in can be accurately identified by combining the result of comparing the food image currently obtained in the refrigerator with the food image obtained in the refrigerator last time. On this basis, the information of the first food is deleted from the current food or added to the current food. That is, when the user takes / puts in food too quickly and the video capture is blurred, the function of the top camera is to record the color of the food, and then compare the current picture taken by the storage layer camera with the picture taken when the door was closed last time, combined with the color information of the identified food, it can more accurately identify the first food taken / put in by the user.

[0076] Embodiment 4

[0077] Based on the above embodiment, after the step of identifying the first food to be taken or put in, the method further includes:

[0078] Sending a prompt message to the user to confirm whether the first food material taken or put in is correct;

[0079] Obtaining a user's response to the prompt information;

[0080] If the response is to confirm that the identified first ingredient taken or put in is correct, the step of deleting the first ingredient from the current ingredients or adding the first ingredient to the current ingredients is performed.

[0081] If the response is to confirm that the first ingredient taken or put in is incorrect, then the user's modification operation on the first ingredient is obtained, and the steps of deleting the first ingredient from the current ingredient or adding the first ingredient to the current ingredient are performed.

[0082] In actual application, after the server identifies the first ingredient to be taken or put in, it obtains the name of the first ingredient, and organizes the first ingredient image corresponding to the name of the first ingredient, the nutritional information of the ingredient, the recommended fresh-keeping days of the ingredient, and the location of the first ingredient in the refrigerator, and sends the organized result to the APP of the user's mobile phone. The APP will prompt the user that there is information about the ingredients to be taken / put in, and the user compares the information of the ingredients taken / put in the refrigerator on the APP to see if it is accurate. When the user receives the prompt information, he can check it immediately or later. When checking the prompt information, the user checks whether the result of the first ingredient to be taken or put in identified by the server is correct. If it is correct, confirm it. Otherwise, the user can modify the wrong recognition result through the APP and save the correct first ingredient information. For example, when the user checks and finds that the ingredient information is entered incorrectly, the incorrect information can be modified by manually entering the correct information, such as modifying the name or quantity of the ingredient. The modified information will be saved to the server for management.

[0083] Users can also view the food information of the refrigerator in the APP, such as the remaining ingredients in the refrigerator (current ingredients) and their quantity, as well as the type of remaining ingredients, their location in the refrigerator, their shelf life, nutritional value, compatibility and incompatibility, and other food information.

[0084] In addition, the server will record the removal of ingredients. When an ingredient is taken out of the refrigerator, the server will send a message to the APP to notify the user that the ingredient has been taken out. If the ingredient has not been taken out, the user will be reminded to eat it as soon as possible before the ingredient is about to expire.

[0085] Embodiment 5

[0086] Based on the above embodiment, the step of generating a recipe to be recommended according to the target ingredients includes:

[0087] Acquire input user information, wherein the user information includes at least one of a geographic location, a dietary preference, and health information;

[0088] At least one target recipe is recommended to the user based on the user information and the target ingredients.

[0089] In actual applications, when users select target ingredients on their mobile phone APP, they can voluntarily fill in and input user information related to themselves, including: geographical location, dietary preferences, and health information. When recommending recipes, the server recommends the recipe that best meets the user's needs based on at least one of the user's location information, dietary preferences, and health information, and based on the user information entered by the user and the target ingredients selected by the user, to achieve a personalized recipe recommendation effect.

[0090] If the user information is empty, that is, the user does not choose to input user information to assist in recommending recipes, at least one recipe can be directly recommended to the user based on the target ingredients selected by the user. Of course, in some cases, the user's geographical location can also be inferred from the current ingredients, for example, the user's geographical location can be inferred based on the geographical location information of the current ingredients, and the dietary preferences can also be inferred based on the category of the target ingredients selected by the user, which will not be listed here one by one.

[0091] by Figure 3 The process shown in FIG. 1 is taken as an example to illustrate the practical application of the above-mentioned embodiment of the present disclosure. Figure 3 As shown, when the user puts food into the refrigerator, the camera in the refrigerator collects the current food image and transmits it to the server. The server compares the currently captured image with the image taken after the refrigerator door was closed last time. If the two are inconsistent, it means that new food has been added to the refrigerator. At this time, the newly added (put in) food is identified, and the relevant information of the food is sorted out and sent to the user's mobile phone APP for display. The user confirms whether to modify the food information. If no modification is required, the user selects the target food. The server selects recipes that match the selected target food from the database based on the target food and recommends them to the user. The user can view the recommended recipes through the mobile phone APP.

[0092] Preferably, the user views the ingredients in the refrigerator on the APP and selects the target ingredients they want to eat. The server compares and searches in the server's database according to the target ingredients selected by the user, and recommends recipes related to the target ingredients. That is, the user selects several ingredients of his or her preference according to the ingredient information he or she has seen, and sends the combination to the server. The server compares and searches in the server database according to the several ingredient combinations selected by the user, and feeds back a recipe containing the ingredient combination selected by the user. In the comparison and search process, recipes with high coupling are sorted in order and recommended to the user through a large number of analysis and comparisons. The user can choose his or her favorite recipe from one or more recommended recipes in the APP.

[0093] In this embodiment, when a user wishes to recommend a recipe, the user selects a target ingredient from the current ingredients. After learning the target ingredient information selected by the user, the server screens the recipe ingredient information stored in the database to obtain a recipe containing the target ingredient name. On this basis, the server further calculates the overlap between the recipe ingredient information and the ingredient information selected by the user, and sorts the recipes according to the overlap.

[0094] For example, if the user selects three ingredients, and there is a recipe A in the database that requires the three ingredients selected by the user, then the recipe A will be ranked first and recommended to the user. In addition, location information can be added to analyze the user's location, and the local food preferences can be added to the ranking judgment conditions, so as to more accurately recommend the user's favorite recipes.

[0095] In this embodiment, recipe data is pre-stored in the server, and the recipe data includes ingredients corresponding to the recipe. The recipe data is entered into the server in advance by professional personnel.

[0096] In this embodiment, users can view recipes generated by the ingredients they choose on the APP, select their favorite recipes, and watch cooking tutorials. This recipe is uploaded to the server in advance, including teaching videos, graphic steps, and the quantity of ingredients, etc., which can guide users to cook according to the recipe steps and make delicious dishes. For example, in this embodiment, when a recipe is entered into the server, recipe information such as the name of the recipe, the name and weight of the required ingredients, the name and weight of the auxiliary ingredients, the cooking steps, and the recipe taste classification label will be entered.

[0097] Embodiment 6

[0098] Figure 2 A structural block diagram of a recipe recommendation device provided by an embodiment of the present disclosure, such as Figure 2 As shown, the recipe recommendation device comprises:

[0099] The acquisition module is used to obtain the current ingredients in the refrigerator;

[0100] A response module, used to respond to the user's selection operation on the current ingredient and determine the current ingredient selected by the user as the target ingredient;

[0101] The recommendation module is used to recommend recipes to users based on target ingredients.

[0102] It can be understood that the acquisition module can be used to execute the step of acquiring the current ingredients in the refrigerator in the recipe recommendation method in the aforementioned embodiment, the response module can be used to execute the step of responding to the user's selection of the current ingredients in the recipe recommendation method in the aforementioned embodiment and determining the current ingredients selected by the user as the target ingredients, and the recommendation module can be used to execute the step of recommending recipes to the user based on the target ingredients in the recipe recommendation method in the aforementioned embodiment. Please refer to the specific description of the aforementioned embodiment for the specific content of each step, which will not be repeated in this embodiment.

[0103] This embodiment obtains the current ingredients in the refrigerator; responds to the user's selection operation on the current ingredients, determines the current ingredients selected by the user as target ingredients; recommends recipes to the user based on the target ingredients; thereby limiting the user's ingredient selection range to the refrigerator, and on this basis, recommends recipes to the user based on the target ingredients selected by the user from the refrigerator, thereby solving the problem in the prior art that the user does not have corresponding ingredients to make the recommended recipes caused by the recipe recommendation method, and avoiding the trouble of the user thinking about the recipe combination by himself.

[0104] In this embodiment, when a user wishes to obtain a recommended recipe, the user selects the current ingredients included in the refrigerator through a terminal such as a mobile phone, and a target ingredient is formed based on the ingredients selected by the user from the current ingredients. On this basis, a recipe is recommended to the user based on the target ingredient. The recommended recipes may be one or more recipes related to the target ingredient. The recipes related to the target ingredient in the database may be sorted according to preset rules (e.g., from high to low in number of recommendations, from high to low in collections / favorites), and then all displayed to the user. Alternatively, the top ranking recipes may be displayed to the user after being sorted according to preset rules for the user to select.

[0105] This embodiment recommends suitable recipes by intelligently matching the current ingredients in the refrigerator, thereby maximizing the value of the current ingredients and achieving the technical effect of saving food.

[0106] In addition, while obtaining the current ingredients in the refrigerator, this embodiment can also obtain relevant information of the current ingredients, including the name of the ingredients, the number of days they remain fresh, and their nutritional value, etc., so as to organize the detailed information of the remaining ingredients (current ingredients) in the refrigerator for the user, eliminating the need for the user to open the refrigerator door to check the ingredients one by one, thereby reducing the user's tedious food management work.

[0107] Embodiment 7

[0108] On the basis of the above embodiments, this embodiment provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the method described in the above embodiments is implemented.

[0109] The above-mentioned storage media can be flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, CD, server, App application store, etc.

[0110] Embodiment 8

[0111] Based on the above embodiments, Figure 5 This is a structural block diagram of a server provided by an embodiment of the present disclosure. This embodiment provides a server, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method described in the above embodiment is implemented.

[0112] The processor can be an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a controller, a microcontroller, a microprocessor or other electronic components to execute the methods in the above embodiments.

[0113] The memory can be implemented by any type of volatile or non-volatile storage device or a combination of them, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0114] Embodiment 9

[0115] Based on the above embodiments, the present disclosure provides a recipe recommendation system, including:

[0116] The server defined in the above embodiment; and

[0117] The refrigerator comprises at least one storage chamber, each of which comprises at least one storage layer, and a storage layer camera is installed on each of the storage layers. The storage layer camera is used to capture images of food in the refrigerator so that the server can identify the current food in the refrigerator.

[0118] The refrigerator further includes: a top camera installed on the top of each storage chamber, for collecting a first image of a first food item being taken out or put in. A camera module for photographing food items is installed in the refrigerator, and has the functions of taking and uploading pictures.

[0119] Among them, the storage layer camera and the top camera can use camera modules.

[0120] Figure 4 FIG. 1 is a schematic diagram showing the structure of a refrigerator provided by an embodiment of the present disclosure, wherein only the refrigerating chamber portion is shown. Figure 4As shown, in this embodiment, a camera module is installed in the refrigerator, and the storage room includes a cold storage room, a variable temperature room, and a freezer room, wherein the cold storage room is divided into four storage layers, namely: a1, a2, a3, and a4, and the freezer room is divided into three storage layers, namely: b1, b2, and b3, and the variable temperature room is: c1. Each time the door of the storage room is closed, the camera module of each storage layer takes a group of pictures and transmits them to the server via WiFi. Taking the cold storage room as an example, 5 high-speed capture cameras can be set, of which 4 are four storage layer cameras 401, and the other is a top camera 402, which cooperate with each other to achieve 360-degree accurate identification of food in the refrigerator without dead angles. The other storage layers are similar, and examples are not given here one by one. The top camera takes images to identify the food when the user puts in or takes out the food. When the captured image is blurred, it can also be compared with the image taken by the storage layer camera to improve the accuracy of recognition.

[0121] In the embodiments provided in the present disclosure, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the above-mentioned module, program segment or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0122] It should be noted that in the present disclosure, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element limited by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0123] Although the embodiments disclosed in the present disclosure are as above, the above contents are only embodiments adopted for facilitating the understanding of the present disclosure and are not intended to limit the present disclosure. Any technician in the technical field to which the present disclosure belongs can make any modifications and changes in the form and details of the implementation without departing from the spirit and scope disclosed in the present disclosure, but the scope of patent protection of the present disclosure shall still be subject to the scope defined in the attached claims.

Claims

1. A recipe recommendation method, the method is applied to a server, characterized in that: The method comprises: Acquire a first image of a food taking operation captured by a camera device at the top of a refrigerator storage compartment; Identify the food in the first image; wherein, when the food to be taken cannot be identified based on the first image taken by the top camera device, use the storage layer camera device of the refrigerator storage chamber to obtain the current image of the food in the refrigerator; compare the current image of the food in the refrigerator with the image of the food in the refrigerator previously obtained by the storage layer camera device to obtain a comparison result; determine the first food based on the comparison result and the color of the first food identified based on the first image; Remove the first ingredient from the current ingredients; In response to a user's selection operation on a current ingredient, determining the current ingredient selected by the user as a target ingredient; Recommend recipes to users based on target ingredients.

2. The recipe recommendation method according to claim 1, characterized in that: After the step of identifying the first food to be taken, the method further includes: Sending a prompt message to the user to confirm whether the first food item taken is correct; Obtaining a user's response to the prompt information; If the response is to confirm that the identified first ingredient taken is correct, then the step of deleting the first ingredient from the current ingredients is performed.

3. The recipe recommendation method according to claim 2, characterized in that: If the response is to confirm that the first ingredient taken is incorrect, then the user's modification operation on the first ingredient is obtained, and a step of deleting the first ingredient from the current ingredients is performed.

4. The recipe recommendation method according to claim 1, characterized in that: The step of recommending a recipe to a user according to the target ingredients comprises: Acquire input user information, wherein the user information includes at least one of a geographic location, a dietary preference, and health information; At least one target recipe is recommended to the user based on the user information and the target ingredients.

5. A device based on the recipe recommendation method according to any one of claims 1 to 4, characterized in that: include: The acquisition module is used to obtain the current ingredients in the refrigerator; A response module, used to respond to the user's selection operation on the current ingredient and determine the current ingredient selected by the user as the target ingredient; The recommendation module is used to recommend recipes to users based on target ingredients.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.

7. A server, characterized in that: The method comprises a processor and a memory, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method according to any one of claims 1 to 4 is implemented.

8. A recipe recommendation system, characterized in that: include: The server according to claim 7; as well as The refrigerator comprises at least one storage chamber, each of which comprises at least one storage layer, and a storage layer camera is installed on each of the storage layers. The storage layer camera is used to capture images of food in the refrigerator so that the server can identify the current food in the refrigerator.

Images