Menu suggestion system

Abstract

By ensuring expiration dates that can lead to food waste, and by preventing food from accumulating unattended by users, we aim to improve the efficiency of food consumption. [Solution] A menu suggestion system that proposes menus using information about ingredients stored in a refrigerator comprises: a storage unit that stores the target date for using up the ingredients and the number of days elapsed since the ingredients were stored; a date and time determination unit that determines multiple dates and times for suggesting menus; an ingredient determination unit that determines which ingredients to be used on which date and time from the ingredients stored in the refrigerator; and a menu determination unit that determines a menu using the ingredients determined by the ingredient determination unit. The ingredient determination unit narrows down the ingredients stored in the refrigerator to those with the closest target date for using up, and then narrows down the narrowed-down ingredients to those with the longest elapsed time.

Description

Technical Field

[0001] The present invention relates to a menu proposal system.

Background Art

[0002] Patent Document 1 discloses a menu planning device that divides the menu planning period set by a user into unit periods, selects ingredients whose expiration dates fall within a predetermined period from the start time of the unit period as priority ingredients, and plans a menu (paragraphs 0013 - 0014, 0017, FIGS. 4 - 5).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technology disclosed in Patent Document 1, ingredients with the same expiration date are treated in the same way. However, even for ingredients with the same expiration date, ingredients with a longer number of days elapsed since being stored in the refrigerator are considered to be less user - friendly and more likely to remain for the user compared to ingredients with a shorter number of days elapsed. Therefore, it is preferable to encourage the user to consume ingredients with a longer number of days elapsed.

Means for Solving the Problems

[0005] To solve the above problems, the present invention provides a menu suggestion system that proposes menus using information on ingredients stored in a refrigerator, comprising: a storage unit that stores the target date for using up the ingredients and the number of days elapsed since the ingredients were stored; a date and time determination unit that determines a plurality of dates and times for suggesting menus; an ingredient determination unit that determines which ingredients to be used on which date and time from the ingredients stored in the refrigerator; and a menu determination unit that determines a menu using the ingredients determined by the ingredient determination unit, wherein the ingredient determination unit narrows down the ingredients stored in the refrigerator to those with the closest target date for using up, and then narrows down the narrowed-down ingredients to those with the longest elapsed time. [Effects of the Invention]

[0006] According to the present invention, it is possible to ensure that expiration dates that lead to food waste are met, while also preventing food from accumulating unattended by users, thereby improving the efficiency of food consumption. [Brief explanation of the drawing]

[0007] [Figure 1] System configuration diagram of a menu suggestion system in an embodiment of the present invention. [Figure 2] Functional block diagram of a home appliance in an embodiment of the present invention. [Figure 3] Functional block diagram of a terminal device in an embodiment of the present invention. [Figure 4] Hardware configuration diagram of a terminal device in an embodiment of the present invention. [Figure 5] Hardware configuration diagram of a menu suggestion device in an embodiment of the present invention. [Figure 6] A diagram showing user management information used in embodiments of the present invention. [Figure 7] A diagram showing information on stored food items used in an embodiment of the present invention. [Figure 8] A diagram showing shopping memo information used in an embodiment of the present invention. [Figure 9] A diagram showing recipe information used in embodiments of the present invention. [Figure 10]Diagram showing device information used in an embodiment of the present invention. [Figure 11] Diagram showing the My Menu screen in an embodiment of the present invention. [Figure 12] Diagram showing the "Collective Menu Proposal" screen. [Figure 13] Diagram showing the manual food ingredient registration screen. [Figure 14] Confirmation screen indicating that a menu proposal utilizing household appliances is in progress. [Figure 15] Screen showing the proposal result of the "Collective Menu Proposal". [Figure 16A] Diagram showing the method for determining the food ingredients on the first day (the result of the first narrowing down). [Figure 16B] Diagram showing the method for determining the food ingredients on the first day (the result of the second narrowing down). [Figure 16C] Diagram showing the method for determining the food ingredients on the second day (before narrowing down). [Figure 16D] Diagram showing the method for determining the food ingredients on the second day (the result of narrowing down). [Figure 16E] Diagram showing the method for determining the food ingredients on the sixth day (before narrowing down). [Figure 16F] Diagram showing the method for determining the food ingredients on the sixth day (the result of narrowing down). [Figure 16G] Diagram showing the method for determining the food ingredients on the seventh day (before narrowing down). [Figure 17] Diagram showing the shopping memo screen in an embodiment of the present invention. [Figure 18] Screen showing the inventory list. [Figure 19] Diagram showing the recipe trend screen in an embodiment of the present invention. [Figure 20] Diagram showing another My Menu screen in an embodiment of the present invention. [Figure 21] Diagram showing yet another My Menu screen in an embodiment of the present invention.

Modes for Carrying Out the Invention

[0008] Hereinafter, embodiments of the present invention will be described.

[0009] Figure 1 is a system configuration diagram of the menu suggestion system in this embodiment. In Figure 1, household appliances such as a refrigerator 31, an induction cooktop 32, and a microwave oven 33 are used within house 1, and household chores are performed. It is also assumed that the occupants of house 1, i.e., the people performing the household chores, have terminal devices 10. These household appliances and terminal devices 10 can be connected to each other via a router 40 or directly.

[0010] The menu suggestion device 20 is connected to the network 50. Furthermore, these home appliances and terminal devices 10 are connected to the network 50, which can be realized via the router 40 or directly via the internet. The connections between the terminal devices 10, home appliances, router 40, and network 50 can be wired or wireless. The following describes each of these devices.

[0011] First, in House 1, a refrigerator 31, an induction cooktop 32, and a microwave oven 33 are used as home appliances. Note that House 1 is just one example of an area where home appliances are used, and this embodiment can be applied to other areas as well. Furthermore, there may be multiple areas of use. In addition, each of the above-mentioned home appliances is just an example, and only a part of them may be used, or other home appliances may be added. In particular, the refrigerator 31 is just one example of a storage unit that can store food, and other storage units such as a pantry or wine cellar may also be used, and in this embodiment, these storage units are also treated as home appliances. Similarly, the induction cooktop 32 and microwave oven 33 are just examples, and other cooking appliances may be used, or at least one of them may be omitted.

[0012] Here, Figure 2 is a functional block diagram of the home appliance in this embodiment. As shown in Figure 2, the home appliance has a control unit 301, a home appliance communication unit 302, a display and operation panel 303, an operating unit 304, and a sensor unit 305. These are connected to each other via a communication path. The following describes each of the components.

[0013] The control unit 301 creates and outputs control signals to realize the functions of the home appliance, such as cooling and heating, and controls the operation of the home appliance. The control unit 301 can be implemented using an MPU (Micro-Processing Unit), and can also be implemented using dedicated hardware or software such as programs.

[0014] The home appliance communication unit 302 has communication and short-range wireless communication functions via the router 40 and network 50. The home appliance communication unit 302 also outputs information and operating status detected by the sensor unit 305, and receives control instructions from terminal devices 10 and menu suggestion devices 20, etc.

[0015] The display and operation panel 305 receives commands from the user for operation of the home appliance and outputs the operating status of the home appliance. The display and operation panel 305 may also be configured by separating it into an operation section (e.g., buttons) for receiving commands and an output section such as a display section for displaying information.

[0016] The operating unit 304 performs various functions according to the control from the control unit 301. These functions include cooling and heating, and can be implemented using compressors, motors, actuators, etc.

[0017] The sensor unit 305 detects the operating status of home appliances. For example, in the case of a refrigerator, the sensor unit 304 detects the temperature inside the refrigerator, and if the refrigerator is equipped with a camera, the sensor unit 305 acquires an image of the inside of the refrigerator.

[0018] Next, the terminal device 10 will be described. The terminal device 10 is used by the user to manage home appliances and can be implemented as a computer such as a smartphone, mobile phone, tablet, or PC. Furthermore, when the terminal device 10 is implemented as a so-called mobile computer such as a smartphone, it can be used not only inside the house 1 but also outdoors. In addition, although only one terminal device 10 is shown in Figure 1, multiple devices may be prepared for each family member, or a user may use multiple terminal devices 10.

[0019] Here, Figure 3 is a functional block diagram of the terminal device 10 in this embodiment. In Figure 3, the terminal device 10 includes a terminal communication unit 11, a shooting unit 12, a display information creation unit 13, a user information management unit 14, a food ingredient management unit 15, a date and time determination unit 16a, a food ingredient determination unit 16b, a menu determination unit 16c, a shopping memo management unit 17, an input unit 18, an output unit 19, and a storage unit 100.

[0020] The terminal communication unit 11 has communication and short-range wireless communication functions via the router 40 and network 50. The shooting unit 12 has a camera-like shooting function. The display information creation unit 13 creates information to be displayed on the terminal device 10. The user information management unit 14 manages user management information 110 related to the user of the terminal device 10. The food ingredient management unit 15 manages the food ingredients managed and stored in the house 1. The date and time determination unit 16a determines multiple dates and times for proposing a menu. The food ingredient determination unit 16b determines the food ingredients to be used on the date and time determined by the date and time determination unit 16a. The menu determination unit 16c determines a menu using the food ingredients determined by the food ingredient determination unit 16b. The shopping memo management unit 17 manages shopping memos indicating the food ingredients that the user wishes to purchase.

[0021] The input unit 18 accepts various operations from the user. The output unit 19 outputs various information such as menu suggestions. The input unit 18 and the output unit 19 can be integrated into a single unit, like a touch panel. Furthermore, the storage unit 100 stores image data captured by the shooting unit 12, processing in the display information creation unit 13 to the shopping memo management unit 17, and various information used in processing by home appliances and the menu suggestion device 20. If a camera for capturing images of the inside of the refrigerator is installed on top of the refrigerator, it is not necessary to take images on the terminal side. When such a camera is installed on top of the refrigerator, it is possible to capture and store images of the shelves and door pockets of the refrigerator compartment, the vegetable compartment, the freezer, etc., at the time the user opens and closes the refrigerator.

[0022] Here, we will describe one implementation example of the terminal device 10. Figure 4 is a hardware configuration diagram of the terminal device 10 in this embodiment. In Figure 4, the terminal device 10 includes a touch panel 101, a processing unit 102, a communication device 103, a storage device 104, and a camera, which are connected to each other via a communication path.

[0023] First, the touch panel 101 has a configuration that also serves as the input unit 18 and output unit 19 in Figure 3, and accepts user operations and displays various information. The touch panel 101 may also be configured as separate input and output devices. Furthermore, the processing unit 102 can be implemented as a processor such as a CPU (Central Processing Unit) and performs calculations according to the home appliance management program 105 (integrated application) stored in the storage device 104, which will be described later.

[0024] The home appliance management program 105 is composed of, according to its function, a user management module 106, a food ingredient management module 107, a date and time determination module 108a, a food ingredient determination module 108b, a menu determination module 108c, and a shopping memo management module 109. Note that each of these modules may be implemented as an individual program or as a combination of some of them.

[0025] Here, the configuration shown in Figure 3, which performs the same function as each module, is as follows: User Management Module 106: User Information Management Unit 14 Food ingredient management module 107: Food ingredient management department 15 Date and time determination module 108a: Date and time determination unit 16a Ingredient selection module 108b: Ingredient selection unit 16b Menu determination module 108c: Menu determination unit 16c Shopping list management module 109: Shopping list management section 17 Note that the display information creation unit 13 in Figure 3 is assumed to function on an OS (Operating System) not shown on the terminal device 10. However, it may be implemented as a function of the home appliance management program 105, or as a separate application program.

[0026] Therefore, the processing unit 102 will perform calculations corresponding to the processing of the user information management unit 14, the food ingredient management unit 15, the date and time determination unit 16a, the food ingredient determination unit 16b, the menu determination unit 16c, and the shopping memo management unit 16, in accordance with the home appliance management program 105.

[0027] Furthermore, the storage device 104 stores the home appliance management program 105, user management information 110, stored food information 111, shopping memo information 112, recipe information 113, and device information 114. Here, the home appliance management program 105 may be a program for general-purpose and integrated management of home appliances, or it may consist of multiple programs for each home appliance. In the latter case, separate management programs for the refrigerator 31, induction cooker 32, and microwave oven 33 would be used. The user management information 110, stored food information 111, shopping memo information 112, recipe information 113, and device information 114 will be explained later when describing the information stored by the menu suggestion device. The home appliance management program 105 may also be implemented as a menu suggestion program whose main function is menu suggestion.

[0028] Furthermore, the storage device 104 may be implemented as a main memory device such as memory and a secondary memory device (storage medium) which is a so-called storage device. The secondary memory device may be implemented as an external HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, etc. In addition, at least a portion of the home appliance management program 105, user management information 110, stored food information 111, shopping memo information 112, recipe information 113, and device information 114 can be omitted. This can be maintained by the menu suggestion device 20 described later. Furthermore, at least a portion of the modules (functions) of the home appliance management program 105 may be provided in the home appliance or the menu suggestion device 20.

[0029] This concludes the explanation of Figure 4, and we will now return to the explanation of Figure 1. The menu suggestion device 20 can be implemented using computers such as servers and clouds. The menu suggestion device 20 also includes a device communication unit 21, a display information creation unit 22, a user information management unit 23, a food ingredient management unit 24, a date and time determination unit 25a, a food ingredient determination unit 25b, a menu determination unit 25c, a shopping memo management unit 26, and a storage unit 27.

[0030] Here, the device communication unit 21 connects to the terminal device 10 and home appliances via the network 50. The display information creation unit 22 creates information to be displayed on the terminal device 10, similar to the display information creation unit 13 of the terminal device 10. The user information management unit 23 manages user management information 271 related to the users of the terminal device 10. The food ingredient management unit 24 manages food ingredients managed and stored in the house 1, similar to the food ingredient management unit 15 of the terminal device 10. The date and time determination unit 25a determines multiple dates and times for proposing a menu, similar to the date and time determination unit 16a of the terminal device 10. The food ingredient determination unit 25b determines the food ingredients to be used on the date and time determined by the date and time determination unit 25a. The menu determination unit 25c determines a menu using the food ingredients determined by the food ingredient determination unit 25b. The shopping memo management unit 26 manages shopping memos, similar to the shopping memo management unit 17 of the terminal device 10.

[0031] Furthermore, the memory unit 27 stores user management information 271, stored food information 272, shopping memo information 273, recipe information 274, and equipment information 275. These pieces of information will be explained later, but before that, let's describe one implementation example of the menu suggestion device 20.

[0032] Figure 5 is a hardware diagram of the menu suggestion device 20 in this embodiment. In Figure 5, the menu suggestion device 20 includes a processing unit 201, a communication device 202, a memory 203, and a sub-storage device 204, which are connected to each other via a communication path.

[0033] First, the processing unit 201 can be implemented using a processor such as a CPU, and it performs calculations according to the home appliance management program 205 stored in the secondary memory device 204, which will be described later. The home appliance management program 205 will be described later.

[0034] Furthermore, the communication device 202 corresponds to the device communication unit 21 in Figure 1, connects to the network 50, and communicates with other devices.

[0035] Furthermore, the memory 203 and the secondary storage device 204 correspond to the storage unit 27 in Figure 1. The memory 203 is where the home appliance management program 205 and information used for processing by the processing unit 201, which are stored in the secondary storage device 204, are loaded. The secondary storage device 204 can be implemented as a so-called storage device. The secondary storage device 204 stores the home appliance management program 205, user management information 271, stored food information 272, shopping memo information 273, recipe information 274, and device information 275. The secondary storage device 204 may also be implemented as various storage media such as an external HDD (Hard Disk Drive), SSD (Solid State Drive), or memory card, or it may be implemented as a separate device from the menu suggestion device 20, such as a file server.

[0036] Here, the home appliance management program 205 consists of a user information management module 206, a food ingredient management module 207, a date and time determination module 208a, a food ingredient determination module 208b, a menu determination module 208c, and a shopping memo management module 209. Note that each of these modules may be implemented as an individual program or a combination of some of them. Furthermore, the home appliance management program 205 may be implemented as a menu suggestion program whose main function is menu suggestion.

[0037] Here, the configuration shown in Figure 1, which performs the same function as each module, is as follows: User Information Management Module 206: User Information Management Department 23 Food ingredient management module 207: Food ingredient management department 24 Date and time determination module 208a: Date and time determination unit 25a Ingredient selection module 208b: Ingredient selection unit 25b Menu determination module 208c: Menu determination unit 25c Shopping list management module 209: Shopping list management section 26 Therefore, the processing unit 201 will execute the processing of the user information management unit 23, the food ingredient management unit 24, the date and time determination unit 25a, the food ingredient determination unit 25b, the menu determination unit 25c, and the shopping memo management unit 25 in accordance with the home appliance management program 205.

[0038] Note that the display information creation unit 22 in Figure 1 is assumed to function on an OS (Operating System) not shown in the menu suggestion device 20. However, it may also be implemented as a function of the home appliance management program 205, or as a separate application program.

[0039] Next, we will explain the information stored in the secondary memory device 204.

[0040] First, Figure 6 shows the user management information 271 used in this embodiment. User management information 271 is information about users who use home appliances. In Figure 6, the user management information 271 has items for each user, such as owned appliances, food preferences, and nutritional awareness. Owned appliances refer to the home appliances owned by the user. For example, home appliances purchased from an e-commerce site associated with the business that manages the menu suggestion device 20 may be automatically registered in the user management information 271. Alternatively, the user may manually register home appliances in the user management information 271 using the terminal device 10.

[0041] Food preference indicates the degree of preference for certain foods, and parameters can be set in three stages: less, normal, and more for meat, seafood, and vegetables. Nutrient awareness indicates the degree of desired intake, and parameters can be set using numerical values ​​from 0 to 100 for calories, salt, carbohydrates, fat, protein, and dietary fiber. Food preference and nutrient awareness are reflected in user management information 271 when set or changed by the user on the recipe trend screen shown in Figure 19 below. In addition, user management information 271 may also include the user's address, telephone number, email address, and other contact information. Furthermore, user management information 110 stored in terminal device 10 may have the same items as user management information 271 and consist of records of users using terminal device 10.

[0042] Next, Figure 7 shows the stored food information 272 used in this embodiment. The stored food information 272 is information about food stored in the house 1, such as the refrigerator 31. In Figure 7, the stored food information 272 has the following items for each user: food name, quantity, elapsed days, and target use date. If the refrigerator 31 is equipped with a camera that takes images of the inside of the refrigerator, the food name and quantity are automatically registered by analyzing the images acquired by the camera, but the user may also register them manually using the terminal device 10. In addition to the quantity of food, the amount of food may also be entered manually or automatically. The elapsed days is the number of days that have elapsed from the storage date and time when the food was stored in the refrigerator 31 to the present. The storage date and time corresponds to the date and time when the food name and quantity of the new food were registered as stored food information 272. The target use date is manually registered by the user as the date on which they want to use the food, and does not necessarily have to be the expiration date or best-before date. Furthermore, while Figure 7 shows the number of days remaining until the target date for using up the product, calculated from the present, a specific date could also be used.

[0043] The stored food information 272 may include images of food items acquired by a camera installed in the refrigerator 31 or by the imaging unit 12 of the terminal device 10, and may also include information such as the location where the food items are stored, such as the refrigerator compartment or vegetable compartment. Furthermore, the stored food information 111 stored in the terminal device 10 may have the same items as the stored food information 272 and may consist of records of users using the terminal device 10.

[0044] Next, Figure 8 shows the shopping memo information 273 used in this embodiment. The shopping memo information 273 is information about the ingredients that the user wishes to purchase. In Figure 8, the shopping memo information 273 has the items of ingredient name and quantity for each user. Here, the ingredients stored in the shopping memo information 273 are not limited to those that the user wishes to purchase and has manually added, but also include ingredients that are missing in order to cook the menu suggested by the integrated application and that need to be purchased. Furthermore, the shopping memo information 112 stored in the terminal device 10 may have the same items as the shopping memo information 273 and consist of records of users using the terminal device 10.

[0045] Next, Figure 9 shows the recipe information 274 used in this embodiment. Recipe information 274 is information that shows a recipe for a dish, indicating the dish and how to cook it. In Figure 9, recipe information 274 has the following items for each dish: ingredients, quantities, and cooking method. First, the dish is information that identifies the dish that is the subject of the recipe information, and the name of the dish can be used. The ingredients indicate the ingredients used in the dish. The quantities indicate the quantities of ingredients used in the dish. Furthermore, the cooking method indicates the cooking method, that is, the procedure, for the dish. Here, the recipe information 113 stored in the terminal device 10 has the same items as recipe information 274. However, it may consist of records for dishes specific to the user of the terminal device 10.

[0046] Next, Figure 10 shows the device information 276 used in this embodiment. The device information 275 is information indicating the operation of home appliances registered as owned by the user. In Figure 10, the device information 275 has the following items for each user: owned appliances, pairing status, and camera setting status. In the example in Figure 10, the refrigerator of model AA1 and the microwave oven of model BB1 are home appliances with communication functions, and since the pairing (authentication) process with the terminal device 10 has been completed, it is shown that they are in a state where communication connection is possible. On the other hand, the IH cooker of model CC1 is a home appliance that does not have a communication function, so information such as the pairing status is not stored. Also, in the example in Figure 10, it is shown that the camera setting of the refrigerator of model AA1 is ON. If the camera setting is OFF, food information based on the image acquired by the camera cannot be obtained, so the stored food information 272 in Figure 7 must be manually registered by the user using the terminal device 10. Furthermore, the device information 114 stored by the terminal device 10 may have the same items as the device information 275 and may consist of records of users who use the terminal device 10.

[0047] The integrated application of this embodiment provides user-friendly display screens on the terminal device 10 for "My Menu," "Shopping Memo," and "Recipe Trends." In this embodiment, separate screens for "My Menu," "Shopping Memo," and "Recipe Trends" are provided, and these can be switched using tabs within the screen.

[0048] Figure 11 shows the My Menu screen 101a in this embodiment. In this embodiment, the My Menu screen 101a is displayed on the touch panel 101 of the terminal device 10. The integrated application in this embodiment also has a "bulk menu suggestion" function that allows the user to receive menu suggestions for multiple meals. The My Menu screen 101a is a screen for receiving menu suggestions, is created based on device information 275, and consists of a notification display area 1011 and tabs 1012.

[0049] The notification display area 1011 is an area where the user can proceed to the "bulk menu suggestion" function, and it also displays information about home appliances that can be considered when receiving the menu suggestion. In Figure 11, a refrigerator of model AA1 is displayed, so the user can receive menu suggestions that utilize the stored food information managed by this refrigerator. Also in Figure 11, a microwave oven of model BB1 is displayed, so the user can receive menu suggestions in which the output and heating time are pre-set using the microwave oven's auto function, and if the suggestion is accepted, it is also possible to send the auto function information to the microwave oven. The information in the notification display area 1011 is extracted and displayed by the display information creation unit 13 by referring to the user's device information 275 and selecting home appliances owned by the user that have completed the pairing process with the user's terminal device 10.

[0050] Tab 1012 is an area for selectively displaying one of the following: "My Menu," "Shopping Memo," or "Recipe Trends." In Figure 11, "My Menu" is selected, so the My Menu screen 101a is displayed as described above.

[0051] Figure 12 shows the "Batch Menu Suggestion" screen. The "Batch Menu Suggestion" screen is displayed on the touch panel 101 of the terminal device 10 when the notification display area 1011 is tapped on the My Menu screen 101a shown in Figure 11. The "Batch Menu Suggestion" screen includes a date selection area 1013, a manual ingredient registration area 1014, an ingredient exclusion area 1015, and a suggestion acceptance button 1016.

[0052] The date selection area 1013 in Figure 12 is for specifying the dates for which menu suggestions are desired. A calendar screen (not shown) is displayed separately, allowing users to specify a maximum of 7 days, including the start and end dates. It is also possible to specify any days between the start and end dates as excluded days for which menu suggestions are not desired.

[0053] The manual ingredient registration area 1014 in Figure 12 is an area for manually registering ingredients used in a menu. When this area is tapped, the screen shown in Figure 13 is displayed.

[0054] Figure 13 shows the manual ingredient registration screen. When refrigerator storage information is unavailable, or when there are ingredients that cannot be identified from the images acquired by the camera, the user can manually register ingredients stored in the refrigerator or other ingredients in the house. It is desirable to pre-determine the ingredients that can be registered and allow the user to select from them, in order to facilitate association with the ingredients included in the recipe information 274 shown in Figure 9.

[0055] The ingredient exclusion area 1015 in Figure 12 is an area for users to specify ingredients they do not want to consume. When this area is tapped, a screen similar to the manual ingredient registration screen in Figure 13 is displayed, allowing the user to select the ingredients they want to exclude from a list of candidates. For example, if a user has an allergy to a particular ingredient, they may select that ingredient.

[0056] The suggestion submission button 1016 in Figure 12 is a button for executing the menu suggestion, and when this button is tapped, the screen shown in Figure 14 is displayed.

[0057] Figure 14 shows a confirmation screen indicating that meal planning suggestions using home appliances are in progress. This screen displays a message indicating that the ingredients in the refrigerator are being checked, so the user understands that meal planning suggestions will be made using the information about the ingredients stored in the refrigerator. Similarly, a message indicating that meal planning using cooking appliances is being checked may also be displayed.

[0058] Figure 15 shows the screen displaying the results of the "Bulk Menu Suggestion" feature. In Figure 15, the menus assigned to each day from the start date, July 21, to the end date, July 27, are shown. However, July 23 was designated as an excluded day, so no menus are listed for that day. Also, on July 27, the user who received the suggestion canceled the menu assigned to that day, so no menus are listed for that day either. In this way, a week's worth of menus are displayed in a list, allowing users to quickly check their menu repertoire. If more than one meal (for example, lunch and dinner) is needed on the same day, the system can be configured to suggest multiple menus for the same day, distinguishing each meal. Furthermore, on the screen in Figure 15, when a menu for a given date is tapped, details such as cooking methods are displayed based on the recipe information 274 shown in Figure 9.

[0059] Users can modify the suggested menu through a predetermined procedure. For example, they can swap the menu assigned to one day with the menu assigned to another day, or change it to a menu they have previously used or a menu they have registered as a favorite.

[0060] Next, we will explain how the menus assigned to each date and time are determined. Here, we will explain assuming that information on the ingredients stored in the refrigerator is available. In this case, the ingredient determination unit 16b uses this information to determine the ingredients for the proposed date and time, and then the menu determination unit 16c determines a menu using those ingredients by referring to the recipe information 274 shown in Figure 9. The determined menu is displayed as the proposed result in Figure 15, and the user decides whether or not to accept the proposal. If the user decides to accept a menu, any ingredients that are not in stock are added by the shopping memo management unit 17 to the shopping memo information 273 shown in Figure 8, and the user can view this information at any time on the shopping memo screen 101b shown in Figure 17, which will be described later.

[0061] Here, the ingredient determination unit 16b determines the ingredients to be allocated to each proposed date and time according to certain rules regarding prioritization. The following will explain these rules in detail, mainly using Figures 16A to 16G.

[0062] First, the ingredient selection unit 16b determines the ingredients to be allocated to the first day. The ingredient selection unit 16b narrows down the ingredients stored in the stored ingredient information 272 shown in Figure 7 to those with an approaching expiration date (ingredients with a short remaining time until the expiration date). Figure 16A shows that the ingredients have been narrowed down to "raw meat" and "eggs," which have an expiration date of "only 1 day" remaining. Subsequently, the ingredient selection unit 16b further narrows down the ingredients narrowed down in Figure 16A to those with a longer elapsed time. Specifically, since "eggs" have been used for "5 days" longer than "processed meat" has been used for "2 days," the ingredient selection unit 16b narrows down the ingredients to "eggs," as shown in Figure 16B. As a result, the menu for the first day (July 21st in the example of Figure 15) proposes a dish that includes "eggs" as an ingredient (an omelet in the example of Figure 15).

[0063] Next, as shown in Figure 16C, the ingredient selection unit 16b determines which ingredients to allocate to the second day from the remaining ingredients, excluding "eggs," which have already been determined as ingredients for the first day. Of the remaining ingredients shown in Figure 16C, the ingredient with the closest target usage date is "raw meat," which has "1 day left." Therefore, as shown in Figure 16D, the ingredient selection unit 16b narrows down the ingredients to "raw meat." As a result, the menu for the second day is proposed to include dishes that contain "raw meat" as an ingredient.

[0064] Figure 16E shows that the ingredients for days 1 through 5 have been determined to be "processed meat," "raw meat," "onions," "eggs," and "cucumbers." The ingredient determination unit 16b determines which ingredients to allocate to day 6 from the remaining ingredients shown in Figure 16E: "leeks," "radishes," and "bell peppers." Since the remaining ingredients share the same target date for use and the same number of days elapsed, the narrowing down method described above is not possible. Therefore, the ingredient determination unit 16b narrows down the ingredients to those with the largest quantities. Specifically, since there are "5 bell peppers" more than "1 leek" and "1 radish," the ingredient determination unit 16b narrows down the ingredients to "bell peppers," as shown in Figure 16F. As a result, a dish including "bell peppers" as an ingredient is proposed for the menu on day 6. Note that if the quantity of ingredients is managed in addition to the number of individual ingredients, the ingredient determination unit 16b may also narrow down the ingredients to those with the largest quantities.

[0065] Figure 16G shows that the ingredients for days 1 through 6 have been determined to be "processed meat," "raw meat," "onions," "eggs," "cucumbers," and "bell peppers." The ingredient determination unit 16b determines which ingredient to assign to day 7 from the remaining ingredients shown in Figure 16G, namely "leeks" and "radishes." Since the remaining ingredients share the same target usage date, elapsed days, and quantity, the aforementioned narrowing down method is not possible. In such cases, the ingredient determination unit 16b randomly narrows down the ingredients.

[0066] In this way, the ingredient selection unit 16b narrows down the ingredients based on priority order: target use date, number of days elapsed, quantity, and random selection. In particular, if there are multiple ingredients with the same target use date, the unit prioritizes allocating ingredients with a longer elapsed period, thereby encouraging the consumption of ingredients that are inconvenient for users and tend to linger. As a result, it becomes possible to improve the efficiency of ingredient consumption while adhering to expiration dates that would otherwise lead to food waste.

[0067] Next, Figure 17 shows the shopping memo screen 101b in this embodiment. In this embodiment, the shopping memo screen 101b is also displayed on the touch panel 101 of the terminal device 10. The shopping memo screen 101b is created based on the shopping memo information 273 or the shopping memo information 112, and is a screen that shows the shopping memo, that is, the ingredients that the user wants to buy or the ingredients that need to be bought. Specifically, as shown in the figure, the "shopping memo" consists of a purchased ingredients display area 1017 and a tab 1012.

[0068] Each purchase ingredient display area 1017 shows ingredients that the user wishes to purchase or that need to be purchased. Users can manually add ingredients they wish to purchase by tapping the add button 1018. The purchase ingredient display area 1017 also allows users to specify the quantity of ingredients. As mentioned above, ingredients that need to be purchased are those that are lacking when cooking the menu suggested by the integrated app, and the ingredient management unit 15 automatically adds the name and quantity of these ingredients.

[0069] Furthermore, on the shopping memo screen 101b, the inventory list of the refrigerator 31 can be viewed as shown in Figure 18. The inventory list is created based on the stored food information 272 or stored food information 111. It is also desirable to display the date and time when the stored food information 272 or stored food information 111 was last updated as the update date and time of the inventory list. By referring to this inventory list, users can easily determine the ingredients they need to buy, that is, the ingredients they need to add to their shopping memo, even when they are out and about.

[0070] Next, Figure 19 shows the recipe trend screen 101c in this embodiment. In this embodiment, the recipe trend screen 101c is also displayed on the touch panel 101 of the terminal device 10. The recipe trend screen 101c is created based on user management information 271 or user management information 110. On this screen, the user can change the parameters of their preferences for meat, seafood, and vegetables, as well as the parameters of nutrients they wish to consume. Furthermore, the food preferences and nutrient awareness set on the recipe trend screen 101c can also be used to determine the menu.

[0071] Figure 20 shows another My Menu screen 101a in this embodiment. Unlike Figure 11, in Figure 20 the refrigerator of model AA1 and the microwave oven of model BB1 are grayed out. This indicates that the pairing process for the freezer and microwave oven has not been completed. Whether or not the pairing process for each appliance is completed is determined based on the aforementioned device information 275 or device information 114. Even if the pairing process for the refrigerator is not completed, tapping the notification display area 1011 will display the same "Batch Menu Suggestion" screen as in Figure 12. If there is stored ingredient information 272 or stored ingredient information 111 that the user has manually registered, as described above, the ingredient determination unit 16b can use that information to determine the ingredients for the suggested date and time, and then the menu determination unit 16c can determine a menu using those ingredients. However, if the user has not manually registered stored ingredient information, the menu determination described above is not possible.

[0072] Here, we will explain how to determine a menu when information on the ingredients stored in the refrigerator is unavailable. In this case, the ingredient determination unit 16b determines the ingredients for the suggested date and time using the information registered on the manual ingredient registration screen shown in Figure 13, and then the menu determination unit 16c similarly determines a menu using those ingredients. Therefore, if no ingredients are registered on the manual ingredient registration screen, a notification prompting the user to register ingredients may be displayed. Also, if no ingredients are registered, the menu determination unit 16c may refer to the user management information 271 or user management information 110 and randomly extract a menu that matches the user's food preferences and nutritional awareness. Note that if there are ingredients registered as excluded, the menu determination unit 16c will not extract a menu using those ingredients.

[0073] Furthermore, if the pairing process is not complete, in addition to the aforementioned grayed-out display, it is desirable to output a notification indicating that pairing is not complete and a notification prompting the user to complete the pairing process. In this case, it may also be possible to inform the user that once the pairing process is complete, even more convenient menu suggestions will be possible by taking into account the stored food information acquired by the refrigerator 31's camera. Also, even if pairing has been completed, if the communication connection is interrupted for any reason, the latest stored food information may not be available. Therefore, in such cases, a notification prompting the user to check the refrigerator's communication environment may also be output to the notification display area 1011.

[0074] Figure 21 shows yet another My Menu screen 101a in this embodiment. Unlike Figures 11 and 20, in Figure 21, no home appliances are displayed in the notification display area 1011. This indicates that the user only owns home appliances that are not covered by the integrated app, or does not own a refrigerator or cooking appliance at all. Even in such cases, when the notification display area 1011 is tapped, the same "Batch Menu Suggestion" screen as in Figure 12 is displayed. For example, even if the user only owns a microwave oven that is not covered by the integrated app, or does not own a microwave oven at all, the menu is determined in the same way as in Figure 20. However, in the case of Figure 21, the automatic function of the microwave oven shown in the cooking method of the suggested menu cannot be used. Therefore, information about the automatic function may be omitted, or information such as the model number of a microwave oven that can use the automatic function may be displayed. In addition, it may be displayed that if a certain model of refrigerator is purchased, effective menu suggestions using the camera can be realized. Furthermore, even if a user owns a home appliance that is compatible with the integrated app, if that appliance is not registered, the screen shown in Figure 21 will be displayed, and a notification prompting the user to register the appliance if they own one may be output. [Explanation of Symbols]

[0075] 1...House, 10...Terminal device, 11...Terminal communication unit, 12...Shooting unit, 13...Display information creation unit, 14...User information management unit, 15...Ingredient management unit, 16a...Date and time determination unit, 16b...Ingredient determination unit, 16c...Menu determination unit, 17...Shopping memo management unit, 18...Input unit, 19...Output unit, 100...Storage unit, 20...Menu suggestion device, 21...Device communication unit, 22...Display information creation unit, 23...User information management unit, 24...Ingredient management unit, 25a...Date and time determination 25b…Ingredient selection unit, 25c…Menu selection unit, 26…Shopping memo management unit, 27…Storage unit, 271…User management information, 272…Stored ingredient information, 273…Shopping memo information, 274…Recipe information, 275…Equipment information, 31…Refrigerator, 32…IH cooker, 33…Microwave oven, 301…Control unit, 302…Home appliance communication unit, 303…Display and operation panel, 304…Operation unit, 305…Sensor unit, 40…Router, 50…Network

Claims

1. In a menu suggestion system that uses information about the ingredients stored in the refrigerator to suggest menus, A storage unit that stores the target date for using up the aforementioned food item and the number of days that have passed since the food item was stored. A date and time determination unit that determines multiple dates and times to propose a menu, A food ingredient determination unit that determines the food ingredient to be used on the date and time from the food ingredients stored in the refrigerator, The system comprises a menu determination unit that determines a menu using the ingredients determined by the ingredient determination unit, The aforementioned ingredient determination unit, A menu suggestion system that narrows down the ingredients stored in the refrigerator to those with the closest target expiration date, and then narrows down the selected ingredients to those with the longest elapsed time.

2. In the menu suggestion system described in claim 1, A menu suggestion system further comprising an output unit that outputs a screen indicating that the stored ingredient information is being checked while the ingredient determination unit is performing the process of determining the ingredients.

3. In the menu suggestion system described in claim 1, It further includes an input section that accepts input for the start and end dates of the menu suggestions. The date and time determination unit is a menu suggestion system that determines the date and time from the period from the start date to the end date.

4. In the menu suggestion system described in claim 3, The aforementioned input unit also accepts input for exclusion dates to exclude from menu suggestions. The date and time determination unit is a menu suggestion system that determines the date and time within the period from the start date to the end date, excluding the excluded days.

5. In the menu suggestion system according to any one of claims 1 to 4, The memory unit also stores the number of ingredients, The aforementioned ingredient determination unit, A menu suggestion system that further narrows down the selection to the aforementioned ingredients that are found in large quantities.

6. In the menu suggestion system described in claim 5, The aforementioned ingredient determination unit, A menu suggestion system that further narrows down the aforementioned ingredients randomly.

7. In the menu suggestion system described in claim 1, It also includes an input section that accepts input for ingredients to be excluded from the menu suggestions. The aforementioned ingredient determination unit is a menu suggestion system that excludes the excluded ingredients from the narrowing down process.

8. In the menu suggestion system described in claim 1, A menu suggestion system further comprising an input section that accepts input for the target date for using up the aforementioned ingredients.

Images