Menu suggestion system

Abstract

We will inform users that by linking their home appliances, they can receive menu suggestions that utilize those appliances. [Solution] A menu suggestion system that suggests menus in cooperation with home appliances includes a storage unit that stores device information for each user, including the registered home appliance and the pairing status between the home appliance and the user's terminal device; a display information creation unit that creates a menu acceptance screen for receiving menu suggestions; and an output unit that outputs the menu acceptance screen. The display information creation unit creates a different menu acceptance screen if the pairing between the home appliance and the terminal device is not yet complete, compared to when the pairing is complete.

Description

Technical Field

[0006] ,

[0004] , , , , , ,

[0005] , , , , ,

[0003] , , , , , , ,

[0001] The present invention relates to a menu proposal system.

Background Art

[0002] Patent Document 1 discloses a technique for providing information related to cooking, such as menus and recipes, considering the cooking appliances used by users (paragraph 0009, FIGS. 4-5).

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technique disclosed in Patent Document 1, even if a cooking appliance is registered in an application, if the cooking appliance is not linked to the menu providing function, not only cannot a menu proposal utilizing the cooking appliance be received, but there is also a possibility that the user may not notice that such a proposal can be received if they are linked.

Means for Solving the Problems

[0005] In order to solve the above problems, the present invention provides a menu proposal system that proposes a menu in cooperation with home appliances, and includes, for each user, a storage unit that stores device information including the registered home appliances and the pairing state between the home appliances and the user's terminal device, a display information creation unit that creates a menu reception screen for receiving a menu proposal, and an output unit that outputs the menu reception screen. When the pairing between the home appliances and the terminal device is not completed, the display information creation unit creates a menu reception screen different from the case where the pairing is completed.

Effects of the Invention

[0006] According to the present invention, by linking home appliances, users can be informed that they can receive menu suggestions that utilize these home appliances. [Brief explanation of the drawing]

[0007] [Figure 1] System configuration diagram of a menu suggestion system in an embodiment of the present invention. [Figure 2] Functional block diagram of a home appliance in an embodiment of the present invention. [Figure 3] Functional block diagram of a terminal device in an embodiment of the present invention. [Figure 4] Hardware configuration diagram of a terminal device in an embodiment of the present invention. [Figure 5] Hardware configuration diagram of a menu suggestion device in an embodiment of the present invention. [Figure 6] A diagram showing user management information used in embodiments of the present invention. [Figure 7] A diagram showing information on stored food items used in an embodiment of the present invention. [Figure 8] A diagram showing shopping memo information used in an embodiment of the present invention. [Figure 9] A diagram showing recipe information used in embodiments of the present invention. [Figure 10] A diagram showing equipment information used in embodiments of the present invention. [Figure 11] A diagram showing the My Menu screen in an embodiment of the present invention. [Figure 12] A diagram showing the "Bulk Menu Suggestion" screen. [Figure 13] A diagram showing the manual ingredient registration screen. [Figure 14] A confirmation screen indicating that meal planning suggestions using home appliances are currently being implemented. [Figure 15] This screen displays the results of the "Bulk Menu Suggestion" feature. [Figure 16A] A diagram showing the method for determining the ingredients for the first day (the result of the first narrowing down). [Figure 16B] A diagram showing the method for determining the ingredients for the first day (results of the second narrowing down process). [Figure 16C] Figure showing the method for determining the ingredients on the second day (before narrowing down). [Figure 16D] Figure showing the method for determining the ingredients on the second day (after narrowing down). [Figure 16E] Figure showing the method for determining the ingredients on the sixth day (before narrowing down). [Figure 16F] Figure showing the method for determining the ingredients on the sixth day (after narrowing down). [Figure 16G] Figure showing the method for determining the ingredients on the seventh day (before narrowing down). [Figure 17] Figure showing the shopping memo screen in the embodiment of the present invention. [Figure 18] Screen showing the inventory list. [Figure 19] Figure showing the recipe trend screen in the embodiment of the present invention. [Figure 20] Figure showing another My menu screen in the embodiment of the present invention. [Figure 21] Figure showing yet another My menu screen in the embodiment of the present invention.

Mode for Carrying Out the Invention

[0008] Hereinafter, embodiments of the present invention will be described.

[0009] FIG. 1 is a system configuration diagram of the menu proposal system in the present embodiment. In FIG. 1, in house 1, household appliances such as refrigerator 31, IH cooker 32, and microwave oven 33 are used for housework. Also, it is assumed that the person living in house 1, that is, the person who performs the housework, has terminal device 10. And these household appliances and terminal device 10 can be connected to each other via router 40 or directly.

[0010] The menu suggestion device 20 is connected to the network 50. Furthermore, these home appliances and terminal devices 10 are connected to the network 50, which can be realized via the router 40 or directly via the internet. The connections between the terminal devices 10, home appliances, router 40, and network 50 can be wired or wireless. The following describes each of these devices.

[0011] First, in House 1, a refrigerator 31, an induction cooktop 32, and a microwave oven 33 are used as home appliances. Note that House 1 is just one example of an area where home appliances are used, and this embodiment can be applied to other areas as well. Furthermore, there may be multiple areas of use. In addition, each of the above-mentioned home appliances is just an example, and only a part of them may be used, or other home appliances may be added. In particular, the refrigerator 31 is just one example of a storage unit that can store food, and other storage units such as a pantry or wine cellar may also be used, and in this embodiment, these storage units are also treated as home appliances. Similarly, the induction cooktop 32 and microwave oven 33 are just examples, and other cooking appliances may be used, or at least one of them may be omitted.

[0012] Here, Figure 2 is a functional block diagram of the home appliance in this embodiment. As shown in Figure 2, the home appliance has a control unit 301, a home appliance communication unit 302, a display and operation panel 303, an operating unit 304, and a sensor unit 305. These are connected to each other via a communication path. The following describes each of the components.

[0013] The control unit 301 creates and outputs control signals to realize the functions of the home appliance, such as cooling and heating, and controls the operation of the home appliance. The control unit 301 can be implemented using an MPU (Micro-Processing Unit), and can also be implemented using dedicated hardware or software such as programs.

[0014] The home appliance communication unit 302 has communication and short-range wireless communication functions via the router 40 and network 50. The home appliance communication unit 302 also outputs information and operating status detected by the sensor unit 305, and receives control instructions from terminal devices 10 and menu suggestion devices 20, etc.

[0015] The display and operation panel 305 receives commands from the user for operation of the home appliance and outputs the operating status of the home appliance. The display and operation panel 305 may also be configured by separating it into an operation section (e.g., buttons) for receiving commands and an output section such as a display section for displaying information.

[0016] The operating unit 304 performs various functions according to the control from the control unit 301. These functions include cooling and heating, and can be implemented using compressors, motors, actuators, etc.

[0017] The sensor unit 305 detects the operating status of home appliances. For example, in the case of a refrigerator, the sensor unit 304 detects the temperature inside the refrigerator, and if the refrigerator is equipped with a camera, the sensor unit 305 acquires an image of the inside of the refrigerator.

[0018] Next, the terminal device 10 will be described. The terminal device 10 is used by the user to manage home appliances and can be implemented as a computer such as a smartphone, mobile phone, tablet, or PC. Furthermore, when the terminal device 10 is implemented as a so-called mobile computer such as a smartphone, it can be used not only inside the house 1 but also outdoors. In addition, although only one terminal device 10 is shown in Figure 1, multiple devices may be prepared for each family member, or a user may use multiple terminal devices 10.

[0019] Here, Figure 3 is a functional block diagram of the terminal device 10 in this embodiment. In Figure 3, the terminal device 10 includes a terminal communication unit 11, a shooting unit 12, a display information creation unit 13, a user information management unit 14, a food ingredient management unit 15, a date and time determination unit 16a, a food ingredient determination unit 16b, a menu determination unit 16c, a shopping memo management unit 17, an input unit 18, an output unit 19, and a storage unit 100.

[0020] The terminal communication unit 11 has communication and short-range wireless communication functions via the router 40 and network 50. The shooting unit 12 has a camera-like shooting function. The display information creation unit 13 creates information to be displayed on the terminal device 10. The user information management unit 14 manages user management information 110 related to the user of the terminal device 10. The food ingredient management unit 15 manages the food ingredients managed and stored in the house 1. The date and time determination unit 16a determines multiple dates and times for proposing a menu. The food ingredient determination unit 16b determines the food ingredients to be used on the date and time determined by the date and time determination unit 16a. The menu determination unit 16c determines a menu using the food ingredients determined by the food ingredient determination unit 16b. The shopping memo management unit 17 manages shopping memos indicating the food ingredients that the user wishes to purchase.

[0021] The input unit 18 accepts various operations from the user. The output unit 19 outputs various information such as menu suggestions. The input unit 18 and the output unit 19 can be integrated into a single unit, like a touch panel. Furthermore, the storage unit 100 stores image data captured by the shooting unit 12, processing in the display information creation unit 13 to the shopping memo management unit 17, and various information used in processing by home appliances and the menu suggestion device 20. If a camera for capturing images of the inside of the refrigerator is installed on top of the refrigerator, it is not necessary to take images on the terminal side. When such a camera is installed on top of the refrigerator, it is possible to capture and store images of the shelves and door pockets of the refrigerator compartment, the vegetable compartment, the freezer, etc., at the time the user opens and closes the refrigerator.

[0022] Here, we will describe one implementation example of the terminal device 10. Figure 4 is a hardware configuration diagram of the terminal device 10 in this embodiment. In Figure 4, the terminal device 10 includes a touch panel 101, a processing unit 102, a communication device 103, a storage device 104, and a camera, which are connected to each other via a communication path.

[0023] First, the touch panel 101 has a configuration that also serves as the input unit 18 and output unit 19 in Figure 3, and accepts user operations and displays various information. The touch panel 101 may also be configured as separate input and output devices. Furthermore, the processing unit 102 can be implemented as a processor such as a CPU (Central Processing Unit) and performs calculations according to the home appliance management program 105 (integrated application) stored in the storage device 104, which will be described later.

[0024] The home appliance management program 105 is composed of, according to its function, a user management module 106, a food ingredient management module 107, a date and time determination module 108a, a food ingredient determination module 108b, a menu determination module 108c, and a shopping memo management module 109. Note that each of these modules may be implemented as an individual program or as a combination of some of them.

[0025] Here, the configuration shown in Figure 3, which performs the same function as each module, is as follows: User Management Module 106: User Information Management Unit 14 Food ingredient management module 107: Food ingredient management department 15 Date and time determination module 108a: Date and time determination unit 16a Ingredient selection module 108b: Ingredient selection unit 16b Menu determination module 108c: Menu determination unit 16c Shopping list management module 109: Shopping list management section 17 Note that the display information creation unit 13 in Figure 3 is assumed to function on an OS (Operating System) not shown on the terminal device 10. However, it may be implemented as a function of the home appliance management program 105, or as a separate application program.

[0026] Therefore, the processing unit 102 will perform calculations corresponding to the processing of the user information management unit 14, the food ingredient management unit 15, the date and time determination unit 16a, the food ingredient determination unit 16b, the menu determination unit 16c, and the shopping memo management unit 16, in accordance with the home appliance management program 105.

[0027] Furthermore, the storage device 104 stores the home appliance management program 105, user management information 110, stored food information 111, shopping memo information 112, recipe information 113, and device information 114. Here, the home appliance management program 105 may be a program for general-purpose and integrated management of home appliances, or it may consist of multiple programs for each home appliance. In the latter case, separate management programs for the refrigerator 31, induction cooker 32, and microwave oven 33 would be used. The user management information 110, stored food information 111, shopping memo information 112, recipe information 113, and device information 114 will be explained later when describing the information stored by the menu suggestion device. The home appliance management program 105 may also be implemented as a menu suggestion program whose main function is menu suggestion.

[0028] Furthermore, the storage device 104 may be implemented as a main memory device such as memory and a secondary memory device (storage medium) which is a so-called storage device. The secondary memory device may be implemented as an external HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, etc. In addition, at least a portion of the home appliance management program 105, user management information 110, stored food information 111, shopping memo information 112, recipe information 113, and device information 114 can be omitted. This can be maintained by the menu suggestion device 20 described later. Furthermore, at least a portion of the modules (functions) of the home appliance management program 105 may be provided in the home appliance or the menu suggestion device 20.

[0029] This concludes the explanation of Figure 4, and we will now return to the explanation of Figure 1. The menu suggestion device 20 can be implemented using computers such as servers and clouds. The menu suggestion device 20 also includes a device communication unit 21, a display information creation unit 22, a user information management unit 23, a food ingredient management unit 24, a date and time determination unit 25a, a food ingredient determination unit 25b, a menu determination unit 25c, a shopping memo management unit 26, and a storage unit 27.

[0030] Here, the device communication unit 21 connects to the terminal device 10 and home appliances via the network 50. The display information creation unit 22 creates information to be displayed on the terminal device 10, similar to the display information creation unit 13 of the terminal device 10. The user information management unit 23 manages user management information 271 related to the users of the terminal device 10. The food ingredient management unit 24 manages food ingredients managed and stored in the house 1, similar to the food ingredient management unit 15 of the terminal device 10. The date and time determination unit 25a determines multiple dates and times for proposing a menu, similar to the date and time determination unit 16a of the terminal device 10. The food ingredient determination unit 25b determines the food ingredients to be used on the date and time determined by the date and time determination unit 25a. The menu determination unit 25c determines a menu using the food ingredients determined by the food ingredient determination unit 25b. The shopping memo management unit 26 manages shopping memos, similar to the shopping memo management unit 17 of the terminal device 10.

[0031] Furthermore, the memory unit 27 stores user management information 271, stored food information 272, shopping memo information 273, recipe information 274, and equipment information 275. These pieces of information will be explained later, but before that, let's describe one implementation example of the menu suggestion device 20.

[0032] Figure 5 is a hardware diagram of the menu suggestion device 20 in this embodiment. In Figure 5, the menu suggestion device 20 includes a processing unit 201, a communication device 202, a memory 203, and a sub-storage device 204, which are connected to each other via a communication path.

[0033] First, the processing unit 201 can be implemented using a processor such as a CPU, and it performs calculations according to the home appliance management program 205 stored in the secondary memory device 204, which will be described later. The home appliance management program 205 will be described later.

[0034] Furthermore, the communication device 202 corresponds to the device communication unit 21 in Figure 1, connects to the network 50, and communicates with other devices.

[0035] Furthermore, the memory 203 and the secondary storage device 204 correspond to the storage unit 27 in Figure 1. The memory 203 is where the home appliance management program 205 and information used for processing by the processing unit 201, which are stored in the secondary storage device 204, are loaded. The secondary storage device 204 can be implemented as a so-called storage device. The secondary storage device 204 stores the home appliance management program 205, user management information 271, stored food information 272, shopping memo information 273, recipe information 274, and device information 275. The secondary storage device 204 may also be implemented as various storage media such as an external HDD (Hard Disk Drive), SSD (Solid State Drive), or memory card, or it may be implemented as a separate device from the menu suggestion device 20, such as a file server.

[0036] Here, the home appliance management program 205 consists of a user information management module 206, a food ingredient management module 207, a date and time determination module 208a, a food ingredient determination module 208b, a menu determination module 208c, and a shopping memo management module 209. Note that each of these modules may be implemented as an individual program or a combination of some of them. Furthermore, the home appliance management program 205 may be implemented as a menu suggestion program whose main function is menu suggestion.

[0037] Here, the configuration shown in Figure 1, which performs the same function as each module, is as follows: User Information Management Module 206: User Information Management Department 23 Food ingredient management module 207: Food ingredient management department 24 Date and time determination module 208a: Date and time determination unit 25a Ingredient selection module 208b: Ingredient selection unit 25b Menu determination module 208c: Menu determination unit 25c Shopping list management module 209: Shopping list management section 26 Therefore, the processing unit 201 will execute the processing of the user information management unit 23, the food ingredient management unit 24, the date and time determination unit 25a, the food ingredient determination unit 25b, the menu determination unit 25c, and the shopping memo management unit 25 in accordance with the home appliance management program 205.

[0038] Note that the display information creation unit 22 in Figure 1 is assumed to function on an OS (Operating System) not shown in the menu suggestion device 20. However, it may also be implemented as a function of the home appliance management program 205, or as a separate application program.

[0039] Next, we will explain the information stored in the secondary memory device 204.

[0040] First, Figure 6 shows the user management information 271 used in this embodiment. User management information 271 is information about users who use home appliances. In Figure 6, the user management information 271 has items for each user, such as owned appliances, food preferences, and nutritional awareness. Owned appliances refer to the home appliances owned by the user. For example, home appliances purchased from an e-commerce site associated with the business that manages the menu suggestion device 20 may be automatically registered in the user management information 271. Alternatively, the user may manually register home appliances in the user management information 271 using the terminal device 10.

[0041] Food preference indicates the degree of preference for certain foods, and parameters can be set in three stages: less, normal, and more for meat, seafood, and vegetables. Nutrient awareness indicates the degree of desired intake, and parameters can be set using numerical values ​​from 0 to 100 for calories, salt, carbohydrates, fat, protein, and dietary fiber. Food preference and nutrient awareness are reflected in user management information 271 when set or changed by the user on the recipe trend screen shown in Figure 19 below. In addition, user management information 271 may also include the user's address, telephone number, email address, and other contact information. Furthermore, user management information 110 stored in terminal device 10 may have the same items as user management information 271 and consist of records of users using terminal device 10.

[0042] Next, Figure 7 shows the stored food information 272 used in this embodiment. The stored food information 272 is information about food stored in the house 1, such as the refrigerator 31. In Figure 7, the stored food information 272 has the following items for each user: food name, quantity, elapsed days, and target use date. If the refrigerator 31 is equipped with a camera that takes images of the inside of the refrigerator, the food name and quantity are automatically registered by analyzing the images acquired by the camera, but the user may also register them manually using the terminal device 10. In addition to the quantity of food, the amount of food may also be entered manually or automatically. The elapsed days is the number of days that have elapsed from the storage date and time when the food was stored in the refrigerator 31 to the present. The storage date and time corresponds to the date and time when the food name and quantity of the new food were registered as stored food information 272. The target use date is manually registered by the user as the date on which they want to use the food, and does not necessarily have to be the expiration date or best-before date. Furthermore, while Figure 7 shows the number of days remaining until the target date for using up the product, calculated from the present, a specific date could also be used.

[0043] The stored food information 272 may include images of food items acquired by a camera installed in the refrigerator 31 or by the imaging unit 12 of the terminal device 10, and may also include information such as the location where the food items are stored, such as the refrigerator compartment or vegetable compartment. Furthermore, the stored food information 111 stored in the terminal device 10 may have the same items as the stored food information 272 and may consist of records of users using the terminal device 10.

[0044] Next, Figure 8 shows the shopping memo information 273 used in this embodiment. The shopping memo information 273 is information about the ingredients that the user wishes to purchase. In Figure 8, the shopping memo information 273 has the items of ingredient name and quantity for each user. Here, the ingredients stored in the shopping memo information 273 are not limited to those that the user wishes to purchase and has manually added, but also include ingredients that are missing in order to cook the menu suggested by the integrated application and that need to be purchased. Furthermore, the shopping memo information 112 stored in the terminal device 10 may have the same items as the shopping memo information 273 and consist of records of users using the terminal device 10.

[0045] Next, Figure 9 shows the recipe information 274 used in this embodiment. Recipe information 274 is information that shows a recipe for a dish, indicating the dish and how to cook it. In Figure 9, recipe information 274 has the following items for each dish: ingredients, quantities, and cooking method. First, the dish is information that identifies the dish that is the subject of the recipe information, and the name of the dish can be used. The ingredients indicate the ingredients used in the dish. The quantities indicate the quantities of ingredients used in the dish. Furthermore, the cooking method indicates the cooking method, that is, the procedure, for the dish. Here, the recipe information 113 stored in the terminal device 10 has the same items as recipe information 274. However, it may consist of records for dishes specific to the user of the terminal device 10.

[0046] Next, Figure 10 shows the device information 276 used in this embodiment. The device information 275 is information indicating the operation of home appliances registered as owned by the user. In Figure 10, the device information 275 has the following items for each user: owned appliances, pairing status, and camera setting status. In the example in Figure 10, the refrigerator of model AA1 and the microwave oven of model BB1 are home appliances with communication functions, and since the pairing (authentication) process with the terminal device 10 has been completed, it is shown that they are in a state where communication connection is possible. On the other hand, the IH cooker of model CC1 is a home appliance that does not have a communication function, so information such as the pairing status is not stored. Also, in the example in Figure 10, it is shown that the camera setting of the refrigerator of model AA1 is ON. If the camera setting is OFF, food information based on the image acquired by the camera cannot be obtained, so the stored food information 272 in Figure 7 must be manually registered by the user using the terminal device 10. Furthermore, the device information 114 stored by the terminal device 10 may have the same items as the device information 275 and may consist of records of users who use the terminal device 10.

[0047] The integrated application of this embodiment provides user-friendly display screens on the terminal device 10 for "My Menu," "Shopping Memo," and "Recipe Trends." In this embodiment, separate screens for "My Menu," "Shopping Memo," and "Recipe Trends" are provided, and these can be switched using tabs within the screen.

[0048] Figure 11 shows the My Menu screen 101a in this embodiment. In this embodiment, the My Menu screen 101a is displayed on the touch panel 101 of the terminal device 10. The integrated application in this embodiment also has a "bulk menu suggestion" function that allows the user to receive menu suggestions for multiple meals. The My Menu screen 101a is a screen for receiving menu suggestions, is created based on device information 275, and consists of a notification display area 1011 and tabs 1012.

[0049] The notification display area 1011 is an area where the user can proceed to the "bulk menu suggestion" function, and it also displays information about home appliances that can be considered when receiving the menu suggestion. In Figure 11, a refrigerator of model AA1 is displayed, so the user can receive menu suggestions that utilize the stored food information managed by this refrigerator. Also in Figure 11, a microwave oven of model BB1 is displayed, so the user can receive menu suggestions in which the output and heating time are pre-set using the microwave oven's auto function, and if the suggestion is accepted, it is also possible to send the auto function information to the microwave oven. The information in the notification display area 1011 is extracted and displayed by the display information creation unit 13 by referring to the user's device information 275 and selecting home appliances owned by the user that have completed the pairing process with the user's terminal device 10.

[0050] Tab 1012 is an area for selectively displaying one of the following: "My Menu," "Shopping Memo," or "Recipe Trends." In Figure 11, "My Menu" is selected, so the My Menu screen 101a is displayed as described above.

[0051] Figure 12 shows the "Batch Menu Suggestion" screen. The "Batch Menu Suggestion" screen is displayed on the touch panel 101 of the terminal device 10 when the notification display area 1011 is tapped on the My Menu screen 101a shown in Figure 11. The "Batch Menu Suggestion" screen includes a date selection area 1013, a manual ingredient registration area 1014, an ingredient exclusion area 1015, and a suggestion acceptance button 1016.

[0052] The date selection area 1013 in Figure 12 is for specifying the dates for which menu suggestions are desired. A calendar screen (not shown) is displayed separately, allowing users to specify a maximum of 7 days, including the start and end dates. It is also possible to specify any days between the start and end dates as excluded days for which menu suggestions are not desired.

[0053] The manual ingredient registration area 1014 in Figure 12 is an area for manually registering ingredients used in a menu. When this area is tapped, the screen shown in Figure 13 is displayed.

[0054] Figure 13 shows the manual ingredient registration screen. When refrigerator storage information is unavailable, or when there are ingredients that cannot be identified from the images acquired by the camera, the user can manually register ingredients stored in the refrigerator or other ingredients in the house. It is desirable to pre-determine the ingredients that can be registered and allow the user to select from them, in order to facilitate association with the ingredients included in the recipe information 274 shown in Figure 9.

[0055] The ingredient exclusion area 1015 in Figure 12 is an area for users to specify ingredients they do not want to consume. When this area is tapped, a screen similar to the manual ingredient registration screen in Figure 13 is displayed, allowing the user to select the ingredients they want to exclude from a list of candidates. For example, if a user has an allergy to a particular ingredient, they may select that ingredient.

[0056] The suggestion submission button 1016 in Figure 12 is a button for executing the menu suggestion, and when this button is tapped, the screen shown in Figure 14 is displayed.

[0057] Figure 14 shows a confirmation screen indicating that meal planning suggestions using home appliances are in progress. This screen displays a message indicating that the ingredients in the refrigerator are being checked, so the user understands that meal planning suggestions will be made using the information about the ingredients stored in the refrigerator. Similarly, a message indicating that meal planning using cooking appliances is being checked may also be displayed.

[0058] Figure 15 shows the screen displaying the results of the "Bulk Menu Suggestion" feature. In Figure 15, the menus assigned to each day from the start date, July 21, to the end date, July 27, are shown. However, July 23 was designated as an excluded day, so no menus are listed for that day. Also, on July 27, the user who received the suggestion canceled the menu assigned to that day, so no menus are listed for that day either. In this way, a week's worth of menus are displayed in a list, allowing users to quickly check their menu repertoire. If more than one meal (for example, lunch and dinner) is needed on the same day, the system can be configured to suggest multiple menus for the same day, distinguishing each meal. Furthermore, on the screen in Figure 15, when a menu for a given date is tapped, details such as cooking methods are displayed based on the recipe information 274 shown in Figure 9.

[0059] Users can modify the suggested menu through a predetermined procedure. For example, they can swap the menu assigned to one day with the menu assigned to another day, or change it to a menu they have previously used or a menu they have registered as a favorite.

[0060] Next, we will explain how the menus assigned to each date and time are determined. Here, we will explain assuming that information on the ingredients stored in the refrigerator is available. In this case, the ingredient determination unit 16b uses this information to determine the ingredients for the proposed date and time, and then the menu determination unit 16c determines a menu using those ingredients by referring to the recipe information 274 shown in Figure 9. The determined menu is displayed as the proposed result in Figure 15, and the user decides whether or not to accept the proposal. If the user decides to accept a menu, any ingredients that are not in stock are added by the shopping memo management unit 17 to the shopping memo information 273 shown in Figure 8, and the user can view this information at any time on the shopping memo screen 101b shown in Figure 17, which will be described later.

[0061] Here, the ingredient determination unit 16b determines the ingredients to be allocated to each proposed date and time according to certain rules regarding prioritization. The following will explain these rules in detail, mainly using Figures 16A to 16G.

[0062] First, the ingredient selection unit 16b determines the ingredients to be allocated to the first day. The ingredient selection unit 16b narrows down the ingredients stored in the stored ingredient information 272 shown in Figure 7 to those with an approaching expiration date (ingredients with a short remaining time until the expiration date). Figure 16A shows that the ingredients have been narrowed down to "raw meat" and "eggs," which have an expiration date of "only 1 day" remaining. Subsequently, the ingredient selection unit 16b further narrows down the ingredients narrowed down in Figure 16A to those with a longer elapsed time. Specifically, since "eggs" have been used for "5 days" longer than "processed meat" has been used for "2 days," the ingredient selection unit 16b narrows down the ingredients to "eggs," as shown in Figure 16B. As a result, the menu for the first day (July 21st in the example of Figure 15) proposes a dish that includes "eggs" as an ingredient (an omelet in the example of Figure 15).

[0063] Next, as shown in Figure 16C, the ingredient selection unit 16b determines which ingredients to allocate to the second day from the remaining ingredients, excluding "eggs," which have already been determined as ingredients for the first day. Of the remaining ingredients shown in Figure 16C, the ingredient with the closest target usage date is "raw meat," which has "1 day left." Therefore, as shown in Figure 16D, the ingredient selection unit 16b narrows down the ingredients to "raw meat." As a result, the menu for the second day is proposed to include dishes that contain "raw meat" as an ingredient.

[0064] Figure 16E shows that the ingredients for days 1 through 5 have been determined to be "processed meat," "raw meat," "onions," "eggs," and "cucumbers." The ingredient determination unit 16b determines which ingredients to allocate to day 6 from the remaining ingredients shown in Figure 16E: "leeks," "radishes," and "bell peppers." Since the remaining ingredients share the same target date for use and the same number of days elapsed, the narrowing down method described above is not possible. Therefore, the ingredient determination unit 16b narrows down the ingredients to those with the largest quantities. Specifically, since there are "5 bell peppers" more than "1 leek" and "1 radish," the ingredient determination unit 16b narrows down the ingredients to "bell peppers," as shown in Figure 16F. As a result, a dish including "bell peppers" as an ingredient is proposed for the menu on day 6. Note that if the quantity of ingredients is managed in addition to the number of individual ingredients, the ingredient determination unit 16b may also narrow down the ingredients to those with the largest quantities.

[0065] Figure 16G shows that the ingredients for days 1 through 6 have been determined to be "processed meat," "raw meat," "onions," "eggs," "cucumbers," and "bell peppers." The ingredient determination unit 16b determines which ingredient to assign to day 7 from the remaining ingredients shown in Figure 16G, namely "leeks" and "radishes." Since the remaining ingredients share the same target usage date, elapsed days, and quantity, the aforementioned narrowing down method is not possible. In such cases, the ingredient determination unit 16b randomly narrows down the ingredients.

[0066] In this way, the ingredient selection unit 16b narrows down the ingredients based on priority order: target use date, number of days elapsed, quantity, and random selection. In particular, if there are multiple ingredients with the same target use date, the unit prioritizes allocating ingredients with a longer elapsed period, thereby encouraging the consumption of ingredients that are inconvenient for users and tend to linger. As a result, it becomes possible to improve the efficiency of ingredient consumption while adhering to expiration dates that would otherwise lead to food waste.

[0067] Next, Figure 17 shows the shopping memo screen 101b in this embodiment. In this embodiment, the shopping memo screen 101b is also displayed on the touch panel 101 of the terminal device 10. The shopping memo screen 101b is created based on the shopping memo information 273 or the shopping memo information 112, and is a screen that shows the shopping memo, that is, the ingredients that the user wants to buy or the ingredients that need to be bought. Specifically, as shown in the figure, the "shopping memo" consists of a purchased ingredients display area 1017 and a tab 1012.

[0068] Each purchase ingredient display area 1017 shows ingredients that the user wishes to purchase or that need to be purchased. Users can manually add ingredients they wish to purchase by tapping the add button 1018. The purchase ingredient display area 1017 also allows users to specify the quantity of ingredients. As mentioned above, ingredients that need to be purchased are those that are lacking when cooking the menu suggested by the integrated app, and the ingredient management unit 15 automatically adds the name and quantity of these ingredients.

[0069] Furthermore, on the shopping memo screen 101b, the inventory list of the refrigerator 31 can be viewed as shown in Figure 18. The inventory list is created based on the stored food information 272 or stored food information 111. It is also desirable to display the date and time when the stored food information 272 or stored food information 111 was last updated as the update date and time of the inventory list. By referring to this inventory list, users can easily determine the ingredients they need to buy, that is, the ingredients they need to add to their shopping memo, even when they are out and about.

[0070] Next, Figure 19 shows the recipe trend screen 101c in this embodiment. In this embodiment, the recipe trend screen 101c is also displayed on the touch panel 101 of the terminal device 10. The recipe trend screen 101c is created based on user management information 271 or user management information 110. On this screen, the user can change the parameters of their preferences for meat, seafood, and vegetables, as well as the parameters of nutrients they wish to consume. Furthermore, the food preferences and nutrient awareness set on the recipe trend screen 101c can also be used to determine the menu.

[0071] Figure 20 shows another My Menu screen 101a in this embodiment. Unlike Figure 11, in Figure 20 the refrigerator of model AA1 and the microwave oven of model BB1 are grayed out. This indicates that the pairing process for the freezer and microwave oven has not been completed. Whether or not the pairing process for each appliance is completed is determined based on the aforementioned device information 275 or device information 114. Even if the pairing process for the refrigerator is not completed, tapping the notification display area 1011 will display the same "Batch Menu Suggestion" screen as in Figure 12. If there is stored ingredient information 272 or stored ingredient information 111 that the user has manually registered, as described above, the ingredient determination unit 16b can use that information to determine the ingredients for the suggested date and time, and then the menu determination unit 16c can determine a menu using those ingredients. However, if the user has not manually registered stored ingredient information, the menu determination described above is not possible.

[0072] Here, we will explain how to determine a menu when information on the ingredients stored in the refrigerator is unavailable. In this case, the ingredient determination unit 16b determines the ingredients for the suggested date and time using the information registered on the manual ingredient registration screen shown in Figure 13, and then the menu determination unit 16c similarly determines a menu using those ingredients. Therefore, if no ingredients are registered on the manual ingredient registration screen, a notification prompting the user to register ingredients may be displayed. Also, if no ingredients are registered, the menu determination unit 16c may refer to the user management information 271 or user management information 110 and randomly extract a menu that matches the user's food preferences and nutritional awareness. Note that if there are ingredients registered as excluded, the menu determination unit 16c will not extract a menu using those ingredients.

[0073] Furthermore, if the pairing process is not complete, in addition to the aforementioned grayed-out display, it is desirable to output a notification indicating that pairing is not complete and a notification prompting the user to complete the pairing process. In this case, it may also be possible to inform the user that once the pairing process is complete, even more convenient menu suggestions will be possible by taking into account the stored food information acquired by the refrigerator 31's camera. Also, even if pairing has been completed, if the communication connection is interrupted for any reason, the latest stored food information may not be available. Therefore, in such cases, a notification prompting the user to check the refrigerator's communication environment may also be output to the notification display area 1011.

[0074] Figure 21 shows yet another My Menu screen 101a in this embodiment. Unlike Figures 11 and 20, in Figure 21, no home appliances are displayed in the notification display area 1011. This indicates that the user only owns home appliances that are not covered by the integrated app, or does not own a refrigerator or cooking appliance at all. Even in such cases, when the notification display area 1011 is tapped, the same "Batch Menu Suggestion" screen as in Figure 12 is displayed. For example, even if the user only owns a microwave oven that is not covered by the integrated app, or does not own a microwave oven at all, the menu is determined in the same way as in Figure 20. However, in the case of Figure 21, the automatic function of the microwave oven shown in the cooking method of the suggested menu cannot be used. Therefore, information about the automatic function may be omitted, or information such as the model number of a microwave oven that can use the automatic function may be displayed. In addition, it may be displayed that if a certain model of refrigerator is purchased, effective menu suggestions using the camera can be realized. Furthermore, even if a user owns a home appliance that is compatible with the integrated app, if that appliance is not registered, the screen shown in Figure 21 will be displayed, and a notification prompting the user to register the appliance if they own one may be output. [Explanation of Symbols]

[0075] 1...House, 10...Terminal device, 11...Terminal communication unit, 12...Shooting unit, 13...Display information creation unit, 14...User information management unit, 15...Ingredient management unit, 16a...Date and time determination unit, 16b...Ingredient determination unit, 16c...Menu determination unit, 17...Shopping memo management unit, 18...Input unit, 19...Output unit, 100...Storage unit, 20...Menu suggestion device, 21...Device communication unit, 22...Display information creation unit, 23...User information management unit, 24...Ingredient management unit, 25a...Date and time determination 25b…Ingredient selection unit, 25c…Menu selection unit, 26…Shopping memo management unit, 27…Storage unit, 271…User management information, 272…Stored ingredient information, 273…Shopping memo information, 274…Recipe information, 275…Equipment information, 31…Refrigerator, 32…IH cooker, 33…Microwave oven, 301…Control unit, 302…Home appliance communication unit, 303…Display and operation panel, 304…Operation unit, 305…Sensor unit, 40…Router, 50…Network

Claims

1. In a menu suggestion system that works in conjunction with home appliances to propose menus, A storage unit that stores device information for each user, including the registered home appliance and the pairing status between that home appliance and the user's terminal device, The display information creation unit creates a menu submission screen that accepts menu suggestions, It comprises an output unit that outputs the menu order screen, The display information creation unit is a menu suggestion system that creates a different menu request screen when pairing between the home appliance and the terminal device is not completed compared to when pairing is completed.

2. In the menu suggestion system described in claim 1, The aforementioned display information creation unit is a menu suggestion system that, if the home appliance is not registered, creates a screen that notifies the user of the functions that can be realized when the home appliance is registered.

3. In the menu suggestion system described in claim 1, The display information creation unit is a menu suggestion system that creates a screen prompting the user to perform the pairing if the pairing has not been completed.

4. In the menu suggestion system described in claim 1, The aforementioned home appliance is a refrigerator equipped with a camera, A menu suggestion system that, when the pairing of the refrigerator is completed and the camera is in a state where it can acquire information on stored food items, suggests a menu that utilizes the information on stored food items.

5. In the menu suggestion system described in claim 1, The aforementioned home appliance is a refrigerator equipped with a camera, The aforementioned display information creation unit is a menu suggestion system that, when the camera is in a state where it can acquire stored food information, creates a screen that notifies the user that the food information will be used.

6. In the menu suggestion system described in claim 1, The aforementioned home appliance is a cooking appliance, A menu suggestion system that, when the pairing of the aforementioned cooking appliance is complete, suggests a menu that utilizes the aforementioned cooking appliance.

7. In the menu suggestion system described in claim 1, The aforementioned home appliance is a cooking appliance, The display information creation unit is a menu suggestion system that displays the model number of the appliance on the menu reception screen when the pairing of the cooking appliance is complete.

Images