Program and Food Ingredient Management System

Abstract

To properly manage foodstuffs according to the life of a user.SOLUTION: A foodstuff management system has a storage for storing foodstuffs, a terminal device, and a foodstuff management device, and manages the foodstuffs stored in the storage. The foodstuff management system has: a storage unit which stores stored foodstuff information comprising a plurality of items regarding the foodstuffs; a display information generation unit which generates a foodstuff management screen presenting the foodstuffs based on the stored foodstuff information; an output unit which displays the foodstuff management screen; and a foodstuff management unit which extracts stored foodstuff information from the storage unit in accordance with filter items received from a user to select the plurality of items. The display information generation unit generates the foodstuff management screen based on the extracted stored foodstuff information. The output unit displays the foodstuff management screen generated based on the extracted stored foodstuff information.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a technology for managing food ingredients. In particular, it relates to a technology for managing food ingredients stored in a storage.

[0002] Note that food ingredients include foods such as meats and fish, beverages, seasonings, processed foods, and cooked dishes. In addition, the storage only needs to be able to store food ingredients, and includes refrigerators, pantries, etc., and also includes those with other notations such as storages. Furthermore, the storage in the present application includes concepts such as storage, custody, and preservation.

Background Art

[0003] Currently, due to the spread of IT technology, food ingredient management using a computer has been carried out. Patent Document 1 discloses a technology for "appropriately managing food ingredients in a refrigerator by a user". For this purpose, Patent Document 1 discloses that "a storage room designation unit 936 that designates any one of a plurality of storage rooms 61 to 64 provided in the refrigerator 10 based on a user operation on an operation / display unit 24 for inputting / outputting information or information supplied from the refrigerator 10, and an image obtained from a photographing unit 26 that photographs an image are stored in an in-storage-room image storage unit 912 as an in-storage-room image associated with the storage rooms 61 to 64 designated by the storage room designation unit 936, and an in-storage-room image storage control unit 938" are provided in the refrigerator management device 20.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In Patent Document 1, a user can use a portable terminal that can be realized by a smartphone to check an image inside the refrigerator, that is, food ingredients. Here, due to changes such as the diversification of recent lifestyles, it is necessary to manage food ingredients in a multi-faceted manner. However, in Patent Document 1, it was difficult to manage food ingredients according to the user's life simply by displaying an image of the food ingredients.

[0006] Therefore, in the present invention, it is an object to appropriately manage food ingredients according to the user's life. An example of this object is to realize a display according to the user's request.

Means for Solving the Problems

[0007] In order to solve the above problems, in the present invention, food ingredients are managed according to each stage in housework such as purchase, storage, and cooking of food ingredients, the situation of the food ingredients, and the state of the food ingredients. More specifically, in a food ingredient management system having a storage for storing food ingredients, a terminal device, and a food ingredient management device, for managing the food ingredients stored in the storage, a storage unit that stores storage food ingredient information composed of a plurality of items related to the food ingredients, the above-mentioned a display information creation unit that creates a food ingredient management screen indicating the food ingredients based on the storage food ingredient information, an output unit that displays the food ingredient management screen, and according to a filter item for selecting the plurality of items received from the user, the above-mentioned it has a food ingredient management unit that extracts storage food ingredient information from the storage unit. The display information creation unit creates the food ingredient management screen based on the extracted storage food ingredient information, and the output unit displays the food ingredient management screen created based on the extracted storage food ingredient information and, the filter items are the storage location of the food ingredients, the food ingredient category for classifying the food ingredients, and the expiration date of the food ingredients. The storage location of the food ingredients can be selected for each location in the storage warehouse which is the upper layer and the storage warehouse which is the lower layer. The food ingredient category can be selected for each upper layer and lower layer. When expiration is specified for the expiration date of the food ingredients as the filter item, the output unit displays, as the food ingredient management screen, food ingredient icons, food ingredient names, storage location icons indicating the storage locations read from the stored food ingredient information, and expiration alerts for expired food ingredients It is a program for causing a food ingredient management system or a terminal device to function.

Advantages of the Invention

[0008] According to the present invention, it becomes possible to appropriately manage food ingredients according to the user's life.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15A

Figure 15B

Figure 15C

Figure 15D

Figure 16

Figure 17

Figure 18A

Figure 18B

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24A

Figure 24B

Figure 25

Figure 26A

Figure 26B

Modes for Carrying Out the Invention

[0010] Hereinafter, an embodiment of the present invention will be described. In this embodiment, the management of food ingredients in ordinary households will be described as an example. In particular, in this embodiment, not only the management during storage in a storage such as a refrigerator is considered, but comprehensive food ingredient management including cooking, which is a form of purchase and use of food ingredients, is realized. FIG. 1 is a diagram for explaining the concept in this embodiment.

[0011] In FIG. 1, food ingredients will go through each stage of purchase, storage, and cooking. Specifically, food ingredients are purchased at store 50, stored in a storage such as refrigerator 31 in house 1, and cooked using cooking appliances such as IH cooker 32 and microwave oven 33. Therefore, in this embodiment, food ingredients are comprehensively managed according to each stage. More specifically, "food ingredient management", "shopping memo" management including "purchase proposal", and "recipe proposal" are carried out. For example, as shown in FIG. 1, for the "purchase" stage, "food ingredient management", "recipe proposal", "purchase proposal", and "shopping memo" are realized. Also, for the "storage stage", "food ingredient management" and "shopping memo" are realized. And for the "cooking" stage, "food ingredient management" and "recipe proposal" are realized.

[0012] As described above, food ingredients go through each stage, which represents the stages and flow of housework. Also, regarding the flow of housework, "purchase" is carried out according to "storage" and "cooking", and it is not just a simple flow, but a housework cycle occurs. Therefore, in this embodiment, housework support including comprehensive food ingredient management reflecting the housework cycle such as "food ingredient management", "shopping memo", and "recipe proposal" as described above is realized. Hereinafter, the configuration for realizing this housework support, particularly food ingredient management, will be described.

[0013] FIG. 2 is a system configuration diagram of the food ingredient management system in this embodiment. In FIG. 2, in house 1, household appliances such as refrigerator 31, IH cooker 32, and microwave oven 33 are used for housework. Also, assume that the person living in house 1, that is, the person performing the housework, has terminal device 10. And these household appliances and terminal device 10 can be connected to each other via router 40 or directly.

[0014] And the food ingredient management device 20 is connected to the network 60. Further, these home appliances and terminal devices 10 are connected to the network 60 that can be realized via the router 40 or directly through the Internet or the like. Also, sales systems such as the physical store system 51 and the EC system 52 of the store 50 that sells food ingredients are connected to the network 60. Furthermore, the connection between the terminal device 10, the home appliances and the router 40, and the network 60 may be a wired connection or a wireless connection. Hereinafter, each of these devices will be described.

[0015] First, in the house 1, as home appliances, a refrigerator 31, an IH cooker 32, and a microwave oven 33 are being used. Note that the house 1 is an example of the usage area of home appliances, and this embodiment can also be applied to other areas. Also, there may be a plurality of usage areas. Furthermore, each of the above-mentioned home appliances is also an example, and it may be a part thereof, or other home appliances may be added. In particular, the refrigerator 31 is an example of a storage that can store food ingredients, and other storages such as a pantry and a wine cellar can also be used, and in this embodiment, this storage is also treated as a home appliance. Also, the IH cooker 32 and the microwave oven 33 are also examples, and other cooking appliances may be used, or at least one of them may be omitted. Furthermore, as home appliances, home appliances other than the refrigerator 31 and cooking appliances may be used.

[0016] Here, FIG. 3 shows a functional block diagram of the system for managing food ingredients in this embodiment. FIG. 3 may communicate with home appliances such as the refrigerator 31. As shown in FIG. 3, the system for managing food ingredients includes a control unit 310 that controls the home appliance itself, a home appliance communication unit 306, a display operation panel 307, an operation unit 308, a sensor unit 309, and a server unit 301. And these are connected to each other via a communication path. Hereinafter, each configuration will be described. Also, the display operation panel 307 and the server unit 301 may be in the terminal device 10 owned by the user. Also, the server unit may be within the company that provides this food ingredient management system or within the server under its jurisdiction.

[0017] First, the server unit 301 includes a control signal generation unit 302, a food ingredient management unit 303, a recipe proposal unit 304, and a shopping memo management unit 305. That is, the server unit 301 executes various information processes for managing food ingredients. Note that the control signal generation unit 302 may be within a control unit 310 that controls the home appliance itself, and creates and outputs a control signal for realizing functions of the home appliance such as temperature adjustment inside the storage, and controls the operation of the home appliance. In particular, in the refrigerator 31, temperature adjustment (refrigeration, freezing) can be realized to reach the set temperature. Also, the IH cooker 32 and the microwave oven 33 can realize various cooking functions such as heating.

[0018] In addition, the food ingredient management unit 303 manages the food ingredients managed and stored in the house 1. In particular, when the home appliance is a storage such as the refrigerator 31, it manages the food ingredients stored in itself and other storages. The recipe proposal unit 304 identifies a recipe indicating a dish and its cooking method according to the stored food ingredients and the shopping memo. The shopping memo management unit 305 manages a shopping memo indicating the food ingredients desired to be purchased by the user and related persons such as family members.

[0019] Note that the server unit 301 can be realized by an MPU (Micro-Processing Unit), and the control signal generation unit 302, the food ingredient management unit 303, the recipe proposal unit 304, and the shopping memo management unit 305 can be realized by software such as dedicated hardware or a program. Also, in a storage such as a pantry, the control signal generation unit 302 and the operation unit 308 may be omitted.

[0020] In addition, the home appliance communication unit 306 has communication functions via a router 40 or a network 60 and a short-range wireless communication function. The home appliance communication unit 306 outputs the content and operating status detected by the sensor unit 309, and receives control instructions from the terminal device 10, the food management device 20, etc. Further, the display operation panel 307 of the home appliance or the user's terminal device 10 receives operations on the home appliance from the user and outputs the operating status of the home appliance. Note that the display operation panel 307 may be configured to be divided into an operation unit (e.g., buttons) that receives operations and an output unit such as a display unit that performs displays.

[0021] In addition, the operation unit 308 executes various functions according to the control from the control unit 310. For this purpose, for example, the control signal created by the control signal creation unit 302 is used. The functions to be executed include a refrigeration function (temperature adjustment function), a cooking function, etc., and can be realized by a compressor, a motor, an actuator, etc.

[0022] In addition, the sensor unit 309 detects the status of the home appliance such as a camera. This status includes the temperature during storage or cooking. Further, in the storage, it is desirable for the sensor unit 309 to detect the storage status. And as the storage status, it is desirable to photograph the stored food ingredients.

[0023] Next, the terminal device 10 in FIGS. 1 and 2 will be described. The terminal device 10 is used by the user or family members to manage home appliances and can be realized by a computer such as a smartphone, a mobile phone, a tablet, or a PC. And when the terminal device 10 is realized by a so-called mobile computer such as a smartphone, it can be used not only inside the house 1 but also in a store 50, etc. Also, in FIGS. 1 and 2, only one terminal device 10 is shown, but a plurality of them may be prepared for family members, etc., or the user may use a plurality of terminal devices 10.

[0024] Here, FIG. 4 is a functional block diagram of the terminal device 10 in the present embodiment. In FIG. 4, the terminal device 10 includes a terminal communication unit 11, a photographing unit 12, a display information creation unit 13, a foodstuff management unit 14, a recipe proposal unit 15, a shopping memo management unit 16, a user information management unit 17, an input unit 18, an output unit 19, and a storage unit 100. Note that the terminal device itself only has a display function, and foodstuff management, recipe proposal, and shopping memo managed by the server unit 301 may be received and only displayed.

[0025] Then, the terminal communication unit 11 has a communication function via a router 40 or a network 60 and a short-range wireless communication function. Also, the photographing unit 12 has a photographing function such as a camera. The display information creation unit 13 creates information to be displayed on the terminal device 10. Similar to the foodstuff management unit 303, the foodstuff management unit 14 manages foodstuffs managed and stored in the house 1. Similar to the recipe proposal unit 304, the recipe proposal unit 15 identifies a recipe indicating a dish and its cooking method according to the stored foodstuffs and shopping memo. Similar to the shopping memo management unit 305, the shopping memo management unit 16 manages a shopping memo indicating foodstuffs desired to be purchased by users and their related persons such as family members. The user information management unit 17 manages user management information 110 regarding the user of the terminal device 10, their family members, that is, related persons of housework.

[0026] The input unit 18 receives various operations from the user and family members. The output unit 19 outputs various information such as the housework situation and advice regarding housework. Note that the input unit 18 and the output unit 19 can be integrally configured like a touch panel. Furthermore, the storage unit 100 stores image data photographed by the photographing unit 12, various information used in the processing by the display information creation unit 13 to the user information management unit 17, and the processing of home appliances and the foodstuff management device 20. When there is a camera for photographing the inside image of the refrigerator on the upper part of the refrigerator, it is not necessary to photograph on the terminal side. When there is a camera on the upper part of such a refrigerator, it is possible to photograph the inside of the refrigerator, the door side, the vegetable compartment, the freezer, etc. at the timing when the user opens and closes, and store the images.

[0027] Here, an exemplary implementation of the terminal device 10 will be described. FIG. 5 is a hardware configuration diagram of the terminal device 10 in the present embodiment. In FIG. 5, the terminal device 10 includes a touch panel 101, a processing device 102, a communication device 103, a storage device 104, and a camera, which are connected to each other via a communication path.

[0028] First, the touch panel 101 has a configuration that combines the input unit 18 and the output unit 19 in FIG. 4, and accepts operations from the user and displays various information. Note that the touch panel 101 may be configured separately as an input device and an output device. Further, the processing device 102 can be realized by a processor such as a CPU (Central Processing Unit), and executes calculations according to the home appliance management program 105 (integrated application) stored in the storage device 104 described later.

[0029] The home appliance management program 105 is composed of a food ingredient management module 106, a recipe proposal module 107, a shopping memo management module 108, and a user management module 109 for each of its functions. Note that each of these modules may be realized by an individual program or a partial combination.

[0030] Here, the configuration shown in FIG. 5 that executes the same functions as each module is as follows. Food ingredient management module 106: Food ingredient management unit 14 Recipe proposal module 107: Recipe proposal unit 15 Shopping memo management module 108: Shopping memo management unit 16 User management module 109: User information management unit 17 Note that the display information creation unit 13 in FIG. 4 is assumed to function on an OS (Operating System) not shown in the terminal device 10. However, it may be realized as one function of the home appliance management program 105 or as another application program.

[0031] Therefore, the processing device 102 executes operations corresponding to the processing of the food ingredient management unit 14, the recipe proposal unit 15, the shopping memo management unit 16, and the user information management unit 17 in accordance with the home appliance management program 105.

[0032] In addition, the storage device 104 stores the home appliance management program 105, user management information 110, stored food ingredient information 111, shopping memo information 112, recipe information 113, icon information 114, and cooking history information 115. Here, the home appliance management program 105 may be a program for generally and integrally managing home appliances, or may be composed of a plurality of programs for each home appliance. In the latter case, the management programs for the refrigerator 31, the IH cooker 32, and the microwave oven 33 will be used. Note that the user management information 110, the stored food ingredient information 111, the shopping memo information 112, the recipe information 113, the icon information 114, and the cooking history information 115 will be described later when explaining the information stored in the food ingredient management device. Note that the home appliance management program 105 may be realized as a food ingredient management program including recipe proposal and the like.

[0033] In addition, the storage device 104 may be realized by a main storage device such as a memory and a secondary storage device (storage medium) which is a so-called storage. Note that the secondary storage device may be realized by an external HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, or the like. Furthermore, at least a part of the home appliance management program 105, the user management information 110, the stored food ingredient information 111, the shopping memo information 112, the recipe information 113, the icon information 114, and the cooking history information 115 can be omitted. This is because it is sufficient if it is held in the food ingredient management device 20 described later. Moreover, at least some modules (functions) of the home appliance management program 105 may be provided in the home appliances or the food ingredient management device 20.

[0034] The description of FIG. 5 is now complete, and we return to the description of FIG. 2. The food management device 20 is provided to realize the use of home appliances, that is, to assist with housework, and can be realized by a computer such as a server or the cloud. Assisting with housework includes appropriate food management according to the stage of food ingredients and housework. For this purpose, the food management device 20 has a device communication unit 21, a display information creation unit 22, a food management unit 23, a recipe proposal unit 24, a shopping memo management unit 25, a user information management unit 26, and a storage unit 27.

[0035] Here, the device communication unit 21 is connected to the terminal device 10 and home appliances via the network 60. Also, the display information creation unit 22 creates information to be displayed on the terminal device 10 in the same manner as the display information creation unit 13 of the terminal device 10. Further, the food management unit 23 manages the food ingredients stored and managed in the house 1 in the same manner as the food management unit 303 or the food management unit 14 of the terminal device 10.

[0036] Also, the recipe proposal unit 24 identifies a recipe indicating a dish and its cooking method in the same manner as the recipe proposal unit 304 or the recipe proposal unit 15. Further, the shopping memo management unit 25 manages the shopping memo in the same manner as the shopping memo management unit 305 or the shopping memo management unit 16. Furthermore, the user information management unit 26 manages user management information 271 regarding the users of the terminal device 10 and their families.

[0037] Moreover, the storage unit 27 stores user management information 271, stored food ingredient information 272, shopping memo information 273, store food ingredient information 274, recipe information 275, icon information 276, and cooking history information 277. Each of these pieces of information will be described later. Before that, an exemplary implementation of the food management device 20 will be described. FIG. 6 is a hardware configuration diagram of the food management device 20 in the present embodiment. In FIG. 6, the food management device 20 has a processing device 201, a communication device 202, a memory 203, and a secondary storage device 204, which are connected to each other via a communication path.

[0038] First, the processing device 201 can be realized by a processor such as a CPU, and executes calculations according to the home appliance management program 205 stored in the auxiliary storage device 204 described later. The home appliance management program 205 will be described later.

[0039] Also, the communication device 202 corresponds to the device communication unit 21 in FIG. 2, connects to the network 60, and communicates with other devices.

[0040] Also, the memory 203 and the auxiliary storage device 204 correspond to the storage unit 27 in FIG. 2. The memory 203 expands the home appliance management program 205 stored in the auxiliary storage device 204 and the information used in the processing by the processing device 201. The auxiliary storage device 204 can be realized by a so-called storage. The auxiliary storage device 204 stores a home appliance management program 205, user management information 271, stored food ingredient information 272, shopping memo information 273, store food ingredient information 274, recipe information 275, icon information 276, and cooking history information 277. The auxiliary storage device 204 may be realized by various storage media such as an external HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, etc., or may be realized by a device separate from the food ingredient management device 20 such as a file server.

[0041] Here, the home appliance management program 205 is composed of a food ingredient management module 206, a recipe proposal module 207, a shopping memo management module 208, and a user information management module 209. Note that each of these modules may be realized by an individual program or a partial combination. The home appliance management program 205 may also be realized as a food ingredient management program having functions such as recipe proposal.

[0042] Here, the configuration shown in FIG. 2 that executes the same functions as each module is as follows. Food ingredient management module 206: Food ingredient management unit 23 Recipe proposal module 207: Recipe proposal unit 24 Shopping memo management module 208: Shopping memo management unit 25 User information management module 209: User information management unit 26 Therefore, the processing device 201 will execute the processing of the food management unit 23, the recipe proposal unit 24, the shopping memo management unit 25, and the user information management unit 26 according to the home appliance management program 205.

[0043] Note that the display information creation unit 22 in FIG. 2 is assumed to function on an OS (Operating System) not shown in the food management device 20. However, it may be realized as a function of the home appliance management program 205, or may be realized as another application program.

[0044] Next, each piece of information stored in the auxiliary storage device 204 will be described together with the information shown in FIG. 5. First, FIG. 7 is a diagram showing user management information 271 used in this embodiment. The user management information 271 is information about users who use home appliances. In FIG. 7, the user management information 271 has items for user, address, contact information, owned devices, and standing supplies for each user or for each family to which a user belongs. First, a family indicates the unit of people living in House 1. Also, a user indicates a member of the family and can be expressed by attributes such as "dad", name, and nickname, and is often involved in housework including food management. The address indicates the address of the corresponding user, but it may be a single address as a family. Also, the contact information indicates the contact information such as the phone number or email address of the corresponding user, but it may be a single contact information as a family.

[0045] Also, the owned devices list the home appliances in House 1, but may be an item for each user. Furthermore, the standing supplies indicate what is always stocked as food for the family or user. Note that this item may be omitted.

[0046] Here, the user management information 110 stored in the terminal device 10 may have the same items as the user management information 271 and may be composed of records of the users who use the terminal device 10, or may be composed of records for the families of the users.

[0047] Next, FIG. 8 is a diagram showing the stored food information 272 used in the present embodiment. The stored food information 272 is information regarding the food stored in the house 1 such as the refrigerator 31. In FIG. 8, the stored food information 272 has items of food, quantity, storage location, storage date, expiration date / best-before date, expired, icon, and notification information for each user or for each family to which a user belongs. Further, for each user, the stored food information 272 first shows the stored food, and more preferably, it is desirable to use hierarchical items. For example, in the example of FIG. 8, upper-level hierarchies such as meats and vegetables are shown, and specific product names such as beef A and daikon radish B are shown. Note that proper nouns such as product names can be used for beef A. Also, the quantity indicates the quantity of the corresponding food.

[0048] Also, the storage location indicates the storage location of the corresponding food. More preferably, it is desirable to use hierarchical items for the storage location. That is, storage compartments such as the refrigerator 31 and the pantry are the upper-level hierarchies, and locations within the storage compartments such as the freezer are the lower-level hierarchies. However, the storage location may be a non-hierarchical item such as a storage compartment. Also, the storage date indicates the date when the corresponding food was stored in the storage location. Note that the storage date may be, for example, the purchase date when starting to manage the food, or it may indicate up to that date and time.

[0049] Also, the expiration date / best-before date indicates the management deadline of the corresponding food, and in the present embodiment, the expiration date and the best-before date are used. Also, for expired, "expired" is recorded when the corresponding expiration date / best-before date is exceeded or is approaching, and "not expired" is recorded otherwise. Also, the icon is image data indicating the corresponding food. Note that this item may be managed by the icon information 276 described later.

[0050] Furthermore, the notification information is information regarding notifications for the management of the corresponding food ingredients. Specifically, as the notification information, it indicates the conditions of the notification and the content to be notified. Here, the conditions include the timing of the notification. Also, the content includes alerts and related recipes. Regarding the food ingredients, as general definition information, food ingredient definition information including its icon and notification information may be used. Also, when the stored food ingredient information 272 is managed for each family, within that family, the stored food ingredient information 272 can be shared. That is, the terminal device 10 of the family members can access the corresponding stored food ingredient information 272. Also, when the stored food ingredient information 272 is stored for each individual user, it can be shared with the family, other groups, or individuals to which the said individual user belongs, and the sharing may utilize SNS such as email or message apps. Note that this sharing is the same for the shopping memo information 273 and cooking history information 277 described later. Furthermore, the stored food ingredient information 272 may be managed for each user. Here, the stored food ingredient information 111 stored in the terminal device 10 may have the same items as the stored food ingredient information 272 and may be composed of records of the user using the said terminal device 10, or may be composed of records for the user's family members.

[0051] Next, FIG. 9 is a diagram showing the shopping memo information 273 used in the present embodiment. The shopping memo information 273 is information regarding food ingredients desired to be purchased by the user or the family. Note that the desire to purchase includes purchase plans, considerations, and proposals. In FIG. 9, the shopping memo information 273 has items for food ingredients, daily necessities, purchased items, and icons for each family or each user. First, the user is the same item as the user management information 271.

[0052] In addition, the food ingredients indicate the food ingredients that the corresponding user wishes to purchase, has planned to purchase, or has been proposed to purchase. The stock items indicate whether the corresponding food ingredients are stock items, but may be omitted because they overlap with the stored food ingredient information 272. Furthermore, the icon is the image data of the corresponding food ingredient. Note that this item may be managed by the icon information 276 described later. Here, the shopping memo information 112 stored in the terminal device 10 may have the same items as the shopping memo information 273 and may be composed of records of the users who use the terminal device 10, or may be composed of records of the families of the users.

[0053] Next, FIG. 10 is a diagram showing the store food ingredient information 274 used in the present embodiment. The store food ingredient information 274 is information regarding food ingredients that can be purchased. In FIG. 10, the store food ingredient information 274 has items of food ingredients, quantities, and expiration dates / best-before dates for each store. First, the store is an item indicating the seller of the food ingredients, and may be a real store such as a supermarket, or may be any online store such as an EC site.

[0054] In addition, the food ingredients indicate the food ingredients sold or to be sold at the corresponding store. Also, the quantity indicates the quantity of the corresponding food ingredient. Furthermore, the expiration date / best-before date indicates the management period of the corresponding food ingredient, and the expiration date and best-before date are used in the present embodiment. Note that the terminal device 10 in FIG. 5 may store information corresponding to the store food ingredient information 274.

[0055] Next, FIG. 11 is a diagram showing the recipe information 275 used in the present embodiment. The recipe information 275 is information indicating the recipe of a dish showing the dish and its cooking method. In FIG. 11, the recipe information 275 has items of food ingredients, quantities, and cooking methods for each dish. First, the dish is information for identifying the dish that is the target of the recipe information, and a dish name can be used.

[0056] In addition, the ingredients indicate the ingredients used in the corresponding dish. Also, the quantity indicates the quantity of the ingredients used in the corresponding dish. Furthermore, the cooking method indicates the cooking method of the corresponding dish, that is, the procedure. Here, the recipe information 113 stored in the terminal device 10 has the same items as the recipe information 275. However, it may be composed of records of dishes specialized for the user of the terminal device 10 and their family members.

[0057] Next, FIG. 12 is a diagram showing the icon information 276 used in the present embodiment. The icon information 276 is information that defines the icons presented to the user. As shown in FIG. 12, the icon information 276 defines the icons for each target. First, the target indicates the target of the icon to be displayed and is mainly divided into ingredients and management information. The ingredients are determined for each type. Also, the management information indicates additional information about the ingredients to be managed. For example, it includes new registration, that is, the fact that it has been newly stored, etc.

[0058] Also, the icon is the image data to be displayed. Here, the icon information 114 stored in the terminal device 10 has the same items as the icon information 276. However, it may be composed of records of ingredients and management information specialized for the user of the terminal device 10 and their family members.

[0059] Next, FIG. 13 is a diagram showing the cooking history information 277 used in the present embodiment. The cooking history information 277 is information regarding the history of the dishes cooked in the house 1. As shown in FIG. 13, the cooking history information 277 has items for each family member, for each user, including household appliances, dishes, ingredients, and cooking time.

[0060] First, the family and the user indicate the family member or user who prepared the meal, and either one can be used. Also, the home appliance indicates the home appliance used in the corresponding meal. Further, the food ingredients indicate the food ingredients used in the corresponding meal. Additionally, the cooking time indicates the time when the corresponding meal was prepared. Here, the cooking history information 115 stored in the terminal device 10 has the same items as the cooking history information 277 and may be composed of records of the users who use the terminal device 10, or may be composed of records for the families of the users. With the above, the description of the information used in this embodiment is completed, and we return to the description of FIG. 2.

[0061] In FIG. 2, the physical store system 51 is a computer system operated in a physical store that sells food ingredients, and manages the inventory in the store. Note that the physical store system 51 may manage multiple stores of the same chain store collectively, or may manage each store individually. Further, the EC system 52 is a computer system for realizing so-called online shopping targeting food ingredients. Then, in response to an order (purchase request) from the terminal device 10, it sells food ingredients to the user. Note that the physical store system 51 may realize online shopping. Further, it is desirable for the physical store system 51 and the EC system 52 to store food ingredient information and recipe information regarding their own food ingredients. With the above, the description of the configuration of this embodiment is completed.

[0062] Next, the processing in this embodiment will be described. FIG. 14 is a diagram showing the processing flow (concept) in this embodiment. In each step of FIG. 14, information collection, information management / updating, and information presentation are performed using at least a part of the above-described devices. Then, by repeating the processing shown in FIG. 14 according to the cycle of housework, the management of food ingredients is realized.

[0063] In the information collection step, purchase status, storage status, cooking history, etc. are acquired. Also, in the information management / updating step, settings and updates of stored food ingredient information 111 and stored food ingredient information 272 are performed, or updates of shopping memo information 112 and shopping memo information 273 are performed. Furthermore, in the information presentation step, stored food ingredient information 111, stored food ingredient information 272, and shopping memos are presented to the user, or recipes and purchases are proposed. Examples 1 to 4 showing more specific aspects of the above embodiments will be described below.

Example

[0064] First, Example 1 provides a display screen on the terminal device 10 that is easy for the user to use for "food ingredient management", "recipe proposal", and "shopping memo". In this example, screens for "food ingredient management", "recipe proposal", and "shopping memo" are prepared, and these can be switched using tabs within the screen. FIG. 15A is a diagram showing the food ingredient management screen 101a in this example. In this example, it is assumed that the food ingredient management screen 101a is displayed on the touch panel 101 of the terminal device 10.

[0065] The food ingredient management screen 101a is created based on the stored food ingredient information 272 or the stored food ingredient information 111 and is a screen showing the stored food ingredients, and is composed of a food ingredient display area 1011 and a tab 1012. And in the food ingredient display area 1011, "stored food ingredients" are displayed in a list format. Also, in each food ingredient display area 1011, for each stored food ingredient, a food ingredient icon 1011a, a food ingredient name 1011b, and an approximate expiration date 1011c are shown. The example in FIG. 15A shows that "beef", "daikon radish", "milk", and "frozen pizza" are stored and managed in house 1 (for example, refrigerator 31).

[0066] Also, in tab 1012, it is an area for selectively displaying any one of "Food Material Management", "Recipe Proposal", and "Shopping Memo". In this area, an area for selectively displaying "Settings" which enables batch settings and the like to be described later may be further provided. That is, the areas for displaying "Food Material Management", "Recipe Proposal", "Shopping Memo", and "Settings" are areas that receive specifications for tab 1012. In FIG. 15A, since "Food Material Management" is specified, the food material management screen 101a is displayed as described above.

[0067] Next, FIG. 15B is a diagram showing the recipe proposal screen 101b in the present embodiment. In the present embodiment, it is assumed that the recipe proposal screen 101b is also displayed on the touch panel 101 of the terminal device 10. The recipe proposal screen 101b is created based on the recipe information 275 or the recipe information 113 and shows the recipe of the proposed dish. Specifically, as shown in the figure, it is composed of a list specification area 1013 for a proposed recipe such as "Today's Recipe Diagnosis", a recipe display area 1014, and a tab 1012. And the list specification area 1013 is an area for displaying the proposed recipes in a list.

[0068] Also, the recipe display area 1014 shows the image of the dish, the ingredients, and the cooking method. Also, in tab 1012 of FIG. 15B, "Recipe Proposal" is specified, so the display as shown in the figure is being made. Also, for example, when it is changed from "Food Material Management" to "Recipe Proposal" in tab 1012, the screen transitions from the food material management screen 101a in FIG. 15A to the recipe proposal screen 101b in FIG. 15B.

[0069] Next, FIG. 15C is a diagram showing the shopping memo screen 101c in the present embodiment. In the present embodiment, it is assumed that the shopping memo screen 101c is also displayed on the touch panel 101 of the terminal device 10. The shopping memo screen 101c is created based on the shopping memo information 273 or the shopping memo information 112 and is a screen showing the shopping memo, that is, the ingredients desired to be purchased. Specifically, as shown in the figure, as the "Shopping Memo", it is composed of a purchased ingredient display area 1015 and a tab 1012.

[0070] And in each purchased food display area 1015, the foods that the user wishes to purchase are displayed. Note that the foods that the user wishes to purchase may be those input by the user, or may be foods proposed from the system side such as the food management device 20 or the terminal device 10. Also, in the purchased food display area 1015, the number (quantity) of the foods that the user wishes to purchase can be specified.

[0071] Also, since "shopping memo" is specified in the tab 1012 of FIG. 15C, the display as shown in the figure is made. Also, for example, when the tab 1012 is changed from "recipe proposal" or "food management" to "shopping memo", the screen transitions from the screens shown in FIGS. 15A and B to the shopping memo screen 101c of FIG. 15C. Note that this example of transition is merely an example, and by specifying the tab 1012, it is also possible to change to the food management screen 101a of FIG. 15A. As described above, by the tab 1012 of the first embodiment, selection of each screen becomes possible. Note that at least one of the food management screen 101a and the shopping memo screen 101c can be shared by the family. That is, on each of the terminal devices 10 of the family members, at least one of the common food management screen 101a and the shopping memo screen 101c can be displayed as a "family screen". This is because the stored food information 272 and the shopping memo information 273 are managed in family units. Further, on the shopping memo screen 101c, a refrigerator photo showing the inside of the refrigerator 31 as shown in FIG. 15D can be referred to. The refrigerator photo is an image taken by the user at the timing when the user opened the refrigerator using the camera above the refrigerator or outside the refrigerator compartment. Further, as shown in the shopping memo screen 101c of FIG. 15D, when the storage location is tapped, it is possible to select an image of the inside of the refrigerator, an image of the door side, an image of the vegetable compartment, and an image of the freezer. Further, when the refrigerator image is tapped, it is possible to enlarge, reduce, or tilt the image of the inside of the refrigerator as shown in FIG. 15D (refer to the tip of the arrow).

[0072] Next, the processing in Example 1 including the above-described screen display will be described. FIG. 16 is a flowchart showing the processing flow in Example 1. First, in step S1, the terminal device 10 is activated, that is, the home appliance management program 105 starts operating in response to a user's instruction. This means that the display information creation unit 13 to the user information management unit 17 in FIG. 4 become operable.

[0073] Also, in step S2, the shopping memo management unit 16 reads its own shopping memo information 112 or the shopping memo information input via the input unit 18. Then, in step S3, the terminal communication unit 11 transmits a request for information related to the stored food materials that are the management target including the read shopping memo information to the refrigerator 31 and the food material management device 20. This is executed to update various information to the latest according to the shopping memo information updated locally in the terminal device 10. For this reason, the shopping memo in step S2 is not essential, and it may be any update request or designation of food materials, or simply a request for the latest information.

[0074] Also, in step S4, the home appliance communication unit 306 of the refrigerator 31 receives the request in step S3. Further, in step S5, according to the control signal of the control signal creation unit 302, the sensor unit 309 photographs the inside of the cabinet. As a result, image data of the food materials stored in the cabinet is acquired. Note that instead of photographing the inside image when there is a request from the terminal device 10, for example, when there is an external camera on the upper part of the refrigerator 31, it may be appropriately photographed at the timing when the user opens the door of the refrigerator 31 or the like, and the already photographed image may be transmitted. Also, in step S6, the home appliance communication unit 306 transmits the photographed image data to the terminal device 10. Then, in step S11, the terminal communication unit 11 receives the image data. Note that as shown in FIG. 17 described later, when making a photographing request inside the cabinet, steps S3 to S6 and S11 can be omitted.

[0075] Also, in step S7, the device communication unit 21 of the food management device 20 receives the request in step S3. Also, in step S8, the food management unit 23 identifies the stored food information 272 and the shopping memo information 273 corresponding to the request. Also, the recipe proposal unit 24 identifies the recipe information 275 corresponding to the request. Alternatively, the recipe proposal unit 24 may create recipe information. Then, in step S9, the device communication unit 21 transmits the identified stored food information 272, the shopping memo information 273, and the recipe information 275 to the terminal device 10. Then, in step S12, the terminal communication unit 11 receives these.

[0076] Also, in step S13, the display information creation unit 22 creates display information using the information received in steps S11 and S12. That is, the display information creation unit 22 creates the food management screen 101a from the stored food information 272. Also, the display information creation unit 22 creates the recipe proposal screen 101b from the recipe information 275. Further, the display information creation unit 22 will create the shopping memo screen 101c from the shopping memo information 273. Here, the user has a need to use the shopping memo screen 101c while checking the inside of the refrigerator 31, that is, the food in the refrigerator 31. That is, there is a desire to check whether the desired food is stored in the refrigerator 31. Therefore, the display information creation unit 22 may create the shopping memo screen 101c so as to include the photographed data received in step S11. Further, in the creation of the food management screen 101a, the stored food information 272 stored in the food management device 20 may not reflect the food that has been recently stored in the refrigerator 31. In this case, it is desirable for the display information creation unit 22 to include the image data received in step S11 in the food management screen 101a. Note that As a result of the above, the respective screens shown in FIGS. 15A to 15C are created.

[0077] Then, in step S14, the output unit 19 displays the created food material management screen 101a, recipe proposal screen 101b, and shopping memo screen 101c. As a result, switching of the display screen using the tab 1012 as described above can be realized. Here, in the display process in step S14, various information can be updated according to the input from the user. One specific example of this will be described below.

[0078] FIG. 17 is a flowchart showing a specific example of the display process in the first embodiment. First, in step S15, the output unit 19 displays the display screen created in step S13. At this time, which screen to display may be determined according to the initial setting or may be the previously displayed screen. In this example, it is assumed that the shopping memo screen 101c is displayed.

[0079] Also, in step S16, the shopping memo management unit 16 determines whether there is a change to the shopping memo. For this purpose, the shopping memo management unit 16 determines whether the user has input a change instruction to the input unit 18. As a result, if there is a change (Yes), the process proceeds to step S17. If there is no change (No), the process proceeds to step S20.

[0080] Also, in step S17, the terminal communication unit 11 notifies the food material management device 20 of the change to the shopping memo including the change content. Also, the device communication unit 21 of the food material management device 20 receives the change notification. Also, the shopping memo management unit 25 updates the shopping memo information 273 according to the change notification. Then, the process proceeds to step S9, and subsequent processing is executed according to the update result. Note that when the shopping memo information is managed only by the terminal device 10, the shopping memo information 112 may be updated by itself, and steps S17 to S19 may be omitted.

[0081] Also, in step S20, the food ingredient management unit 23 checks whether there is a shortage in the notified stored food ingredient information 272. Specifically, it checks whether there is a shortage in the food ingredients used in the notified recipe information 275 or the shopping memo information 273, or whether there is a shortage in the standing stocks regardless of the recipe information 275, etc. As a result, if only the standing stocks are insufficient, the process proceeds to step S23. If non-standing stocks are insufficient, the process proceeds to step S21. Further, if there is no shortage in both standing stocks and non-standing stocks, the process proceeds to step S24.

[0082] Also, in step S21, the food ingredient management unit 23 conducts an order confirmation for non-standing stocks. Specifically, the food ingredient management unit 23 causes the output unit 19 to display a screen for receiving an input of whether an order for the insufficient non-standing stocks is necessary and, if necessary, the quantity thereof. As a result, if an order is necessary (required), the process proceeds to step S23. Also, if it is not necessary (not required), the process proceeds to step S22.

[0083] Also, in step S22, the food ingredient management unit 23 checks whether there is a shortage not only in non-standing stocks but also in standing stocks. As a result, if there is also a shortage in standing stocks (Yes), the process proceeds to step S23. Also, if there is no shortage (No), the process proceeds to step S24. Note that the confirmation of standing stocks in step S20 and step S22 can be achieved by comparing the standing stocks in the user management information 271 with the stored food ingredient information 272.

[0084] Also, in step S23, the food ingredient management unit 23 executes an order process according to steps S20 to S22. Specifically, the following processes are executed.

[0085] (1) When transitioning from step S20 The food ingredient management unit 23 creates order information corresponding to the standing stocks in the user management information 271 for the insufficient standing stocks, and transmits it to the physical store system 51 or the EC system 52 via the terminal communication unit 11. That is, automatic ordering of standing stocks is performed. However, the transmission of the order information may be conditional on user confirmation. (2) When transitioning from step S21 The ingredient management department 23 creates order information indicating the ingredients input by the user and their quantities, and transmits it to the physical store system 51 and the EC system 52 via the terminal communication department 11. At this time, if there is also a shortage of standing inventory, it is desirable for the ingredient management department 23 to include the standing inventory in the order information. (3) When transitioning from step S22 The ingredient management department 23 executes the automatic ordering process in the same way as (1).

[0086] In step S23, it may be executed in cooperation with the ingredient management device 20 as follows. First, the ingredient management department 14 uses the terminal communication department 11 to notify the ingredient management device 20 of inquiry information including the ingredients in short supply. Then, the ingredient management department 23 of the ingredient management device 20 searches the store ingredient information 274 to confirm which stores have inventory. As a result, the ingredient management department 23 answers the terminal device 10 via the device communication department 21 about the stores with inventory.

[0087] Also, the output unit 19 of the terminal device 10 displays the answer. Then, the ingredient management department 14 creates order information according to the user's designation. Also, if the store does not support online shopping for the inventory, the user can go to the store and make a purchase.

[0088] Also, in step S24, the ingredient management department 23 determines whether there is a request to photograph the inside of the refrigerator 31. Specifically, it determines whether a request to photograph the inside, that is, the stored ingredients, has been received via the input unit 18. As a result, if there is a request (Yes), it transitions to step S25. Also, if there is no request (No), it transitions to step S32 to continue the display. Note that this step can be executed as appropriate and does not have to be preceded by the processing up to step S24.

[0089] Also, in step S25, the terminal communication unit 11 transmits a shooting request to the refrigerator 31. In response to this, in step S26, the home appliance communication unit 306 of the refrigerator 31 receives the shooting request. Then, in step S27, according to the control signal from the control signal creation unit 302, the sensor unit 309 shoots the inside of the compartment to obtain image data.

[0090] Also, in step S28, the home appliance communication unit 306 transmits the image data to the food management device 20 and / or the terminal device 10. The transmission destination of the image data may be either the food management device 20 or the terminal device 10, or may include the terminal devices of family members other than the terminal device 10.

[0091] Also, in step S29, the food management unit 23 of the food management device 20 updates the icon information 276 in the transmitted image data. Also, in this step, each of the food management unit 23 and the shopping memo management unit 25 may update the icons of the stored food information 272 and the shopping memo information 273 in the transmitted image data. As described above, it becomes possible to use icons of each piece of information that are actually stored. Note that the update of the stored food information 272 and the shopping memo information 273 may be either one of them.

[0092] Also, in step S30, the output unit 19 displays the image data notified in step S20. Then, in step S31, the icons are updated in the same manner as in step S29. That is, the food management unit 14 updates the icon information 114 in the notified image data. Also, each of the food management unit 14 and the shopping memo management unit 16 may update the icons of the stored food information 111 and the shopping memo information 112 in the transmitted image data. As described above, it becomes possible to use icons of each piece of information that are actually stored. Note that the update of the stored food information 111 and the shopping memo information 112 may be either one of them. Then, in step S32, the display on the output unit 19 continues.

[0093] The description of this flowchart is hereby completed. By the processes shown in the flowchart, ordering (purchasing) of the lacking food ingredients and timely update of icons can be realized. Also, in the first embodiment, the terminal device 10, the refrigerator 31, and the food ingredient management device 20 cooperate to execute the above-mentioned processes, but these processes may be executed by any one or two of these devices. Furthermore, the device for processing each step may be other than those exemplified. For example, the display on the output unit 19 of the terminal device 10 may be performed on the display operation panel 307 of the refrigerator 31. Additionally, the recipe creation in step S9 may be executed by the recipe proposal unit 15 of the terminal device 10. Also, in this embodiment, on the output unit 19 of the terminal device 10, any one of the food ingredient management screen 101a, the recipe proposal screen 101b, and the shopping memo screen 101c, and the tab 1012 for selecting these will be displayed on one screen.

Embodiment

[0094] Next, the second embodiment realizes the setting of the notification timing to the user and the batch setting for the notified food ingredients in "Food Ingredient Management". For example, conditions such as the notification timing of expiration for a plurality of stored food ingredients can be set. Furthermore, the user can perform batch setting independently from other users such as family members with whom food ingredient management and shopping lists can be shared. The stored food ingredient information 272 may be managed for each family so that it can be shared among family members (see FIG. 8). However, this is just an example, and management may be performed in units of groups other than families. Furthermore, in order to share the stored food ingredient information among these groups, SNS such as email or a message app may be used.

[0095] The processing of this embodiment will be described below. FIG. 18A is a flowchart showing the processing flow in Embodiment 2. Further, a screen for the batch setting is shown in FIG. 18B. First, in step S35, the output unit 19 of the terminal device 10 displays the setting screen at the bottom of FIG. 18A. In the setting screen, for example, it is possible to set consumption standard notification, ingredients with expired consumption standards, and ingredients to be excluded from search. Regarding the consumption standard notification, when the user taps the consumption standard notification in FIG. 18A, the timing of the notification recommending consumption for each ingredient can be set. For example, it can be set to the day of the consumption standard date, 1 day before, 2 days before, etc. Regarding the ingredients with expired consumption standards, when the user taps the ingredients with expired consumption standards in FIG. 18A, it is possible to set at what timing they will be automatically deleted or not deleted when the day for recommended consumption has passed. For example, when setting automatic deletion, it is possible to select whether to delete at the standard date (0:00), after 24 hours from the standard date, or after 72 hours. Also, regarding the setting of ingredients to be excluded from search (ingredients excluded from search), when the user taps the setting of ingredients to be excluded from search in FIG. 18A and transitions to the screen, the user can manually register ingredients. Regarding the ingredients registered in this ingredient excluded from search, they are excluded from the notification targets of the above-mentioned consumption standard notification, or even if a deadline is set in the setting of ingredients with expired consumption standards, they are excluded from the deletion targets and not deleted. Since such multiple settings are possible, in step S36, the input unit 18 receives an input from the user indicating the above-mentioned changed content. Then, in step S37, the ingredient management unit 14 notifies the ingredient management device 20 of the received changed content via the terminal communication unit 11.

[0096] Also, in step S38, the device communication unit 21 of the ingredient management device 20 receives the changed content. In response to this, in step S39, the ingredient management unit 23 searches for the stored ingredient information 272 corresponding to the changed content. Here, the stored ingredient information 272 of the user of the terminal device 10 or their family will be searched. Then, the ingredient management unit 23 batch-updates the notification information of the searched stored ingredient information 272 according to the changed content.

[0097] The above concludes the description of this flowchart. Through the processes shown in the flowchart, it is possible to achieve batch settings such as notification information of the stored food ingredients information 272 of the user or family members. Also, in the second embodiment, the terminal device 10, the refrigerator 31, and the food ingredient management device 20 cooperate to execute the above-described processes, but these processes may be executed by any one device or two devices. Furthermore, the device that processes each step may be other than the exemplified ones. For example, the display on the output unit 19 of the terminal device 10 may be performed on the display operation panel 307 of the refrigerator 31. Alternatively, the processes after step S38 may be executed by the food ingredient management unit 14 of the terminal device 10.

[0098] Next, a single display example in the second embodiment will be described. FIG. 19 is a diagram showing a food ingredient management screen 101a in the second embodiment. The food ingredient management screen 101a in this embodiment is also composed of a food ingredient display area 1011 and tabs 1012. However, in each food ingredient display area 1011, a management icon of the food ingredient management information is displayed in association with the food ingredient icon 1011a. As the management icons, a new registration icon 1011d and a storage location icon 1011e are used. These use the icons (images) recorded in the icon information 276 or the icon information 114. For example, in the example of FIG. 19, since "daikon radish" has been registered in the stored food ingredients information 272 or the stored food ingredients information 111 most recently (within a predetermined time), the new registration icon 1011d is associated with and displayed on the food ingredient icon 1011a of "daikon radish". For this purpose, the food ingredient management unit 14 reads out the new registration icon 1011d for new registration from the icon information 276 or the icon information 114. Then, the food ingredient management unit 14 associates and displays this via the output unit 19 with the food ingredient icon 1011a.

[0099] Also, in the example of FIG. 19, the storage location icon 1011e is associated with and displayed for each food ingredient icon 1011a. For this purpose, the food ingredient management unit 14 reads out the storage location of each food ingredient from the stored food ingredient information 272. Then, the food ingredient management unit 14 reads out the storage location icon 1011e indicating the read storage location from the icon information 276 or the icon information 114. In response to this, the food ingredient management unit 14 displays the read storage location icon 1011e in association with the food ingredient icon 1011a via the output unit 19. Here, the storage location icon 1011e in this embodiment indicates a storage compartment (upper hierarchy) such as the refrigerator 31 as a whole icon, and indicates a location within the storage compartment (lower hierarchy) at the blackened position. This is determined according to the storage location of the stored food ingredient information 272 or the stored food ingredient information 111.

[0100] Note that as these display formats, it is desirable to superimpose the new registration icon 1011d and the storage location icon 1011e on a part of the food ingredient icon 1011a. By performing such a display, the user can intuitively grasp the status of the stored food ingredients. Thus, the description of Example 2 ends.

Example

[0101] Next, in Example 3, in "food ingredient management", a filter display is performed for the user. In this embodiment, filtering can be realized by the storage location, the type of food ingredient, the expiration date, etc. The details will be described below. FIG. 20 is a flowchart showing the processing flow in Example 3. First, in step S35, the output unit 19 of the terminal device 10 is displaying the food ingredient management screen 101a. This is the same as in Example 2.

[0102] Also, in step S41, the food ingredient management unit 14 determines whether there is a filter request. For this purpose, for example, it is determined whether the user has input a filter request via the input unit 18. As a result, if there is a filter request (Yes), the process proceeds to step S42. If there is no filter request (No), the process returns to step S35 and the display continues.

[0103] Also, in step S42, the food ingredient management unit 14 causes the output unit 19 to display a filter item input screen 101d for inputting filter items. Here, FIG. 21 is a diagram showing the filter item input screen 101d in the third embodiment. In FIG. 21, the filter item input screen 101d is composed of the following areas for designating "filter items". That is, it is a total item designation area 1016a, a newly registered food ingredient designation area 1016b, a storage location designation area 1016c, an expiration date designation area 1016d, and a food ingredient category designation area 1016e.

[0104] And the total item designation area 1016a is a display area for designating all items, that is, for displaying all food ingredient information. Here, when designated in this area (painted black in the figure), all of the "stored food ingredients" are displayed. Also, the newly registered food ingredient designation area 1016b is a display area for designating the newly registered "stored food ingredients" described in the second embodiment as filter items. Also, the storage location designation area 1016c is a display area for designating the storage location as a filter item. As shown in FIG. 21, the storage location designation area 1016c enables designation for each of the above-described storage cabinets (upper layer) and locations within the storage cabinet (lower layer) as the storage location. Also, when there are a plurality of storage cabinets, any one of the storage cabinets can be filtered and selected. Further, when the user has a plurality of refrigerators, filtering is also selectable for each refrigerator.

[0105] In addition, the expiration date specification area 1016d is a display area for specifying the expiration date as a filter item. The expiration date specification area 1016d can specify the period until the expiration date or whether it has expired. In FIG. 21, the expiration date is used, but other dates such as the best-before date may also be used. Furthermore, the food category specification area 1016e is a display area for classifying "stored food ingredients" as a filter item according to the food category. As shown in FIG. 21, the food category can be specified hierarchically. This hierarchy can be identified using the food ingredient items in the stored food ingredient information 272 or the stored food ingredient information 111. Note that the filter items are not limited to those shown in FIG. 21. For example, the family members (users) may be used. Furthermore, some of the items in FIG. 21 may be omitted. In particular, it is desirable to use the storage location and the food category. In this step, the input to the above filter item input screen 101d is received.

[0106] Also, in step S43, the input unit 18 receives an input indicating a filter item from the user. Then, in step S44, the terminal communication unit 11 notifies the food ingredient management device 20 of the received filter item.

[0107] Also, in step S45, the device communication unit 21 of the food ingredient management device 20 receives the filter item. In response to this, in step S46, the food ingredient management unit 23 extracts the stored food ingredient information 272 corresponding to the filter item. Here, the relevant information is extracted from the stored food ingredient information 272 of the user or their family members of the terminal device 10. Then, in step S47, the food ingredient management unit 23 notifies the terminal device 10 of the extracted stored food ingredient information 272 via the device communication unit 21.

[0108] Also, in step S48, the food ingredient management unit 14 causes the output unit 19 to display the stored food ingredient information 272 notified, that is, the filtered information. Here, taking filtering by expiration date (expiration of use-by date) as an example, the display content in step S48 will be described. FIG. 22 is a diagram showing an example of a filtering screen 101e in the third embodiment. In this figure, an example is shown in which, in step S43, "expired" is received for "expiration of use-by date" on the filter item input screen 101d.

[0109] Filtering screen 101 e is composed of an expired food ingredient display area 1017, and in each of them, a food ingredient icon 1011a , food ingredient name 1011b , a storage location icon 1011e and an expired alert 1011f are displayed. The food ingredient icon 1011a, the food ingredient name 1011b, the food ingredient name 1011b and the storage location icon 1011e about have been described in the first and second embodiments. The expired alert 1011f indicates that the expiration of use-by date or the like has passed. More preferably, as illustrated, it is desirable to include that time period.

[0110] In the above third embodiment, "food ingredient management" has been described as an example, but filter display can also be applied to "shopping memo" and "recipe proposal". Also, by the processing of this embodiment, filter display can be realized with items desired by the user, and display that meets the user's needs can be realized. Further, in the first embodiment, the terminal device 10, the cooking equipment and the food ingredient management device 20 cooperate to execute the above-described processing, but these processes may be executed by any one device or two devices. Furthermore, the device that processes each step may be other than the exemplified one. For example, the display of the output unit 19 of the terminal device 10 may be performed on the display operation panel 307 of the refrigerator 31 or the cooking equipment. Alternatively, steps S45 to S37 may be executed by the food ingredient management unit 14 of the terminal device 10.

Example

[0111] Next, in Example 4, in "Food Ingredient Management", "Shopping Memo", and "Recipe Proposal", the stored food ingredient information 272 and the stored food ingredient information 111 are updated according to various situations related to food ingredients. More specifically, the stored food ingredient information of expired or used ingredients in cooking is deleted, and for the ingredients lacking in "Recipe Proposal" (lacking ingredients), they are reflected in the shopping memo information 273 and the shopping memo information 112.

[0112] First, the deletion of the stored food ingredient information will be explained. FIG. 23 is a flowchart showing the deletion process of the stored food ingredient information in Example 4. First, in step S49, the cooking function is executed by the operation unit 308 of the cooking device (IH cooker 32 or microwave oven 33).

[0113] Then, at the timing of the end or start of cooking, the food ingredient management unit 303 notifies the food ingredient management device 20 via the home appliance communication unit 306 of the cooking history including the food ingredients used in cooking. Note that the food ingredient management unit 303 can identify the used food ingredients based on the cooking menu for the display operation panel 307 or the input to the terminal device 10.

[0114] Also, in step S51, the food ingredient management unit 23 of the food ingredient management device 20 records the received cooking history as the cooking history information 277. The above processing is appropriately executed when cooking is performed. Also, in this step, the food ingredient management unit 23 updates the stored food ingredient information 272 using the cooking history information 277. For example, an item indicating whether it has been used is provided in the stored food ingredient information 272, and it is recorded here that it has been used.

[0115] Also, independently of the processing up to step S51, the processing after step S52 is executed. The processing after step S52 is executed as appropriate, for example, periodically. First, in step S52, the food ingredient management unit 23 checks whether there is an expired food ingredient or a used food ingredient. For this purpose, the food ingredient management unit 23 uses the expiration date / shelf life item in the stored food ingredient information 272 to check whether there is no expired food ingredient. Also, the food ingredient management unit 23 uses the item indicating used in the stored food ingredient information 272 to check whether there is no used food ingredient. As a result, if there is an expired or used food ingredient (Yes), the process proceeds to step S53. Otherwise (No), step S52 is executed as appropriate.

[0116] Also, in step S53, the food ingredient management unit 23 updates the stored food ingredient information 272. Specifically, the food ingredient management unit 23 records the fact in the expired item of the stored food ingredient information 272 determined in step S52. Note that the expired item may be updated as appropriate, and step S53 may be omitted if this item is used for determination in step S52.

[0117] Also, in step S53, the food ingredient management unit 23 notifies the terminal device 10 via the device communication unit 21 about the used and / or expired items. This notification includes the identification information of the corresponding food ingredient or its stored food ingredient information 272.

[0118] Also, in step S55, the terminal communication unit 11 of the terminal device 10 receives the notification in step S54. Then, in step S56, the food ingredient management unit 23 displays the food ingredient corresponding to the notification on the output unit 19. In response to this display, in step S57, the food ingredient management unit 23 determines whether to delete the stored food ingredient information 272 of the notified food ingredient. For this purpose, the food ingredient management unit 23 makes a determination according to the deletion permission for the input unit 18. As a result, if it is to be deleted (Yes), the process proceeds to step S58. Also, if it is not to be deleted (No), the process ends.

[0119] Hereinafter, specific examples of step S56 and step S57 will be described separately for expired and cooked. FIG. 24A is a diagram showing a food management screen 101a including a pop-up screen 1018a for expired food ingredients in Example 4. First, in step S56, this food management screen 101a is displayed. Here, in FIG. 24A, a pop-up screen 1018a is superimposed on the food management screen 101a. And the pop-up screen 1018a is used to confirm the deletion of the stored food ingredient information of the expired food ingredient. That is, the pop-up screen 1018a is provided with an expired food ingredient, a statement for confirming the deletion of the stored food ingredient information, and an area for confirming deletion. In the example of FIG. 24A, "レ point" is entered in "frozen pizza" and "potato". And when the user selects "delete", it transitions to step S58.

[0120] Also, FIG. 24B is a diagram showing a food management screen 101a including a pop-up screen 1018b for used food ingredients in Example 4. First, in step S56, this food management screen 101a is displayed. Here, in FIG. 24B, a pop-up screen 1018b is superimposed on the food management screen 101a. And the pop-up screen 1018b is used to confirm the deletion of the stored food ingredient information of the used food ingredient. That is, the pop-up screen 1018a is provided with a used food ingredient, a statement for confirming the deletion of the stored food ingredient information, and an area for confirming deletion. In the example of FIG. 24B, "レ point" is entered in "frozen pizza" and "potato". And when the user selects "delete", it transitions to step S58. Note that in this embodiment, the confirmation of the deletion of the deleted food ingredient and the used food ingredient is performed on separate screens, but it may also be performed on one screen.

[0121] As a result of the above, in step S58, the food ingredient management unit 23 notifies the food ingredient management device 20 of a deletion request via the terminal communication unit 11. This deletion request includes information indicating the food ingredients selected (レ point) in step S57.

[0122] Also, in step S59, the device communication unit 21 of the foodstuff management device 20 receives a deletion request. Then, in step S60, the foodstuff management unit 23 deletes the corresponding stored foodstuff information 272 in response to the deletion request. That is, the corresponding record in the stored foodstuff information 272 of FIG. 8 is deleted.

[0123] Next, the process for reflecting the lacking foodstuffs in the "recipe proposal" in the shopping memo information 273 and the shopping memo information 112 will be described. FIG. 25 is a flowchart showing the update process of the shopping memo information 273 in the fourth embodiment. First, in step S61, the recipe proposal unit 15 of the terminal device 10 notifies the foodstuff management device 20 of a recipe information proposal request via the terminal communication unit 11. This proposal request includes information used for proposing a recipe, such as information for identifying the user, information related to the dish, and its foodstuffs.

[0124] Also, in step S62, the device communication unit 21 of the foodstuff management device 20 receives the said proposal request. Note that steps S61 and S62 may be omitted, and this flowchart may be started from step S63.

[0125] Also, in step S63, the recipe proposal unit 24 identifies recipe information for the user in response to the proposal request or autonomously. In this embodiment, the recipe proposal unit 24 extracts the corresponding recipe information from the stored recipe information 275. However, the recipe proposal unit 24 may create the recipe information from the user management information 271, etc., or may acquire it from a recipe providing system connected to the network 60 in addition to the actual store system 51 and the EC system 52.

[0126] Also, in step S64, the recipe proposal unit 24 checks whether there are any missing ingredients for the cooking indicated by the specified recipe information. For this purpose, the recipe proposal unit 24 compares the specified recipe information with the stored ingredient information 272 of the corresponding user or their family members to check whether there are any missing ingredients. That is, it checks whether there are any missing ingredients among the ingredients used in the dish indicated by the recipe information that are not included in the stored ingredient information 272. As a result, if there are no missing ingredients (No), the process proceeds to step S65. If there are missing ingredients (Yes), the process proceeds to step S68.

[0127] Also, in step S65, the recipe proposal unit 24 notifies the terminal device 10 of the specified recipe information via the device communication unit 21. Also, in step S66, the terminal communication unit 11 of the terminal device 10 receives the recipe information. Then, in step S67, the recipe proposal unit 24 causes the output unit 19 to display a recipe proposal screen 101b based on the received recipe information. Here, FIG. 26A is a diagram showing the recipe proposal screen 101b in Example 4. FIG. 26A shows that an area 1019a indicating that there are no missing ingredients for the corresponding recipe is added compared to the recipe proposal screen 101b (FIG. 15B) in Example 1. Thus, the user can understand that there are no missing ingredients.

[0128] Also, in step S68, the shopping memo management unit 25 adds the ingredients that are lacking in step S64 to the shopping memo information 273. Also, in step S69, the shopping memo management unit 25 notifies the terminal device 10 via the device communication unit 21 of the recipe information specified in step S63, that is, the recipe information including the missing ingredients and the added shopping memo information added in step S68.

[0129] Also, in step S70, the terminal communication unit 11 of the terminal device 10 receives recipe information and shopping memo information. In response to this, in step S71, the recipe proposal unit 24 causes the output unit 19 to display a recipe proposal screen 101b corresponding to the received recipe information. Then, in step S72, the recipe proposal unit 15 determines whether the user has made a specification for the lacking ingredients. As a result, if there is no specification (No), the process transitions to step S71 and the display continues. If there is a specification (Yes), the process transitions to step S73. Also, in step S73, the shopping memo management unit 16 causes the output unit 19 to display a shopping memo screen 101c corresponding to the received shopping information according to the received recipe information. The lacking ingredients will also be included in this shopping memo screen 101c.

[0130] Here, steps S71 to S73 will be specifically described using the display screen. FIG. 26B is a diagram showing the recipe proposal screen 101b and the shopping memo screen 101c and their transition in the fourth embodiment. First, in step S71, the recipe proposal screen 101b shown in FIG. 26B is displayed. This recipe proposal screen 101b is provided with a shortage confirmation area 1019b compared to the recipe proposal screen 101b (FIG. 15B) in the first embodiment and the recipe proposal screen 101b in FIG. 26A. Here, when the shortage confirmation area 1019b is specified by the user, the screen is switched (transitions) to the shopping memo screen 101c as shown by the arrow in FIG. 26B. In this embodiment, the screen is switched from the recipe proposal screen 101b to the shopping memo screen 101c according to the specification, that is, the input. However, even if it is specified, the screen switching may be suppressed. In this case, the tab 1012 may be used to perform the switching manually.

[0131] This shopping memo screen 101c is provided with a lacking ingredient display area 1015a showing the lacking ingredient "onion" compared to the shopping memo screen 101c (FIG. 15C) in the first embodiment. By displaying the lacking ingredient display area 1015a separately from the purchased ingredient display area 1015, it is easier to grasp the lacking ingredients.

[0132] Furthermore, in this embodiment, "purchase proposal" is realized by the display of the shortage confirmation area 1019b in step S71 and the display of the shortage food ingredient display area 1015a in step S73. That is, the recipe proposal unit 24 and the shopping memo management unit 16 can function as a purchase proposal unit that proposes food ingredients to be purchased. With the above, the description of steps S71 to S73 using FIG. 26B is completed, and the description returns to FIG. 25.

[0133] Also, in step S74, the shopping memo management unit 16 determines whether it has received an update instruction for the shopping memo. For this purpose, the shopping memo management unit 16 determines whether it has received an update instruction from the user for the shopping memo screen 101c in FIG. 26B. Here, this update instruction includes adding the shortage food ingredients to the shopping memo information 273 and rejecting the proposed recipe information. These can be specified by input to the shopping memo screen 101c.

[0134] As a result, when an update instruction is received (Yes), the process proceeds to step S75. Also, when an update instruction is not received (No), the process proceeds to step S73, and the display of the shopping memo screen 101c is continued. Note that in step S73, in order to transition to the recipe proposal screen 101b, it can be realized by using the tab 1012. Conversely, in step S71, it is also possible to realize the transition to the shopping memo screen 101c by using the designation to the tab 1012.

[0135] Also, in step S75, the shopping memo management unit 16 notifies the food ingredient management device 20 of an update request via the terminal communication unit 11. In response to this, in step S76, the device communication unit 21 of the food ingredient management device 20 receives the update request. Then, in step S77, the shopping memo management unit 25 updates the shopping memo information 273 in response to the update request. That is, the shortage food ingredients presented in step S71 or step S73 are added to the shopping memo information 273. Also, the recipe proposal unit 24 may add the fact that the proposed recipe information has been rejected to the recipe information 275. It is desirable to reflect this result in the specification of the recipe information to be proposed hereafter.

[0136] According to the above-described Example 4, it is possible to appropriately update information according to the status of food materials such as used or expired. Also in Example 4, the terminal device 10 and the food material management device 20 cooperate to execute the above-described processing, but these processes may be executed by any one of the devices. Furthermore, even if the device that processes each step is other than the exemplified one, it may be acceptable. For example, the display of the output unit 19 of the terminal device 10 may be performed on the display operation panel 307 of the refrigerator 31 or the cooking equipment. Additionally, from the creation of the recipe information in step S63 to the update of the shopping memo information in step S68, it may be executed by the recipe proposal unit 15 or the shopping memo management unit 16 of the terminal device 10. Furthermore, the processing entity in each embodiment is not limited to the above-described one. For example, in Example 4, at least a part of the processing may be executed by home electric appliances including the refrigerator 31.

[0137] Note that, for each of the above-described embodiments, at least a part of them may be combined and implemented. For example, some embodiments such as Embodiment 1 and 3 may be combined, or each of Embodiments 1 to 4 may be combined.

Explanation of Reference Numerals

[0138] 1…House, 10…Terminal device, 11…Terminal communication unit, 12…Photographing unit, 13…Display information creation unit, 14…Food ingredient management unit, 15…Recipe proposal unit, 16…Shopping memo management unit, 17…User information management unit, 18…Input unit, 19…Output unit, 100…Memory unit, 20…Food ingredient management device, 21…Device communication unit, 22…Display information creation unit, 23…Food ingredient management unit, 24…Recipe proposal unit, 25…Shopping memo management unit, 26…User information management unit, 27…Memory unit, 271…User management information, 272…Stored food ingredient information, 273…Shopping memo information, 274…Store food ingredient information, 275…Recipe information, 276…Icon information, 277…Cooking history information, 31…Refrigerator, 32…IH cooker, 33…Microwave oven, 301…Server unit, 302…Control signal creation unit, 303…Food ingredient management unit, 304…Recipe proposal unit, 305…Shopping memo management unit, 306…Home appliance communication unit, 307…Display operation panel, 308…Operation unit, 309…Sensor unit, 310…Control unit, 40…Router, 50…Store, 51…Physical store system, 52…EC system, 60…Network

Claims

1. A program for causing a storage cabinet for storing food ingredients, a food ingredient management device, and a terminal device constituting a food ingredient management system to function, wherein the food ingredient management device has a storage unit that stores storage food ingredient information composed of a plurality of items related to the food ingredients, the program causes the terminal device to function as a display information creation unit that creates a food ingredient management screen showing the food ingredients based on the storage food ingredient information, function as an output unit that displays the food ingredient management screen, the food ingredient management device has a food ingredient management unit that extracts storage food ingredient information from the storage unit according to filter items for selecting the plurality of items received from a user, the display information creation unit creates the food ingredient management screen based on the extracted storage food ingredient information, the output unit displays the food ingredient management screen created based on the extracted storage food ingredient information, the filter items are the storage location of the food ingredients, a food ingredient category for classifying the food ingredients, and the expiration date of the food ingredients, the storage location of the food ingredients can be selected for each location in a storage cabinet that is a higher-level storage cabinet and a storage cabinet that is a lower-level storage cabinet, the food ingredient category can be selected for each higher level and lower level, when expiration is specified for the expiration date of the food ingredients as the filter item, the output unit is a program that displays, as the food ingredient management screen, a food ingredient icon, a food ingredient name, a storage location icon indicating the storage location read from the storage food ingredient information, and an expiration alert for expired food ingredients.

2. In the program according to claim 1, a program that enables selection of any one of a plurality of storage cabinets as the storage location.

3. In the program according to claim 1, the output unit is a program that displays the food ingredient icon and the storage location icon in association with each other.

4. In the program according to claim 3, the output unit is a program that superimposes and displays the storage location icon on a part of the food ingredient icon.

5. A food ingredient management system having a storage cabinet for storing food ingredients, a terminal device, and a food ingredient management device, for managing the food ingredients stored in the storage cabinet, wherein it has a storage unit that stores storage food ingredient information composed of a plurality of items related to the food ingredients, a display information creation unit that creates a food ingredient management screen showing the food ingredients based on the storage food ingredient information, an output unit that displays the food ingredient management screen, A food management unit that extracts stored food information from the storage unit according to filter items for selecting the plurality of items received from a user. The display information creation unit creates the food management screen based on the extracted stored food information. The output unit displays the food management screen created based on the extracted stored food information. The filter items are the storage location of the food, the food category for classifying the food, and the expiration date of the food. The storage location of the food can be selected for each location in the storage warehouse which is the upper hierarchy and the storage warehouse which is the lower hierarchy. The food category can be selected for each upper hierarchy and lower hierarchy. When expiration is specified for the expiration date of the food as the filter item, the output unit is a food management system that displays, as the food management screen, a food icon for expired food, a food name, a storage location icon indicating the storage location read from the stored food information, and an expiration alert.

6. In the food management system according to claim 5, A food management system in which any one of a plurality of storage warehouses can be selected as the storage location.

7. In the food management system according to claim 5, The output unit is a food management system that displays the food icon and the storage location icon in association with each other.

8. In the food management system according to claim 7, The output unit is a food management system that displays the storage location icon superimposed on a part of the food icon.

Images