Program, terminal, and control method for terminal

Abstract

To provide a program, a terminal, and a control method for a terminal that can improve convenience for a user in relation to addition of food products to a shopping list.SOLUTION: A program causes a processor of a terminal comprising a display unit to function as: a display control unit which displays, on the display unit in a switchable manner, a plurality of non-shopping list screens in which a shopping list as a list of food products that a user is going to purchase is not displayed; and a reception unit for, on a non-shopping list screen, receiving an operation to add the food products displayed on the non-shopping list screen to the shopping list. The display control unit can display a shopping list screen for displaying the shopping list. When the reception unit receives the addition operation, the display control unit adds the food products to be added to the shopping list displayed on the shopping list screen.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to a program, a terminal device, and a control method for a terminal device. [Background technology]

[0002] Patent Document 1 discloses a technology in which food and ingredients registered by operating an inventory management icon are displayed on a shopping list. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-014384 A Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides a program, a terminal device, and a method for controlling a terminal device that can improve user convenience in adding food items to a shopping list. [Means for solving the problem]

[0005] The program of the present disclosure causes a processor of a terminal device having a display unit to function as a display control unit that switches between multiple non-shopping list screens on the display unit that do not display a shopping list, which is a list of foods that a user plans to purchase, and a reception unit that accepts an operation on the non-shopping list screen to add foods displayed on the non-shopping list screen to the shopping list, wherein the display control unit is capable of displaying a shopping list screen that displays the shopping list, and when the reception unit accepts the operation to add, the food to be added is added to the shopping list displayed on the shopping list screen.

[0006] In addition, the terminal device of the present disclosure includes a display unit, a display control unit that switches between multiple non-shopping list screens that do not display a shopping list, which is a list of foods that the user plans to purchase, on the display unit, and a reception unit that receives an operation on the non-shopping list screen to add foods displayed on the non-shopping list screen to the shopping list, wherein the display control unit is capable of displaying a shopping list screen that displays the shopping list, and when the reception unit receives the operation to add, the food to be added is added to the shopping list displayed on the shopping list screen.

[0007] In addition, a control method for a terminal device in the present disclosure switches between a plurality of non-shopping list screens that do not display a shopping list, which is a list of foods that the user plans to purchase, and accepts an operation on the non-shopping list screen to add foods displayed on the non-shopping list screen to the shopping list, and is capable of displaying a shopping list screen that displays the shopping list, and when the operation to add is accepted, adds the food to be added to the shopping list displayed on the shopping list screen. Effect of the Invention

[0008] The program, the terminal device, and the control method of the terminal device disclosed herein allow the user P to add food items to the shopping list from multiple screens other than the shopping list screen, thereby improving the convenience of the user P in adding food items to the shopping list. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 shows a configuration of a food management system according to a first embodiment. [Diagram 2] FIG. 1 is a plan view of a refrigerator and an image capturing device according to a first embodiment, as viewed from the front. [Diagram 3] FIG. 1 shows the configuration of a terminal device and a food management server according to a first embodiment. [Figure 4] FIG. 13 is a diagram showing an example of a first inventory screen in the first embodiment. [Diagram 5]FIG. 13 is a diagram showing an example of a second inventory screen in the first embodiment. [Figure 6] FIG. 13 is a diagram showing an example of a third inventory screen in the first embodiment. [Figure 7] FIG. 13 is a diagram showing an example of a first food detail screen in the first embodiment. [Figure 8] FIG. 13 is a diagram showing an example of a second food detail screen in the first embodiment. [Figure 9] FIG. 13 shows an example of a My Page screen in the first embodiment. [Figure 10] FIG. 13 shows an example of a registered food screen in the first embodiment. [Figure 11] FIG. 13 is a diagram showing an example of a recipe screen according to the first embodiment. [Figure 12] FIG. 13 shows an example of a material list screen in the first embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a shopping list addition screen in the first embodiment. [Figure 14] FIG. 13 is a diagram showing an example of a shopping list screen in the first embodiment. [Figure 15] FIG. 13 is a diagram showing an example of a shopping list screen in the first embodiment. [Figure 16] FIG. 13 shows an example of a food addition screen in the first embodiment. [Figure 17] FIG. 1 shows examples of various databases according to the first embodiment. [Figure 18] FIG. 1 shows examples of various databases according to the first embodiment. [Figure 19] A flowchart showing the operation of a food management system in the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] (The knowledge and other information that formed the basis of this disclosure) At the time when the inventors came up with the present disclosure, there was a technology in which a shopping list displayed foods and ingredients registered by operating an inventory management icon. However, in Patent Document 1, although it is possible to add foods to the shopping list from the registration and editing screen, adding foods to the shopping list from other screens is not taken into consideration. Therefore, in Patent Document 1, it is necessary to display the registration and editing screen every time you want to add food to the shopping list, and the inventors discovered a problem that there is room for improvement in improving the user's convenience in adding foods to the shopping list, and have come to constitute the subject of the present disclosure in order to solve this problem. Therefore, the present disclosure provides a program, a terminal device, and a method for controlling a terminal device that can improve user convenience in adding food items to a shopping list.

[0011] Hereinafter, the embodiments will be described in detail with reference to the drawings. However, in some cases, more detailed explanations than necessary may be omitted. For example, detailed explanations of already well-known matters or duplicate explanations of substantially the same configurations may be omitted. It should be noted that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0012] (Embodiment 1) [1-1. Configuration] [1-1-1. Food control system configuration] FIG. 1 is a diagram showing the configuration of a food management system 1000 in the first embodiment. The food management system 1000 is a system that manages food F owned by a user P and food F that was owned by the user P. The food F owned by the user P includes food F whose weight is detected by a weight sensor 1 and food F stored in a refrigerator 2. The food management system 1000 of this embodiment manages food F by, for example, managing the stock amount of food F, the estimated best-before date or expiration date of food F (hereinafter referred to as "estimated expiration date"), the name of food F (hereinafter referred to as "food name"), and the like.

[0013] Hereinafter, food F whose weight is detected by weight sensor 1 will be referred to as "detection target food" and will be designated with the symbol "KF" and appropriately expressed as "detection target food KF." Also, food F stored in refrigerator 2 will be referred to as "contained food" and will be designated with the symbol "SF" and appropriately expressed as "contained food SF."

[0014] The food management system 1000 of this embodiment comprises two weight sensors 1: a first weight sensor 11 and a second weight sensor 12. Weight sensor 1 is a plate-shaped device, and detects the weight of the detection target food KF placed on its upper surface. The first weight sensor 11 is provided in the refrigerator compartment 21 of the refrigerator 2 installed in the facility H. A container filled with milk F1 is placed on the upper surface of the first weight sensor 11, and the first weight sensor 11 detects the weight of the milk F1 filled in the placed container. The second weight sensor 12 is provided on a shelf 3 set in the facility H. The second weight sensor 12 has a case 4 placed on its upper surface, and detects the total weight of the rice F2 contained in the case 4.

[0015] The number and installation positions of weight sensors 1 provided in food management system 1000 of the present embodiment are merely an example, and are not limited to the number and installation positions shown in FIG.

[0016] The weight sensor 1 communicates with a food management server 5 connected to a network NW. The network NW includes the Internet, a telephone network, and other communication networks. The weight sensor 1 detects the weight of the target food KF at a predetermined period or at a predetermined timing, and transmits first upload data D1 to the food management server 5 every time the weight is detected. The first upload data D1 is data to be uploaded to the food management server 5, and includes the detected weight and a sensor ID (Identification) that uniquely identifies the weight sensor 1. The sensor ID is stored in a predetermined storage area of ​​the weight sensor 1.

[0017] The food management system 1000 includes a refrigerator 2 . The refrigerator 2 includes a main box 20 with an opening at the front. The main box 20 includes a refrigerator compartment 21, an ice making compartment 22, a fresh freezing compartment 23, a freezer compartment 24, and a vegetable compartment 25. These storage compartments are cooled by cold air. A revolving door 21A is provided at an opening 201 at the front of the refrigerator compartment 21. The door 21A includes a revolving right door 21B and a revolving left door 21C. The ice making compartment 22, the fresh freezing compartment 23, the freezer compartment 24, and the vegetable compartment 25 are provided with drawers 22A, 23A, 24A, and 25A, respectively. Each of the drawers 22A to 25A is open at the top when installed. The drawer 25A in this embodiment has two storage cases, a lower case and an upper case disposed above the lower case. Moreover, drawer 24A in this embodiment has three storage cases: a lower case, a middle case arranged on the lower case, and an upper case arranged on the middle case.

[0018] Hereinafter, when there is no need to distinguish between drawers 22A, 23A, 24A, and 25A, the drawers will be designated by the symbol "26A" and appropriately referred to as "drawer 26A."

[0019] The food management system 1000 includes a photographing device 6 that photographs the refrigerator 2. The photographing device 6 is a device that obtains a photographed image PG by photographing. The photographing device 6 is attached to the top surface 20A of the main box 20 of the refrigerator 2. The photographing device 6 will be described with reference to FIG.

[0020] FIG. 2 is a plan view of the refrigerator 2 and the camera device 6 attached to the refrigerator 2, viewed from the front. FIG. 2 illustrates the X-axis, Y-axis, and Z-axis. The X-axis direction corresponds to the width direction of the camera device 6 and the left-right direction of the camera device 6. The positive direction of the X-axis is to the right. The Y-axis direction corresponds to the front-rear direction of the camera device 6. The positive direction of the Y-axis is forward. The Z-axis direction corresponds to the up-down direction of the camera device 6. The positive direction of the Z-axis is upward.

[0021] Fig. 2 is a plan view of the refrigerator 2 and the image capturing device 6 attached to the refrigerator 2, seen from the front. The refrigerator 2 shown in Fig. 2 has its door 21A in an open state.

[0022] The image capturing device 6 includes a wide-angle camera 60 and a narrow-angle camera 61. When the image capturing device 6 is attached to the refrigerator 2 and the door 21A is in a closed state, the wide-angle camera 60 and the narrow-angle camera 61 are located in front of the door 21A.

[0023] The wide-angle camera 60 has a wider angle than the narrow-angle camera 61. With the imaging device 6 attached to the refrigerator 2, the wide-angle camera 60 captures an image of the refrigerating compartment 21 from above and in front of the refrigerator 2. 2 when viewed from the front of the refrigerator 2. Range RA1 is a range that includes the door pockets of right door 21B and left door 21C and opening 201 of refrigerator compartment 21 when right door 21B and left door 21C are in the maximum open state. In addition, the shooting range of wide-angle camera 60 is a range that includes, in the front-to-rear direction, from the front ends of right door 21B and left door 21C in the open state to the front end of shelf 21D when viewed from the side (right or left) of the refrigerator 2.

[0024] Narrow-angle camera 61 is a camera with a narrower angle than wide-angle camera 60. With imaging device 6 attached to refrigerator 2, narrow-angle camera 61 captures an image of drawer 26A from above and in the front of refrigerator 2. 2 when viewed from the front of refrigerator 2. Range RA2 is a range that includes drawer 26A when viewed from the front of refrigerator 2. In addition, for example, the shooting range of narrow-angle camera 61 is a range that includes drawer 26A when it is pulled out to the maximum in the front-to-rear direction when viewed from the side of refrigerator 2.

[0025] The devices included in the image capturing device 6 are not limited to the wide-angle camera 60 and the narrow-angle camera 61. The image capturing device 6 may further include other devices such as a first distance measuring sensor for detecting the opening and closing of the right door 21B, a second distance measuring sensor for detecting the opening and closing of the left door 21C, a thermopile for detecting the opening and closing of the drawer 26A, a human sensor, an illuminance sensor, and various types of LEDs (Light Emitting Diodes).

[0026] Returning to the description of Fig. 1, the photographing device 6 connects to the network NW and communicates with the food management server 5. The photographing device 6 transmits second upload data D2 to the food management server 5 every time the wide-angle camera 60 captures an image.

[0027] The second upload data D2 is data to be uploaded to the food management server 5. In the second upload data D2, the photography related information of the refrigerator compartment 21, the photography related information of the right door 21B, the photography related information of the left door 21C, and the photography device ID that uniquely identifies the photography device 6 are recorded. The photographing related information for the refrigerator compartment 21 includes a photographed image PG of the interior of the refrigerator compartment 21 photographed by the wide-angle camera 60 and the photographing date and time of the photographed image PG. The photographing related information for the right door 21B includes a photographed image PG of the interior of the right door 21B photographed by the wide-angle camera 60 and the photographing date and time of the photographed image PG. The photographing related information for the left door 21C includes a photographed image PG of the interior of the left door 21C photographed by the wide-angle camera 60 and the photographing date and time of the photographed image PG. The photographing device ID is recorded in a predetermined storage area of ​​the photographing device 6.

[0028] The photographing device 6 transmits the third upload data D3 to the food management server 5 every time the narrow-angle camera 61 captures an image.

[0029] The third upload data D3 is data to be uploaded to the food management server 5. The third upload data D3 includes information related to photography of the storage case of the drawer 26A. The information related to photography of the storage case includes a captured image PG of the top surface of the storage case captured by the narrow-angle camera 61 and the date and time when the captured image PG was captured. In addition, the third upload data D3 records the type of storage case shown in the captured image PG recorded in the photography related information, the type of storage room in which the storage case shown in this captured image PG is located, and the photography device ID.

[0030] The food management system 1000 includes a terminal device 7. The terminal device 7 is a PC (Personal Computer) such as a smartphone, a tablet terminal, etc. An application program related to the management of food F is installed on the terminal device 7, and the terminal device 7 communicates with the food management server 5 by the function of this application program. In the following description, this application program is referred to as the "food management application" and is given the reference number "711." The food management application 711 corresponds to an example of a "program".

[0031] 1, a user P who is inside facility H is indicated by a solid line, and a user P who is outside facility H is indicated by a dotted line. When used by user P who is inside facility H, terminal device 7 communicates with food management server 5 via communication device 8 or without communication device 8. When used by user P who is outside facility H and a communication connection with communication device 8 cannot be established, terminal device 7 communicates with food management server 5 without via communication device 8.

[0032] The communication device 8 is connected to the network NW and communicates with the food management server 5 via the network NW. The communication device 8 functions as an interface device for connecting the weight sensor 1, the photographing device 6, and the terminal device 7 to the network NW. The communication device 8 establishes a local network in the facility H.

[0033] The food management system 1000 includes a food management server 5. The food management server 5 is a device that manages food F. The food management server 5 is connected to a network NW, and processes information using devices connected to the network NW as clients. Note that in each figure, the food management server 5 is represented by a single block, but this does not necessarily mean that the food management server 5 is composed of a single device.

[0034] [1-1-2. Terminal device configuration] FIG. 3 is a diagram showing the configuration of the terminal device 7 and the food management server 5. First, the configuration of the terminal device 7 will be described. The terminal device 7 includes a terminal control device 70, a terminal communication unit 71, and a touch panel 72. The touch panel 72 corresponds to an example of a "display unit."

[0035] The terminal control device 70 includes a terminal processor 700 such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), a terminal memory 710, and an interface circuit to which other devices and sensors are connected. The terminal processor 700 corresponds to an example of a "processor."

[0036] The terminal memory 710 is a memory that stores programs and data. The terminal memory 710 stores data to be processed by the food management application 711 and the terminal processor 700. The terminal memory 710 has a non-volatile storage area. The terminal memory 710 may also have a volatile storage area and constitute a work area for the terminal processor 700. The terminal memory 710 is composed of, for example, a ROM (Read Only Memory) or a RAM (Random Access Memory). The terminal memory 710 stores an account ID that uniquely identifies a user P of the food management application 711.

[0037] The terminal communication unit 71 includes hardware such as a communication circuit that complies with a predetermined communication standard, and communicates with the food management server 5 under the control of the terminal processor 700 . The touch panel 72 includes a display panel and a touch sensor that is provided over or integral with the display panel.

[0038] The terminal processor 700 reads out and executes a food management application 711 stored in the terminal memory 710, thereby functioning as a terminal communication control unit 701, a display control unit 702, and a reception unit 703.

[0039] The terminal communication control unit 701 communicates with the food management server 5 via the terminal communication unit 71. The display control unit 702 causes a user interface related to management of the food F whose weight is detected by the weight sensor 1 and the food F stored in the refrigerator 2 to be displayed on the touch panel 72. In the following description, this user interface is referred to as an "application UI (User Interface)" and is denoted by the reference numeral "720." The reception unit 703 receives various inputs from the user P via the application UI 720 .

[0040] [1-1-3. App UI configuration] Next, the configuration of the application UI 720 will be described with reference to FIGS. In Fig. 4 to Fig. 16, the upward direction in the figure is indicated by the symbol "UP", the downward direction in the figure is indicated by the symbol "DW", the leftward direction in the figure is indicated by the symbol "L", and the rightward direction in the figure is indicated by the symbol "R". The up-down direction in Fig. 4 to Fig. 16 is a direction approximately parallel to the side of the display surface of the touch panel 72 when the display surface of the touch panel 72 is viewed. The left-right direction in Fig. 4 to Fig. 16 is a direction approximately parallel to the side perpendicular to the side of the display surface of the touch panel 72 when the display surface of the touch panel 72 is viewed.

[0041] The display control unit 702 switchably displays a plurality of non-shopping list screens NLG on the application UI 720. The non-shopping list screen NLG is a screen that does not display a shopping list that is a list of food items F that the user P plans to purchase. Furthermore, the display control unit 702 switchably displays a non-shopping list screen NLG and a shopping list screen SLG on the application UI 720. The shopping list screen SLG is a screen that displays a shopping list.

[0042] [1-1-3-1. Configuration of the first inventory screen] First, the first stock screen SG1 will be described. FIG. 4 is a diagram showing an example of the first inventory screen SG1.

[0043] The first inventory screen SG1 is a non-shopping list screen NLG, and is a screen that displays the inventory list of food F. The first inventory screen SG1 has a first switching button B1, a second switching button B2, and a third switching button B3. Note that the arrangement and patterns of the first switching button B1, the second switching button B2, and the third switching button B3 are not limited to those shown in FIG.

[0044] The first switching button B1 is a software button for switching the screen displayed by the application UI 720 to the third inventory screen SG3. When the reception unit 703 receives an operation of selecting the first switching button B1 on the first inventory screen SG1, the display control unit 702 switches the screen displayed by the application UI 720 from the first inventory screen SG1 to the third inventory screen SG3.

[0045] The second switching button B2 is a software button for switching the screen displayed by the application UI 720 to the second inventory screen SG2. When the reception unit 703 receives an operation of selecting the second switching button B2 on the first inventory screen SG1, the display control unit 702 switches the screen displayed by the application UI 720 from the first inventory screen SG1 to the second inventory screen SG2.

[0046] The third switching button B3 is a software button for switching the screen displayed by the application UI 720 to the shopping list screen SLG. When the reception unit 703 receives an operation of selecting the third switching button B3 on the first inventory screen SG1, the display control unit 702 switches the screen displayed by the application UI 720 from the first inventory screen SG1 to the shopping list screen SLG.

[0047] The first inventory screen SG1 has a first area A1. The first area A1 is an area that displays a food icon IC1 for each food F owned by the user P. The food icon IC1 is an icon that indicates the food F. FIG. 4 illustrates an example in which the first area A1 displays 15 food icons IC1.

[0048] The food icon IC1 displayed in the first area A1 is selectable. When the reception unit 703 receives an operation to select the food icon IC1 on the first inventory screen SG1 that does not display a recipe search screen, the display control unit 702 displays a food details screen FDG for the food indicated by the selected food icon IC1. The food details screen FDG will be described later.

[0049] The first inventory screen SG1 has a search button B4 and a menu button B5. In Fig. 4, the search button B4 and the menu button B5 are superimposed on the first area A1, but the display positions of the search button B4 and the menu button B5 are not limited to the positions shown in Fig. 4.

[0050] The search button B4 is a software button for searching for a recipe. When the reception unit 703 receives an operation to select the search button B4, the display control unit 702 displays a text input field for recipe search and a recipe search screen on the first inventory screen SG1. The menu button B5 is a software button for displaying various menus. When the reception unit 703 receives an operation for selecting the menu button B5, the display control unit 702 superimposes a menu screen displaying various menus on the first inventory screen SG1.

[0051] The first inventory screen SG1 has a home button B6, a recipe button B7, a registered home appliance button B8, an inventory button B9, and a my page button B10. Note that the arrangement and design of the home button B6, the recipe button B7, the registered home appliance button B8, the inventory button B9, and the my page button B10 are not limited to the arrangement and design shown in FIG.

[0052] The home button B6 is a software button for switching the screen displayed by the application UI 720 to the home screen. When the reception unit 703 receives an operation of selecting the home button B6 on the first inventory screen SG1, the display control unit 702 switches the screen displayed by the application UI 720 from the first inventory screen SG1 to the home screen.

[0053] The recipe button B7 is a software button for switching the screen displayed by the application UI 720 to a recipe list screen. The recipe list screen is a screen that displays a list of recipes. When the reception unit 703 receives an operation to select the recipe button B7 on the first inventory screen SG1, the display control unit 702 switches the screen displayed by the application UI 720 from the first inventory screen SG1 to the recipe list screen.

[0054] The registered home appliances button B8 is a software button for switching the screen displayed by the application UI 720 to a registered home appliances screen. The registered home appliances screen is a screen that displays home appliances registered in the food management application 711. When the reception unit 703 receives an operation to select the registered home appliances button B8 on the first inventory screen SG1, the display control unit 702 switches the screen displayed by the application UI 720 from the first inventory screen SG1 to the registered home appliances screen.

[0055] The stock button B9 is a software button for switching the screen displayed by the application UI 720 to the stock screen SG1. On the first stock screen SG1, the reception unit 703 does not receive an operation for selecting the stock button B9.

[0056] The My Page button B10 is a software button for switching the screen displayed by the application UI 720 to the My Page screen MPG. The My Page screen MPG is a screen that displays food F that the user has registered as a favorite. When the reception unit 703 receives an operation to select the My Page button B10 on the first inventory screen SG1, the display control unit 702 switches the screen displayed by the application UI 720 from the first inventory screen SG1 to the My Page screen MPG.

[0057] [1-1-3-2. Configuration of the second inventory screen] Next, the second inventory screen SG2 will be described. FIG. 5 is a diagram showing an example of the second inventory screen SG2.

[0058] The second inventory screen SG2 is a non-shopping list screen NLG, and is a screen that displays the inventory list of food items F. The second inventory screen SG2 has a first switching button B1, a third switching button B3, and a fourth switching button B11. Note that the display positions and designs of the first switching button B1, the third switching button B3, and the fourth switching button B11 on the second inventory screen SG2 are not limited to the display positions and designs shown in FIG.

[0059] The fourth switching button B11 is a software button for switching the screen displayed by the application UI 720 to the first inventory screen SG1. When the reception unit 703 receives an operation of selecting the fourth switching button B11 on the second inventory screen SG2, the display control unit 702 switches the screen displayed by the application UI 720 from the second inventory screen SG2 to the first inventory screen SG1.

[0060] The second inventory screen SG2 has a pull-down selection field C2. The selection field C2 is a field for changing the display order of the food information FJ of the stored foods SF among the food information FJ displayed in the second area A2 to the most recent order based on the date that the user P stored the food F in the refrigerator (hereinafter referred to as the "storage date"), the shortest estimated expiration date of the food F, or the oldest storage date. The selection field C2 displays a list of display order options and accepts an operation to select one option from the list. When the receiving unit 703 accepts an operation to select one option in the selection field C2, the display control unit 702 changes the display order of the food information FJ displayed in the second area A2 to the display order indicated by the option selected in the selection field C2.

[0061] The second inventory screen SG2 has a second area A2. The second area A2 is an area that displays food information FJ for each food F. The food information FJ has a food icon IC1, food name information FJ1, holding start date information FJ2, estimated expiration date information FJ3, inventory amount information FJ4, a slider SR, a register button B12, and an add button B13.

[0062] The food name information FJ1 is information that indicates the name of the food. The holding start date information FJ2 is information that indicates the holding start date, which is the date on which the user P started holding the item. The holding start date includes the date of entry. The estimated expiration date information FJ3 is information that indicates the estimated expiration date of the food F. The inventory quantity information FJ4 is information that indicates the inventory quantity of food F. The inventory quantity indicated by the inventory quantity information FJ4 is composed of a numerical value and a unit. The numerical value indicated by the inventory quantity information FJ4 can be changed using the slider SR or the food details screen FDG. In addition, the unit indicated by the inventory quantity information FJ4 can be changed using the food details screen FDG.

[0063] The slider SR is a UI component that accepts an operation to change the stock amount indicated by the stock amount information FJ4. The slider SR indicates the stock amount indicated by the stock amount information FJ4 by positioning the control SS at a position corresponding to the stock amount indicated by the stock amount information FJ4. The slider SR accepts an operation to change the numerical value of the stock amount indicated by the stock amount information FJ4 via the control SS. The registration button B12 is a software button for registering the food F indicated by the corresponding food information FJ as a favorite food F. The add button B13 is a software button for adding the food F indicated by the corresponding food information FJ to the shopping list.

[0064] In the second inventory screen SG2, a food icon IC1 and food name information FJ1 are selectable for each food information FJ. When the reception unit 703 receives an operation to select the food icon IC1 or the food name information FJ1 in the second inventory screen SG2, the display control unit 702 displays the food details screen FDG for the food indicated by the selected food icon IC1 or food name information FJ1.

[0065] The second inventory screen SG2 has a search button B4 and a menu button B5. The second inventory screen SG2 also has a home button B6, a recipe button B7, a registered home appliance button B8, an inventory button B9, and a my page button B10.

[0066] When the acceptance unit 703 accepts an operation of selecting the home button B6 on the second inventory screen SG2, the display control unit 702 switches the screen displayed by the application UI 720 from the second inventory screen SG2 to the home screen. When the reception unit 703 receives an operation to select the recipe button B7 on the second inventory screen SG2, the display control unit 702 switches the screen displayed by the application UI 720 from the second inventory screen SG2 to a recipe list screen. When the reception unit 703 receives an operation to select the registered home appliance button B8 on the second inventory screen SG2, the display control unit 702 switches the screen displayed by the application UI 720 from the second inventory screen SG2 to the registered home appliance screen. In the second inventory screen SG2, the reception unit 703 does not accept an operation to select the inventory button B9. When the acceptance unit 703 accepts an operation to select the My Page button B10 on the second inventory screen SG2, the display control unit 702 switches the screen displayed by the application UI 720 from the second inventory screen SG2 to the My Page screen MPG.

[0067] [1-1-3-3. Configuration of the 3rd inventory screen] Next, the configuration of the third inventory screen SG3 will be described. FIG. 6 is a diagram showing an example of the third inventory screen SG3.

[0068] The third inventory screen SG3 is a non-shopping list screen NLG, and is a screen that displays the photographed images PG.

[0069] The third inventory screen SG3 has a hide button B14. The hide button B14 is a software button for hiding the third inventory screen SG3. When the reception unit 703 receives an operation for selecting the hide button B14, the display control unit 702 returns the screen displayed by the application UI 720 to the screen displayed immediately before the transition from the third inventory screen SG3 to the third inventory screen SG3. For example, when the hide button B14 is operated on the third inventory screen SG3 switched from the second inventory screen SG2 by the first switching button B1, the display control unit 702 switches the screen displayed by the application UI 720 from the third inventory screen SG3 to the second inventory screen SG2.

[0070] The third inventory screen SG3 has a third area A3. The third area A3 is an area for displaying a photographed image PG The third area A3 displays a photographed image PG of the type selected in the fourth area A4.

[0071] Here, the fourth area A4 of the third inventory screen SG3 will be described. The fourth area A4 is an area for changing the type of captured image PG displayed in the third area A3. The fourth area A4 has a number of switching buttons corresponding to the types of interiors of the refrigerator 2. When the reception unit 703 receives an operation to select a switching button in the fourth area A4, the display control unit 702 displays the captured image PG of the storage room corresponding to the selected switching button. Note that the captured image PG of the storage room may be switched by swiping left and right in the third area A3.

[0072] When displaying the captured image PG of the vegetable compartment 25 in the third area A3, the display control unit 702 displays the captured image PG of each storage case included in the vegetable compartment 25 side by side. When displaying the captured image PG of the freezer compartment 24 in the third area A3, the display control unit 702 displays the captured image PG of each storage case included in the freezer compartment 24 side by side. FIG. 6 illustrates an example in which the captured image PG of the freezer compartment 24 having three storage cases is displayed. Therefore, in FIG. 6, the third area A3 displays the captured image PG of the three storage cases side by side.

[0073] The third area A3 displays, for each photographed image PG, photographing date and time information NJ. The photographing date and time information NJ is information indicating the photographing date and time, and indicates the date and time when the corresponding photographed image PG was obtained.

[0074] The photographed images PG displayed in the third area A3 can be selected for each photographed image PG. When the reception unit 703 receives an operation to select one photographed image PG in the third area A3, the display control unit 702 displays a screen for enlarging the selected photographed image PG.

[0075] [1-1-3-4. Food details screen configuration] Next, an example of the food details screen FDG is shown. The food details screen FDG is a non-shopping list screen NLG that displays detailed information about one food F.

[0076] FIG. 7 is a diagram showing an example of the first food details screen FDG1. The first food details screen FDG1 is a food details screen FDG relating to the stored food SF. As shown in FIG. 7, the first food details screen FDG1 has a back button B14, a first switching button B1, a register button B12, an add button B13, and a delete button B15.

[0077] The back button B14 is a software button for returning the screen displayed by the app UI 720 to the screen displayed immediately before transitioning to the first food details screen FDG1. When the reception unit 703 receives an operation of selecting the back button B14 on the first food details screen FDG1, the display control unit 702 returns the screen displayed by the app UI 720 to the screen displayed immediately before transitioning to the first food details screen FDG1.

[0078] The Delete button B15 is a software button for deleting the food F, the details of which are displayed on the first food details screen FDG1, from the inventory list displayed by the application UI720.

[0079] The first food details screen FDG1 has a fifth area A5. The fifth area A5 is an area for displaying detailed information about the stored food SF. The fifth area A5 includes a food icon IC1, food name information FJ1, inventory amount information FJ4, holding start date information FJ2, estimated expiration date information FJ3, storage location information KJ, and first notification timing information TJ1.

[0080] The food name information FJ1 is information that indicates the name of the food. The stock quantity information FJ4 is information indicating the stock quantity, and indicates the stock quantity by a combination of a numerical value and a unit. The holding start date information FJ2 is information indicating the date (hereinafter referred to as the "holding start date") when the user P started holding the food F. In the case of stored food SF, the holding start date is the date of entry into storage. The storage location information KJ is information that indicates the location where the food F is stored. The first notification timing information TJ1 is information indicating the first notification timing, which is the timing for notifying that the food F has been forgotten to be used.

[0081] The fifth area A5 has a first change button B16, a second change button B17, a third change button B18, a fourth change button B19, and a fifth change button B20.

[0082] The first change button B16 is a software button for changing the numerical value and unit of the stock amount indicated by the stock amount information FJ4 on the first food details screen FDG1. The second change button B17 is a software button for changing the holding start date indicated by the holding start date information FJ2 on the first food details screen FDG1. The third change button B18 is a software button for changing the approximate expiration date indicated by the approximate expiration date information FJ3 on the first food details screen FDG1. The fourth change button B19 is a software button for changing the storage location indicated by the storage location information KJ on the first food details screen FDG1. When the storage location information KJ is changed, the estimated expiration date information FJ3 may be automatically changed. The fifth change button B20 is a software button for changing the first notification timing indicated by the first notification timing information TJ1 on the first food details screen FDG1.

[0083] The fifth area A5 has an area change button B25. The area change button B25 is a software button for changing the display area of ​​the fifth area A5.

[0084] The first food details screen FDG1 has a sixth area A6. The sixth area A6 is an area that displays recipes that use the food F indicated on the first food details screen FDG1. The sixth area A6 displays one or more recipe icons IC3 of recipes that use the food F indicated on the first food details screen FDG1. The recipe icon IC3 is an icon that indicates a recipe. The recipe icon IC3 is displayed so as to be selectable. When the receiving unit 703 receives an operation to select the recipe icon IC3, the display control unit 702 switches the screen displayed by the app UI 720 from the first food details screen FDG1 to a recipe screen RG that displays the recipe indicated by the selected recipe icon IC3.

[0085] The first food details screen FDG1 has a confirm button B21. The Confirm button B21 is a software button for confirming the content displayed on the first food details screen FDG1. The accepting unit 703 accepts an operation of selecting the Confirm button B21.

[0086] The first food details screen FDG1 has a seventh area A7. The seventh area A7 is an area for displaying information relating to key points regarding storage of the food F displayed on the first food details screen FDG1.

[0087] FIG. 8 is a diagram showing an example of the second food details screen FDG2. The second food details screen FDG2 is a food details screen FDG relating to the detection target food KF. As shown in FIG. 8, the second food details screen FDG2 has a back button B22, a first switching button B1, a register button B12, an add button B13, and a delete button B23.

[0088] The back button B22 is a software button for returning the screen displayed by the app UI 720 to the screen displayed immediately before transitioning to the second food details screen FDG2. When the reception unit 703 receives an operation of selecting the back button B22 on the second food details screen FDG2, the display control unit 702 returns the screen displayed by the app UI 720 to the screen displayed immediately before transitioning to the second food details screen FDG2.

[0089] The Delete button B23 is a software button for deleting the food F targeted by the second food details screen FDG2 from the inventory list displayed by the application UI720.

[0090] The second food details screen FDG2 has an eighth area A8. The eighth area A8 is an area that displays detailed information about the food F. The eighth area A8 has a food icon IC1, food name information FJ1, holding start date information FJ2, inventory amount information FJ4, estimated expiration date information FJ3, storage location information KJ, first notification timing information TJ1, and second notification timing information TJ2.

[0091] The second notification timing information TJ2 is information indicating the second notification timing, which is the timing for notifying the remaining amount of the detection target food KF.

[0092] The eighth area A8 has a first change button B16, a second change button B17, a third change button B18, a fourth change button B19, a fifth change button B20, and a sixth change button B24. The sixth change button B24 is a software button for changing the second notification timing.

[0093] The eighth area A8 has a graph GF. Graph GF is a graph showing the change in weight detected by weight sensor 1 over the past week.

[0094] The eighth area A8 has an area change button B25. The area change button B25 is a software button for changing the display area of ​​the eighth area A8.

[0095] The second food details screen FDG2 has a ninth area A9. The ninth area A9 may include a software button for confirming the content displayed on the second food details screen FDG2. The ninth area A9 displays one or more recipe icons IC3 of recipes using the food F displayed on the second food details screen FDG2. When the receiving unit 703 receives an operation to select the recipe icon IC3, the display control unit 702 switches the screen displayed by the application UI 720 from the second food details screen FDG2 to a recipe screen RG that displays the recipe indicated by the selected recipe icon IC3.

[0096] The second food details screen FDG2 has a tenth area A10. The tenth area A10 is an area for displaying information relating to key points regarding storage of the food F displayed on the second food details screen FDG2.

[0097] In addition, the first food details screen FDG1 and the second food details screen FDG2 may have a third switching button B3.

[0098] [1-1-3-5. My Page screen configuration] Next, the mypage screen MPG will be described. FIG. 9 is a diagram showing an example of the My Page screen MPG.

[0099] The my page screen MPG is a screen that collectively displays the foods F and recipes that the user P likes. The my page screen MPG is a non-shopping list screen NLG.

[0100] The mypage screen MPG has a third switching button B3. When the acceptance unit 703 accepts an operation to select the third switching button B3 on the mypage screen MPG, the display control unit 702 switches the screen displayed by the application UI 720 from the mypage screen MPG to the shopping list screen SLG.

[0101] The my page screen MPG has an eleventh area A11. The eleventh area A11 is an area that displays foods F that the user P likes. That is, the eleventh area A11 is an area that displays foods F that the user P has registered as favorites in the food management application 711. The eleventh area A11 displays a food-related icon IC4 for each food F. The food-related icon IC4 is an icon that indicates the image and name of the food. The food-related icon IC4 displays inventory information PAJ that indicates whether or not there is stock. In the eleventh area A11, the food-related icon IC4 is displayed selectably. When the receiving unit 703 receives an operation to select the food-related icon IC4, the display control unit 702 displays a food details screen FDG for the food indicated by the selected food-related icon IC4.

[0102] The eleventh area A11 has a list button B26. The list button B26 is a screen for displaying a list of foods F that the user P has registered as favorites.

[0103] The mypage screen MPG has a twelfth area A12. The twelfth area A12 is an area that displays recipes that the user P likes. That is, the twelfth area A12 is an area that displays recipes that the user P has registered as favorites in the food management application 711. The twelfth area A12 displays recipe icons IC3 for each recipe side by side. The recipe icons IC3 are displayed so that they can be selected. When the reception unit 703 receives an operation to select the recipe icon IC3, the display control unit 702 switches the screen displayed by the application UI 720 from the my page screen MPG to a recipe screen RG that displays the recipe indicated by the selected recipe icon IC3.

[0104] The twelfth area A12 has a list button B27. The list button B27 is a screen for displaying a list of recipes that the user P has registered as favorites.

[0105] The my page screen MPG has a home button B6, a recipe button B7, a registered home appliance button B8, an inventory button B9, and a my page button B10.

[0106] When the reception unit 703 receives an operation of selecting the home button B6 on the mypage screen MPG, the display control unit 702 switches the screen displayed by the application UI 720 from the mypage screen MPG to the home screen. When the reception unit 703 receives an operation to select the recipe button B7 on the mypage screen MPG, the display control unit 702 switches the screen displayed by the application UI 720 from the mypage screen MPG to the recipe list screen. When the reception unit 703 receives an operation to select the registered home appliances button B8 on the mypage screen MPG, the display control unit 702 switches the screen displayed by the application UI 720 from the mypage screen MPG to the registered home appliances screen. When the reception unit 703 receives an operation to select the stock button B9 on the mypage screen MPG, the display control unit 702 switches the screen displayed by the application UI 720 from the mypage screen MPG to the first stock screen SG1 or the second stock screen SG2. On the My Page screen MPG, the acceptance unit 703 does not accept an operation to select the My Page button B10.

[0107] When the receiving unit 703 receives an operation to select the list button B26, the display control unit 702 switches the screen displayed by the application UI 720 from the My Page screen MPG to the registered food screen RFG.

[0108] [1-1-3-6. Composition of registered food screen] FIG. 10 is a diagram showing an example of the registered food screen RFG. The registered food screen RFG is a screen that displays the favorite foods F of the user P. The registered food screen RFG is a non-shopping list screen NLG.

[0109] The registered food screen RFG has a home button B6, a recipe button B7, a registered home appliance button B8, an inventory button B9, and a my page button B10.

[0110] When the receiving unit 703 receives an operation of selecting the home button B6 on the registered food screen RFG, the display control unit 702 switches the screen displayed by the application UI 720 from the registered food screen RFG to the home screen. When the receiving unit 703 receives an operation to select the recipe button B7 on the registered food screen RFG, the display control unit 702 switches the screen displayed by the application UI 720 from the registered food screen RFG to the recipe list screen. When the reception unit 703 receives an operation of selecting the registered home appliance button B8 on the registered food screen RFG, the display control unit 702 switches the screen displayed by the application UI 720 from the registered food screen RFG to the registered home appliance screen. When the receiving unit 703 receives an operation to select the inventory button B9 on the registered food screen RFG, the display control unit 702 switches the screen displayed by the application UI 720 from the registered food screen RFG to the first inventory screen SG1 or the second inventory screen SG2. On the My Page screen MPG, the acceptance unit 703 does not accept an operation to select the My Page button B10.

[0111] The registered food screen RFG has a back button B28. The back button B28 is a software button for returning the screen displayed by the application UI 720 to the mypage screen MPG. When the reception unit 703 receives an operation of selecting the back button B28 on the registered food screen RFG, the display control unit 702 returns the screen displayed by the application UI 720 to the mypage screen MPG.

[0112] The registered food screen RFG has a thirteenth area A13. The thirteenth area A13 is an area that displays a list of foods F that the user P has registered as favorites. For each food F, the thirteenth area A13 has a food icon IC1, food name information FJ1, stock availability string SM, and an option display button B29.

[0113] The stock availability string SM is a string indicating whether or not the corresponding food F is in the stock list. If the corresponding food F is in the stock list, the stock availability string SM is, for example, a string saying "In stock." If the corresponding food F is not in the stock list, the stock availability string SM is, for example, a string saying "Out of stock."

[0114] The option display button B29 is a software button for displaying at least a first option for selecting to add food F to the shopping list, and a second option for selecting to delete food F from the registered food screen RFG. When an operation for selecting the option display button B29 is received, the display control unit 702 displays the first option and the second option on the registered food screen RFG. When the first option is selected, the display control unit 702 adds food F corresponding to the operated option display button B29 to the shopping list. On the other hand, when the second option is selected, the display control unit 702 deletes food F corresponding to the operated option display button B29 from the registered food screen RFG.

[0115] The food F and recipes that the user P likes may be displayed on separate screens.

[0116] [1-1-3-7. Recipe screen configuration] Next, the configuration of the recipe screen RG will be described. FIG. 11 is a diagram showing an example of the recipe screen RG. The recipe screen RG is a screen that displays one recipe. The recipe screen RG is a non-shopping list screen NLG.

[0117] The recipe screen RG has a back button B30, a register button B31, and an add button B32. The display positions and designs of the back button B30, the register button B31, and the add button B32 are not limited to the positions and designs shown in FIG.

[0118] The back button B30 is a software button for returning the screen displayed by the application UI 720 to the screen displayed immediately before transitioning to the recipe screen RG. When the reception unit 703 receives an operation of selecting the back button B14 on the recipe screen RG, the display control unit 702 returns the screen displayed by the application UI 720 to the screen displayed immediately before transitioning to the recipe screen RG.

[0119] The registration button B31 is a software button for registering a recipe as a user P's favorite recipe. The add button B32 is a software button for adding ingredients for a dish to be made according to a recipe displayed on the recipe screen RG to a shopping list.

[0120] The recipe screen RG has a fourteenth area A14. The 14th area A14 is an area for displaying a recipe. More specifically, the 14th area A14 displays an image of the dish, the name of the dish, the type of appliance used to prepare the dish, the calories consumed by the dish, the salt content of the dish, the cooking steps of the dish, etc.

[0121] The recipe screen RG has a fifteenth area A15. The fifteenth area A15 is an area having various software buttons related to the recipe screen RG. The fifteenth area A15 has an ingredient display button B33, a previous process button B34, a next process button B35, and a comment display button B36.

[0122] First, the Previous Process button B34, the Next Process button B35, and the Comment Display button B36 will be described. The previous process button B34 is a software button for switching the cooking process indicated by the recipe displayed on the recipe screen RG to the process immediately before the currently displayed process. The next process button B35 is a software button for switching the cooking process indicated by the recipe displayed on the recipe screen RG to the process immediately following the currently displayed process. The comment display button B36 is a software button for displaying comments related to the recipe displayed on the recipe screen RG.

[0123] The ingredient display button B33 is a software button for displaying a list of ingredients that make up a dish created according to a recipe displayed on the recipe screen RG. When the reception unit 703 receives an operation to select the ingredient display button B33, the display control unit 702 superimposes an ingredient list screen MLG that displays a list of ingredients on the recipe screen RG.

[0124] FIG. 12 is a diagram showing an example of the material list screen MLG. The ingredient list screen MLG is a screen that displays a list of ingredients that make up a dish created according to a recipe displayed on the recipe screen RG. The ingredient list screen MLG is a non-shopping list screen NLG.

[0125] The material list screen MLG has a sixteenth area A16 and a seventeenth area A17. The 16th area A16 is an area that displays a list of ingredients for a dish made according to a recipe displayed on the recipe screen RG. The 16th area A16 displays an ingredient list image MLI that displays a list of the ingredients. The reception unit 703 receives an operation to scroll the ingredient list image MLI in the 16th area A16. When the reception unit 703 receives an operation to scroll the ingredient list image MLI, the display control unit 702 changes the display portion of the ingredient list image MLI based on the scroll direction and scroll amount received by the reception unit 703. Note that the amount of ingredients may be changed and displayed by changing the desired seasoning or the number of people.

[0126] The material list image MLI has a hide button B37. The hide button B37 is a software button for hiding the material list screen MLG. When the reception unit 703 receives an operation for selecting the hide button B37, the display control unit 702 hides the material list screen MLG.

[0127] The 17th area A17 is an area for displaying the shopping list addition screen SAG. The 17th area A17 has a fifth switching button B38. The fifth switching button B38 is a software button for switching the screen displayed by the application UI 720 from the recipe screen RG to the shopping list addition screen SAG. When the reception unit 703 receives an operation to select the fifth switching button B38, the display control unit 702 switches the screen displayed by the application UI 720 from the recipe screen RG to the shopping list addition screen SAG.

[0128] When the accepting unit 703 accepts an operation to select the fifth switching button B38, the food F among the ingredients that is not in the inventory list may be automatically added to the shopping list. Also, all of the ingredients may be automatically added to the shopping list.

[0129] [1-1-3-8. Configuration of the shopping list addition screen] Next, the configuration of the shopping list addition screen SAG will be described. FIG. 13 is a diagram showing an example of the shopping list addition screen SAG. The shopping list addition screen SAG is a screen for adding ingredients for a dish to be made according to a recipe displayed on the recipe screen RG to a shopping list. The shopping list addition screen SAG is a non-shopping list screen NLG.

[0130] The shopping list addition screen SAG has a back button B39 and a first switching button B1.

[0131] The back button B39 is a software button for returning the screen displayed by the application UI 720 to the screen displayed immediately before transitioning to the shopping list addition screen SAG. When the reception unit 703 receives an operation of selecting the back button B39 on the shopping list addition screen SAG, the display control unit 702 returns the screen displayed by the application UI 720 from the shopping list addition screen SAG to the recipe screen RG that displays the ingredient list screen MLG.

[0132] The add shopping list screen SAG has an 18th area A18. The eighteenth area A18 is an area that displays a list of ingredients displayed on the ingredient list screen MLG before the transition. The eighteenth area A18 has a check box CB1 and food name information FJ1 for each food F that is an ingredient.

[0133] The eighteenth area A18 displays an in-stock image SHI in association with the check box CB1 and food name information FJ1 for the food F that is in stock on the inventory list. In Fig. 13, an in-stock image SHI is displayed for each of minced meat, onion, and tomato.

[0134] In the 18th area A18, when the display of the shopping list addition screen SAG starts, the check box CB1 is checked for food F that is not in the inventory list. That is, the display control unit 702 starts displaying the shopping list addition screen SAG with food F that is not in stock in the inventory list selected as food F to be added to the shopping list. For example, if garlic is not in the inventory list, the check box CB1 corresponding to garlic will be checked when the shopping list addition screen SAG starts to be displayed. Note that the user P can uncheck the checked check box CB1. Also, for food F that is not on the inventory list, the check box CB1 does not need to be checked when the shopping list addition screen SAG starts to be displayed.

[0135] The reception unit 703 receives a scroll operation in the up and down direction in the 18th area A18. When the reception unit 703 receives a scroll operation in the 18th area A18, the display control unit 702 displays the ingredients that cannot be displayed in the 18th area A18 based on the scroll direction and scroll amount received by the reception unit 703.

[0136] The add shopping list screen SAG has a 19th area A19. The 19th area A19 is an area for adding the food F with the check box CB1 checked to the shopping list. The 19th area A19 has an Add button B40. The Add button B40 is a software button for adding the food F with the check box CB1 checked to the shopping list. When the reception unit 703 receives an operation of selecting the Add button B40 with the check box CB1 checked, the display control unit 702 adds the food F with the check box CB1 checked to the shopping list. When the reception unit 703 receives an operation of selecting the Add button B40 with the check box CB1 checked, the display control unit 702 switches the screen displayed by the application UI 720 from the shopping list addition screen SAG to the recipe screen RG. When the reception unit 703 receives an operation of selecting the Add button B40 with the check box CB1 checked, the display control unit 702 may switch the screen displayed by the application UI 720 from the shopping list addition screen SAG to the shopping list screen SLG.

[0137] [1-1-3-9. Shopping list screen configuration] FIG. 14 is a diagram showing an example of the shopping list screen SLG. The shopping list screen SLG is a screen that displays a shopping list. The shopping list is a list that displays a list of food items F that the user P plans to purchase.

[0138] The shopping list screen SLG has a back button B41 and a first switching button B1. The back button B41 is a software button for returning the screen displayed by the application UI 720 to the screen displayed immediately before transitioning to the shopping list screen SLG. When the reception unit 703 receives an operation of selecting the back button B41 on the shopping list screen SLG, the display control unit 702 returns the screen displayed by the application UI 720 to the screen displayed immediately before transitioning from the shopping list screen SLG to the shopping list screen SLG.

[0139] The shopping list screen SLG has a twentieth area A20. The twentieth area A20 is an area for displaying one or more inquiry icons IC5. When multiple inquiry icons IC5 are displayed in the twentieth area A20, the inquiry icons IC5 are displayed side by side in the left-right direction.

[0140] The inquiry icon IC5 is an icon that displays recipe information CJ. The recipe information CJ is information indicating a recipe that can be cooked using a first food item owned by the user P and a second food item that is not included in the shopping list. In FIG. 14, the recipe information CJ indicates carbonara.

[0141] The inquiry icon IC5 is an icon that displays the second food information FDJ. The second food information FDJ is information indicating a second food. In Fig. 14, the second food indicated by the second food information FDJ is onion.

[0142] The inquiry icon IC5 is an icon that displays the inquiry information IJ. The inquiry information IJ is information inquiring about adding a second food item to the shopping list. In FIG. 14, the character string "Would you like to add onions to your shopping list?" is the inquiry information IJ.

[0143] The inquiry icon IC5 is displayed selectably in the twentieth area A20. When the reception unit 703 receives an operation to select the inquiry icon IC5, the display control unit 702 adds the second food indicated by the inquiry icon IC5 to the shopping list displayed on the shopping list screen SLG. Note that adding to the shopping list means displaying the food name information FJ1 of the food F to be added in the twentieth area A21.

[0144] The shopping list screen SLG has a twenty-first area A21 and a twenty-second area A22. The twenty-first area A21 and the twenty-second area A22 are areas that display a list of food items F that the user P plans to purchase.

[0145] The twenty-first area A21 displays a list of foods F by predetermined categories such as meat, fish, vegetables, etc. For each food F that has not been checked by the user P, an unchecked check box CB2, food name information FJ1, and menu button B42 are displayed. Note that a check operation is an operation of checking the check box CB2. For example, when shopping, the user P checks the foods that he or she has put in the shopping cart.

[0146] The menu button B42 is a software button for displaying a menu for deleting the corresponding food F from the shopping list, registering it on the personal page screen MPG, etc. When an instruction to delete the food F from the shopping list is given by operating the menu button B42, the display control unit 702 hides the food F corresponding to the operated menu button B42 on the shopping list screen SLG.

[0147] The twenty-first area A21 displays an in-stock image SHI in association with a check box CB2, food name information FJ1, and menu button B42 for a food item F that is in stock on the inventory list.

[0148] For food F that is in stock on the inventory list, the twenty-first area A21 may display necessity level information NDJ indicating the degree of necessity for purchase instead of or in addition to the in-stock image SHI.

[0149] Fig. 15 is a diagram showing an example of a shopping list screen SLG displaying necessity degree information NDJ. Fig. 15 illustrates an example of a configuration in which necessity degree information NDJ is displayed instead of an in-stock image SHI.

[0150] 15 shows an example in which the first necessity degree information NDJ1 is displayed for a mushroom called "Enoki". Also, in FIG. 15, an example in which the second necessity degree information NDJ2 is displayed for a cauliflower is shown.

[0151] The first necessity degree information NDJ1 is necessity degree information NDJ indicating the degree of necessity for purchase based on the inventory amount. For example, the first necessity degree information NDJ1 indicates the degree of necessity of purchase based on the inventory amount by using character strings such as "low remaining" or "still in stock". Note that the degree of necessity indicated by the character string "low remaining" is higher than the degree of necessity indicated by the character string "still in stock". Note that the first necessity degree information NDJ1 may be displayed by an icon.

[0152] The degree of necessity indicated by the first necessity degree information NDJ1 is a degree of necessity determined according to the stock amount of food F. For example, when the stock amount of food F is equal to or greater than "A1", the first necessity degree information NDJ1 indicates the character string "still in stock". Also, when the stock amount of food F is less than "A1", the first necessity degree information NDJ1 indicates the character string "low remaining". Note that the threshold value for "A1" may differ depending on the type of food F.

[0153] The degree of necessity indicated by the first necessity degree information NDJ1 may be determined according to the stock amount of food F and the family structure of user P. For example, if user P's family consists of four people and the stock amount of food F is equal to or greater than "4×A1", the first necessity degree information NDJ1 indicates the character string "still in stock". Also, if user P's family consists of four people and the stock amount of food F is less than "4×A1", the first necessity degree information NDJ1 indicates the character string "low remaining". The threshold value for "A1" may differ depending on the type of food F.

[0154] The second necessity degree information NDJ2 is necessity degree information NDJ indicating the degree of necessity of purchase based on the perspective of an estimated deadline. For example, the second necessity degree information NDJ2 indicates the degree of necessity of purchase based on the perspective of an estimated deadline by character strings such as "still some time until the deadline", "the deadline is approaching", "the deadline has passed", "need to replace", etc. The degree of necessity indicated by the character string "still some time until the deadline" is lower than the degree of necessity indicated by each of the character strings "deadline is approaching", "expiration has passed", and "replacement is necessary". The degree of necessity indicated by the character string "deadline is approaching" is lower than the degree of necessity indicated by each of the character strings "expiration has passed" and "replacement is necessary". The degree of necessity indicated by the character string "expiration has passed" is lower than the degree of necessity indicated by the character string "replacement is necessary". The second necessity degree information NDJ2 may be displayed by an icon.

[0155] The degree of necessity indicated by the second necessity degree information NDJ2 is the degree of necessity determined according to the estimated expiration date of food F. For example, if the number of days between the estimated expiration date of food F and the present time is "B1" or more, the second necessity degree information NDJ2 indicates the character string "still some time until the expiration date". Also, for example, if the number of days between the estimated expiration date of food F and the present time is "B2" or more, the second necessity degree information NDJ2 indicates the character string "the expiration date is approaching". Note that "B1" is smaller than "B2". Also, for example, if the number of days that the current date has passed the estimated expiration date of food F is "B3" or less, the second necessity degree information NDJ2 indicates the character string "past expiration date". Also, for example, if the number of days that the current date has passed the estimated expiration date of food F is greater than "B3", the second necessity degree information NDJ2 indicates the character string "needs to be replaced".

[0156] 14 and 15, the 22nd area A22 displays a checked check box CB2 and food name information FJ1 for each food F checked by the user P. In the food name information FJ1 displayed in the 22nd area A22, a strikethrough is added to the food name. The strikethrough may be a horizontal line or a diagonal line.

[0157] When the check box CB2 is checked in the 21st area A21, the display control unit 702 hides the checked food F in the 21st area A21, and displays the food F hidden in the 21st area A21 in the 22nd area A22.

[0158] The 22nd area A22, like the 21st area A21, displays an in-stock image SHI for food F that is in stock on the inventory list, in association with a check box CB2 and food name information FJ1.

[0159] The 22nd area A22 has a delete button B43. The delete button B43 is a software button for deleting all of the check boxes CB2, food name information FJ1, and in-stock images SHI displayed in the 22nd area A22, so that the 22nd area A22 does not display any food F. When the receiving unit 703 receives an operation to select the delete button B43, the display control unit 702 deletes all of the check boxes CB2, food name information FJ1, and in-stock images SHI in the 22nd area A22.

[0160] The shopping list screen SLG has an add food button B44. The add food button B44 is a software button for adding food F to the shopping list displayed on the shopping list screen SLG. When the reception unit 703 receives an operation to select the add food button B44, the display control unit 702 switches the screen displayed by the application UI 720 from the shopping list screen SLG to the food addition screen FAG.

[0161] [1-1-3-10. Composition of the food addition screen] FIG. 16 is a diagram showing an example of the food addition screen FAG. The food addition screen FAG is a screen for adding food F to the shopping list displayed on the shopping list screen SLG. The food addition screen FAG is a non-shopping list screen NLG.

[0162] The food addition screen FAG has a back button B45. The back button B45 is a software button for returning the screen displayed by the application UI 720 to the shopping list screen SLG. When the reception unit 703 receives an operation of selecting the back button B45 on the food addition screen FAG, the display control unit 702 returns the screen displayed by the application UI 720 from the food addition screen FAG to the shopping list screen SLG.

[0163] The food addition screen FAG has a 23rd area A23. The 23rd area A23 is an area having a plurality of switching buttons for switching the food F displayed in the 24th area A24. The switching buttons are software buttons. The 23rd area A23 has, for example, a switching button for switching to the food F registered by the user P as consumed, a switching button for switching to the food F registered by the user P as a favorite, a switching button for switching to the food F frequently used by the user P, a switching button for switching to the food F corresponding to meat, a switching button for switching to the food F corresponding to fish, and the like.

[0164] Note that consumed food F refers to food F whose inventory has been changed to zero using the slider SR (for example, by moving the control SS to the left end on the slider SR) or food F that has been deleted from the inventory list on the inventory screen SG. In addition, the food F that the user P frequently uses is the food F based on a prior medical interview, the user P's usage tendency, and the like.

[0165] When the receiving unit 703 receives an operation to select one of the switching buttons in the twenty-third area A23, the display control unit 702 displays the food F corresponding to the selected switching button in the twenty-first area A21.

[0166] The food addition screen FAG has a 24th area A24. The twenty-fourth area A24 displays, for each food F, a check box CB3, a food icon IC1, and food name information FJ1.

[0167] The food addition screen FAG has an Add button B46. The Add button B46 is a software button for adding the food F having a checked check box CB3 in the 24th region A24 to the shopping list. The Add button B46 may be a software button that is inoperable if no check box CB3 in the 24th region A24 is checked.

[0168] When the receiving unit 703 receives an operation to select the Add button B46, the display control unit 702 adds the food F, whose check box CB3 is checked in the 24th area A24, to the shopping list. More specifically, the display control unit 702 displays the food name information FJ1 of the food F, whose check box CB3 is checked in the 24th area A24, in the 21st area A21.

[0169] The food addition screen FAG has a text input field C3. The text entry field C3 is a field where text is entered when searching for food F to add to the shopping list. The accepting unit 703 accepts the input of text in the text entry field C3.

[0170] When the accepting unit 703 accepts a text input to the text input field C3, the display control unit 702 performs the following process. If there is no checked checkbox CB3 in the 24th area A24, the display control unit 702 displays a screen displaying a list of foods F that include the input text in their food names. Next, when the receiving unit 703 receives an operation to select one food F on the screen, the display control unit 702 returns the screen displayed by the application UI 720 to the food addition screen FAG, and adds the selected food F to the shopping list. If there is a checked check box CB3 in the twenty-fourth area A24, the display control unit 702 displays a screen asking whether it is OK to add food F, for which the check box CB3 is checked, to the shopping list. If the reception unit 703 receives an operation on this inquiry screen to allow addition to the shopping list, the display control unit 702 adds food F, which has the check box CB3 checked, to the shopping list, and then performs the same operation as when there is no checked check box CB3 in the 24th area A24. On the other hand, if the reception unit 703 receives an operation on this inquiry screen not allowing addition to the shopping list, the display control unit 702 hides the inquiry screen.

[0171] The display of the food addition screen FAG may start with a check mark in the checkbox CB3 of the consumed food F. Also, food F whose inventory has been changed to zero using the slider SR, or food F that has been deleted from the inventory list on the inventory screen SG, may be automatically added to the shopping list.

[0172] [1-1-4. Food management server configuration] Returning to the explanation of FIG. 3, the food management server 5 includes a server control device 50 and a server communication unit 51.

[0173] The server control device 50 includes a server processor 500 such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), a server memory 510, and an interface circuit to which other devices and sensors are connected.

[0174] The server memory 510 is a memory that stores programs and data. The server memory 510 stores a control program 511, a first management DB (database) 512, a second management DB 513, a third management DB 514, a fourth management DB 515, a fifth management DB 516, a sixth management DB 517, and data to be processed by the server processor 500. The server memory 510 has a non-volatile storage area. The server memory 510 may also have a volatile storage area and constitute a work area of ​​the server processor 500. The server memory 510 is constituted by, for example, a ROM (Read Only Memory) or a RAM (Random Access Memory).

[0175] 17 and 18 are diagrams showing an example of a database stored in the server memory 510. FIG.

[0176] The first management DB 512 is a database for managing the photographed images PG. Each record R1 stored in the first management DB 512 includes an account ID and an imaging device ID. Furthermore, the record R1 includes a first field, a second field, and a third field.

[0177] The first field is a field for storing data related to the refrigerator compartment 21, and has image capturing related information for the refrigerator compartment, image capturing related information for the right door 21B, and image capturing related information for the left door 21C. The second field is a field for storing data relating to the freezer compartment 24, and includes imaging-related information for the upper case of the freezer compartment 24, imaging-related information for the middle case of the freezer compartment 24, and imaging-related information for the lower case of the freezer compartment 24. The third field is a field for storing data related to the vegetable compartment 25, and has photography-related information for the upper case of the vegetable compartment 25 and photography-related information for the lower case of the vegetable compartment 25.

[0178] The second management DB 513 is a database for managing stored food SF owned by the user P. Each record R2 stored in the second management DB 513 has an account ID and an imaging device ID. In addition, the record R2 records, for each stored food SF owned by the user P, a food ID, a food icon IC1, food name information FJ1, inventory amount information FJ4, holding start date information FJ2, estimated expiration date information FJ3, storage location information KJ, and first notification timing information TJ1.

[0179] The third management DB 514 is a database that manages detection target foods KF held by the user P. Each record R3 stored in the third management DB 514 includes an account ID, a sensor ID, a food ID, a food icon IC1, food name information FJ1, inventory amount information FJ4, holding start date information FJ2, estimated expiration date information FJ3, storage location information KJ, first notification timing information TJ1, second notification timing information TJ2, and group data. The group data includes weight values ​​detected by the weight sensor 1 for the most recent week.

[0180] The fourth management DB 515 is a database for managing the shopping list. Each record R4 stored in the fourth management DB 515 has an account ID. The record R4 also has a food ID and food name information FJ1 for each food item included in the shopping list.

[0181] The fifth management DB 516 is a database that manages the My Page screen MPG. One record R5 stored in the fifth management DB 516 has an account ID. In addition, the record R5 records a food ID, a food icon IC1, food name information FJ1, and a food-related icon IC4 for each food F that the user P has registered as a favorite. In addition, the record R5 records a recipe icon IC3 for each recipe that the user P has registered as a favorite.

[0182] The sixth management DB 517 is a database for managing the food addition screen FAG. Each record R6 stored in the sixth management DB 517 has an account ID. In addition, the record R6 records a food ID, a food icon IC1, food name information FJ1, and switch button type information for each food displayed on the food addition screen FAG. The switching button type information is information that indicates the type of the switching button in the 23rd area A23. Note that record R6 may record multiple pieces of switch button type information for one food F. For example, when the check box CB3 for food F is checked in the area of ​​one switch button, the other switch button areas for food F may also be checked in the same manner.

[0183] Returning to the explanation of FIG. 3, the server communication unit 51 includes hardware such as a communication circuit conforming to a predetermined communication standard, and communicates with devices connected to the network NW under the control of the server control device 50.

[0184] The server processor 500 reads and executes a control program 511 stored in a server memory 510 , thereby functioning as a server communication control unit 501 and a server processing unit 502 .

[0185] The server communication control unit 501 communicates with the weight sensor 1, the image capturing device 6, and the terminal device 7 via the server communication unit 51.

[0186] The server processing unit 502 performs various information processes on the weight sensor 1, the image capturing device 6, and the terminal device 7 as clients.

[0187] When server communication control unit 501 receives first upload data D1, server processing unit 502 executes the following process. The server processing unit 502 identifies a record R3 having the sensor ID recorded in the received first upload data D1 from the third management DB 534. Next, the server processing unit 502 converts the weight recorded in the first upload data D1 into the inventory amount of food F using a predetermined algorithm. Next, the server processing unit 502 updates the inventory amount indicated by the inventory amount information FJ4 recorded in the identified record R2 to the converted inventory amount. In addition, the server processing unit 502 updates the group data in the identified record R3 to include the weight value recorded in the received first upload data D1.

[0188] When server communication control unit 501 receives second upload data D2, server processing unit 502 executes the following process. The server processing unit 502 identifies, from the first management DB 512, a record R1 having the image capturing device ID recorded in the received second upload data D2. Next, the server processing unit 502 updates the image capturing related information of the refrigerator compartment 21 contained in the identified record R1 to the image capturing related information of the refrigerator compartment 21 recorded in the received second upload data D2. The server processing unit 502 also updates the image capturing related information of the right door 21B contained in the identified record R1 to the image capturing related information of the right door 21B recorded in the received second upload data D2. The server processing unit 502 also updates the image capturing related information of the left door 21C contained in the identified record R1 to the image capturing related information of the left door 21C recorded in the received second upload data D2.

[0189] When server communication control unit 501 receives third upload data D3, server processing unit 502 executes the following process.

[0190] The server processing unit 502 identifies a record R1 having the photographing device ID recorded in the received third upload data D3 from the first management DB 512. Next, the server processing unit 502 identifies the photographing related information to be updated from the photographed image PG of the identified record R1 based on the type of the storage room and the type of the storage case recorded in the received third upload data D3. Next, the server processing unit 502 updates the identified photographing related information to be updated to the photographing related information of the storage case recorded in the third upload data D3.

[0191] Furthermore, when server communication control unit 501 receives third upload data D3, server processing unit 502 executes the following process.

[0192] The server processing unit 502 identifies, from the second management DB 513, the record R2 having the image capturing apparatus ID recorded in the received third upload data D3. Next, the server processing unit 502 detects food F from the photographed image PG of the storage case recorded in the received third upload data D3 by a predetermined image recognition process, and recognizes each of the detected foods F. In recognizing the foods F, the server processing unit 502 obtains the food ID, food icon IC1, and food name information FJ1 for the food F that has the highest degree of match with the detected food F from a predetermined database.

[0193] Next, the server processing unit 502 estimates the stock amount of each of the recognized foods F from the size of the food F in the photographed image PG and the like, using a predetermined algorithm.

[0194] Next, the server processing unit 502 determines whether the food F in the inventory list includes the food F that appears in the photographed image PG recorded in the third upload data D3. The server processing unit 502 acquires the food ID corresponding to the storage location information KJ indicating the type of storage chamber and the type of storage case recorded in the third upload data D3 from the identified record R2. Next, if the food ID acquired when recognizing the food F is present in the food IDs in the identified record R2, the server processing unit 502 determines that the food F in the inventory list includes the food F that appears in the photographed image PG recorded in the third upload data D3.

[0195] If the server processing unit 502 determines that the food F included in the inventory list is a food F that appears in the photographed image PG recorded in the third upload data D3, it updates the inventory quantity information FJ4 contained in the identified record R2, which corresponds to the food ID of the food F that appears in the photographed image PG, to indicate the estimated inventory quantity.

[0196] [1-2. Operation] Next, the operation of each part of the food management system 1000 related to the application UI 720 will be described. Fig. 19 is a flowchart showing the operation of the food management system 1000. In Fig. 19, a flowchart FA shows the operation of the terminal device 7, and a flowchart FB shows the operation of the food management server 5.

[0197] The terminal communication control unit 701 determines whether or not to request the food management server 5 to transmit a record (step SA1).

[0198] For example, when food management application 711 is launched, terminal communication control unit 701 makes an affirmative determination in step SA1. Also, for example, when a predetermined period (e.g., one-minute period) arrives while application UI 720 is displayed, terminal communication control unit 701 makes an affirmative determination in step SA1. Also, for example, when a predetermined trigger occurs to update the display contents of application UI 720, terminal communication control unit 701 makes an affirmative determination in step SA1. Note that an example of the predetermined trigger is when an update button that updates the display contents of application UI 720 is operated.

[0199] When the terminal communication control unit 701 determines to request transmission of the record (step SA1: YES), it transmits record request information, which is information requesting the record, to the food management server 5 (step SA2). The record request information includes the account ID stored in the terminal memory 710.

[0200] As shown in the flowchart FB, the server communication control unit 501 receives record request information from the terminal device 7 (step SB1).

[0201] Next, server processing unit 502 identifies records R1 to R6 corresponding to the account ID included in the record request information received in step SB1 from each database (step SB2).

[0202] Next, the server processing unit 502 transmits the records R1 to R6 identified in step SB2 to the terminal device 7 (step SB3).

[0203] As shown in the flowchart FA, the terminal communication control unit 701 receives records R1 to R6 from the food management server 5 (step SA3).

[0204] Next, the display control unit 702 generates various screens to be displayed by the application UI 720 based on the records R1 to R6 received in step SA3 (step SA4).

[0205] Step SA4 will now be described in detail. The display control unit 702 generates a first inventory screen SG1 that displays the food icons IC1 recorded in the records R2 and R3.

[0206] Step SA4 will now be described in detail. The display control unit 702 generates a second inventory screen SG2 based on records R2 and R3. In generating the second inventory screen SG2, the display control unit 702 generates food information FJ based on various information contained in records R2 and R3. Then, the display control unit 702 generates the second inventory screen SG2 that displays the food information FJ generated from record R3.

[0207] Step SA4 will now be described in detail. The display control unit 702 generates a third inventory screen SG3 based on various types of photography related information recorded in the record R1.

[0208] Step SA4 will now be described in detail. The display control unit 702 generates a first food details screen FDG1 that displays various information recorded in the record R2.

[0209] Step SA4 will now be described in detail. The display control unit 702 generates a graph GF from the group data recorded in record R3. Then, the display control unit 702 displays various information recorded in record R2 and generates a second food details screen FDG2 that displays the generated graph GF.

[0210] Step SA4 will now be described in detail. The display control unit 702 generates a MyPage screen MPG based on the records R2 and R5. In generating the MyPage screen MPG, the display control unit 702 generates a MyPage screen MPG that displays a food-related icon IC4 recorded in record R5. In generating the MyPage screen MPG, the display control unit 702 displays stock availability information PAJ indicating that there is stock on the food-related icon IC4 corresponding to the food ID whose stock amount information FJ4 indicates a value other than zero. In generating the MyPage screen MPG, the display control unit 702 also displays stock availability information PAJ indicating that there is no stock on the food-related icon IC4 corresponding to the food ID whose stock amount information FJ4 indicates zero. In generating the MyPage screen MPG, the display control unit 702 also displays a recipe icon IC3 recorded in record R5 in the 12th area A12.

[0211] Step SA4 will now be described in detail. The display control unit 702 generates a registered food screen RFG based on records R2 and R5. The display control unit 702 generates a registered food screen RFG that displays the food icon IC1 and food name information FJ1 recorded in record R5. In generating the registered food screen RFG, the display control unit 702 displays the stock availability string SM of "In stock" for the food icon IC1 and food name information FJ1 corresponding to the food ID whose stock quantity information FJ4 indicates a value other than zero. In generating the registered food screen RFG, the display control unit 702 displays the stock availability string SM of "Out of stock" for the food icon IC1 and food name information FJ1 corresponding to the food ID whose stock quantity information FJ4 indicates zero.

[0212] Step SA4 will now be described in detail. The display control unit 702 generates a shopping list screen SLG based on the records R2 and R4. The display control unit 702 generates a shopping list screen SLG that displays the food name information FJ1 recorded in the record R4. In generating the shopping list screen SLG, the display control unit 702 refers to the stock amount information FJ4 recorded in the record R2 and displays an in-stock image SHI for the food F whose stock amount is not zero. In generating the shopping list screen SLG, the display control unit 702 may display the necessity degree information NDJ by referring to the stock amount information FJ4 and the estimated expiration date information FJ3 recorded in the record R2. In generating the shopping list screen SLG, the display control unit 702 may display the necessity degree information NDJ by referring to the family composition information indicating the family composition of the user P and the stock amount information FJ4 recorded in the record R2. In addition, the family composition information is input to the terminal device 7 in advance and stored in a storage area (such as the terminal memory 710 or the server memory 510) that the terminal device 7 can acquire. Furthermore, the display control unit 702 acquires data of the inquiry icon IC5 using a predetermined method, and generates a shopping list screen SLG that displays the acquired inquiry icon IC5.

[0213] Step SA4 will now be described in detail. The display control unit 702 generates a food addition screen FAG based on the record R6. The display control unit 702 generates display contents of the 24th area A24 for each type of switch button indicated by the switch button type information, and generates a food addition screen FAG that can switchably display the generated 24th area A24.

[0214] Returning to the explanation of the flowchart FA, the display control unit 702 displays the screen generated in step SA4 in response to the operation on the application UI 720 accepted by the accepting unit 703 (step SA5).

[0215] Next, the operation of food management system 1000 when a software button displayed by application UI 720 is operated will be described.

[0216] When the receiving unit 703 receives an operation to select the Add button B13, the terminal communication control unit 701 transmits first addition request information to the food management server 5. The first addition request information is information requesting that the food F targeted by the Add button B13 be added to the shopping list. The first addition request information records an account ID, a food ID of the food F targeted by the Add button B13, a food icon IC1 of the food F, and food name information FJ1 of the food F. When the server communication control unit 501 receives the first addition request information, the server processing unit 502 identifies a record R4 of the account ID recorded in the received first addition request information from the fourth management DB 515. Then, the server processing unit 502 records the food ID, food icon IC1, and food name information FJ1 recorded in the first addition request information in the identified record R4.

[0217] Furthermore, when the receiving unit 703 receives an operation to select the Add button B13, the display control unit 701 adds food F, which is the addition target of the Add button B13, to the shopping list.

[0218] When the receiving unit 703 receives an operation to add food F on the registered food screen RFG, the terminal communication control unit 701 transmits second addition request information to the food management server 5. The second addition request information is information requesting that food F, which is instructed to be added on the registered food screen RFG, be added to the shopping list. The second addition request information records the account ID, the food ID of food F, which is instructed to be added on the registered food screen RFG, the food icon IC1 of the food F, and the food name information FJ1 of the food F. When the server communication control unit 501 receives the second addition request information, the server processing unit 502 identifies the record R4 of the account ID recorded in the received second addition request information from the fourth management DB 515. Then, the server processing unit 502 records the food ID, the food icon IC1, and the food name information FJ1 recorded in the second addition request information in the identified record R4.

[0219] Furthermore, when the receiving unit 703 receives an operation to add food F on the registered food screen RFG, the display control unit 701 adds food F, which is instructed to be added on the registered food screen RFG, to the shopping list.

[0220] When the reception unit 703 receives an operation to select the Add button B40, the terminal communication control unit 701 transmits the third addition request information to the food management server 5. The third addition request information is information requesting that the food F, whose check box CB1 is checked on the shopping list addition screen SAG, be added to the shopping list. The third addition request information records an account ID. The third addition request information records a food ID, a food icon IC1, and food name information FJ1 for each food F, whose check box CB1 is checked. When the server communication control unit 501 receives the third addition request information, the server processing unit 502 identifies the record R4 of the account ID recorded in the received third addition request information from the fourth management DB 515. Then, the server processing unit 502 records the food ID, food icon IC1, and food name information FJ1 recorded in the third addition request information in the identified record R4.

[0221] Furthermore, when the acceptance unit 703 accepts an operation to select the add button B40, the display control unit 701 adds the food item F that is the addition target of the add button B40 to the shopping list.

[0222] When the receiving unit 703 receives an operation to add food F on the food addition screen FAG, the terminal communication control unit 701 transmits fourth addition request information to the food management server 5. The fourth addition request information is information requesting that food F, which is the target of addition on the food addition screen FAG, be added to the shopping list. The fourth addition request information records an account ID. In addition, the fourth addition request information records a food ID, a food icon IC1, and food name information FJ1 for each food F, which is the target of addition on the food addition screen FAG. When the server communication control unit 501 receives the fourth addition request information, the server processing unit 502 identifies the record R4 of the account ID recorded in the received fourth addition request information from the fourth management DB 515. Then, the server processing unit 502 records the food ID, the food icon IC1, and the food name information FJ1 recorded in the fourth addition request information in the identified record R4.

[0223] Furthermore, when the receiving unit 703 receives an operation to add food F on the food addition screen FAG, the display control unit 701 adds food F, which is instructed to be added on the food addition screen FAG, to the shopping list.

[0224] The terminal device 7 stores various information related to the display of the shopping list screen SLG in the terminal memory 710. When an update is made to the shopping list, such as the addition of food F, the terminal device 7 appropriately updates the various stored information related to the display of the shopping list screen SLG. This allows the terminal device 7 to display an appropriate shopping list screen SLG even when offline.

[0225] The above-mentioned operation of the food management system 1000 is configured such that the food management server 5 transmits records R1 to R6. However, the records transmitted by the food management server 5 to the terminal device 7 do not have to be all of records R1 to R6. The food management server 5 may be configured such that the terminal device 7 transmits records necessary for displaying the screen. For example, when the terminal device 7 displays the shopping list screen SLG, the terminal device 7 requests records R2 and R4 from the food management server 5, and the food management server 5 transmits records R2 and R4 to the terminal device 7.

[0226] [1-3. Effects, etc.] The food management application 711 causes the terminal processor 700 of the terminal device 7 equipped with the touch panel 72 to function as a display control unit 702 that displays a shopping list, which is a list of foods that the user P plans to purchase, on the touch panel 72. The display control unit 702 displays, in the shopping list, cooking information CJ that indicates dishes that can be cooked using a first food item owned by the user P and a second food item not included in the shopping list.

[0227] This can increase the user P's desire to purchase food F that can be consumed by the user P's food F, thereby increasing the possibility that the user P will consume the food F. Therefore, food waste of the food F owned by the user P can be reduced.

[0228] The display control unit 702 displays, together with the dish information CJ, inquiry information IJ inquiring about adding the second food to the shopping list.

[0229] This allows user P to easily understand that food F that can be used to consume food F owned by user P can be added to the shopping list. This increases the likelihood that user P will remember to purchase food F that can be used to consume food F owned by user P. This further reduces food waste of food F owned by user P.

[0230] The food management application 711 causes the terminal processor 700 to function as a reception unit 703 that receives a selection of the inquiry information IJ. When the reception unit 703 receives the selection of the inquiry information IJ, the display control unit 702 adds the second food to the shopping list.

[0231] According to this, the user P can add the second food to the shopping list by a simple operation of selecting the inquiry information IJ. Therefore, the user P can easily add food F that can be used to consume the food F owned by the user P to the shopping list.

[0232] The display control unit 702 displays an in-stock image SHI indicating that the food F is in stock for the food F included in the inventory list, which is a list of the food F owned by the user P, among the food F shown in the shopping list.

[0233] This allows the user P to easily know which food items F are in stock among the food items F shown in the shopping list. This prevents the user P from forgetting to purchase food items F that are out of stock, or from purchasing extra food items F that are in stock.

[0234] The display control unit 702 displays necessity degree information NDJ indicating the degree of necessity for purchase of foods F included in an inventory list, which is a list of foods F owned by the user P, among the foods F shown in the shopping list.

[0235] This allows the user P to easily understand which food item F should be given priority for purchase among the food items F shown in the shopping list. This improves the convenience of the user P when viewing the shopping list.

[0236] The degree of need indicated by the necessity information NDJ is based on the amount of food in stock.

[0237] This allows the user P to easily understand which food item F should be given priority for purchase from the standpoint of inventory, among the food items F shown in the shopping list. This further improves the convenience of the user P when viewing the shopping list.

[0238] The degree of necessity indicated by the necessity degree information NDJ is based on the stock amount of food F and the family composition of user P.

[0239] According to this, since the necessity degree information NDJ that takes into account the family structure of the user P is displayed, the user P can easily and appropriately grasp, from the viewpoint of the amount of stock, which food F of the foods F shown in the shopping list should be purchased with priority. This further improves the convenience of the user P when viewing the shopping list.

[0240] The degree of necessity indicated by the necessity degree information NDJ is a degree based on the approximate expiration date of the food F.

[0241] This allows the user P to easily understand which food item F should be given priority for purchase among the food items F shown in the shopping list, from the perspective of the estimated expiration date. This further improves the convenience of the user P when viewing the shopping list.

[0242] The terminal device 7 includes a touch panel 72 and a display control unit 702 that displays a shopping list on the touch panel 72. The display control unit 702 displays, in the shopping list, cooking information CJ that indicates dishes that can be cooked using a first food item owned by a user P and a second food item that is not included in the shopping list.

[0243] This provides the same effects as the food management application 711 described above.

[0244] The control method of the terminal device 7 displaying the shopping list is to display, in the shopping list, recipe information CJ indicating recipes that can be cooked using a first food item owned by the user P and a second food item that is not included in the shopping list.

[0245] This provides the same effects as the food management application 711 described above.

[0246] The food management application 711 causes the terminal processor 700 to function as a display control unit 702 that switchably displays multiple non-shopping list screens NLG that do not display a shopping list on the touch panel 72, and a reception unit 703 that receives an operation on the non-shopping list screen NLG to add a food F displayed on the non-shopping list screen NLG to the shopping list. The display control unit 702 is capable of displaying a shopping list screen SLG that displays a shopping list, and when the reception unit 703 receives an operation to add, adds the food F to be added to the shopping list displayed on the shopping list screen SLG.

[0247] This allows food items to be added to the shopping list from multiple screens other than the shopping list screen, thereby improving the convenience for the user P in adding food items to the shopping list.

[0248] The plurality of non-shopping list screens NLG includes an inventory screen SG that displays an inventory list, which is a list of food items owned by user P.

[0249] According to this, since food F can be added to the shopping list from the screen that displays the inventory list, food F that is about to run out of stock or food F that the user wants to replenish can be easily added to the shopping list. This further improves the convenience for the user P in adding food to the shopping list.

[0250] The plurality of non-shopping list screens NLG includes a registered foods screen RFG that displays foods F that are favorited by user P.

[0251] According to this, since the food F displayed on the registered food screen RFG can be added to the shopping list, the food F that the user P likes can be easily added to the shopping list. Therefore, the convenience of the user P in adding foods to the shopping list can be further improved.

[0252] The plurality of non-shopping list screens NLG includes an add shopping list screen SAG for adding ingredients indicated by a recipe to a shopping list.

[0253] According to this, since the food F displayed on the shopping list addition screen SAG can be added to the shopping list, ingredients indicated in the recipe can be easily added to the shopping list. Therefore, the convenience of the user P in adding foods to the shopping list can be further improved.

[0254] The shopping list addition screen SAG displays an in-stock image SHI indicating that the ingredient corresponding to the food F in stock in the inventory list is in stock.

[0255] This allows the user P to easily know which ingredients are in stock among the ingredients indicated by the recipe. This prevents the user P from forgetting to purchase food F that is out of stock, or from purchasing extra food F that is in stock.

[0256] Each of the ingredients shown on the shopping list addition screen SAG can be selected as a food F to be added to the shopping list. The display control unit 702 starts displaying the shopping list addition screen SAG when an ingredient corresponding to a food F that is out of stock in the inventory list is selected as a food F to be added to the shopping list.

[0257] According to this, when the shopping list addition screen SAG starts to be displayed, food F that is out of stock in the inventory list is automatically selected as a target to be added. Therefore, the user P does not need to set the food F that is out of stock in the inventory list as a target to be added to the shopping list. This further improves the convenience for the user P in adding foods to the shopping list.

[0258] The plurality of non-shopping list screens NLG includes a food add screen FAG for adding food to a shopping list.

[0259] According to this, since the food F displayed on the food addition screen FAG can be added to the shopping list, the food F can be easily added to the shopping list from a dedicated screen for adding the food F to the shopping list. Therefore, the convenience of the user P in adding the food F to the shopping list can be improved.

[0260] The terminal device 7 includes a touch panel 72, a display control unit 702 that switchably displays multiple non-shopping list screens NLG that do not display a shopping list using the touch panel 72, and a reception unit 703 that receives an operation on the non-shopping list screen NLG to add a food item F displayed on the non-shopping list screen NLG to the shopping list. The display control unit 702 is capable of displaying a shopping list screen SLG that displays a shopping list, and when the reception unit 703 receives an operation to add a food item F displayed on the non-shopping list screen NLG, it adds the food item F to be added to the shopping list displayed on the shopping list screen SLG.

[0261] This provides the same effects as the food management application 711 described above.

[0262] The control method of the terminal device 7 switchably displays a plurality of non-shopping list screens NLG that do not display a shopping list. The control method of the terminal device 7 accepts an operation on the non-shopping list screen NLG to add a food item F displayed on the non-shopping list screen NLG to the shopping list. The control method of the terminal device 7 is capable of displaying a shopping list screen SLG that displays a shopping list, and when an operation to add a food item F displayed on the non-shopping list screen NLG to the shopping list is accepted, the control method of the terminal device 7 adds the food item F to be added to the shopping list displayed on the shopping list screen SLG.

[0263] This provides the same effects as the food management application 711 described above.

[0264] (Other embodiments) As described above, the above-mentioned first embodiment has been described as an example disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. In addition, it is also possible to combine the components described in the above-mentioned first embodiment to create a new embodiment. Therefore, other embodiments will be exemplified below.

[0265] In the above-described first embodiment, the shopping list screen SLG is configured to display the inquiry icon IC5. In another embodiment, when the current location of the terminal device 7 is located in a store or place where shopping can be performed, the shopping list screen SLG may display information that the user P can benefit from at the store (for example, discount information or information on products on sale) instead of or together with the inquiry icon IC5. In this other embodiment, the terminal device 7 acquires the current location of the terminal device 7 using a Global Navigation Satellite System (GSNN). In addition, in this other embodiment, the terminal device 7 determines whether the current location of the terminal device 7 is located in a store or place where shopping can be performed from map data or the like. In this other embodiment, the terminal device 7 acquires information that the user P can benefit from at the store corresponding to the current location of the terminal device 7 by a predetermined method, and reflects the information on the shopping list screen SLG.

[0266] In the above-described first embodiment, the food F whose stock amount has been changed to zero using the slider SR and the food F whose stock list has been deleted on the stock screen SG are displayed on the food addition screen FAG. In other embodiments, the food F whose stock amount has been changed to zero using the slider SR and the food F whose stock list has been deleted on the stock screen SG may be automatically added to the shopping list.

[0267] In the above-mentioned first embodiment, the weight sensor 1 has been described as a plate-shaped device, but the shape of the weight sensor 1 is not limited to a plate shape.

[0268] In the above-described first embodiment, the vegetable compartment 25 is provided below the freezer compartment 24. However, the freezer compartment 24 may be provided below the vegetable compartment 25.

[0269] In the above-described first embodiment, the selection field C2 displays three options, but the number of options displayed by the selection field C2 is not limited to three, and may further include options indicating different display orders. For example, the order may be the order of most or least stocked food F, the order of most frequently used by the user P, or the order of favorite additions.

[0270] In the above-described embodiment 1, the freezer compartment 24 has three storage cases and the vegetable compartment 25 has two storage cases, but the number of storage cases provided in the freezer compartment 24 and the vegetable compartment 25 is not limited to that in embodiment 1.

[0271] In the above-described first embodiment, the terminal device 7 is a smartphone or a tablet PC. In other embodiments, the terminal device 7 may be a desktop or laptop PC.

[0272] In the above-described first embodiment, an application program that can be installed in the terminal device 7 is exemplified as the "program", but the "program" may be a software program that already exists in the terminal device 7, such as a browser.

[0273] In the above-described first embodiment, the various screens displayed by the application UI 720 are generated by the terminal device 7, and the various screens generated by the terminal device 7 are displayed. In another embodiment, the various screens displayed by the application UI 720 may be generated by the food management server 5, and the terminal device 7 may display the various screens generated by the food management server 5.

[0274] The server processor 500 and the terminal processor 700 may be configured with a single processor or multiple processors. These processors may be hardware programmed to realize the corresponding functional units. That is, these processors may be configured with, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0275] The configurations of the food management server 5 and the terminal device 7 shown in Fig. 3 are merely examples, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each unit individually, and it is also possible to implement a configuration in which one processor executes a program to realize the functions of each unit. Also, some of the functions realized by software in the above-mentioned embodiment may be hardware, or some of the functions realized by hardware may be software.

[0276] The step units of the operation shown in Fig. 19 are divided according to the main processing contents in order to facilitate understanding of the operation, and the operation is not limited by the manner in which the processing units are divided or the names thereof. The operation may be divided into more step units according to the processing contents. In addition, one step unit may be divided so as to include more processing. In addition, the order of the steps may be appropriately changed within a range that does not interfere with the purpose of this disclosure.

[0277] It should be noted that the above-described embodiments are intended to illustrate the technology of the present disclosure, and various modifications, substitutions, additions, omissions, and the like can be made within the scope of the claims or their equivalents.

[0278] (Additional Note) The above description of the embodiments discloses the following techniques.

[0279] (Technology 1) A program that causes a processor of a terminal device having a display unit to function as a display control unit that switches between multiple non-shopping list screens on the display unit that do not display a shopping list, which is a list of foods that a user plans to purchase, and a reception unit that receives an operation on the non-shopping list screen to add foods displayed on the non-shopping list screen to the shopping list, wherein the display control unit is capable of displaying a shopping list screen that displays the shopping list, and when the reception unit receives the operation to add, adds the food to be added to the shopping list displayed on the shopping list screen. According to this, food items can be added to the shopping list from multiple screens other than the shopping list screen, thereby improving the convenience for the user in adding food items to the shopping list.

[0280] (Technology 2) The program described in Technology 1, wherein the plurality of non-shopping list screens include an inventory screen that displays an inventory list that is a list of food items owned by the user. According to this, since food items can be added to the shopping list from the screen that displays the inventory list, food items that are running low or that the user wants to replenish can be easily added to the shopping list, thereby improving the convenience for users in adding food items to the shopping list.

[0281] (Technology 3) The program according to Technology 1 or Technology 2, wherein the plurality of non-shopping list screens include a registered food screen that displays the user's favorite foods. According to this, since the food displayed on the registered food screen can be added to the shopping list, the user can easily add his / her favorite food to the shopping list, thereby improving the convenience for the user in adding food to the shopping list.

[0282] (Technology 4) The program described in any one of Technology 1 to Technology 3, wherein the plurality of non-shopping list screens include a shopping list addition screen for adding ingredients indicated by a recipe to the shopping list. According to this, since the food displayed on the shopping list addition screen can be added to the shopping list, ingredients indicated in the recipe can be easily added to the shopping list, thereby improving the convenience for the user in adding food to the shopping list.

[0283] (Technology 5) The program described in Technology 4, in which the shopping list addition screen displays an in-stock image indicating that ingredients corresponding to foods that are in stock in an inventory list, which is a list of foods owned by the user, are in stock. This allows the user to easily know which ingredients are in stock among the ingredients indicated by the recipe, thereby preventing the user from forgetting to purchase food that is out of stock or from purchasing extra food that is in stock.

[0284] (Technology 6) The program described in Technology 4 or Technology 5, wherein each of the ingredients shown on the shopping list addition screen is selectable as a food to add to the shopping list, and the display control unit starts displaying the shopping list addition screen when an ingredient corresponding to a food that is out of stock in the inventory list is selected as a food to add to the shopping list. According to this, when the shopping list addition image starts to be displayed, foods that are out of stock in the inventory list are automatically selected as items to be added. Therefore, the user does not need to set foods that are out of stock in the inventory list as items to be added to the shopping list. This further improves the convenience for the user in adding foods to the shopping list.

[0285] (Technology 7) The program described in Technology 1, wherein the plurality of non-shopping list screens includes a food add screen for adding food to the shopping list. According to this, since the food displayed on the food addition screen can be added to the shopping list, the food can be easily added to the shopping list from a dedicated screen for adding food to the shopping list, thereby improving the convenience for the user in adding food to the shopping list.

[0286] (Technology 8) A terminal device comprising: a display unit; a display control unit that switches between multiple non-shopping list screens that do not display a shopping list, which is a list of foods that a user plans to purchase, on the display unit; and a reception unit that receives an operation on the non-shopping list screen to add foods displayed on the non-shopping list screen to the shopping list, wherein the display control unit is capable of displaying a shopping list screen that displays the shopping list, and when the reception unit receives the operation to add, adds the food to be added to the shopping list displayed on the shopping list screen. This provides the same effect as the program of Technology 1.

[0287] (Technology 9) A control method for a terminal device which displays, in a switchable manner, a number of non-shopping list screens which do not display a shopping list, which is a list of foods that the user intends to purchase, and which accepts an operation on the non-shopping list screen to add foods displayed on the non-shopping list screen to the shopping list, and which is capable of displaying a shopping list screen which displays the shopping list, and which, when the operation to add is accepted, adds the food to be added to the shopping list displayed on the shopping list screen. This provides the same effect as the program of Technology 1. [Industrial Applicability]

[0288] As described above, the program, the terminal device, and the control method for the terminal device according to the present invention can be used to add food items to a shopping list. [Explanation of symbols]

[0289] 1 Weight Sensor 2. Refrigerator 5. Food Management Server 6. Imaging Device 7 Terminal Equipment 8. Communications Equipment 11 First weight sensor 12 Second weight sensor 21 Refrigerator 70 Terminal control device 71 Terminal communication unit 72 Touch panel (display) 700 Terminal Processor (Processor) 701 Terminal communication control unit 702 Display control unit 703 Reception 710 Terminal Memory 711 Food management app (program) 1000 Food Control System CJ Food Information F Food FAG Food Addition Screen FDG food details screen IJ Contact Information MLG Material List Screen MPG My Page Screen NDJ Necessity Information NDJ1 First Necessity Information NDJ2 Second Necessity Information NFJ Necessity Information NLG non-shopping list screen RFG Registered Foods Screen RG Recipe Screen SAG Shopping List Add Screen SF Contained Food SG Inventory Screen SG1 First inventory screen SG2 2nd inventory screen SG3 3rd inventory screen SHI Stock Images SLG Shopping list screen

Claims

1. A processor of a terminal device having a display unit, a display control unit that causes the display unit to switch between a plurality of non-shopping list screens that do not display a shopping list, which is a list of foods that the user plans to purchase; a receiving unit that receives an operation to add a food item displayed on the non-shopping list screen to the shopping list, on the non-shopping list screen; The display control unit is A shopping list screen displaying the shopping list can be displayed, When the reception unit receives the operation to add, the food to be added is added to the shopping list displayed on the shopping list screen. program.

2. the plurality of non-shopping list screens includes an inventory screen that displays an inventory list that is a list of food items owned by the user; The program according to claim 1.

3. the plurality of non-shopping list screens includes a registered food screen displaying a user's favorite foods; The program according to claim 1.

4. the plurality of non-shopping list screens includes an add shopping list screen for adding ingredients indicated by a recipe to the shopping list; The program according to claim 1.

5. The shopping list addition screen displays an in-stock image indicating that ingredients corresponding to foods in stock in an inventory list, which is a list of foods owned by the user, are in stock. The program according to claim 4.

6. each of the ingredients shown on the shopping list addition screen is selectable as a food item to add to the shopping list; The display control unit is start displaying the shopping list addition screen while an ingredient corresponding to a food item that is out of stock in the inventory list is selected as a food item to be added to the shopping list; The program according to claim 4 or 5.

7. the plurality of non-shopping list screens includes an add food screen for adding food to the shopping list; The program according to claim 1.

8. A display unit; a display control unit that causes the display unit to switch between a plurality of non-shopping list screens that do not display a shopping list, which is a list of foods that the user plans to purchase; a reception unit that receives an operation to add a food item displayed on the non-shopping list screen to the shopping list on the non-shopping list screen, The display control unit is A shopping list screen displaying the shopping list can be displayed, When the reception unit receives the operation to add, the food to be added is added to the shopping list displayed on the shopping list screen. Terminal device.

9. A plurality of non-shopping list screens are switchably displayed on the screen, which do not display a shopping list, which is a list of foods that the user plans to purchase; accepting, on the non-shopping list screen, an operation to add a food item displayed on the non-shopping list screen to the shopping list; A shopping list screen displaying the shopping list can be displayed, When the operation to add is accepted, the food to be added is added to the shopping list displayed on the shopping list screen. A method for controlling a terminal device.

Images