Information processor and program

Abstract

To provide a program that can suggest a recipe to a user based on a product the user has purchased.SOLUTION: A program makes a computer function as an acquisition part that obtains an image of a receipt from a user; an extraction part that extracts purchase information indicating the purchases shown on the receipt from the image obtained by the acquisition part; a retrieval part that searches for recipe information concerning a recipe for a dish using the product indicated by the purchase information extracted by the extraction part as an ingredient; and a proposal part that proposes the recipe information searched by the retrieval part to the user.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an information processing device and a program. [Background technology]

[0002] Recipe sites that publish cooking recipes have been known for some time.

[0003] In this regard, Patent Document 1 discloses a configuration in which a recipe site accepts input of recipe characteristic information when it receives a recipe usage report, and outputs either a recipe linked to the recipe characteristic information or a recipe usage report when it receives a recipe search request. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-132026 Summary of the Invention [Problem to be solved by the invention]

[0005] However, although the technology described in Patent Document 1 allows users to input and search for cooking recipes on a recipe site, it does not take into consideration products that the users have purchased in stores, etc. Therefore, the technology described in Patent Document 1 has the problem that it may suggest recipes to the users that are only vaguely related to the products that the users have purchased.

[0006] The present invention has been made in view of the above problems, and its purpose is to provide an information processing device and a program that can suggest cooking recipes to a user according to products purchased by the user. [Means for solving the problem]

[0007] In order to solve the above problem, the program of the present invention causes a computer to function as an acquisition unit that acquires an image of a receipt from a user, an extraction unit that extracts purchase information regarding the purchase indicated by the receipt from the image acquired by the acquisition unit, a search unit that searches for recipe information regarding cooking recipes that use as ingredients the products indicated by the purchase information extracted by the extraction unit, and a suggestion unit that suggests the recipe information searched for by the search unit to the user.

[0008] In addition, the program of the present invention further causes the computer to function as a memory unit that stores the purchase information, and the search unit searches for the recipe information based on past purchase information stored in the memory unit and the purchase information extracted by the extraction unit.

[0009] The search unit searches for menu information relating to a menu including the dish indicated by the searched recipe information, and the suggestion unit suggests the menu information searched by the search unit to the user.

[0010] In addition, the program of the present invention further causes the computer to function as a registration unit that registers the recipe information and a memory unit that stores user information including the browsing history of recipe information registered by other users, and the search unit searches for the recipe information based on the recipe information registered by the registration unit and the browsing history included in the user information.

[0011] The search unit searches for recipe information that differs from the recipe information registered by the registration unit and the recipe information included in the browsing history included in the user information.

[0012] In addition, the search unit compares the ingredients of the dish indicated by the searched recipe information with the products included in the purchase information, and searches for ingredients of the dish that are not included in the purchase information, and the suggestion unit suggests the ingredients searched by the search unit to the user.

[0013] In addition, the program of the present invention further causes the computer to function as a memory unit that stores the purchasing information, the search unit searches for purchasing information from the purchasing information stored in the memory unit regarding stores where the searched material can be purchased, and the suggestion unit suggests to the user information regarding the stores indicated by the purchasing information searched for by the search unit.

[0014] In addition, the program of the present invention further causes the computer to function as a memory unit that stores the purchase information, and the search unit searches for purchase information of other users different from the user stored in the memory unit that includes products purchased by the user and where the store where the products were purchased meets specified conditions, and the suggestion unit suggests to the user information regarding the store and products indicated in the purchase information searched by the search unit.

[0015] In addition, the program of the present invention further causes the computer to function as an advertising unit that provides advertisements related to stores to the user, and the search unit searches for recipe information related to cooking recipes that include ingredients included in the advertisement among the recipes.

[0016] The information processing device of the present invention also includes an acquisition unit that acquires an image of a receipt from a user, an extraction unit that extracts purchase information regarding the purchase indicated by the receipt from the image acquired by the acquisition unit, a search unit that searches for recipe information regarding cooking recipes that use as ingredients the products indicated by the purchase information extracted by the extraction unit, and a suggestion unit that suggests the recipe information searched for by the search unit to the user. [Effects of the Invention]

[0017] According to the present invention, an information processing device and a program can suggest cooking recipes to a user according to products purchased by the user. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a diagram showing the overall configuration of a proposed system according to an embodiment of the present invention; [Figure 2]FIG. 2 is a diagram illustrating an example of a hardware configuration of a server device illustrated in FIG. [Figure 3] 2 is a diagram illustrating an example of a functional configuration of a server device illustrated in FIG. 1. FIG. [Figure 4] 2 is a flowchart showing an example of a processing flow in the server device shown in FIG. [Figure 5A] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 prompts the user to upload an image of a receipt. [Figure 5B] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 registers the contents of an image of a receipt. [Figure 5C] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 suggests recipes and menus. [Figure 5D] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 controls the display of information related to recipes. [Figure 5E] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 controls the display of information about menus. [Figure 5F] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 controls the display of information about material prices. DETAILED DESCRIPTION OF THE INVENTION

[0019] Hereinafter, an embodiment of the present invention (hereinafter referred to as "the present embodiment") will be described with reference to the accompanying drawings. To facilitate understanding of the description, the same components and steps in each drawing will be designated by the same reference numerals as much as possible, and redundant description will be omitted.

[0020] <Overall structure> 1 is a diagram showing the overall configuration of a management system 1 according to this embodiment. As shown in Fig. 1, the management system 1 mainly includes, for example, a server device 10 and terminals 20 of a plurality of users.

[0021] The server device 10 is an information processing device such as a desktop computer or a laptop computer, which receives instructions from a user's terminal 20 and controls the display of display content on the user's terminal 20 in accordance with the instructions. Specifically, the server device 10 acquires an image of a receipt from the user's terminal 20 via the communications network NT. The server device 10 also extracts purchase information from the acquired receipt image, such as the purchased items, their prices, the stores where the purchases were made, and the time of purchase. The server device 10 also searches for recipes and menus according to the extracted purchase information, and suggests the searched recipes and menus to the user's terminal 20 via the communications network NT.

[0022] The user's terminal 20 is, for example, a mobile phone, a smartphone, a tablet, a personal computer, etc., and is a device operated by a user. The user's terminal 20 transmits instructions to the server device 10 via the communication network NT to use display content stored in the server device 10. Furthermore, the display content of the user's terminal 20 is display-controlled by the server device 10 via the communication network NT.

[0023] <Hardware configuration> Fig. 2 is a diagram illustrating an example of a hardware configuration of the server device 10 shown in Fig. 1. As shown in Fig. 2, the server device 10 mainly includes a storage device 11, a CPU (Central Processing Unit) 12, a memory 13, and a communication device 14, for example.

[0024] The storage device 11 is configured with a hard disk, etc. The storage device 11 stores various programs and information required for the CPU 12 to execute processing, as well as information on the processing results.

[0025] The CPU 12 functions as various functional components by executing predetermined programs stored in the memory 13 or the storage device 11. Details of these functional components will be described later.

[0026] The communication device 14 is configured with a communication interface for communicating with external devices, etc. The communication device 14 transmits and receives various information to and from the user's terminal 20 via the communication network NT, for example.

[0027] The server device 10 can be realized using an information processing device such as a dedicated or general-purpose server computer. The server device 10 may be configured from a single information processing device or from multiple information processing devices distributed over a communication network NT. Fig. 2 shows only a portion of the main hardware configuration of the server device 10, and the server device 10 may also be configured with other components that are generally included in a server.

[0028] <Functional configuration> Fig. 3 is a block diagram showing an example of the functional configuration of the server device 10 shown in Fig. 1. As shown in Fig. 3, the server device 10 has, as its functional configuration, for example, an acquisition unit 110, an extraction unit 120, a registration unit 130, a search unit 140, a proposal unit 150, an advertisement unit 160, and a storage unit 190. The functional means other than the storage unit 190 are realized by the CPU 12 executing a program stored in the storage device 11 or the like. Note that all or part of the above functional means may be provided in the user terminal 20, rather than in the server device 10.

[0029] Storage unit 190 has a functional configuration for storing display content 198 and various information. Specifically, storage unit 190 stores user information 191, purchase information 192, product information 193, recipe information 194, menu information 195, store information 196, advertisement information 197, and display content 198.

[0030] User information 191 is information about a user who uses display content 198. User information 191 includes, for example, information such as the user's name, address, telephone number, email address, date of birth, login ID, and login password. User information 191 also includes, for example, a browsing history such as recipe information 194 related to recipes that the user has previously viewed and menu information 195 related to menus that the user has previously viewed. User information 191 also includes, for example, a posting history such as recipe information 194 that the user has previously registered or posted in display content 198 and menu information 195 that the user has previously registered or posted. User information 191 also includes, for example, a browsing history of advertisement information 197 related to advertisements that the user has previously viewed.

[0031] The purchase information 192 is information related to purchases indicated by receipts registered by the user. For each receipt registered by the user, the purchase information 192 includes, for example, the product name and price of the product purchased by the user, the name of the store where the user purchased the product, and the date and time when the user purchased the product.

[0032] Product information 193 is information about products that are ingredients in a recipe. Product information 193 includes, for example, product names and categories to which the products belong. Product names are names of products that appear on receipts, such as "▽▽ Dairy Low-Fat Milk," "▽▽ Dairy Kaoru Cheese," "★★ Confectionery Premium Cocoa," "1 pack of carrots," "5 onions," "1 stalk of broccoli," and "496g of pork belly." Note that "▽▽ Dairy" and "★★ Confectionery" among the product names are examples of the names of the product manufacturers. Categories are information for classifying products, and are established to classify product names that appear on receipts, which are written in different ways depending on the product manufacturer or production company or store. Examples of categories include "cocoa," "milk," "cheese," "carrots," "onions," "broccoli," and "pork belly." Specifically, for example, the product name "★★ Confectionery Premium Cocoa" is associated with the category "cocoa," the product name "▽▽ Dairy Kaoru Cheese" is associated with the category "cheese," and "Pork Belly 496g" is associated with "Pork Belly."

[0033] The recipe information 194 is information about recipes for dishes that use the product as an ingredient. The recipe information 194 includes, for example, a recipe name indicating the name of the recipe and a category name of the ingredients required for the recipe for each recipe. Recipe names include, for example, "Stir-fried vegetables," "Nikujaga," "Cream Stew A," "Cream Stew B," "Agar Jelly," and "Buche de Noel." Examples of combinations of recipe names and category names include, for example, the recipe name "Stir-fried vegetables" is associated with category names of "Green Peppers," "Cabbage," "Onions," "Pork Belly," and "Oyster Sauce." Furthermore, for example, the recipe name "Cream Stew B" is associated with category names of "Milk," "Consommé," "Potatoes," "Broccoli," "Chicken Thigh," and "Onions." Furthermore, for example, the recipe name "Agar Jelly" is associated with category names of "Agar Powder" and "Tangerines (Canned)."

[0034] The menu information 195 is information about a menu including the dishes indicated by the recipe information 194. The menu information 195 includes, for example, a menu name indicating the name of the menu and a recipe name indicating the dishes included in the menu for each menu. The menu names are, for example, "breakfast (Japanese food A)," "breakfast (Japanese food B)," "breakfast (Western food A)," "snack A," "dinner A," and "dinner B." As an example of a combination of a menu name and a recipe name, for example, the menu name "breakfast (Japanese food A)" is associated with the recipe names "rice," "miso soup A," "natto," "grilled salmon," and "rolled egg C." Furthermore, for example, the menu name "breakfast (Western food)" is associated with the recipe names "white bread," "ham and egg D," "coffee," and "yogurt." Furthermore, for example, the menu name "dinner A" is associated with the recipe names "rice," "meat and potato stew," "grilled atka mackerel," and "spinach simmered in soy sauce."

[0035] Store information 196 is information about the store indicated by purchase information 192. Store information 196 includes, for example, a store name indicating the name of the store, the store's address, and the store's telephone number. Store information 196 also includes, for each product, the product names of products available for purchase at the store and the prices of the products available for purchase at the store. Store information 196 also includes information about events that are being held or are scheduled to be held at the store. Information about the event includes, for example, the name of the event, details of the event such as the discount rate and amount of the product, limited products sold only at the event, and the period during which the event will be held.

[0036] The advertisement information 197 is information related to advertisements announced or provided by stores. The advertisement information 197 includes, for example, the store to which the contents described in the advertisement apply, the period to which the contents described in the advertisement apply, the product name, and the price of the product. Note that the advertisement information 197 may also include, for example, information related to the above-mentioned event.

[0037] The display content 198 is content that the server device 10 provides to the user terminal 20 via the communication network NT, and is, for example, an application or web page for a mobile terminal such as a smartphone. The display content 198 includes content that accepts registration of receipt images, recipe registration, and menu registration in accordance with user operations. The display content 198 also includes content that indicates recipes and menus registered by the user, as well as the user's purchase history indicated by the past purchase information 192. The display content 198 also includes content that indicates recipes and menus registered by other users, and information on product prices for each store. The display content 198 also includes content that indicates events that are being held or will be held by the store, and advertisements that are being offered or announced by the store.

[0038] The acquisition unit 110 acquires an image of a receipt from the user's terminal 20 via the communication network NT. The acquisition unit 110 also acquires an image of a dish and an image of a menu from the user's terminal 20 via the communication network NT.

[0039] The extraction unit 120 extracts, from the image of the receipt acquired by the acquisition unit 110, purchase information 192 relating to the purchase indicated by the receipt.

[0040] The registration unit 130 registers the purchase information 192 extracted by the extraction unit 120 as information relating to a new purchase, and adds the information to the purchase information 192 stored in the storage unit 190 to update it.

[0041] The registration unit 130 also registers recipe information 194. Specifically, the registration unit 130 receives input of the recipe name, the ingredients and their quantities included in the recipe, and the cooking steps for the dish indicated by the recipe from the user terminal 20 via the communication network NT, and registers the received content as recipe information 194 and stores it in the memory unit 190. If recipe information 194 is already stored in the memory unit 190, the registration unit 130 adds the content of the registered recipe information 194 to the recipe information 194 stored in the memory unit 190.

[0042] The registration unit 130 also registers menu information 195. Specifically, the registration unit 130 accepts input of the menu name, recipes included in the menu, and supplemental information related to the menu from the user's terminal 20 via the communication network NT, registers the accepted content as menu information 195, and stores it in the memory unit 190. If menu information 195 is already stored in the memory unit 190, the registration unit 130 adds the content of the registered menu information 195 to the menu information 195 stored in the memory unit 190.

[0043] The search unit 140 searches for recipe information 194 of a dish that uses as ingredients the products indicated in the purchase information 192 extracted by the extraction unit 120. The search unit 140 also searches for menu information 195 related to a menu that includes the dish indicated by the recipe information 194. The search unit 140 also compares the ingredients of the dish indicated by the searched recipe information 194 with the products included in the purchase information 192. After performing the comparison, the search unit 140 searches for ingredients of the dish indicated by the recipe information 194 that are not included in the purchase information 192. After searching for the ingredients, the search unit 140 also searches for purchase information 192 related to stores where the searched ingredients can be purchased from the purchase information 192 stored in the storage unit 190.

[0044] Furthermore, the search unit 140 searches for purchase information 192 of other users different from the user stored in the storage unit 190, for purchase information 192 that includes a product purchased by the user and where the store where the product was purchased satisfies a predetermined condition. The predetermined condition is, for example, that the store is within a predetermined distance from the user's address, commute location, nearest station, etc., included in the user information 191. Another predetermined condition is, for example, that the store is a store that has been determined in advance by the user. Another predetermined condition is, for example, that the user has purchased a product from a store from which the user has purchased a product in the past.

[0045] The suggestion unit 150 suggests to the user recipe information 194 searched by the search unit 140. The suggestion unit 150 also suggests to the user menu information 195 searched by the search unit 140. The suggestion unit 150 also suggests to the user ingredients searched by the search unit 140. The suggestion unit 150 also suggests to the user information related to the store indicated by the purchase information 192 searched by the search unit 140. The information related to the store is, for example, the name and location of the store, information about events announced or held at the store, advertisements announced by the store, etc.

[0046] Furthermore, the suggestion unit 150 suggests to the user information about the store and product indicated in the purchase information 192 where the store satisfies a predetermined condition, which is searched by the search unit 140. The information about the product includes, for example, the product name, the product price, and an advertisement related to the product.

[0047] The advertising unit 160 refers to the advertising information 197 stored in the storage unit 190 and provides the user with an advertisement related to the store.

[0048] <Flow of operations> Above, we have explained the functional configuration of the server device 10. Next, we will explain in detail the flow of a series of processes in the server device 10. Figure 4 is a flowchart showing an example of the flow of processes in the server device 10 shown in Figure 1.

[0049] (Step SP10) The server device 10 acquires an image of a receipt from the user's terminal 20 via the communications network NT using the acquisition unit 110. Here, the screen for uploading a receipt image in the display content 198 will be described with reference to FIG. 5A. FIG. 5A is a diagram showing an example of the display content 198 when the server device 10 shown in FIG. 1 prompts the user to upload a receipt image. As shown in FIG. 5A, the display content 198 includes buttons 1981 and 1982 as content that prompts the user to upload a receipt image.

[0050] Button 1981 is a button for taking a photo of the receipt using the user's terminal 20. When the user presses button 1981, the server device 10 activates the photo-taking function of the user's terminal 20. The server device 10 uses the acquisition unit 110 to acquire the image of the receipt taken by the user's terminal 20.

[0051] Button 1982 is a button for causing the user's terminal 20 to upload an image of a receipt to the server device 10. When the user presses button 1982, the server device 10 activates a function on the user's terminal 20 that allows the user to select an image or file. The server device 10 uses the acquisition unit 110 to acquire the image of the receipt selected and uploaded by the user's terminal 20. Returning to FIG. 4, the process proceeds to step SP12.

[0052] (Step SP12) The server device 10 uses the extraction unit 120 to extract purchase information 192 from the receipt image acquired by the acquisition unit 110. To extract purchase information 192 from the receipt image, the extraction unit 120 performs image analysis on the receipt image. The image analysis process includes, for example, character detection processing to detect characters from the image, character recognition processing to identify the detected characters, and information extraction processing to extract information necessary for the purchase information 192 from the group of recognized characters. The process then proceeds to step SP14.

[0053] (Step SP14) The server device 10 uses the registration unit 130 to register the content of the purchase information 192 extracted by the extraction unit 120, and adds the information to the purchase information 192 stored in the storage unit 190. Here, with reference to FIG. 5B , a screen for registering the content of the receipt image in the display content 198 will be described. As shown in FIG. 5B , the display content 198 includes the content of the purchase information 192 extracted by the extraction unit 120 and buttons 1983 and 1984 as content that prompts the user to register the content of the receipt image. The display content 198 includes, as the content of the extracted purchase information 192, information such as the date and time of purchase, the store where the purchase was made, and the name and price of the purchased product.

[0054] Button 1983 is a button for canceling the registration of the contents of the receipt image in server device 10 and returning to the previous content. When the user presses button 1983, server device 10 cancels the registration of purchase information 192 extracted by extraction unit 120 and controls the display of the content that was previously being controlled to be displayed on user terminal 20.

[0055] Button 1984 is a button for registering the contents of the receipt image in server device 10. When the user presses button 1983, server device 10 registers purchase information 192 extracted by extraction unit 120. Then, the process proceeds to step SP16.

[0056] (Step SP16) The server device 10 causes the search unit 140 to search for recipe information 194. Specifically, the server device 10 causes the search unit 140 to search for recipe information 194 related to dishes that use as ingredients the products indicated by the purchase information 192 extracted by the extraction unit 120.

[0057] Note that when searching for recipe information 194, the server device 10 may search for recipe information 194 based on past purchase information 192 stored in the storage unit 190, in addition to the purchase information 192 extracted by the extraction unit 120. Specifically, the server device 10 refers to the past purchase information 192 using the search unit 140, and searches for recipe information 194 of a recipe that includes, for example, any of the products included in the purchase information 192 within the past few days and the product included in the purchase information 192 extracted by the extraction unit 120.

[0058] Furthermore, when searching for recipe information 194, the server device 10 may search for recipe information 194 based on the user's browsing history of recipe information 194 registered by other users, in addition to the purchase information 192 extracted by the extraction unit 120. Specifically, the server device 10 uses the search unit 140 to refer to the browsing history of recipe information 194 registered by other users in the user information 191. The server device 10 uses the search unit 140 to search for recipe information 194 of recipes that the user has viewed within a predetermined period of time in the browsing history and that include the product extracted by the extraction unit 120. Note that the server device 10 may also use the search unit 140 to search for recipe information 194 of recipes that are not included in the browsing history and that include the product extracted by the extraction unit 120. The server device 10 may also search for recipe information 194 related to recipes of dishes that include ingredients included in advertisements provided to the user by the advertising unit 160. Then, the process proceeds to step SP18.

[0059] (Step SP18) The server device 10 causes the search unit 140 to search for menu information 195 relating to a menu that includes the dish indicated by the recipe information 194 searched by the search unit 140.

[0060] When searching for menu information 195, server device 10 may search for menu information 195 based on past purchase information 192 stored in storage unit 190 in addition to recipe information 194 searched by search unit 140. Specifically, server device 10 refers to past purchase information 192 using search unit 140, and searches for menu information 195 of a menu that includes a recipe that includes any of the products included in purchase information 192 within the past few days and a recipe indicated by recipe information 194 searched by search unit 140.

[0061] Furthermore, when searching for menu information 195, the server device 10 may search for menu information 195 based on the user's browsing history of menu information 195 registered by other users, in addition to the recipe information 194 searched by the search unit 140. Specifically, the server device 10 uses the search unit 140 to refer to the browsing history of menu information 195 registered by other users in the user information 191. The server device 10 uses the search unit 140 to search for menu information 195 of a menu that includes the recipe searched by the search unit 140 from among menus viewed by the user within a predetermined period of time in the browsing history. Note that the server device 10 may also use the search unit 140 to search for menu information 195 of a menu that is not included in the browsing history and includes the recipe searched by the search unit 140. Then, the process proceeds to step SP20.

[0062] (Step SP20) The server device 10 searches for the purchase information 192 of other users using the search unit 140. Specifically, the server device 10 searches for the purchase information 192 of other users within a predetermined period in the past, for the purchase information 192 that includes the product included in the purchase information 192 extracted by the extraction unit 120 using the search unit 140. Then, the process proceeds to step SP22.

[0063] (Step SP22) The server device 10 causes the suggestion unit 150 to search for stores where the product included in the purchase information 192 extracted by the extraction unit 120 can be purchased, and information about the product. Specifically, the server device 10 causes the search unit 140 to refer to the store information 196 and other users' purchase information 192, and searches for stores where the product included in the extracted purchase information 192 can be purchased within a predetermined period from the present, as well as the price and quantity of the product. The information about the store is, for example, the store name. The information about the product is, for example, the product name, product price, and product quantity. Then, the process proceeds to step SP24.

[0064] (Step SP24) The server device 10 uses the suggestion unit 150 to suggest to the user the recipes in the recipe information 194 searched by the search unit 140. The server device 10 also uses the suggestion unit 150 to suggest to the user the menus in the menu information 195 searched by the search unit 140. The server device 10 also uses the suggestion unit 150 to suggest to the user information about the stores and products searched by the search unit 140.

[0065] Here, with reference to Figs. 5C to 5E, a description will be given of a screen when the server device 10 suggests information about recipes, menus, stores, and products to the user. Fig. 5C is a diagram showing an example of display content 198 when the server device 10 shown in Fig. 1 suggests a recipe and menu. In display content 198 shown in Fig. 5C, information about the recipe suggested to the user and button 1985 are arranged in the upper row, and information about the menu suggested to the user and button 1986 are arranged in the middle row. In addition, in display content 198 shown in Fig. 5C, information about the products included in purchase information 192 and button 1987 are arranged in the lower row. Although not shown in Fig. 5C, display content 198 may have advertisements tailored to the user arranged in predetermined locations.

[0066] Button 1985 is a button for controlling the display of details of recipes proposed to the user by display content 198, and is arranged for each proposed recipe in display content 198. When button 1985 is pressed by the user, server device 10 controls the display on user terminal 20 of content showing information about the recipe corresponding to the pressed button.

[0067] Here, with reference to Fig. 5D, a description will be given of content whose display is controlled when button 1985 in Fig. 5C is pressed by the user. Fig. 5D is a diagram showing an example of display content 198 when server device 10 shown in Fig. 1 controls the display of information related to a recipe. Display content 198 shown in Fig. 5D includes, from recipe information 194, the types and amounts of ingredients needed for the dish, an image 1988 of the dish, and a description of how to prepare the dish. Display content 198 shown in Fig. 5D also includes information about ingredients missing from the recipe, information about stores where the ingredients can be purchased, and button 1987.

[0068] Button 1987 is a button for displaying and controlling information about stores where ingredients missing for making the recipe suggested to the user by display content 198. When the user presses button 1987, server device 10 controls the display on user terminal 20 of content showing information about stores where the ingredients corresponding to the pressed button can be purchased.

[0069] 5C, button 1986 is a button for controlling the display of details of a menu proposed to the user by display content 198, and is arranged for each proposed menu in display content 198. When button 1986 is pressed by the user, server device 10 controls the display on user terminal 20 of content showing information about the menu corresponding to the pressed button.

[0070] Here, with reference to Fig. 5E, the content whose display is controlled when button 1986 in Fig. 5C is pressed by the user will be described. Fig. 5E is a diagram showing an example of display content 198 when server device 10 shown in Fig. 1 controls the display of information related to a menu. Display content 198 shown in Fig. 5E includes, from menu information 195, the menu name, multiple recipes included in the menu, and menu image 1990. Display content 198 shown in Fig. 5E also includes button 1989 for controlling the display of information related to the recipes included in the menu.

[0071] Button 1989 is a button for controlling the display of information related to recipes included in the menu proposed to the user by display content 198. When button 1989 is pressed by the user, server device 10 controls the display of content indicating information about the recipe corresponding to the pressed button on user terminal 20. Specifically, when the user presses the button to the right of "nikujaga" (meat and potatoes) in display content 198 shown in Fig. 5E, server device 10 controls the display of display content 198 indicating the recipe for "nikujaga" (meat and potatoes) shown in Fig. 5D on user terminal 20.

[0072] 5C, button 1987 is a button for controlling the display of details of stores and products that display content 198 suggests to the user, and is arranged for each suggested product in display content 198. When button 1987 is pressed by the user, server device 10 controls the display on user terminal 20 of content that shows information about stores where the product corresponding to the pressed button can be purchased.

[0073] Here, with reference to Fig. 5F, a description will be given of the content whose display is controlled when button 1987 in Fig. 5C is pressed by the user. Fig. 5F is a diagram showing an example of display content 198 when server device 10 shown in Fig. 1 controls the display of information related to ingredient prices. Display content 198 shown in Fig. 5F includes, with respect to ingredients or products needed for cooking, the names of stores where the ingredients or products can be purchased and information related to the prices of the ingredients or products. Returning to Fig. 4, the process proceeds to step SP26.

[0074] (Step SP26) The server device 10 determines, via the search unit 140, whether or not there are any ingredients missing from the recipe indicated by the recipe information 194 searched by the search unit 140 and the recipe included in the menu information 195 searched by the search unit 140. In this determination, the server device 10, for example, compares the ingredients indicated in the purchasing information 192 extracted by the extraction unit 120 with the recipe, and determines whether or not there are any ingredients required for the recipe that are not included in the purchasing information 192. If the determination is affirmative, the process proceeds to step SP28. On the other hand, if the determination is negative, the series of processes shown in FIG. 4 ends.

[0075] (Step SP28) The server device 10 causes the search unit 140 to search for purchasing information 192 related to stores where ingredients missing from the recipe searched for by the search unit 140 and the recipe included in the menu information 195 searched for by the search unit 140 can be purchased. Then, the process proceeds to step SP30.

[0076] (Step SP30) The server device 10 uses the suggestion unit 150 to suggest ingredients that are missing from the recipes searched for by the search unit 140 and from the recipes included in the menu information 195 searched for by the search unit 140. The server device 10 also uses the suggestion unit 150 to suggest information about stores where the ingredients can be purchased. Then, the series of processes shown in FIG. 4 ends.

[0077] <Effects> As described above, in this embodiment, the program causes the server device 10 (computer) to function as an acquisition unit 110 that acquires an image of a receipt from a user and an extraction unit 120 that extracts purchase information 192 related to the purchase indicated by the receipt from the image acquired by the acquisition unit 110. The program also causes the server device 10 to function as a search unit 140 that searches for recipe information 194 related to cooking recipes that use as ingredients the products indicated in the purchase information 192 extracted by the extraction unit 120, and a suggestion unit 150 that suggests to the user the recipe information 194 searched for by the search unit 140. Therefore, the server device 10 can suggest cooking recipes to the user based on the products purchased by the user.

[0078] Furthermore, in this embodiment, the program causes the server device 10 to further function as a storage unit 190 that stores purchase information 192. Furthermore, the search unit 140 searches for recipe information 194 based on the past purchase information 192 stored in the storage unit 190 and the purchase information 192 extracted by the extraction unit 120. Therefore, the server device 10 can suggest cooking recipes to the user based on products that the user has purchased in the past in addition to the product that the user has purchased this time.

[0079] In this embodiment, the search unit 140 searches for menu information 195 related to a menu including the dish indicated by the searched recipe information 194, and the suggestion unit 150 suggests to the user the menu information 195 searched by the search unit 140. Therefore, the server device 10 can suggest a menu to the user according to the product that the user has purchased this time.

[0080] Furthermore, in this embodiment, the program causes the server device 10 to further function as a registration unit 130 that registers recipe information 194 and a storage unit 190 that stores user information 191 including a browsing history of recipe information 194 registered by other users. Furthermore, the search unit 140 searches for recipe information 194 based on the recipe information 194 registered by the registration unit 130 and the browsing history included in the user information 191. Therefore, the server device 10 can suggest cooking recipes to the user based on recipes registered by other users that the user has previously viewed, in addition to the products that the user has currently purchased.

[0081] Furthermore, in this embodiment, the search unit 140 searches for recipe information 194 that differs from the recipe information 194 registered by the registration unit 130 and the recipe information 194 included in the browsing history included in the user information 191. Therefore, the server device 10 suggests recipes to the user while avoiding recipes registered by other users that the user has already browsed, and can therefore suggest recipes to the user that are likely to be dishes that the user has not made in the past.

[0082] Furthermore, in this embodiment, the search unit 140 compares ingredients of the dish indicated by the searched recipe information 194 with products included in the purchasing information 192, and searches for ingredients of the dish that are not included in the purchasing information 192. Furthermore, the suggestion unit 150 suggests to the user the ingredients searched by the search unit 140. Therefore, the server device 10 can suggest to the user the purchase of ingredients that are missing from the recipe of the dish to be suggested to the user.

[0083] In the present embodiment, the program also causes the server device 10 to function as a storage unit 190 that stores purchase information 192. The search unit 140 searches for purchase information 192 related to a store where the searched material can be purchased from the purchase information 192 stored in the storage unit 190, and the suggestion unit 150 suggests to the user information related to the store indicated in the purchase information 192 searched by the search unit 140. Therefore, the server device 10 can motivate the user to visit the suggested store the next time the user purchases a material.

[0084] In this embodiment, the program also causes the server device 10 to function as a storage unit 190 that stores purchase information 192. The search unit 140 searches for purchase information 192 of other users different from the user stored in the storage unit 190, for purchase information 192 that includes products purchased by the user and where the stores where the products were purchased satisfy predetermined conditions. The suggestion unit 150 suggests to the user information about the stores and products indicated in the purchase information 192 searched by the search unit 140. Therefore, the server device 10 uses the purchase information 192 of other users to suggest to the user stores and products that are more suitable for the user, thereby further motivating the user to visit the suggested stores the next time the user purchases ingredients.

[0085] In this embodiment, the program also causes the server device 10 to function as an advertising unit 160 that provides advertisements related to stores to the user. The search unit 140 also searches for recipe information 194 related to recipes of dishes that include ingredients included in the advertisement. Therefore, the server device 10 can further motivate the user to visit the suggested store the next time the user purchases ingredients.

[0086] <Modification> The present invention is not limited to the above-described embodiments. In other words, variations of the above-described embodiments, which are appropriately modified by a person skilled in the art, are also included within the scope of the present invention as long as they include the features of the present invention. Furthermore, the elements of the above-described embodiments and the modifications described below can be combined to the extent technically possible, and such combinations are also included within the scope of the present invention as long as they include the features of the present invention.

[0087] For example, in the present embodiment, the server device 10 searches for recipe information 194 based on the browsing history of recipe information 194 registered by other users, but this is not limited to this. The server device 10 may also search for recipe information 194 using the search unit 140 based on the recipe information 194 registered by the user using the registration unit 130 and the purchase information 192 extracted by the extraction unit 120. Specifically, the server device 10 may search for recipes that are included in the recipe information 194 registered by the user and include products or ingredients indicated in the purchase information 192 extracted by the extraction unit 120. Alternatively, the server device 10 may search for recipes other than the recipe information 194 registered by the user, including products or ingredients indicated in the purchase information 192 extracted by the extraction unit 120. With this configuration, the server device 10 can suggest cooking recipes to the user by taking into account not only the products purchased by the user this time but also the recipe information 194 registered by the user.

[0088] Furthermore, the server device 10 may receive, via the registration unit 130, an input indicating that a user has adopted a dish indicated in the recipe information 194, and may register the adoption of the recipe in the recipe information 194 in accordance with the input. When the registration unit 130 registers the adoption of a recipe in the recipe information 194, the server device 10 records and updates the number of times the recipe has been adopted in the recipe information 194. With this configuration, the server device 10 can record the number of times the recipe has been adopted by the user while suggesting recipes to the user in accordance with the products purchased by the user.

[0089] Furthermore, the server device 10 may receive, via the registration unit 130, an input indicating that the user has adopted a menu indicated in the menu information 195, and may register the adoption of the menu in accordance with the input in the menu information 195. When the registration unit 130 registers the adoption of a recipe in the menu information 195, the server device 10 records and updates the number of times the menu has been adopted in the menu information 195. With this configuration, the server device 10 can record the number of times the menu has been adopted by the user while suggesting menus to the user according to the products purchased by the user.

[0090] Furthermore, the server device 10 may use the search unit 140 to search for recipes or menus that contain ingredients indicated in the purchase information 192 extracted by the extraction unit 120 and that have been used a predetermined number of times or more among the recipes indicated in the recipe information 194 or the menus indicated in the menu information 195. With this configuration, the server device 10 can suggest to the user popular recipes or menus that have been used a large number of times, depending on the products purchased by the user. [Explanation of symbols]

[0091] 10... server device (information processing device), 110... acquisition unit, 120... extraction unit, 140... search unit, 150... proposal unit

Claims

1. Computer, an acquisition unit that acquires an image of a receipt from a user; an extraction unit that extracts purchase information related to the purchase indicated by the receipt from the image acquired by the acquisition unit; a search unit that searches for recipe information related to recipes for dishes that use as ingredients the products indicated by the purchase information extracted by the extraction unit; a suggestion unit that suggests recipe information searched by the search unit to the user; A program that functions as a

2. causing the computer to further function as a storage unit that stores the purchase information; the search unit searches for the recipe information based on past purchase information stored in the storage unit and the purchase information extracted by the extraction unit. The program according to claim 1.

3. The search unit searches for menu information related to a menu including the dish indicated by the searched recipe information, The suggestion unit suggests the menu information searched by the search unit to the user. The program according to claim 1.

4. The computer The recipe information may further function as a registration unit that registers the recipe information and a storage unit that stores user information including a browsing history of recipe information registered by other users, the search unit searches for the recipe information based on the recipe information registered by the registration unit and a browsing history included in the user information. The program according to claim 1.

5. the search unit searches for recipe information that is different from the recipe information registered by the registration unit and the recipe information included in the browsing history included in the user information. The program according to claim 4.

6. the search unit compares ingredients of the dish indicated by the searched recipe information with products included in the purchase information, and searches for ingredients of the dish that are not included in the purchase information; The suggestion unit suggests the material searched by the search unit to the user. The program according to claim 1.

7. causing the computer to further function as a storage unit that stores the purchase information; the search unit searches for purchase information related to a store where the searched material can be purchased from the purchase information stored in the storage unit; the suggestion unit suggests to the user information about the store indicated by the purchase information searched by the search unit. The program according to claim 6.

8. causing the computer to further function as a storage unit that stores the purchase information; the search unit searches for purchase information of other users different from the user stored in the storage unit, the purchase information including a product purchased by the user and a store where the product was purchased satisfies a predetermined condition; the suggestion unit suggests to the user information about the store and the product indicated by the purchase information searched by the search unit; The program according to claim 1.

9. causing the computer to further function as an advertising unit that provides advertisements related to stores to the user; the search unit searches for recipe information related to a recipe for a dish that includes an ingredient included in the advertisement among the recipes. The program according to claim 1.

10. an acquisition unit that acquires an image of a receipt from a user; an extraction unit that extracts purchase information related to the purchase indicated by the receipt from the image acquired by the acquisition unit; a search unit that searches for recipe information related to recipes for dishes that use the products indicated by the purchase information extracted by the extraction unit as ingredients; a suggestion unit that suggests recipe information searched by the search unit to the user; An information processing device comprising:

Images