Information processing device and program

Abstract

To provide a program capable of suggesting cooking recipes to a user according to a product purchased by the user. [Solution] The program causes the computer to function as an acquisition unit that acquires an image of a receipt from a user, an extraction unit that extracts purchase information regarding the purchase indicated by the receipt from the image acquired by the acquisition unit, a search unit that searches for recipe information regarding cooking recipes that use as ingredients the product indicated by the purchase information extracted by the extraction unit, and a proposal unit that proposes the recipe information searched for by the search unit to the user.

Description

[Technical field]

[0001] The present invention relates to an information processing device and a program. [Background technology]

[0002] 2. Description of the Related Art Recipe sites that publish cooking recipes have been known for some time.

[0003] In this regard, Patent Document 1 discloses a configuration in which a recipe site accepts input of recipe characteristic information when it receives a recipe usage report, and outputs either a recipe linked to the recipe characteristic information or a recipe usage report when it receives a recipe search request. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2022-132026 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology described in Patent Document 1 allows users to input and search for cooking recipes on a recipe site, but does not take into consideration any products that the users have purchased at stores, etc. Therefore, the technology described in Patent Document 1 has a problem in that it may suggest to the user recipes that are weakly related to the products that the user has purchased.

[0006] The present invention has been made in consideration of such problems, and has as its object to provide an information processing device and a program that can suggest cooking recipes to a user according to products purchased by the user. [Means for solving the problem]

[0007] In order to solve the above problems, the program of the present invention causes a computer to function as an acquisition unit that acquires an image of a receipt from a user, an extraction unit that extracts purchase information regarding the purchase indicated by the receipt from the image acquired by the acquisition unit, a search unit that searches for recipe information regarding cooking recipes that use as ingredients the product indicated by the purchase information extracted by the extraction unit, and a proposal unit that proposes the recipe information searched for by the search unit to the user.

[0008] In addition, the program of the present invention further causes the computer to function as a memory unit that stores the purchasing information, and the search unit searches for the recipe information based on the past purchasing information stored in the memory unit and the purchasing information extracted by the extraction unit.

[0009] In addition, the search unit searches for menu information related to a menu including the dish indicated by the searched recipe information, and the suggestion unit suggests the menu information searched by the search unit to the user.

[0010] In addition, the program of the present invention further causes the computer to function as a registration unit that registers the recipe information, and a memory unit that stores user information including a browsing history of recipe information registered by other users, and the search unit searches for the recipe information based on the recipe information registered by the registration unit and the browsing history included in the user information.

[0011] In addition, the search unit searches for recipe information that differs from the recipe information registered by the registration unit and the recipe information included in the browsing history included in the user information.

[0012] In addition, the search unit compares the ingredients of the dish indicated by the searched recipe information with the products included in the purchasing information, and searches for ingredients of the dish that are not included in the purchasing information, and the suggestion unit suggests the ingredients searched for by the search unit to the user.

[0013] In addition, the program of the present invention further causes the computer to function as a memory unit that stores the purchasing information, the search unit searches for purchasing information from the purchasing information stored in the memory unit regarding stores where the searched material can be purchased, and the suggestion unit suggests to the user information regarding the store indicated by the purchasing information searched for by the search unit.

[0014] In addition, the program of the present invention further causes the computer to function as a memory unit that stores the purchasing information, and the search unit searches for purchasing information of other users different from the user stored in the memory unit that includes a product purchased by the user and where the store where the product was purchased satisfies a specified condition, and the suggestion unit suggests to the user information regarding the store and product indicated in the purchasing information searched for by the search unit.

[0015] In addition, the program of the present invention further causes the computer to function as an advertising unit that provides advertisements related to stores to the user, and the search unit searches for recipe information related to cooking recipes that include ingredients included in the advertisement among the recipes.

[0016] In addition, the information processing device of the present invention includes an acquisition unit that acquires an image of a receipt from a user, an extraction unit that extracts purchase information regarding the purchase indicated by the receipt from the image acquired by the acquisition unit, a search unit that searches for recipe information regarding cooking recipes that use as ingredients the product indicated by the purchase information extracted by the extraction unit, and a suggestion unit that suggests the recipe information searched for by the search unit to the user. Effect of the Invention

[0017] According to the present invention, an information processing device and a program can suggest cooking recipes to a user according to products purchased by the user. [Brief description of the drawings]

[0018] [Figure 1] 1 is a diagram showing an overall configuration of a proposed system according to an embodiment of the present invention; [Diagram 2]2 is a diagram illustrating an example of a hardware configuration of a server device illustrated in FIG. 1. [Diagram 3] 2 is a diagram illustrating an example of a functional configuration of a server device illustrated in FIG. [Figure 4] 2 is a flowchart showing an example of a process flow in the server device shown in FIG. [Figure 5A] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 prompts the user to upload an image of a receipt. [Figure 5B] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 registers the contents of an image of a receipt. [Figure 5C] 4 is a diagram showing an example of display content when the server device shown in FIG. 1 suggests recipes and menus. FIG. [Figure 5D] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 controls the display of information related to recipes. [Figure 5E] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 controls the display of information about menus. [Figure 5F] 1. FIG. 4 is a diagram showing an example of display content when the server device shown in FIG. 1 controls the display of information regarding material prices. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, an embodiment of the present invention (hereinafter, referred to as "the present embodiment") will be described with reference to the accompanying drawings. In order to facilitate understanding of the description, the same components and steps in each drawing are denoted by the same reference numerals as much as possible, and duplicated descriptions will be omitted.

[0020] <Overall composition> Fig. 1 is a diagram showing the overall configuration of a management system 1 according to this embodiment. As shown in Fig. 1, the management system 1 includes, as its main components, a server device 10 and terminals 20 of a plurality of users, for example.

[0021] The server device 10 is an information processing device such as a desktop computer or a notebook computer, which receives instructions from the user's terminal 20 and controls the display of display content on the user's terminal 20 in accordance with the instructions. Specifically, the server device 10 acquires an image of a receipt from the user's terminal 20 via the communications network NT. The server device 10 also extracts purchase information related to the purchased item, the price of the item, the store where the item was purchased, the time of purchase, and the like from the acquired image of the receipt. The server device 10 also searches for recipes and menus according to the extracted purchase information, and suggests the searched recipes and menus to the user's terminal 20 via the communications network NT.

[0022] The user's terminal 20 is, for example, a mobile phone, a smartphone, a tablet, a personal computer, etc., and is a device operated by a user. The user's terminal 20 transmits an instruction to the server device 10 via the communication network NT to use the display content stored in the server device 10. In addition, the display content of the user's terminal 20 is display-controlled by the server device 10 via the communication network NT.

[0023] <Hardware configuration> Fig. 2 is a diagram showing an example of a hardware configuration of the server device 10 shown in Fig. 1. As shown in Fig. 2, the server device 10 is mainly configured to include, for example, a storage device 11, a CPU (Central Processing Unit) 12, a memory 13, and a communication device 14.

[0024] The storage device 11 is configured with a hard disk etc. This storage device 11 stores various programs and various information required for the execution of processes in the CPU 12, and information on the results of the processes.

[0025] The CPU 12 functions as various functional components by executing predetermined programs stored in the memory 13 or the storage device 11, etc. The details of these functional components will be described later.

[0026] The communication device 14 is configured with a communication interface for communicating with an external device, etc. The communication device 14 transmits and receives various information to and from a user's terminal 20 via, for example, the communication network NT.

[0027] The server device 10 can be realized by using an information processing device such as a dedicated or general-purpose server computer. The server device 10 may be configured by a single information processing device, or may be configured by a plurality of information processing devices distributed over a communication network NT. Fig. 2 shows only a part of the main hardware configuration of the server device 10, and the server device 10 may be configured by other components that are generally included in a server.

[0028] <Functional configuration> Fig. 3 is a block diagram showing an example of a functional configuration of the server device 10 shown in Fig. 1. As shown in Fig. 3, the server device 10 includes, as its functional configuration, for example, an acquisition unit 110, an extraction unit 120, a registration unit 130, a search unit 140, a proposal unit 150, an advertisement unit 160, and a storage unit 190. The functional means other than the storage unit 190 are realized by the CPU 12 executing a program stored in the storage device 11 or the like. Note that all or a part of the above functional means may be included in the user's terminal 20, not in the server device 10.

[0029] The storage unit 190 is a functional configuration for storing display content 198 and various information. Specifically, the storage unit 190 stores user information 191, purchase information 192, product information 193, recipe information 194, menu information 195, store information 196, advertisement information 197, and display content 198.

[0030] The user information 191 is information about a user who uses the display content 198. The user information 191 includes, for example, information such as the user's name, address, telephone number, email address, date of birth, login ID, and password for login. The user information 191 also includes, for example, a browsing history such as recipe information 194 related to recipes previously viewed by the user and menu information 195 related to menus previously viewed by the user. The user information 191 also includes, for example, a posting history such as recipe information 194 previously registered or posted by the user in the display content 198 and menu information 195 previously registered or posted by the user. The user information 191 also includes, for example, a browsing history of advertisement information 197 related to advertisements previously viewed by the user.

[0031] The purchase information 192 is information related to purchases indicated by receipts registered by the user. For example, the purchase information 192 includes, for each receipt registered by the user, the product name and price of the product purchased by the user, the name of the store where the user purchased the product, and the date and time when the user purchased the product.

[0032] The product information 193 is information about products that are ingredients of a recipe. The product information 193 includes, for example, a product name and a category to which the product belongs. The product name is the name of a product written on a receipt, such as "▽▽ Dairy Low Fat Milk", "▽▽ Dairy Fragrant Cheese", "★★ Confectionery Premium Cocoa", "1 pack of carrots", "5 onions", "1 stalk of broccoli", and "496g of pork belly". Among the product names, "▽▽ Dairy" and "★★ Confectionery" are examples of the name of a company that manufactures the product. The category is information for classifying products, and is provided for classifying product names written in different ways on receipts depending on the product manufacturing company or production company or store. The categories are, for example, "cocoa", "milk", "cheese", "carrot", "onion", "broccoli", and "pork belly". Specifically, for example, the product name "★★ Confectionery Premium Cocoa" is associated with the category "cocoa," the product name "▽▽ Dairy Kaoru Cheese" is associated with the category "cheese," and "Pork Belly 496g" is associated with "Pork Belly."

[0033] The recipe information 194 is information about recipes for dishes using the product as an ingredient. The recipe information 194 includes, for example, a recipe name indicating the name of the recipe and a category name of ingredients required for the recipe for each recipe. The recipe names are, for example, "Stir-fried vegetables", "Meat and potatoes", "Cream stew A", "Cream stew B", "Agar jelly", "Buche de Noel", etc. As an example of a combination of recipe names and category names, for example, the recipe name "Stir-fried vegetables" is associated with category names "green pepper", "cabbage", "onion", "pork belly", and "oyster sauce". Also, for example, the recipe name "Cream stew B" is associated with category names "milk", "consomme", "potato", "broccoli", "chicken thigh", and "onion". Also, for example, the recipe name "Agar jelly" is associated with category names "agar powder" and "mandarin oranges (canned)".

[0034] The menu information 195 is information about a menu including the dishes indicated by the recipe information 194. The menu information 195 includes, for example, a menu name indicating the name of the menu and a recipe name indicating the dishes included in the menu for each menu. The menu names are, for example, "breakfast (Japanese food A)", "breakfast (Japanese food B)", "breakfast (Western food A)", "snack A", "dinner A", "dinner B", etc. As an example of a combination of a menu name and a recipe name, for example, the menu name "breakfast (Japanese food A)" ​​is associated with the recipe names "rice", "miso soup A", "natto", "grilled salmon", and "egg roll C". Also, for example, the menu name "breakfast (Western food)" is associated with the recipe names "bread", "ham and egg D", "coffee", and "yogurt". Also, for example, the menu name "dinner A" is associated with the recipe names "rice", "meat and potatoes", "grilled Atka mackerel", and "boiled spinach".

[0035] Store information 196 is information related to the store indicated by purchase information 192. Store information 196 includes, for example, a store name indicating the name of the store, the store address, and the store telephone number. Store information 196 also includes, for each product, the product names of products available at the store and the prices of the products available at the store. Store information 196 also includes information related to events that are being held or are scheduled to be held at the store. Information related to the event includes, for example, the name of the event, details of the event such as the discount rate or amount of the product, limited products sold only at the event, and the period during which the event will be held.

[0036] The advertisement information 197 is information about advertisements announced or provided by the store. The advertisement information 197 includes, for example, the store to which the contents described in the advertisement apply, the period to which the contents described in the advertisement apply, the product name, and the price of the product. Note that the advertisement information 197 may also include, for example, information about the above-mentioned event.

[0037] The display content 198 is content provided by the server device 10 to the user's terminal 20 via the communication network NT, and is, for example, an application or web page for a mobile terminal such as a smartphone. The display content 198 includes content that accepts registration of receipt images, registration of recipes, and registration of menus according to user operations. The display content 198 also includes content indicating recipes and menus registered by the user, and the user's purchase history indicated by the past purchase information 192. The display content 198 also includes content indicating recipes and menus registered by other users, and information regarding product prices for each store. The display content 198 also includes content indicating events being held or scheduled to be held by the store, and advertisements being provided or announced by the store.

[0038] The acquisition unit 110 acquires an image of a receipt from the user's terminal 20 via the communication network NT. The acquisition unit 110 also acquires an image of a dish and an image of a menu from the user's terminal 20 via the communication network NT.

[0039] The extraction unit 120 extracts, from the image of the receipt acquired by the acquisition unit 110, purchase information 192 relating to the purchase indicated by the receipt.

[0040] The registration unit 130 registers the purchase information 192 extracted by the extraction unit 120 as information related to a new purchase, and adds the information to the purchase information 192 stored in the storage unit 190 to update it.

[0041] Furthermore, the registration unit 130 registers recipe information 194. Specifically, the registration unit 130 accepts input of the recipe name, ingredients and amounts of ingredients included in the recipe, and cooking steps for the dish indicated by the recipe from the user terminal 20 via the communications network NT, registers the accepted contents as recipe information 194, and stores it in the storage unit 190. If recipe information 194 is already stored in the storage unit 190, the registration unit 130 adds the contents of the registered recipe information 194 to the recipe information 194 stored in the storage unit 190.

[0042] The registration unit 130 also registers menu information 195. Specifically, the registration unit 130 accepts input of the menu name, the recipes included in the menu, and supplementary information related to the menu from the user's terminal 20 via the communication network NT, registers the accepted content as menu information 195, and stores it in the storage unit 190. If the menu information 195 is already stored in the storage unit 190, the registration unit 130 adds the content of the registered menu information 195 to the menu information 195 stored in the storage unit 190.

[0043] The search unit 140 searches for recipe information 194 of a dish that uses as an ingredient the product indicated in the purchase information 192 extracted by the extraction unit 120. The search unit 140 also searches for menu information 195 related to a menu including the dish indicated in the recipe information 194. The search unit 140 also compares the ingredients of the dish indicated in the searched recipe information 194 with the products included in the purchase information 192. After the comparison, the search unit 140 further searches for ingredients of the dish indicated in the recipe information 194 that are not included in the purchase information 192. After searching for the ingredients, the search unit 140 further searches for purchase information 192 related to a store where the searched ingredients can be purchased from the purchase information 192 stored in the storage unit 190.

[0044] Furthermore, the search unit 140 searches for purchase information 192 of other users different from the user stored in the storage unit 190, which contains a product purchased by the user and the store where the product was purchased satisfies a predetermined condition. The predetermined condition is, for example, that the store is within a predetermined distance from the user's address, commute location, nearest station, etc., included in the user information 191. The predetermined condition is, for example, that the store is a store that has been determined in advance by the user. The predetermined condition is, for example, that the store is a store from which the user has purchased a product in the past.

[0045] The suggestion unit 150 suggests to the user recipe information 194 searched by the search unit 140. The suggestion unit 150 also suggests to the user menu information 195 searched by the search unit 140. The suggestion unit 150 also suggests to the user ingredients searched by the search unit 140. The suggestion unit 150 also suggests to the user information related to the store indicated by the purchase information 192 searched by the search unit 140. The information related to the store is, for example, the name or location of the store, information on events announced or held at the store, advertisements announced by the store, etc.

[0046] In addition, the suggestion unit 150 suggests to the user information about the store and the product indicated in the purchase information 192 where the store satisfies a predetermined condition searched for by the search unit 140. The information about the product is, for example, the product name, the product price, an advertisement about the product, and the like.

[0047] The advertisement unit 160 refers to the advertisement information 197 stored in the storage unit 190 and provides advertisements related to the store to the user.

[0048] <Flow of operations> Above, we have explained the functional configuration of the server device 10. Next, we will explain in detail the flow of a series of processes in the server device 10. Figure 4 is a flowchart showing an example of the flow of processes in the server device 10 shown in Figure 1.

[0049] (Step SP10) The server device 10 uses the acquisition unit 110 to acquire an image of a receipt from the user's terminal 20 via the communications network NT. Here, with reference to FIG. 5A, a screen for uploading a receipt image in the display content 198 will be described. FIG. 5A is a diagram showing an example of the display content 198 when the server device 10 shown in FIG. 1 prompts the user to upload a receipt image. As shown in FIG. 5A, the display content 198 includes buttons 1981 and 1982 as content that prompts the user to upload a receipt image.

[0050] Button 1981 is a button for taking a photo of the receipt using the user's terminal 20. When the user presses button 1981, the server device 10 activates a photo taking function in the user's terminal 20. The server device 10 uses the acquisition unit 110 to acquire the image of the receipt captured by the user's terminal 20.

[0051] Button 1982 is a button for causing the user's terminal 20 to upload an image of a receipt to the server device 10. When the user presses button 1982, the server device 10 activates a function on the user's terminal 20 that allows the user to select an image or file. The server device 10 uses the acquisition unit 110 to acquire the image of the receipt selected and uploaded by the user's terminal 20. Returning to FIG. 4, the process proceeds to step SP12.

[0052] (Step SP12) The server device 10 uses the extraction unit 120 to extract purchase information 192 from the image of the receipt acquired by the acquisition unit 110. When extracting purchase information 192 from the receipt image, the extraction unit 120 performs image analysis processing on the receipt image. The image analysis processing includes, for example, character detection processing to detect characters from the image, character recognition processing to recognize which characters the detected characters are, and information extraction processing to extract information required for the purchase information 192 from the group of recognized characters. Then, the processing proceeds to step SP14.

[0053] (Step SP14) The server device 10 registers the content of the purchase information 192 extracted by the extraction unit 120 using the registration unit 130, and adds the information to the purchase information 192 stored in the storage unit 190. Here, with reference to FIG. 5B, a screen for registering the content of the receipt image in the display content 198 will be described. As shown in FIG. 5B, the display content 198 includes the content of the purchase information 192 extracted by the extraction unit 120 and buttons 1983 and 1984 as content that prompts the user to register the content of the receipt image. The display content 198 includes, as the content of the extracted purchase information 192, information regarding, for example, the purchase date and time, the store where the purchase was made, and the name and price of the purchased product.

[0054] Button 1983 is a button for canceling registration of the contents of the receipt image in server device 10 and returning to the previous content. When the user presses button 1983, server device 10 cancels registration of purchase information 192 extracted by extraction unit 120, and controls display of the content that was previously being displayed on user terminal 20.

[0055] Button 1984 is a button for registering the contents of the image of the receipt in server device 10. When the user presses button 1983, server device 10 registers purchase information 192 extracted by extraction unit 120. Then, the process proceeds to step SP16.

[0056] (Step SP16) The server device 10 causes the search unit 140 to search for recipe information 194. Specifically, the server device 10 causes the search unit 140 to search for recipe information 194 related to a dish using the product indicated by the purchase information 192 extracted by the extraction unit 120 as an ingredient.

[0057] Note that, when searching for recipe information 194, the server device 10 may search for recipe information 194 based on past purchase information 192 stored in the storage unit 190 in addition to the purchase information 192 extracted by the extraction unit 120. Specifically, the server device 10 refers to the past purchase information 192 by the search unit 140, and searches for recipe information 194 of a recipe that includes, for example, any of the products included in the purchase information 192 within the past few days and the product included in the purchase information 192 extracted by the extraction unit 120.

[0058] Furthermore, when searching for the recipe information 194, the server device 10 may search for the recipe information 194 based on the user's browsing history for the recipe information 194 registered by other users, in addition to the purchase information 192 extracted by the extraction unit 120. Specifically, the server device 10 refers to the browsing history for the recipe information 194 registered by other users in the user information 191 by the search unit 140. The server device 10 searches for the recipe information 194 of the recipe that includes the product extracted by the extraction unit 120 among the recipes viewed by the user within a predetermined period in the browsing history by the search unit 140. Note that the server device 10 may search for the recipe information 194 of the recipe that is not included in the browsing history and includes the product extracted by the extraction unit 120 by the search unit 140. The server device 10 may search for the recipe information 194 related to the recipe of the dish that includes the ingredient included in the advertisement provided to the user by the advertisement unit 160 among the recipes. Then, the process proceeds to the process of step SP18.

[0059] (Step SP18) The server device 10 causes the search unit 140 to search for menu information 195 related to a menu including the dish indicated by the recipe information 194 searched for by the search unit 140.

[0060] In addition, when searching for the menu information 195, the server device 10 may search for the menu information 195 based on the past purchase information 192 stored in the storage unit 190 in addition to the recipe information 194 searched by the search unit 140. Specifically, the server device 10 refers to the past purchase information 192 by the search unit 140, and searches for menu information 195 of a menu that includes a recipe that includes any of the products included in the purchase information 192 within the past few days and a recipe indicated by the recipe information 194 searched by the search unit 140.

[0061] In addition, when searching for the menu information 195, the server device 10 may search for the menu information 195 based on the user's browsing history for the menu information 195 registered by other users in addition to the recipe information 194 searched by the search unit 140. Specifically, the server device 10 refers to the browsing history for the menu information 195 registered by other users in the user information 191 by the search unit 140. The server device 10 searches for the menu information 195 of the menu including the recipe searched by the search unit 140 among the menus viewed by the user within a past predetermined period in the browsing history by the search unit 140. Note that the server device 10 may search for the menu information 195 of the menu that is not included in the browsing history and includes the recipe searched by the search unit 140. Then, the process proceeds to the process of step SP20.

[0062] (Step SP20) The server device 10 searches for the purchase information 192 of other users by the search unit 140. Specifically, the server device 10 searches for the purchase information 192 of other users within a predetermined period in the past, by the search unit 140, for the purchase information 192 that includes the product included in the purchase information 192 extracted by the extraction unit 120. Then, the process proceeds to the process of step SP22.

[0063] (Step SP22) The server device 10 causes the suggestion unit 150 to search for stores where the product included in the purchase information 192 extracted by the extraction unit 120 can be purchased and information about the product. Specifically, the server device 10 causes the search unit 140 to refer to the store information 196 and other users' purchase information 192, and searches for stores where the product included in the extracted purchase information 192 can be purchased within a predetermined period from the present, as well as the price and quantity of the product. The information about the store is, for example, the store name. The information about the product is, for example, the product name, the price of the product, and the quantity of the product. Then, the process proceeds to the process of step SP24.

[0064] (Step SP24) The server device 10 uses the suggestion unit 150 to suggest to the user the recipe of the recipe information 194 searched by the search unit 140. In addition, the server device 10 uses the suggestion unit 150 to suggest to the user a menu of the menu information 195 searched by the search unit 140. In addition, the server device 10 uses the suggestion unit 150 to suggest to the user information related to the store and product searched by the search unit 140.

[0065] Here, with reference to Figs. 5C to 5E, a screen when the server device 10 proposes information on recipes, menus, stores, and products to the user will be described. Fig. 5C is a diagram showing an example of display content 198 when the server device 10 shown in Fig. 1 proposes recipes and menus. In the display content 198 shown in Fig. 5C, information on the recipes proposed to the user and button 1985 are arranged in the upper row, and information on the menus proposed to the user and button 1986 are arranged in the middle row. In addition, in the display content 198 shown in Fig. 5C, information on the products included in the purchase information 192 and button 1987 are arranged in the lower row. Although not shown in Fig. 5C, the display content 198 may have advertisements according to the user arranged in a predetermined position.

[0066] Button 1985 is a button for controlling the display of details of a recipe proposed to the user by display content 198, and is arranged for each proposed recipe in display content 198. When button 1985 is pressed by the user, server device 10 controls the display of content showing information on the recipe corresponding to the pressed button on user terminal 20.

[0067] Here, with reference to Fig. 5D, a description will be given of the contents whose display is controlled when the user presses button 1985 in Fig. 5C. Fig. 5D is a diagram showing an example of display contents 198 when the server device 10 shown in Fig. 1 controls the display of information related to a recipe. Display contents 198 shown in Fig. 5D include, from recipe information 194, the types and amounts of ingredients needed for a dish, an image 1988 of the dish, and a description of how to prepare the dish. Display contents 198 shown in Fig. 5D also includes information about ingredients that are missing from the recipe, information about a store where the ingredients can be purchased, and button 1987.

[0068] Button 1987 is a button for controlling the display of information about a store where ingredients missing for making the recipe proposed to the user by display content 198. When button 1987 is pressed by the user, server device 10 controls the display of content indicating information about a store where the ingredient corresponding to the pressed button can be purchased on user terminal 20.

[0069] Returning to Fig. 5C, button 1986 is a button for controlling the display of details of a menu proposed to the user by display content 198, and is arranged for each proposed menu in display content 198. When button 1986 is pressed by the user, server device 10 controls the display of content showing information about the menu corresponding to the pressed button on user terminal 20.

[0070] Here, with reference to Fig. 5E, a description will be given of the content whose display is controlled when the user presses button 1986 in Fig. 5C. Fig. 5E is a diagram showing an example of display content 198 when server device 10 shown in Fig. 1 controls the display of information related to a menu. Display content 198 shown in Fig. 5E includes, from menu information 195, the menu name, a plurality of recipes included in the menu, and menu image 1990. Display content 198 shown in Fig. 5E also includes button 1989 for controlling the display of information related to recipes included in the menu.

[0071] Button 1989 is a button for controlling the display of information related to recipes included in the menu proposed to the user by display content 198. When button 1989 is pressed by the user, server device 10 controls the display of content showing information on the recipe corresponding to the pressed button on user terminal 20. Specifically, when the user presses the button to the right of "nikujaga" in display content 198 shown in Fig. 5E, server device 10 controls the display of display content 198 showing the recipe for "nikujaga" shown in Fig. 5D on user terminal 20.

[0072] Returning to Fig. 5C, button 1987 is a button for controlling the display of details of the store and product proposed to the user by display content 198, and is arranged for each proposed product in display content 198. When button 1987 is pressed by the user, server device 10 controls the display of content indicating information about a store where the product corresponding to the pressed button can be purchased on user terminal 20.

[0073] Here, with reference to Fig. 5F, a description will be given of the contents whose display is controlled when the user presses button 1987 in Fig. 5C. Fig. 5F is a diagram showing an example of display contents 198 when server device 10 shown in Fig. 1 controls the display of information related to the prices of ingredients. Display contents 198 shown in Fig. 5F includes, with regard to ingredients or products necessary for cooking, the name of a store where the ingredients or products can be purchased, and information related to the prices of the ingredients or products. Returning to Fig. 4, the process proceeds to the process of step SP26.

[0074] (Step SP26) The server device 10 determines, by the search unit 140, whether or not there are any ingredients missing in the recipe indicated by the recipe information 194 searched by the search unit 140 and in the recipe included in the menu information 195 searched by the search unit 140. In this determination, the server device 10, for example, compares the ingredients indicated by the purchase information 192 extracted by the extraction unit 120 with the recipe, and determines whether or not there are any ingredients required for the recipe that are not included in the purchase information 192. If the determination is positive, the process proceeds to step SP28. On the other hand, if the determination is negative, the series of processes shown in FIG. 4 ends.

[0075] (Step SP28) The server device 10 searches, by the search unit 140, for purchase information 192 related to a store where ingredients missing from the recipe searched by the search unit 140 and the recipe included in the menu information 195 searched by the search unit 140 can be purchased. Then, the process proceeds to the process of step SP30.

[0076] (Step SP30) The server device 10 uses the suggestion unit 150 to suggest ingredients that are missing from the recipe searched by the search unit 140 and from the recipe included in the menu information 195 searched by the search unit 140. The server device 10 also uses the suggestion unit 150 to suggest information about a store where the ingredients can be purchased. Then, the series of processes shown in FIG. 4 ends.

[0077] <Effects> As described above, in this embodiment, the program causes the server device 10 (computer) to function as an acquisition unit 110 that acquires an image of a receipt from a user and an extraction unit 120 that extracts purchase information 192 related to the purchase indicated by the receipt from the image acquired by the acquisition unit 110. The program also causes the server device 10 to function as a search unit 140 that searches for recipe information 194 related to a cooking recipe that uses as an ingredient the product indicated in the purchase information 192 extracted by the extraction unit 120, and a suggestion unit 150 that suggests to the user the recipe information 194 searched by the search unit 140. Thus, the server device 10 can suggest cooking recipes to the user according to the products purchased by the user.

[0078] Moreover, in this embodiment, the program causes the server device 10 to further function as a storage unit 190 that stores purchase information 192. Furthermore, the search unit 140 searches for recipe information 194 based on the past purchase information 192 stored in the storage unit 190 and the purchase information 192 extracted by the extraction unit 120. Therefore, the server device 10 can suggest cooking recipes to the user based on products that the user has purchased in the past in addition to the product that the user has purchased this time.

[0079] In the present embodiment, the search unit 140 searches for menu information 195 related to a menu including the dish indicated by the searched recipe information 194, and the suggestion unit 150 suggests to the user the menu information 195 searched by the search unit 140. Thus, the server device 10 can suggest a menu to the user according to the product purchased by the user this time.

[0080] Furthermore, in this embodiment, the program causes the server device 10 to further function as a registration unit 130 that registers recipe information 194, and a storage unit 190 that stores user information 191 including a browsing history of recipe information 194 registered by other users. Furthermore, the search unit 140 searches for recipe information 194 based on the recipe information 194 registered by the registration unit 130 and the browsing history included in the user information 191. Therefore, the server device 10 can suggest cooking recipes to the user according to recipes registered by other users that the user has previously viewed, in addition to the product that the user has currently purchased.

[0081] Furthermore, in this embodiment, the search unit 140 searches for recipe information 194 different from the recipe information 194 registered by the registration unit 130 and the recipe information 194 included in the browsing history included in the user information 191. Therefore, the server device 10 suggests recipes for cooking to the user while avoiding recipes registered by other users that the user has already viewed, and can therefore suggest recipes for cooking to the user that are likely not created by the user in the past.

[0082] Furthermore, in this embodiment, the search unit 140 compares ingredients of the dish indicated by the searched recipe information 194 with products included in the purchasing information 192, and searches for ingredients of the dish that are not included in the purchasing information 192. Furthermore, the suggestion unit 150 suggests to the user the ingredients searched by the search unit 140. Thus, the server device 10 can suggest to the user the purchase of ingredients that are missing from the recipe of the dish to be suggested to the user.

[0083] Moreover, in this embodiment, the program further causes the server device 10 to function as a storage unit 190 that stores purchasing information 192. Furthermore, the search unit 140 searches for purchasing information 192 related to a store where the searched material can be purchased from the purchasing information 192 stored in the storage unit 190, and the suggestion unit 150 suggests to the user information related to the store indicated by the purchasing information 192 searched by the search unit 140. Therefore, the server device 10 can motivate the user to visit the suggested store the next time the user purchases a material.

[0084] In the present embodiment, the program further causes the server device 10 to function as a storage unit 190 that stores purchase information 192. The search unit 140 searches for purchase information 192 of other users different from the user stored in the storage unit 190, which contains a product purchased by the user and the store where the product was purchased satisfies a predetermined condition. The suggestion unit 150 suggests to the user information on the store and product indicated in the purchase information 192 searched by the search unit 140. Therefore, the server device 10 uses the purchase information 192 of other users to suggest to the user a store and product more suitable for the user, and can further motivate the user to visit the suggested store the next time the user purchases materials.

[0085] In the present embodiment, the program also causes the server device 10 to function as an advertising unit 160 that provides advertisements related to stores to the user. The search unit 140 also searches for recipe information 194 related to recipes of dishes that contain ingredients included in the advertisement among the recipes. Therefore, the server device 10 can further motivate the user to visit the suggested store when the user purchases ingredients next time or later.

[0086] <Modification> The present invention is not limited to the above-described embodiment. In other words, the above-described embodiment may be modified by a person skilled in the art as appropriate, and the modifications may be included within the scope of the present invention as long as they include the characteristics of the present invention. In addition, the elements of the above-described embodiment and the modifications described below may be combined to the extent technically possible, and the combinations of these may be included within the scope of the present invention as long as they include the characteristics of the present invention.

[0087] For example, in the present embodiment, the server device 10 searches for recipe information 194 based on the browsing history of recipe information 194 registered by other users, but the present invention is not limited to this. The server device 10 may search for recipe information 194 by the search unit 140 based on the recipe information 194 registered by the user by the registration unit 130 and the purchase information 192 extracted by the extraction unit 120. Specifically, the server device 10 may search for a recipe that is a recipe in the recipe information 194 registered by the user and includes a product or ingredient indicated by the purchase information 192 extracted by the extraction unit 120. The server device 10 may also search for a recipe other than the recipe information 194 registered by the user, including a product or ingredient indicated by the purchase information 192 extracted by the extraction unit 120. According to this configuration, the server device 10 can suggest a cooking recipe to the user in consideration of the recipe information 194 registered by the user in addition to the product purchased by the user this time.

[0088] Furthermore, the server device 10 may receive an input by the registration unit 130 indicating that a user has adopted a dish indicated in the recipe information 194, and register the adoption of the recipe in the recipe information 194 in accordance with the input. When the registration unit 130 registers the adoption of a recipe in the recipe information 194, the server device 10 records and updates the number of times the recipe has been adopted in the recipe information 194. With this configuration, the server device 10 can record the number of times the recipe has been adopted by the user while suggesting a dish recipe to the user according to a product purchased by the user.

[0089] Furthermore, the server device 10 may receive an input indicating that the user has adopted a menu indicated in the menu information 195 through the registration unit 130, and register the adoption of the menu in the menu information 195 according to the input. When the registration unit 130 registers the adoption of a recipe in the menu information 195, the server device 10 records and updates the number of times the menu has been adopted in the menu information 195. With this configuration, the server device 10 can record the number of times the menu has been adopted by the user while suggesting a menu to the user according to the products purchased by the user.

[0090] Furthermore, the server device 10 may search for recipes or menus that contain ingredients indicated by the purchase information 192 extracted by the extraction unit 120 and that have been used a predetermined number of times or more among the recipes indicated by the recipe information 194 or menus indicated by the menu information 195. With this configuration, the server device 10 can suggest to the user popular recipes or menus that have been used a large number of times according to the products purchased by the user. [Explanation of symbols]

[0091] 10: server device (information processing device), 110: acquisition unit, 120: extraction unit, 140: search unit, 150: proposal unit

Claims

1. Computer, an acquisition unit that acquires an image of a receipt from a user; an extraction unit that extracts purchase information related to the purchase indicated by the receipt from the image acquired by the acquisition unit; A storage unit that stores the purchase information; a search unit that searches for recipe information related to a recipe for a dish that uses as an ingredient the product indicated by the purchase information extracted by the extraction unit, and searches for purchase information of other users different from the user stored in the storage unit that includes the product purchased by the user and that is from a store where the product was purchased and that satisfies a predetermined condition; a suggestion unit that suggests recipe information searched for by the search unit to the user and suggests information on a store and a product indicated by the purchase information searched for by the search unit to the user; A program that functions as a

2. causing the computer to further function as a storage unit that stores the purchase information; The search unit searches for the recipe information based on the past purchase information stored in the storage unit and the purchase information extracted by the extraction unit. The program according to claim 1.

3. The search unit searches for menu information related to a menu including a dish indicated by the searched recipe information, The suggestion unit suggests the menu information searched by the search unit to the user. The program according to claim 1.

4. The computer, The recipe information is registered by the recipe registration unit, and the recipe information is stored in the storage unit. The search unit searches for the recipe information based on the recipe information registered by the registration unit and a browsing history included in the user information. The program according to claim 1.

5. The search unit searches for recipe information different from the recipe information registered by the registration unit and the recipe information included in the browsing history included in the user information. The program according to claim 4.

6. The search unit compares ingredients of the dish indicated by the searched recipe information with products included in the purchase information, and searches for ingredients of the dish that are not included in the purchase information; The suggestion unit suggests the material searched by the search unit to the user. The program according to claim 1.

7. causing the computer to further function as a storage unit that stores the purchase information; The search unit searches for purchase information related to a store where the searched material can be purchased from the purchase information stored in the storage unit, The suggestion unit suggests, to the user, information about the store indicated by the purchase information searched by the search unit. The program according to claim 6.

8. causing the computer to further function as an advertising unit that provides advertisements related to stores to the user; the search unit searches for recipe information related to a recipe for a dish that includes an ingredient included in the advertisement among the recipes; The program according to claim 1.

9. An acquisition unit that acquires an image of a receipt from a user; an extraction unit that extracts purchase information related to the purchase indicated by the receipt from the image acquired by the acquisition unit; A storage unit that stores the purchase information; a search unit that searches for recipe information related to a recipe for a dish that uses as an ingredient the product indicated by the purchase information extracted by the extraction unit, and searches for purchase information of other users different from the user stored in the storage unit that includes the product purchased by the user and where the store where the product was purchased satisfies a predetermined condition; a suggestion unit that suggests recipe information searched for by the search unit to the user and suggests information on a store and a product indicated by the purchase information searched for by the search unit to the user; An information processing device comprising:

Images