system

Abstract

Provide a system. A means for a user to input personal information; means for transmitting the information input by the user to a server; A means of obtaining product data from each store, a means for generating a recommended recipe based on the acquired product data and user information; means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; means for displaying the optimal ingredient list and recommended recipes to a user; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, consumers are becoming increasingly health-conscious and are seeking to eat meals that suit their own health condition and preferences. However, it can be difficult to select products that are optimal for one's health condition and within one's budget from the vast amount of product information available at supermarkets. It is also not easy to assemble an optimal menu while taking into account allergy information for specific ingredients and one's health condition. To solve these problems, a system is needed that can automatically suggest optimal ingredients and recipes taking into account the user's health condition, preferences, and budget. [Means for solving the problem]

[0005] This invention provides a system that includes a means for a user to input personal information, a means for transmitting the user-inputted information to a server, a means for acquiring product data from each store, a means for generating recommended recipes based on the acquired product data and the user information, a means for generating an optimal ingredient list taking into account the recommended recipe and the user's budget, and a means for displaying the optimal ingredient list and recommended recipe to the user. Recommended product data from each store is acquired using an API, and the recommended recipes are generated using an algorithm that takes into account the user's health condition and preferences, thereby suggesting the optimal menu and ingredient list to the user. This allows users to easily select foods that match their health condition and preferences within their budget.

[0006] "User" refers to a consumer or individual who uses the system.

[0007] "Personal information" refers to information specific to a user, such as preferences, health status, budget, etc.

[0008] "Server" refers to a central system that receives and processes information sent by users.

[0009] "Store" refers to a supermarket or retail store that sells goods.

[0010] "Product data" refers to information about products sold in stores, including information about special sales and fresh ingredients.

[0011] "Recommended recipes" refer to recipes for dishes that are automatically suggested based on the user's personal information and product data.

[0012] The "budget" refers to the amount of money that the user can spend on shopping.

[0013] "Ingredient List" refers to a list of specific ingredients required based on a Recommended Recipe.

[0014] "API" stands for Application Program Interface, and refers to a standardized interface for exchanging data between a server and a store system.

[0015] An "algorithm" refers to a procedure or calculation method for solving a specific problem, and in this case refers to a recipe generation procedure that takes into account the user's health condition and preferences. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The system of the present invention aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system is used by users using smartphones or tablet devices and operates in the following manner.

[0038] Enter user information

[0039] 1. Users

[0040] Open the smartphone app and enter your preferences, health status, and budget.

[0041] Example: A user enters information such as "diabetes," "budget 2000 yen," "likes chicken," and "milk allergy."

[0042] 2. Terminal

[0043] Check the information entered to ensure it is formatted correctly.

[0044] After confirmation, it is sent to the server.

[0045] Supermarket data acquisition

[0046] 1. Server

[0047] Send a request to the supermarket's API to get the recommended products for the day.

[0048] Example: Obtain data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[0049] Generate recommended recipes

[0050] 1. Server

[0051] Recommended recipes are generated based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets.

[0052] Based on the user's information, the recipe generation algorithm selects "stir-fried chicken thighs and broccoli" and "mushroom soup" as candidates.

[0053] Generate optimal menu within budget

[0054] 1. Server

[0055] From the recommended recipes, a menu that can be achieved within the user's budget is selected.

[0056] Generate a list of ingredients you need, compare it with supermarket prices, and adjust it to fit within your budget.

[0057] Example: Generates a list containing 500g of chicken thighs, 1 stalk of broccoli, and 200g of mushrooms.

[0058] Viewing Proposals

[0059] 1. Server

[0060] The optimal menu and ingredient list will be sent to your device.

[0061] 2. Terminal

[0062] The received data is displayed to the user.

[0063] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and also displays a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0064] Specific examples

[0065] Enter user information

[0066] The user enters the following information into the app:

[0067] Health Condition: Diabetes

[0068] Budget: 2000 yen

[0069] Favorite food: Chicken

[0070] Allergies: Milk

[0071] Supermarket data acquisition

[0072] The server accesses the supermarket's API and retrieves the following data:

[0073] Chicken thigh special sale (200 yen / 100g)

[0074] Broccoli (150 yen / piece)

[0075] Mushrooms (100 yen / 200g)

[0076] Generate recommended recipes

[0077] The server generates a recipe using the following information:

[0078] User information

[0079] Supermarket recommended product data

[0080] The recipe generation algorithm suggested "stir-fried chicken thighs and broccoli" and "mushroom soup."

[0081] Generate optimal menu within budget

[0082] The server generates a list of ingredients that fit within the budget (2000 yen):

[0083] Chicken thigh 500g (1000 yen)

[0084] 1 stalk of broccoli (150 yen)

[0085] 200g mushrooms (100 yen)

[0086] Viewing Proposals

[0087] The server sends the optimal menu and ingredient list to the terminal.

[0088] The device displays the following information to the user:

[0089] Recommended menu items: Stir-fried chicken thigh and broccoli, mushroom soup

[0090] Ingredients: 500g chicken thigh, 1 stalk of broccoli, 200g mushrooms

[0091] The above is a specific embodiment for carrying out the invention. This system allows users to efficiently select appropriate ingredients, purchase them within their budget, and easily lead a healthy diet.

[0092] The processing flow will be explained below.

[0093] Step 1:

[0094] The user launches the smartphone app and enters personal information such as health status, preferences, budget, etc. For example, the user enters information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk."

[0095] Step 2:

[0096] The terminal checks the entered information to make sure that the data format is correct, and once that is confirmed, sends the data to the server.

[0097] Step 3:

[0098] The server sends a request to the supermarket's API. For example, the server sends a "GET" request to get data about the day's specials and fresh items.

[0099] Step 4:

[0100] The server analyzes and structures the product data it obtains. For example, it organizes information such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[0101] Step 5:

[0102] The server generates recommended recipes based on the user's input information and the acquired product data. For example, the server generates recipes such as "Stir-fried chicken thighs and broccoli" and "Mushroom soup" that meet the conditions of "diabetes," "chicken," and "broccoli."

[0103] Step 6:

[0104] The server creates a specific list of ingredients based on the recommended recipe and the user's budget. For example, the server creates a list such as "500g of chicken thighs," "1 stalk of broccoli," and "200g of mushrooms."

[0105] Step 7:

[0106] The server sends the optimal menu and ingredient list to the terminal. The server sends the recommended recipe and the corresponding ingredient list in data format to the terminal.

[0107] Step 8:

[0108] The device analyzes the received data and displays it to the user. For example, the device might display "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0109] Step 9:

[0110] The user can refer to the app while shopping at the supermarket and purchase products while checking the recommended ingredients list.

[0111] The above is a detailed flow of the processing steps. This system allows users to shop efficiently and healthily.

[0112] Example 1

[0113] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0114] In today's busy lifestyles, it is extremely difficult for users to maintain a healthy diet while shopping efficiently within a budget. In particular, selecting appropriate recipes based on health status and food preferences and purchasing ingredients within a budget requires a lot of time and effort. Conventional methods make these processes cumbersome, making it difficult to create an optimal shopping list.

[0115] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0116] In this invention, the server includes: a means for a user to input personal information; a means for transmitting the user-inputted information to the server; a means for acquiring product data from each store; a means for generating a recommended recipe based on the acquired product data and the user information; a means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; a means for displaying the optimal ingredient list and recommended recipe to the user; a means for using a generative AI model when generating the recommended recipe based on the acquired product data; and a means for using a budget optimization algorithm when generating the optimal ingredient list. This enables users to efficiently obtain optimal recipes and necessary ingredient lists based on their health condition, preferences, and budget.

[0117] A "user" refers to an individual who inputs their own information (health status, preferences, budget, allergies) into the system and receives recipe and ingredient recommendations.

[0118] "Personal Information" refers to information provided by the User, such as health status, preferences, budget, allergies, etc.

[0119] The term "server" refers to a computer system that receives information sent by users, acquires product data from each store, and generates recommended recipes and optimal ingredient lists.

[0120] "Terminal" refers to an electronic device such as a smartphone or tablet on which a user inputs personal information and communicates with a server.

[0121] "Store" refers to a sales facility with which the server communicates to obtain product data.

[0122] "Product data" refers to data such as prices, inventory, and special sale information for ingredients and products offered by each store.

[0123] "Recommended recipe" refers to cooking instructions generated based on the user's personal information and acquired product data.

[0124] "Ingredient list" refers to a list containing the necessary ingredients, their quantities, and their prices, generated taking into account the recommended recipe and the user's budget.

[0125] A "generative AI model" refers to an artificial intelligence algorithm that generates recommended recipes using a user's personal information and product data as input.

[0126] "Budget optimization algorithm" refers to a computational technique used to generate an optimal ingredient list within a user's budget constraints.

[0127] The system of the present invention aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system is used by users using smartphones or tablet devices and operates in the following manner.

[0128] Enter user information

[0129] 1. Users

[0130] Users launch the app on their smartphone or tablet and enter their health status, food preferences, budget, and allergy information, such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk."

[0131] 2. Terminal

[0132] The app on the device checks whether the data entered is in the correct format. If there are no errors, it sends the information to the server. The device uses common hardware such as a smartphone or tablet.

[0133] Supermarket data acquisition

[0134] 1. Server

[0135] The server sends a request to the supermarket's API to retrieve the recommended product data for that day. For example, it accesses the supermarket API endpoint (e.g., https: / / api.supermarket.com / products) and retrieves data such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[0136] Generate recommended recipes

[0137] 1. Server

[0138] The server generates recommended recipes based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets. A generative AI model is used for this process. For example, the following prompt is input to the generative AI model: "Generate recipes using chicken thighs for diabetics."

[0139] Generate optimal menu within budget

[0140] 1. Server

[0141] From the recommended recipes, a menu that can be achieved within the user's budget is selected and a list of necessary ingredients is generated. A budget optimization algorithm is used for this. Specifically, the server combines the generated recommended recipe with supermarket product data to create an ingredient list that fits within the budget, such as 500g of chicken thighs (1,000 yen), one stalk of broccoli (150 yen), and 200g of mushrooms (100 yen).

[0142] Viewing Proposals

[0143] 1. Server

[0144] The optimal menu and ingredient list are sent to the device, for example in JSON format.

[0145] 2. Terminal

[0146] The device analyzes the data received from the server and displays it to the user. The app screen displays, "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup. Required ingredients: 500g chicken thighs (1,000 yen), 1 stalk of broccoli (150 yen), 200g mushrooms (100 yen)."

[0147] As a concrete example, a user inputs the following information: health condition "diabetes," budget "2,000 yen," favorite ingredient "chicken," and allergy "milk." The server accesses a supermarket API to obtain data on "chicken thigh sale (200 yen / 100g)," "broccoli (150 yen / stalk)," and "mushrooms (100 yen / 200g)," and then uses a generative AI model to suggest "stir-fried chicken thighs and broccoli" and "mushroom soup." The server generates an ingredient list (500g of chicken thighs, one stalk of broccoli, and 200g of mushrooms) that fits within the budget and sends it to the device, which displays it to the user. In this way, users can smoothly select ingredients and menu items that meet their criteria and shop efficiently within their budget.

[0148] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0149] Step 1:

[0150] The user enters personal information

[0151] Users launch the app on their smartphone or tablet and enter their health status, food preferences, budget, and allergy information.

[0152] Input: health condition, preferences, budget, allergy information

[0153] Output: Data entered into the terminal

[0154] Specific behavior: The user enters information such as "Diabetes," "Budget 2000 yen," "I like chicken," and "I'm allergic to milk" into form fields using the keyboard.

[0155] Step 2:

[0156] The device checks the input data and sends it to the server

[0157] The app on the device checks whether there are any errors in the format of the data entered.

[0158] Input: Data entered by the user

[0159] Output: Data to send to the server

[0160] Specific behavior: The terminal validates the input fields, and if there are any errors, displays an error message and prompts the user to correct them. If there are no errors, the data is sent to the server.

[0161] Step 3:

[0162] The server retrieves product data from the supermarket API

[0163] The server sends a request to the supermarket's API to retrieve the recommended products for that day.

[0164] Input: Request from server

[0165] Output: Supermarket product data

[0166] Specific operation: The server sends a request to the Super API endpoint (e.g., https: / / api.supermarket.com / products) and receives data such as "Chicken thighs on sale for 200 yen / 100g" and "Fresh broccoli for 150 yen / stalk" as a response.

[0167] Step 4:

[0168] The server generates recommended recipes based on user information and product data.

[0169] The server generates recommended recipes based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets, using a generative AI model.

[0170] Input: User's personal information, supermarket product data

[0171] Output: Recommended recipe

[0172] Specific operation: The server inputs the prompt "Recipes using chicken thighs for diabetics" into the recipe generation AI model, and the model generates recommended recipes such as "Stir-fried chicken thighs and broccoli" and "Mushroom soup."

[0173] Step 5:

[0174] The server will generate the best grocery list that fits within your budget.

[0175] From the recommended recipes, we select a menu that is feasible within the user's budget and generate a list of ingredients, using a budget optimization algorithm.

[0176] Input: Recommended recipes, supermarket product data, user budget

[0177] Output: Optimal ingredients list

[0178] Specific operation: The server combines the generated recommended recipe with supermarket product data to create a list of ingredients that fit within the budget, such as 500g of chicken thighs (1,000 yen), one stalk of broccoli (150 yen), and 200g of mushrooms (100 yen).

[0179] Step 6:

[0180] The server sends the optimal menu and ingredient list to the device.

[0181] The optimal menu and ingredient list will be sent to your device.

[0182] Input: Optimal menu and ingredient list

[0183] Output: Data sent to the terminal

[0184] Specific operation: The server sends the ingredient list and recommended menu items in JSON format to the device.

[0185] Step 7:

[0186] The device displays the optimal menu and ingredient list to the user.

[0187] The received data is displayed to the user.

[0188] Input: Data received from the server

[0189] Output: Information displayed to the user

[0190] Specific operation: The device analyzes the data received from the server and displays on the app screen, "Today's recommended menu is stir-fried chicken thighs and broccoli, and mushroom soup. List of ingredients needed: 500g chicken thighs (1,000 yen), 1 stalk of broccoli (150 yen), 200g mushrooms (100 yen)."

[0191] (Application example 1)

[0192] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0193] Conventional healthy eating support systems can suggest recipes based on the user's preferences and health status, and generate ingredient lists within a budget. However, it is difficult for users to receive real-time advice while shopping in the store. Furthermore, input interfaces are limited to smartphones, which makes them less convenient for users. Therefore, there is a demand for systems with more user-friendly and intuitive interfaces.

[0194] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0195] In this invention, the server includes: a means for a user to input personal information; a means for transmitting the user-input information to the server; a means for acquiring product data from each store; a means for generating a recommended recipe based on the acquired product data and the user information; a means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; a means for displaying the optimal ingredient list and recommended recipe to the user; and a means for displaying the optimal ingredient list and recommended recipe to the user using smart glasses and collecting information via voice input. This enables users to efficiently shop in physical stores while referring to the recommended recipe and ingredient list that reflect their health condition, preferences, and budget in real time.

[0196] Definition of Terms

[0197] The "means by which users input personal information" refers to an interface through which users input information such as their preferences, health status, budget, etc. Examples of such interfaces include smart glasses, smartphones, and tablet devices.

[0198] The "means for transmitting the information input by the user to the server" refers to an interface and communication module for transmitting the information input by the user to the server via a network, including Wi-Fi and data communication modules.

[0199] "Means for obtaining product data from each store" refers to an interface for obtaining data on the day's specials and recommended products from each store, such as a supermarket. Specifically, the store's API or beacon technology is used.

[0200] The "means for generating recommended recipes based on the acquired product data and user information" refers to algorithms and software for automatically generating optimal recipes based on product data acquired from stores and information such as the user's preferences and health condition.

[0201] The "means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget" refers to an algorithm and software for generating an ingredient list that can be purchased within the user's budget based on the recommended recipe.

[0202] The "means for displaying the optimal ingredient list and recommended recipes to the user" refers to a display device for visually presenting the generated optimal ingredient list and recommended recipes to the user, including the display of smart glasses or a smartphone.

[0203] The "means for displaying the optimal ingredient list and recommended recipes to the user using smart glasses and collecting information through voice input" refers to an interface and voice recognition technology for displaying an ingredient list and recipes on the display of smart glasses and accepting voice input from the user.

[0204] MODE FOR CARRYING OUT THE INVENTION

[0205] The present invention provides a support system that helps users to shop efficiently within their budget while maintaining a healthy diet. Specific embodiments of the system will be described in detail below.

[0206] 1. Enter user information

[0207] Users use input interfaces such as smart glasses or smartphones to input personal information such as their health status, preferences, and budget. A voice input interface is also available, allowing users to input information intuitively. This allows users to easily reflect their health status and preferences in the system.

[0208] 2. User Information Submission

[0209] The input information is sent to the server via the smart glasses or smartphone's communication function, using Wi-Fi or a data communication module. Based on the received information, the server starts the process of acquiring data from each store and generating recipes.

[0210] 3. Obtaining data from each store

[0211] The server uses APIs to retrieve daily specials and recommended product data from supermarkets, grocery stores, and other retailers, which can use beacon technology or the store's Wi-Fi. This data is updated in real time, providing users with the latest options.

[0212] 4. Generating recommended recipes

[0213] The server generates recommended recipes based on the acquired product data and the user's personal information. The recipes are generated using an algorithm that takes into account the user's health condition and preferences. For example, a user with diabetes may be suggested low-carb menus, and a recipe using chicken on sale may be generated.

[0214] 5. Generating the optimal ingredient list

[0215] Based on the generated recommended recipes, an optimal list of ingredients that fits within the user's budget is generated. This list is compared with the acquired product data to appropriately select the necessary ingredients. This allows the user to efficiently purchase healthy ingredients within their budget.

[0216] 6. Display of proposals

[0217] The optimal ingredient list and recommended recipes are displayed on the screen of smart glasses or a smartphone. In the case of smart glasses, the ingredient list and recipe are displayed on the screen, allowing users to check them in real time at the time of purchase. Voice input is also possible, further improving convenience.

[0218] Specific examples

[0219] For example, a user puts on smart glasses, enters a supermarket, and speaks the following information:

[0220] Health Condition: Diabetes

[0221] Budget: 2000 yen

[0222] Favorite food: Chicken

[0223] Allergies: Milk

[0224] The server obtains data such as "Chicken thighs on sale for 200 yen / 100g" and "Fresh broccoli for 150 yen / stalk" via the store's API, and generates recipes based on the user's information. The generated recipes are "Stir-fried chicken thighs and broccoli" and "Mushroom soup," and the list of ingredients needed (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms) is displayed on the smart glasses' display.

[0225] Finally, the user can give instructions to the system using the following prompt sentences:

[0226] Create healthy recipes based on your input:

[0227] Health Condition: Diabetes

[0228] Budget: 2000 yen

[0229] Favorite food: Chicken

[0230] Allergies: Milk

[0231] Available ingredients list:

[0232] Chicken thigh special sale 200 yen / 100g

[0233] Broccoli 150 yen / piece

[0234] Mushrooms 100 yen / 200g

[0235] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0236] Program processing steps

[0237] Processing Steps

[0238] Step 1:

[0239] (Processing content)

[0240] The user enters personal information.

[0241] (input)

[0242] Users use smart glasses or smartphones to input personal information such as their health status, preferences, and budget.

[0243] (Data processing, data calculation and output)

[0244] The device collects information using voice recognition and touch input, checks the format for errors, and then sends the information to the server after verification.

[0245] Step 2:

[0246] (Processing content)

[0247] The information input by the user is sent to the server.

[0248] (input)

[0249] The smart glasses or smartphone receives the entered personal information.

[0250] (Data processing, data calculation and output)

[0251] The device's communication module (Wi-Fi or data communication) is used to send the user's input information to the server, which then stores the received information in a database.

[0252] Step 3:

[0253] (Processing content)

[0254] Obtain product data from each store.

[0255] (input)

[0256] Personal information sent by the user to the server.

[0257] (Data processing, data calculation and output)

[0258] The server uses each store's API to obtain the recommended product data for that day. The obtained data includes information such as product name, price, and category, and is stored in a database.

[0259] Step 4:

[0260] (Processing content)

[0261] A recommended recipe is generated based on the acquired product data and the user information.

[0262] (input)

[0263] Product data and user personal information obtained by the server.

[0264] (Data processing, data calculation and output)

[0265] The server uses the generative AI model to generate recommended recipes based on the user's health status and preferences. For example, it might suggest low-carb options to a user with diabetes. The generated recipe information is then passed on to the next processing step.

[0266] Step 5:

[0267] (Processing content)

[0268] An optimal ingredient list is generated taking into consideration the recommended recipe and the user's budget.

[0269] (input)

[0270] Suggested recipes and user budget information.

[0271] (Data processing, data calculation and output)

[0272] The server compares the recommended recipe with the user's budget and generates a list of ingredients that can be purchased within the budget. This calculation also uses price information from the product data to generate the final ingredient list.

[0273] Step 6:

[0274] (Processing content)

[0275] The optimum ingredient list and recommended recipes are displayed to the user.

[0276] (input)

[0277] Best ingredients list and recommended recipes.

[0278] (Data processing, data calculation and output)

[0279] The server converts the generated optimal ingredient list and recommended recipes into a format that can be displayed on the screen of smart glasses or a smartphone, and sends it to the device, which then visually presents the received information to the user.

[0280] Step 7:

[0281] (Processing content)

[0282] The optimal ingredient list and recommended recipes are displayed to the user using smart glasses, and information is collected through voice input.

[0283] (input)

[0284] The best ingredient list and recipe suggestions displayed on smart glasses.

[0285] (Data processing, data calculation and output)

[0286] The user puts on the smart glasses and checks the information displayed on the screen. The user can then give additional instructions or modify the information by voice input. The voice instructions are recognized by the device and, if necessary, retransmitted to the server for processing updates.

[0287] As an example of this process, a user puts on a pair of smart glasses and instructs the system using the following prompt sentence:

[0288] Create healthy recipes based on your input:

[0289] Health Condition: Diabetes

[0290] Budget: 2000 yen

[0291] Favorite food: Chicken

[0292] Allergies: Milk

[0293] Available ingredients list:

[0294] Chicken thigh special sale 200 yen / 100g

[0295] Broccoli 150 yen / piece

[0296] Mushrooms 100 yen / 200g

[0297] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0298] The present invention relates to a system that aims to support users in shopping efficiently within their budget while maintaining a healthy diet, and also suggests optimal recipes taking into account the user's emotional state. This system is used by users using smartphones or tablet devices, and operates in the following manner.

[0299] Enter user information

[0300] 1. Users

[0301] Users open the smartphone app and enter personal information such as their health status, preferences, budget, etc. The app also uses a video camera and microphone to record voice and facial expression data to ascertain the user's emotional state.

[0302] Example: The user can enter information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "milk allergy" along with the emotion they are currently feeling (for example, "tired" or "happy"), or the app can automatically analyze their emotions.

[0303] 2. Terminal

[0304] The entered information and recorded voice and facial expression data are checked to ensure there are no formatting errors. After confirmation, this data is sent to the server.

[0305] Supermarket data acquisition

[0306] 1. Server

[0307] Send a request to the supermarket's API to get the recommended products for the day.

[0308] Example: Obtain data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[0309] Generate recommended recipes

[0310] 1. Server

[0311] Recommended recipes are generated based on the user's personal information (preferences, health status, budget), product data obtained from supermarkets, and the user's emotional state recognized by an emotion engine.

[0312] The recipe generation algorithm selects multiple recipes, such as "stir-fried chicken thighs and broccoli" and "mushroom soup," based on the user's information.

[0313] If the user is tired, the emotion engine will recommend easy recipes or recipes containing ingredients that will lift their spirits, and if the user is happy, it will suggest special dishes or new recipes.

[0314] Generate optimal menu within budget

[0315] 1. Server

[0316] From the recommended recipes, a menu that can be achieved within the user's budget is selected.

[0317] Generate a list of ingredients you need, compare it with supermarket prices, and adjust it to fit within your budget.

[0318] Example: A list might be generated that includes 500g of chicken thighs, 1 stalk of broccoli, and 200g of mushrooms.

[0319] Viewing Proposals

[0320] 1. Server

[0321] The optimal menu and ingredient list will be sent to your device.

[0322] 2. Terminal

[0323] The received data is displayed to the user.

[0324] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and also displays a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0325] Specific examples

[0326] Enter user information

[0327] The user enters the following information into the app:

[0328] Health Condition: Diabetes

[0329] Budget: 2000 yen

[0330] Favorite food: Chicken

[0331] Allergies: Milk

[0332] Emotional state: Tired

[0333] Supermarket data acquisition

[0334] The server accesses the supermarket's API and retrieves the following data:

[0335] Chicken thigh special sale (200 yen / 100g)

[0336] Broccoli (150 yen / piece)

[0337] Mushrooms (100 yen / 200g)

[0338] Generate recommended recipes

[0339] The server generates a recipe using the following information:

[0340] User information

[0341] Supermarket recommended product data

[0342] Emotional state by emotion engine

[0343] The recipe generation algorithm suggests "stir-fried chicken thighs and broccoli" and "mushroom soup," selecting easy-to-make recipes for tired users.

[0344] Generate optimal menu within budget

[0345] The server generates a list of ingredients that fit within the budget (2000 yen):

[0346] Chicken thigh 500g (1000 yen)

[0347] 1 stalk of broccoli (150 yen)

[0348] 200g mushrooms (100 yen)

[0349] Viewing Proposals

[0350] The server sends the optimal menu and ingredient list to the terminal.

[0351] The device displays the following information to the user:

[0352] Recommended menu items: Stir-fried chicken thigh and broccoli, mushroom soup

[0353] Ingredients: 500g chicken thigh, 1 stalk of broccoli, 200g mushrooms

[0354] The above is a specific embodiment for carrying out the invention. This system allows users to select the optimal ingredients for their health and emotional state, purchase them within their budget, and easily lead a healthy and mood-appropriate diet.

[0355] The processing flow will be explained below.

[0356] Step 1:

[0357] The user launches the smartphone app and inputs personal information such as health status, preferences, and budget. In addition, a video camera and microphone are used to record voice and facial expression data. For example, the user inputs information such as "diabetes," "budget of 2,000 yen," "likes chicken," "allergy to milk," and "tired."

[0358] Step 2:

[0359] The device checks the entered information and recorded voice and facial expression data to ensure there are no formatting errors. Once verified, this data is sent to the server.

[0360] Step 3:

[0361] The server sends a request to the supermarket's API to retrieve data on the day's specials and fresh products. For example, the server retrieves data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[0362] Step 4:

[0363] The server analyzes and structures the product data it obtains. For example, it organizes information such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[0364] Step 5:

[0365] The server uses an emotion engine to recognize the user's emotional state, for example, recognizing the emotion "tired" from recorded voice and video facial expressions.

[0366] Step 6:

[0367] The server generates recommended recipes based on the user's personal information, health status, product data obtained from supermarkets, and the user's recognized emotional state. Based on the user's information, the recipe generation algorithm selects easy-to-make recipes for a tired user, such as "stir-fried chicken thighs and broccoli" or "mushroom soup."

[0368] Step 7:

[0369] The server creates a specific ingredient list based on the recommended recipe and the user's budget. For example, it creates a list such as "500g chicken thighs," "1 stalk of broccoli," and "200g mushrooms."

[0370] Step 8:

[0371] The server sends the optimal menu and ingredient list to the terminal. The recommended recipe and the corresponding ingredient list are sent to the terminal in data format.

[0372] Step 9:

[0373] The device analyzes the received data and displays it to the user. The displayed content is "Today's recommended menu is stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0374] Step 10:

[0375] The user can refer to the app while shopping at the supermarket and purchase products while checking the recommended ingredients list.

[0376] This is the detailed flow of the processing steps. This system enables users to shop efficiently and healthily, and also suggests recipes that suit their emotional state, allowing them to lead a more fulfilling diet.

[0377] Example 2

[0378] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0379] Conventional shopping support systems suggest recipes based on the user's health condition, preferences, and budget, but they are unable to consider the user's emotional state. As a result, recipe suggestions that match the user's mood at the time are insufficient, which can lead to reduced user satisfaction. Additionally, the personal information entered by the user may be inaccurate, resulting in reduced suggestion accuracy.

[0380] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting personal information of the user, means for transmitting the information input by the user to the server, means for acquiring product data from each store, means for generating recommended recipes based on the acquired product data and the user information, means for generating an optimal ingredient list taking into account the recommended recipes and the user's budget, means for displaying the optimal ingredient list and recommended recipes to the user, means for recording voice data and facial expression data to analyze the user's emotional state, and means for adjusting the recommended recipes taking into account the emotional state. This enables highly accurate recipe suggestions that also take the user's emotional state into account.

[0381] A "user" is an individual or group that uses the system and inputs information such as health status, preferences, budget, and emotional state.

[0382] "Personal Information" is information entered by a user about a user's particular circumstances and preferences, such as health status, preferences, budget, emotional state, and allergy information.

[0383] The "server" is a computer system that receives information sent by users, acquires data from each store, and generates recommended recipes and ingredient lists.

[0384] "Stores" refer to retail stores such as supermarkets and food retailers, and are entities that provide product data through APIs.

[0385] "Product data" refers to information such as product name, price, and stock status obtained from the store.

[0386] A "recommended recipe" is a recipe for a dish that is suggested to a user based on the user's personal information and product data obtained from a store.

[0387] The "ingredient list" is a list of ingredients and their amounts required to make a recommended recipe.

[0388] "Voice data" is information input by voice from a user, and is data for analyzing the emotional state of the user.

[0389] "Facial expression data" is information based on facial expressions input by the user, and is data for analyzing the emotional state of the user.

[0390] An "emotional state" is a user's psychological or emotional state, including states such as tiredness, joy, anxiety, etc.

[0391] The "emotion engine" is an analysis system that analyzes the user's emotional state from their voice data and facial expression data, and adjusts recommended recipes based on that information.

[0392] "API" stands for Application Programming Interface, and is the interface used by the server to obtain data from each store.

[0393] The present invention is a system that aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system proposes optimal recipes taking into account the user's emotional state and is configured so that the user can use it on a smartphone or tablet device. Details for specifically implementing the present invention are described below.

[0394] Enter user information

[0395] A user opens a smartphone app and inputs personal information such as their health condition, preferences, budget, and emotional state. At this time, a video camera and microphone are used to record voice and facial expression data. An emotion engine is then used to analyze the user's emotional state from this data.

[0396] Example: A user enters information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk," and the app automatically analyzes their current emotions (e.g., "tired").

[0397] Data transmission and check

[0398] The device checks the input information and recorded voice and facial expression data to ensure there are no format errors, and then sends this data to the server.

[0399] Get product data

[0400] The server sends a request to the supermarket's API endpoint to retrieve the recommended product data for that day, such as "Chicken thigh special sale 200 yen / 100g" or "Fresh broccoli 150 yen / stalk."

[0401] Generate recommended recipes

[0402] The server references the user's personal information (preferences, health status, budget) and compares the acquired product data. Furthermore, it uses an emotion engine to generate recommended recipes that take into account the user's emotional state. Specifically, if the user is tired, it recommends easy-to-make recipes, and if the user is happy, it suggests special dishes or new recipes.

[0403] Example: A recipe generation algorithm suggests the following recipes: "Stir-fried chicken thighs and broccoli" and "Mushroom soup."

[0404] Generate optimal menu within budget

[0405] The server selects from the recommended recipes a menu that is feasible within the user's budget, generates a list of ingredients, and compares it with supermarket price information to ensure it fits within the budget.

[0406] Example: A list such as 500g of chicken thigh (1000 yen), 1 stalk of broccoli (150 yen), and 200g of mushrooms (100 yen) is generated.

[0407] Viewing Proposals

[0408] The server sends the optimal menu and ingredient list to the terminal, which displays the received data to the user.

[0409] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and provides a specific list of ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0410] Prompt Sentence Examples

[0411] "When a user enters personal information into the app, such as 'diabetes,' 'budget of 2,000 yen,' 'likes chicken,' and 'milk allergy,' and records their emotional state as 'tired,' the server accesses the supermarket's API and obtains product data such as 'chicken thighs on sale for 200 yen / 100g' and 'fresh broccoli for 150 yen / stalk.' The server then generates recipes such as 'stir-fried chicken thighs and broccoli' or 'mushroom soup' based on the user's information and the obtained product data, recommends recipes that are easy to make taking into account the user's emotional state, and sends a list of ingredients that fit within the user's budget (500g chicken thighs, one stalk of broccoli, 200g mushrooms) to the device, which then displays it to the user."

[0412] This invention allows users to easily obtain optimal ingredients and recipes that suit their emotional and health conditions, and allows them to shop within their budget. The hardware used includes smartphones and tablet devices, and the software includes a supermarket API, an emotion engine, and a recipe generation algorithm.

[0413] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0414] Step 1: Enter your information

[0415] 1. The user launches the app on their smartphone and an input form is displayed.

[0416] 2. The user inputs their health condition (e.g., "diabetes"), preferences (e.g., "I like chicken"), budget (e.g., "2,000 yen"), and allergy information (e.g., "milk allergy"). They also input their emotional state (e.g., "I'm tired"), or the emotional data is automatically recorded using a video camera or microphone. Specific actions include showing facial expressions to the camera or speaking into the microphone, such as "I'm tired today."

[0417] Input: User's health status, preferences, budget, allergy information, emotional state

[0418] Output: Verified personal information data

[0419] Step 2: Submit and verify data

[0420] 1. The device checks the information entered and checks for formatting errors, for example displaying a warning if the budget field is blank.

[0421] 2. After confirmation, the terminal sends the user's input information and recorded data to the server. The transmission format generally uses the HTTPS protocol, and the data is encrypted.

[0422] Input: Verified personal data

[0423] Output: Data sent to the server

[0424] Step 3: Obtain supermarket data

[0425] 1. The server sends a request to the supermarket API, for example, "GET / api / v1 / products / today_specials".

[0426] 2. The server retrieves the recommended product data for that day and stores it in a database. The retrieved product data includes product name, price, and stock information.

[0427] Input: API request

[0428] Output: Retrieved product data

[0429] Step 4: Generate recommended recipes

[0430] 1. The server retrieves the user's personal information (health status, preferences, budget) from the database.

[0431] 2. Based on the product data acquired by the server, a recipe generation algorithm is used to generate recipe candidates. For example, recipes such as "Stir-fried chicken thighs and broccoli" or "Mushroom soup" are generated.

[0432] 3. The server uses an emotion engine to analyze the user's emotional state and adjust the recipe accordingly. For example, it might recommend easy recipes to a tired user.

[0433] Input: User information data, product data

[0434] Output: Recommended recipe

[0435] Step 5: Generate the optimal menu

[0436] 1. The server selects from the recommended recipes a recipe that is feasible within the user's budget.

[0437] 2. The server generates a list of ingredients needed and adjusts it based on price information. For example, a list might be generated that includes "500g of chicken thighs (1000 yen)," "1 stalk of broccoli (150 yen)," and "200g of mushrooms (100 yen)."

[0438] Input: Recommended recipes, product price information

[0439] Output: Budgeted ingredients list

[0440] Step 6: View the proposal

[0441] 1. The server sends the optimal menu and ingredient list to the device. The sending format is mainly JSON.

[0442] 2. The device displays the received data to the user. Specifically, the app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients.

[0443] Input: Optimal menu, ingredients list

[0444] Output: Information displayed to the user

[0445] Through these steps, users can easily obtain the optimal ingredients and recipes that suit their emotional and health states, and shop efficiently within their budget.

[0446] (Application example 2)

[0447] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0448] Today's consumers want the right ingredients and recipes based on their health status, budget, and preferences, but it is difficult to do so efficiently. Furthermore, because consumers' emotional state is an important factor in ingredient selection, recipe suggestions based on their emotional state are also necessary. In addition, a lack of systems that allow consumers to easily order optimal ingredients has been pointed out. To solve these issues, there is a need for a system that can recommend optimal ingredients and recipes based on a user's overall health status, preferences, budget, and emotional state, and then order food on the spot.

[0449] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0450] In this invention, the server includes: means for a user to input personal information and emotional state; means for transmitting the user's input information and emotional state to the server; means for acquiring product data from each store; means for generating recommended recipes based on the acquired product data and the user's information and emotional state; means for generating an optimal ingredient list taking into account the recommended recipe and the user's budget; means for displaying the optimal ingredient list and recommended recipe to the user; and means for the user to order food based on the displayed ingredient list and recommended recipe. This enables consumers to efficiently select optimal ingredients and recipes that suit their health condition, preferences, budget, and emotional state, and easily order food on the spot.

[0451] "Means for users to input personal information and emotional state" refers to a device or interface that allows a user to input personal information such as their health status, preferences, budget, emotional state, etc.

[0452] "Means for transmitting the information and emotional state input by the user to the server" refers to a communication function for transmitting the information and emotional state input by the user to the server via the Internet or the like.

[0453] "Means of obtaining product data from each store" refers to technology for obtaining information on the day's special sales and recommended products through the APIs of supermarkets and stores.

[0454] "Means for generating recommended recipes based on the acquired product data and the user's information and emotional state" refers to an algorithm or program that generates the optimal recipe for the user based on the product data acquired by the server and the user's input information.

[0455] "Means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget" refers to an algorithm or program that generates an optimal ingredient list that is efficient and fits within the budget based on the generated recommended recipe and the user's budget.

[0456] The term "means for displaying the optimal ingredient list and recommended recipes to the user" refers to an interface for displaying the generated ingredient list and recipes on the user's device.

[0457] "A means for the user to order food based on the displayed ingredient list and recommended recipe" refers to a function that allows the user to order the suggested food as is based on the displayed information.

[0458] The purpose of this invention is to provide a food delivery system that allows users to manage their healthy eating habits. This system suggests optimal ingredients and recipes based on the user's health condition, preferences, budget, and emotional state, and allows the user to order food directly.

[0459] Hardware and Software Use

[0460] The system is implemented using the following hardware and software:

[0461] Smartphone: Used by users to enter information, see suggested recipes and ingredient lists, and order food.

[0462] Cloud server: Stores user input data and combines it with store data to generate optimal recipes and ingredient lists.

[0463] Network: An internet connection to send and receive data between your device and the cloud server.

[0464] Store API: An interface for obtaining the latest product data for each store.

[0465] Emotion analysis engine: Analyzes the user's voice and facial expression data to recognize their emotional state.

[0466] Data processing and calculation

[0467] The server processes data and performs calculations in the following steps.

[0468] 1. Input and transmission of user information: The user uses a smartphone to input information about their health condition, preferences, budget, and emotional state. The input information is then transmitted to the server via the network.

[0469] 2. Product data acquisition: The server uses each store's API to acquire the latest product data, including the price and availability of ingredients.

[0470] 3. Recipe generation: The server generates the optimal recipe for the user based on the acquired product data and the user's input information. The recipe generation algorithm takes into account not only the user's health condition and preferences, but also their emotional state. For example, if the user is "tired," it will suggest an easy recipe, and if the user is "happy," it will suggest a special dish.

[0471] 4. Generate an ingredient list: The optimal ingredient list is generated based on the generated recipe and budget. This ingredient list is adjusted to fit within the budget.

[0472] 5. Displaying and ordering data: The server displays the generated recipe and ingredient list on the user's smartphone. The user can then order food on the spot based on the displayed information.

[0473] Specific example explanation

[0474] As a specific example of operation, a user inputs their health condition (diabetes), budget (2,000 yen), preferences (likes chicken), allergies (milk), and emotional state (tired). The input data is sent from the smartphone device to the server, which then obtains data such as "chicken thigh sale (200 yen / 100g)," "broccoli (150 yen / stalk)," and "mushrooms (100 yen / 200g)" via the supermarket API. The emotion analysis engine analyzes the user's emotion of "tired" and suggests easy-to-make recipes such as "stir-fried chicken thigh and broccoli" and "mushroom soup."

[0475] Examples of prompts to input to a generative AI model include:

[0476] "Suggest the best recipes for a diabetic user who has a budget of 2000 yen, loves chicken, is allergic to milk, and is tired. Prioritize dishes that are as easy to make as possible, and use data from a super API to provide recipes that fit within that budget."

[0477] As described above, the present invention provides optimal ingredients and recipes according to the individual needs of users, and realizes an environment in which food can be easily ordered on the spot.

[0478] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0479] Step 1:

[0480] Enter user information

[0481] Users use their smartphones to input their health status, budget, preferences, allergies, and emotional state into the application, which also provides a function to automatically analyze their emotional state using voice and facial expression data.

[0482] Input: Health condition (e.g., diabetes), budget (e.g., 2,000 yen), preferences (e.g., chicken), allergies (e.g., milk allergy), emotional state (e.g., tired)

[0483] Output: User input data is temporarily stored in the terminal.

[0484] What it does: The user inputs information into a smartphone app, which uses the camera and microphone to analyze voice and facial expressions as needed.

[0485] Step 2:

[0486] User information sent to server

[0487] The terminal checks the entered user information for formatting errors and sends it to the server, where it is stored.

[0488] Input: Data entered by the user

[0489] Output: The checked user data is sent to the server and stored.

[0490] Specific operation: The terminal checks the format of the user-entered data and sends the data to the server via the network.

[0491] Step 3:

[0492] Get product data

[0493] The server uses each store's API to retrieve the latest product data, including product name, price, and stock status.

[0494] Input: API request for each store

[0495] Output: Retrieved product data

[0496] Specific operation: The server sends a request to each store's API to obtain the day's special sale information and recommended product data.

[0497] Step 4:

[0498] Generate recommended recipes

[0499] The server generates recommended recipes based on the acquired product data, user information, and emotional state. This is handled by a recipe generation algorithm.

[0500] Input: User data, store product data

[0501] Output: Recommended recipe

[0502] Specific operation: The recipe generation algorithm generates and selects multiple recipes taking into account the user's health condition, preferences, and emotional state.

[0503] Step 5:

[0504] Generate an ingredient list

[0505] The server generates an optimal ingredient list taking into account the recommended recipe and the user's budget, thereby listing ingredients that can be purchased within the budget.

[0506] Input: Recommended recipe, user budget

[0507] Output: Optimal ingredients list

[0508] Specific operation: The server generates and lists the optimal ingredients list that fits within the budget based on the recommended recipe and store data.

[0509] Step 6:

[0510] View recommended recipes and ingredient lists

[0511] The server sends the generated recommended recipes and optimal ingredient lists to the user's smartphone and displays them, allowing the user to check the recommended recipes.

[0512] Input: Recommended recipes, best ingredient lists

[0513] Output: Display on the user's terminal

[0514] Specific behavior: Data is sent from the server to the user's device and the app displays it.

[0515] Step 7:

[0516] Food ordering

[0517] The user orders food based on the displayed ingredient list and recommended recipes, and the order information is sent to the food delivery service via the server.

[0518] Input: Ingredient list, order request

[0519] Output: Order confirmation and shipping arrangements

[0520] What happens: The user places an order for the ingredients they selected, and the order information is sent to the food delivery service via the server, which then arranges for delivery and confirms the order.

[0521] Through these steps, users will be presented with the best ingredients and recipes that suit their health condition, preferences, budget, and emotional state, and can easily order food on the spot.

[0522] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0523] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0524] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0525] [Second embodiment]

[0526] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0527] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0528] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0529] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0530] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0531] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0532] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0533] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0534] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0535] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0536] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0537] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0538] The system of the present invention aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system is used by users using smartphones or tablet devices and operates in the following manner.

[0539] Enter user information

[0540] 1. Users

[0541] Open the smartphone app and enter your preferences, health status, and budget.

[0542] Example: A user enters information such as "diabetes," "budget 2000 yen," "likes chicken," and "milk allergy."

[0543] 2. Terminal

[0544] Check the information entered to ensure it is formatted correctly.

[0545] After confirmation, it is sent to the server.

[0546] Supermarket data acquisition

[0547] 1. Server

[0548] Send a request to the supermarket's API to get the recommended products for the day.

[0549] Example: Obtain data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[0550] Generate recommended recipes

[0551] 1. Server

[0552] Recommended recipes are generated based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets.

[0553] Based on the user's information, the recipe generation algorithm selects "stir-fried chicken thighs and broccoli" and "mushroom soup" as candidates.

[0554] Generate optimal menu within budget

[0555] 1. Server

[0556] From the recommended recipes, a menu that can be achieved within the user's budget is selected.

[0557] Generate a list of ingredients you need, compare it with supermarket prices, and adjust it to fit within your budget.

[0558] Example: Generates a list containing 500g of chicken thighs, 1 stalk of broccoli, and 200g of mushrooms.

[0559] Viewing Proposals

[0560] 1. Server

[0561] The optimal menu and ingredient list will be sent to your device.

[0562] 2. Terminal

[0563] The received data is displayed to the user.

[0564] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and also displays a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0565] Specific examples

[0566] Enter user information

[0567] The user enters the following information into the app:

[0568] Health Condition: Diabetes

[0569] Budget: 2000 yen

[0570] Favorite food: Chicken

[0571] Allergies: Milk

[0572] Supermarket data acquisition

[0573] The server accesses the supermarket's API and retrieves the following data:

[0574] Chicken thigh special sale (200 yen / 100g)

[0575] Broccoli (150 yen / piece)

[0576] Mushrooms (100 yen / 200g)

[0577] Generate recommended recipes

[0578] The server generates a recipe using the following information:

[0579] User information

[0580] Supermarket recommended product data

[0581] The recipe generation algorithm suggested "stir-fried chicken thighs and broccoli" and "mushroom soup."

[0582] Generate optimal menu within budget

[0583] The server generates a list of ingredients that fit within the budget (2000 yen):

[0584] Chicken thigh 500g (1000 yen)

[0585] 1 stalk of broccoli (150 yen)

[0586] 200g mushrooms (100 yen)

[0587] Viewing Proposals

[0588] The server sends the optimal menu and ingredient list to the terminal.

[0589] The device displays the following information to the user:

[0590] Recommended menu items: Stir-fried chicken thigh and broccoli, mushroom soup

[0591] Ingredients: 500g chicken thigh, 1 stalk of broccoli, 200g mushrooms

[0592] The above is a specific embodiment for carrying out the invention. This system allows users to efficiently select appropriate ingredients, purchase them within their budget, and easily lead a healthy diet.

[0593] The processing flow will be explained below.

[0594] Step 1:

[0595] The user launches the smartphone app and enters personal information such as health status, preferences, budget, etc. For example, the user enters information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk."

[0596] Step 2:

[0597] The terminal checks the entered information to make sure that the data format is correct, and once that is confirmed, sends the data to the server.

[0598] Step 3:

[0599] The server sends a request to the supermarket's API. For example, the server sends a "GET" request to get data about the day's specials and fresh items.

[0600] Step 4:

[0601] The server analyzes and structures the product data it obtains. For example, it organizes information such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[0602] Step 5:

[0603] The server generates recommended recipes based on the user's input information and the acquired product data. For example, the server generates recipes such as "Stir-fried chicken thighs and broccoli" and "Mushroom soup" that meet the conditions of "diabetes," "chicken," and "broccoli."

[0604] Step 6:

[0605] The server creates a specific list of ingredients based on the recommended recipe and the user's budget. For example, the server creates a list such as "500g of chicken thighs," "1 stalk of broccoli," and "200g of mushrooms."

[0606] Step 7:

[0607] The server sends the optimal menu and ingredient list to the terminal. The server sends the recommended recipe and the corresponding ingredient list in data format to the terminal.

[0608] Step 8:

[0609] The device analyzes the received data and displays it to the user. For example, the device might display "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0610] Step 9:

[0611] The user can refer to the app while shopping at the supermarket and purchase products while checking the recommended ingredients list.

[0612] The above is a detailed flow of the processing steps. This system allows users to shop efficiently and healthily.

[0613] Example 1

[0614] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0615] In today's busy lifestyles, it is extremely difficult for users to maintain a healthy diet while shopping efficiently within a budget. In particular, selecting appropriate recipes based on health status and food preferences and purchasing ingredients within a budget requires a lot of time and effort. Conventional methods make these processes cumbersome, making it difficult to create an optimal shopping list.

[0616] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0617] In this invention, the server includes: a means for a user to input personal information; a means for transmitting the user-inputted information to the server; a means for acquiring product data from each store; a means for generating a recommended recipe based on the acquired product data and the user information; a means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; a means for displaying the optimal ingredient list and recommended recipe to the user; a means for using a generative AI model when generating the recommended recipe based on the acquired product data; and a means for using a budget optimization algorithm when generating the optimal ingredient list. This enables users to efficiently obtain optimal recipes and necessary ingredient lists based on their health condition, preferences, and budget.

[0618] A "user" refers to an individual who inputs their own information (health status, preferences, budget, allergies) into the system and receives recipe and ingredient recommendations.

[0619] "Personal Information" refers to information provided by the User, such as health status, preferences, budget, allergies, etc.

[0620] The term "server" refers to a computer system that receives information sent by users, acquires product data from each store, and generates recommended recipes and optimal ingredient lists.

[0621] "Terminal" refers to an electronic device such as a smartphone or tablet on which a user inputs personal information and communicates with a server.

[0622] "Store" refers to a sales facility with which the server communicates to obtain product data.

[0623] "Product data" refers to data such as prices, inventory, and special sale information for ingredients and products offered by each store.

[0624] "Recommended recipe" refers to cooking instructions generated based on the user's personal information and acquired product data.

[0625] "Ingredient list" refers to a list containing the necessary ingredients, their quantities, and their prices, generated taking into account the recommended recipe and the user's budget.

[0626] A "generative AI model" refers to an artificial intelligence algorithm that generates recommended recipes using a user's personal information and product data as input.

[0627] "Budget optimization algorithm" refers to a computational technique used to generate an optimal ingredient list within a user's budget constraints.

[0628] The system of the present invention aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system is used by users using smartphones or tablet devices and operates in the following manner.

[0629] Enter user information

[0630] 1. Users

[0631] Users launch the app on their smartphone or tablet and enter their health status, food preferences, budget, and allergy information, such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk."

[0632] 2. Terminal

[0633] The app on the device checks whether the data entered is in the correct format. If there are no errors, it sends the information to the server. The device uses common hardware such as a smartphone or tablet.

[0634] Supermarket data acquisition

[0635] 1. Server

[0636] The server sends a request to the supermarket's API to retrieve the recommended product data for that day. For example, it accesses the supermarket API endpoint (e.g., https: / / api.supermarket.com / products) and retrieves data such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[0637] Generate recommended recipes

[0638] 1. Server

[0639] The server generates recommended recipes based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets. A generative AI model is used for this process. For example, the following prompt is input to the generative AI model: "Generate recipes using chicken thighs for diabetics."

[0640] Generate optimal menu within budget

[0641] 1. Server

[0642] From the recommended recipes, a menu that can be achieved within the user's budget is selected and a list of necessary ingredients is generated. A budget optimization algorithm is used for this. Specifically, the server combines the generated recommended recipe with supermarket product data to create an ingredient list that fits within the budget, such as 500g of chicken thighs (1,000 yen), one stalk of broccoli (150 yen), and 200g of mushrooms (100 yen).

[0643] Viewing Proposals

[0644] 1. Server

[0645] The optimal menu and ingredient list are sent to the device, for example in JSON format.

[0646] 2. Terminal

[0647] The device analyzes the data received from the server and displays it to the user. The app screen displays, "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup. Required ingredients: 500g chicken thighs (1,000 yen), 1 stalk of broccoli (150 yen), 200g mushrooms (100 yen)."

[0648] As a concrete example, a user inputs the following information: health condition "diabetes," budget "2,000 yen," favorite ingredient "chicken," and allergy "milk." The server accesses a supermarket API to obtain data on "chicken thigh sale (200 yen / 100g)," "broccoli (150 yen / stalk)," and "mushrooms (100 yen / 200g)," and then uses a generative AI model to suggest "stir-fried chicken thighs and broccoli" and "mushroom soup." The server generates an ingredient list (500g of chicken thighs, one stalk of broccoli, and 200g of mushrooms) that fits within the budget and sends it to the device, which displays it to the user. In this way, users can smoothly select ingredients and menu items that meet their criteria and shop efficiently within their budget.

[0649] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0650] Step 1:

[0651] The user enters personal information

[0652] Users launch the app on their smartphone or tablet and enter their health status, food preferences, budget, and allergy information.

[0653] Input: health condition, preferences, budget, allergy information

[0654] Output: Data entered into the terminal

[0655] Specific behavior: The user enters information such as "Diabetes," "Budget 2000 yen," "I like chicken," and "I'm allergic to milk" into form fields using the keyboard.

[0656] Step 2:

[0657] The device checks the input data and sends it to the server

[0658] The app on the device checks whether there are any errors in the format of the data entered.

[0659] Input: Data entered by the user

[0660] Output: Data to send to the server

[0661] Specific behavior: The terminal validates the input fields, and if there are any errors, displays an error message and prompts the user to correct them. If there are no errors, the data is sent to the server.

[0662] Step 3:

[0663] The server retrieves product data from the supermarket API

[0664] The server sends a request to the supermarket's API to retrieve the recommended products for that day.

[0665] Input: Request from server

[0666] Output: Supermarket product data

[0667] Specific operation: The server sends a request to the Super API endpoint (e.g., https: / / api.supermarket.com / products) and receives data such as "Chicken thighs on sale for 200 yen / 100g" and "Fresh broccoli for 150 yen / stalk" as a response.

[0668] Step 4:

[0669] The server generates recommended recipes based on user information and product data.

[0670] The server generates recommended recipes based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets, using a generative AI model.

[0671] Input: User's personal information, supermarket product data

[0672] Output: Recommended recipe

[0673] Specific operation: The server inputs the prompt "Recipes using chicken thighs for diabetics" into the recipe generation AI model, and the model generates recommended recipes such as "Stir-fried chicken thighs and broccoli" and "Mushroom soup."

[0674] Step 5:

[0675] The server will generate the best grocery list that fits within your budget.

[0676] From the recommended recipes, we select a menu that is feasible within the user's budget and generate a list of ingredients, using a budget optimization algorithm.

[0677] Input: Recommended recipes, supermarket product data, user budget

[0678] Output: Optimal ingredients list

[0679] Specific operation: The server combines the generated recommended recipe with supermarket product data to create a list of ingredients that fit within the budget, such as 500g of chicken thighs (1,000 yen), one stalk of broccoli (150 yen), and 200g of mushrooms (100 yen).

[0680] Step 6:

[0681] The server sends the optimal menu and ingredient list to the device.

[0682] The optimal menu and ingredient list will be sent to your device.

[0683] Input: Optimal menu and ingredient list

[0684] Output: Data sent to the terminal

[0685] Specific operation: The server sends the ingredient list and recommended menu items in JSON format to the device.

[0686] Step 7:

[0687] The device displays the optimal menu and ingredient list to the user.

[0688] The received data is displayed to the user.

[0689] Input: Data received from the server

[0690] Output: Information displayed to the user

[0691] Specific operation: The device analyzes the data received from the server and displays on the app screen, "Today's recommended menu is stir-fried chicken thighs and broccoli, and mushroom soup. List of ingredients needed: 500g chicken thighs (1,000 yen), 1 stalk of broccoli (150 yen), 200g mushrooms (100 yen)."

[0692] (Application example 1)

[0693] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0694] Conventional healthy eating support systems can suggest recipes based on the user's preferences and health status, and generate ingredient lists within a budget. However, it is difficult for users to receive real-time advice while shopping in the store. Furthermore, input interfaces are limited to smartphones, which makes them less convenient for users. Therefore, there is a demand for systems with more user-friendly and intuitive interfaces.

[0695] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0696] In this invention, the server includes: a means for a user to input personal information; a means for transmitting the user-input information to the server; a means for acquiring product data from each store; a means for generating a recommended recipe based on the acquired product data and the user information; a means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; a means for displaying the optimal ingredient list and recommended recipe to the user; and a means for displaying the optimal ingredient list and recommended recipe to the user using smart glasses and collecting information via voice input. This enables users to efficiently shop in physical stores while referring to the recommended recipe and ingredient list that reflect their health condition, preferences, and budget in real time.

[0697] Definition of Terms

[0698] The "means by which users input personal information" refers to an interface through which users input information such as their preferences, health status, budget, etc. Examples of such interfaces include smart glasses, smartphones, and tablet devices.

[0699] The "means for transmitting the information input by the user to the server" refers to an interface and communication module for transmitting the information input by the user to the server via a network, including Wi-Fi and data communication modules.

[0700] "Means for obtaining product data from each store" refers to an interface for obtaining data on the day's specials and recommended products from each store, such as a supermarket. Specifically, the store's API or beacon technology is used.

[0701] The "means for generating recommended recipes based on the acquired product data and user information" refers to algorithms and software for automatically generating optimal recipes based on product data acquired from stores and information such as the user's preferences and health condition.

[0702] The "means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget" refers to an algorithm and software for generating an ingredient list that can be purchased within the user's budget based on the recommended recipe.

[0703] The "means for displaying the optimal ingredient list and recommended recipes to the user" refers to a display device for visually presenting the generated optimal ingredient list and recommended recipes to the user, including the display of smart glasses or a smartphone.

[0704] The "means for displaying the optimal ingredient list and recommended recipes to the user using smart glasses and collecting information through voice input" refers to an interface and voice recognition technology for displaying an ingredient list and recipes on the display of smart glasses and accepting voice input from the user.

[0705] MODE FOR CARRYING OUT THE INVENTION

[0706] The present invention provides a support system that helps users to shop efficiently within their budget while maintaining a healthy diet. Specific embodiments of the system will be described in detail below.

[0707] 1. Enter user information

[0708] Users use input interfaces such as smart glasses or smartphones to input personal information such as their health status, preferences, and budget. A voice input interface is also available, allowing users to input information intuitively. This allows users to easily reflect their health status and preferences in the system.

[0709] 2. User Information Submission

[0710] The input information is sent to the server via the smart glasses or smartphone's communication function, using Wi-Fi or a data communication module. Based on the received information, the server starts the process of acquiring data from each store and generating recipes.

[0711] 3. Obtaining data from each store

[0712] The server uses APIs to retrieve daily specials and recommended product data from supermarkets, grocery stores, and other retailers, which can use beacon technology or the store's Wi-Fi. This data is updated in real time, providing users with the latest options.

[0713] 4. Generating recommended recipes

[0714] The server generates recommended recipes based on the acquired product data and the user's personal information. The recipes are generated using an algorithm that takes into account the user's health condition and preferences. For example, a user with diabetes may be suggested low-carb menus, and a recipe using chicken on sale may be generated.

[0715] 5. Generating the optimal ingredient list

[0716] Based on the generated recommended recipes, an optimal list of ingredients that fits within the user's budget is generated. This list is compared with the acquired product data to appropriately select the necessary ingredients. This allows the user to efficiently purchase healthy ingredients within their budget.

[0717] 6. Display of proposals

[0718] The optimal ingredient list and recommended recipes are displayed on the screen of smart glasses or a smartphone. In the case of smart glasses, the ingredient list and recipe are displayed on the screen, allowing users to check them in real time at the time of purchase. Voice input is also possible, further improving convenience.

[0719] Specific examples

[0720] For example, a user puts on smart glasses, enters a supermarket, and speaks the following information:

[0721] Health Condition: Diabetes

[0722] Budget: 2000 yen

[0723] Favorite food: Chicken

[0724] Allergies: Milk

[0725] The server obtains data such as "Chicken thighs on sale for 200 yen / 100g" and "Fresh broccoli for 150 yen / stalk" via the store's API, and generates recipes based on the user's information. The generated recipes are "Stir-fried chicken thighs and broccoli" and "Mushroom soup," and the list of ingredients needed (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms) is displayed on the smart glasses' display.

[0726] Finally, the user can give instructions to the system using the following prompt sentences:

[0727] Create healthy recipes based on your input:

[0728] Health Condition: Diabetes

[0729] Budget: 2000 yen

[0730] Favorite food: Chicken

[0731] Allergies: Milk

[0732] Available ingredients list:

[0733] Chicken thigh special sale 200 yen / 100g

[0734] Broccoli 150 yen / piece

[0735] Mushrooms 100 yen / 200g

[0736] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0737] Program processing steps

[0738] Processing Steps

[0739] Step 1:

[0740] (Processing content)

[0741] The user enters personal information.

[0742] (input)

[0743] Users use smart glasses or smartphones to input personal information such as their health status, preferences, and budget.

[0744] (Data processing, data calculation and output)

[0745] The device collects information using voice recognition and touch input, checks the format for errors, and then sends the information to the server after verification.

[0746] Step 2:

[0747] (Processing content)

[0748] The information input by the user is sent to the server.

[0749] (input)

[0750] The smart glasses or smartphone receives the entered personal information.

[0751] (Data processing, data calculation and output)

[0752] The device's communication module (Wi-Fi or data communication) is used to send the user's input information to the server, which then stores the received information in a database.

[0753] Step 3:

[0754] (Processing content)

[0755] Obtain product data from each store.

[0756] (input)

[0757] Personal information sent by the user to the server.

[0758] (Data processing, data calculation and output)

[0759] The server uses each store's API to obtain the recommended product data for that day. The obtained data includes information such as product name, price, and category, and is stored in a database.

[0760] Step 4:

[0761] (Processing content)

[0762] A recommended recipe is generated based on the acquired product data and the user information.

[0763] (input)

[0764] Product data and user personal information obtained by the server.

[0765] (Data processing, data calculation and output)

[0766] The server uses the generative AI model to generate recommended recipes based on the user's health status and preferences. For example, it might suggest low-carb options to a user with diabetes. The generated recipe information is then passed on to the next processing step.

[0767] Step 5:

[0768] (Processing content)

[0769] An optimal ingredient list is generated taking into consideration the recommended recipe and the user's budget.

[0770] (input)

[0771] Suggested recipes and user budget information.

[0772] (Data processing, data calculation and output)

[0773] The server compares the recommended recipe with the user's budget and generates a list of ingredients that can be purchased within the budget. This calculation also uses price information from the product data to generate the final ingredient list.

[0774] Step 6:

[0775] (Processing content)

[0776] The optimum ingredient list and recommended recipes are displayed to the user.

[0777] (input)

[0778] Best ingredients list and recommended recipes.

[0779] (Data processing, data calculation and output)

[0780] The server converts the generated optimal ingredient list and recommended recipes into a format that can be displayed on the screen of smart glasses or a smartphone, and sends it to the device, which then visually presents the received information to the user.

[0781] Step 7:

[0782] (Processing content)

[0783] The optimal ingredient list and recommended recipes are displayed to the user using smart glasses, and information is collected through voice input.

[0784] (input)

[0785] The best ingredient list and recipe suggestions displayed on smart glasses.

[0786] (Data processing, data calculation and output)

[0787] The user puts on the smart glasses and checks the information displayed on the screen. The user can then give additional instructions or modify the information by voice input. The voice instructions are recognized by the device and, if necessary, retransmitted to the server for processing updates.

[0788] As an example of this process, a user puts on a pair of smart glasses and instructs the system using the following prompt sentence:

[0789] Create healthy recipes based on your input:

[0790] Health Condition: Diabetes

[0791] Budget: 2000 yen

[0792] Favorite food: Chicken

[0793] Allergies: Milk

[0794] Available ingredients list:

[0795] Chicken thigh special sale 200 yen / 100g

[0796] Broccoli 150 yen / piece

[0797] Mushrooms 100 yen / 200g

[0798] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0799] The present invention relates to a system that aims to support users in shopping efficiently within their budget while maintaining a healthy diet, and also suggests optimal recipes taking into account the user's emotional state. This system is used by users using smartphones or tablet devices, and operates in the following manner.

[0800] Enter user information

[0801] 1. Users

[0802] Users open the smartphone app and enter personal information such as their health status, preferences, budget, etc. The app also uses a video camera and microphone to record voice and facial expression data to ascertain the user's emotional state.

[0803] Example: The user can enter information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "milk allergy" along with the emotion they are currently feeling (for example, "tired" or "happy"), or the app can automatically analyze their emotions.

[0804] 2. Terminal

[0805] The entered information and recorded voice and facial expression data are checked to ensure there are no formatting errors. After confirmation, this data is sent to the server.

[0806] Supermarket data acquisition

[0807] 1. Server

[0808] Send a request to the supermarket's API to get the recommended products for the day.

[0809] Example: Obtain data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[0810] Generate recommended recipes

[0811] 1. Server

[0812] Recommended recipes are generated based on the user's personal information (preferences, health status, budget), product data obtained from supermarkets, and the user's emotional state recognized by an emotion engine.

[0813] The recipe generation algorithm selects multiple recipes, such as "stir-fried chicken thighs and broccoli" and "mushroom soup," based on the user's information.

[0814] If the user is tired, the emotion engine will recommend easy recipes or recipes containing ingredients that will lift their spirits, and if the user is happy, it will suggest special dishes or new recipes.

[0815] Generate optimal menu within budget

[0816] 1. Server

[0817] From the recommended recipes, a menu that can be achieved within the user's budget is selected.

[0818] Generate a list of ingredients you need, compare it with supermarket prices, and adjust it to fit within your budget.

[0819] Example: A list might be generated that includes 500g of chicken thighs, 1 stalk of broccoli, and 200g of mushrooms.

[0820] Viewing Proposals

[0821] 1. Server

[0822] The optimal menu and ingredient list will be sent to your device.

[0823] 2. Terminal

[0824] The received data is displayed to the user.

[0825] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and also displays a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0826] Specific examples

[0827] Enter user information

[0828] The user enters the following information into the app:

[0829] Health Condition: Diabetes

[0830] Budget: 2000 yen

[0831] Favorite food: Chicken

[0832] Allergies: Milk

[0833] Emotional state: Tired

[0834] Supermarket data acquisition

[0835] The server accesses the supermarket's API and retrieves the following data:

[0836] Chicken thigh special sale (200 yen / 100g)

[0837] Broccoli (150 yen / piece)

[0838] Mushrooms (100 yen / 200g)

[0839] Generate recommended recipes

[0840] The server generates a recipe using the following information:

[0841] User information

[0842] Supermarket recommended product data

[0843] Emotional state by emotion engine

[0844] The recipe generation algorithm suggests "stir-fried chicken thighs and broccoli" and "mushroom soup," selecting easy-to-make recipes for tired users.

[0845] Generate optimal menu within budget

[0846] The server generates a list of ingredients that fit within the budget (2000 yen):

[0847] Chicken thigh 500g (1000 yen)

[0848] 1 stalk of broccoli (150 yen)

[0849] 200g mushrooms (100 yen)

[0850] Viewing Proposals

[0851] The server sends the optimal menu and ingredient list to the terminal.

[0852] The device displays the following information to the user:

[0853] Recommended menu items: Stir-fried chicken thigh and broccoli, mushroom soup

[0854] Ingredients: 500g chicken thigh, 1 stalk of broccoli, 200g mushrooms

[0855] The above is a specific embodiment for carrying out the invention. This system allows users to select the optimal ingredients for their health and emotional state, purchase them within their budget, and easily lead a healthy and mood-appropriate diet.

[0856] The processing flow will be explained below.

[0857] Step 1:

[0858] The user launches the smartphone app and inputs personal information such as health status, preferences, and budget. In addition, a video camera and microphone are used to record voice and facial expression data. For example, the user inputs information such as "diabetes," "budget of 2,000 yen," "likes chicken," "allergy to milk," and "tired."

[0859] Step 2:

[0860] The device checks the entered information and recorded voice and facial expression data to ensure there are no formatting errors. Once verified, this data is sent to the server.

[0861] Step 3:

[0862] The server sends a request to the supermarket's API to retrieve data on the day's specials and fresh products. For example, the server retrieves data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[0863] Step 4:

[0864] The server analyzes and structures the product data it obtains. For example, it organizes information such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[0865] Step 5:

[0866] The server uses an emotion engine to recognize the user's emotional state, for example, recognizing the emotion "tired" from recorded voice and video facial expressions.

[0867] Step 6:

[0868] The server generates recommended recipes based on the user's personal information, health status, product data obtained from supermarkets, and the user's recognized emotional state. Based on the user's information, the recipe generation algorithm selects easy-to-make recipes for a tired user, such as "stir-fried chicken thighs and broccoli" or "mushroom soup."

[0869] Step 7:

[0870] The server creates a specific ingredient list based on the recommended recipe and the user's budget. For example, it creates a list such as "500g chicken thighs," "1 stalk of broccoli," and "200g mushrooms."

[0871] Step 8:

[0872] The server sends the optimal menu and ingredient list to the terminal. The recommended recipe and the corresponding ingredient list are sent to the terminal in data format.

[0873] Step 9:

[0874] The device analyzes the received data and displays it to the user. The displayed content is "Today's recommended menu is stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0875] Step 10:

[0876] The user can refer to the app while shopping at the supermarket and purchase products while checking the recommended ingredients list.

[0877] This is the detailed flow of the processing steps. This system enables users to shop efficiently and healthily, and also suggests recipes that suit their emotional state, allowing them to lead a more fulfilling diet.

[0878] Example 2

[0879] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0880] Conventional shopping support systems suggest recipes based on the user's health condition, preferences, and budget, but they are unable to consider the user's emotional state. As a result, recipe suggestions that match the user's mood at the time are insufficient, which can lead to reduced user satisfaction. Additionally, the personal information entered by the user may be inaccurate, resulting in reduced suggestion accuracy.

[0881] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting personal information of the user, means for transmitting the information input by the user to the server, means for acquiring product data from each store, means for generating recommended recipes based on the acquired product data and the user information, means for generating an optimal ingredient list taking into account the recommended recipes and the user's budget, means for displaying the optimal ingredient list and recommended recipes to the user, means for recording voice data and facial expression data to analyze the user's emotional state, and means for adjusting the recommended recipes taking into account the emotional state. This enables highly accurate recipe suggestions that also take the user's emotional state into account.

[0882] A "user" is an individual or group that uses the system and inputs information such as health status, preferences, budget, and emotional state.

[0883] "Personal Information" is information entered by a user about a user's particular circumstances and preferences, such as health status, preferences, budget, emotional state, and allergy information.

[0884] The "server" is a computer system that receives information sent by users, acquires data from each store, and generates recommended recipes and ingredient lists.

[0885] "Stores" refer to retail stores such as supermarkets and food retailers, and are entities that provide product data through APIs.

[0886] "Product data" refers to information such as product name, price, and stock status obtained from the store.

[0887] A "recommended recipe" is a recipe for a dish that is suggested to a user based on the user's personal information and product data obtained from a store.

[0888] The "ingredient list" is a list of ingredients and their amounts required to make a recommended recipe.

[0889] "Voice data" is information input by voice from a user, and is data for analyzing the emotional state of the user.

[0890] "Facial expression data" is information based on facial expressions input by the user, and is data for analyzing the emotional state of the user.

[0891] An "emotional state" is a user's psychological or emotional state, including states such as tiredness, joy, anxiety, etc.

[0892] The "emotion engine" is an analysis system that analyzes the user's emotional state from their voice data and facial expression data, and adjusts recommended recipes based on that information.

[0893] "API" stands for Application Programming Interface, and is the interface used by the server to obtain data from each store.

[0894] The present invention is a system that aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system proposes optimal recipes taking into account the user's emotional state and is configured so that the user can use it on a smartphone or tablet device. Details for specifically implementing the present invention are described below.

[0895] Enter user information

[0896] A user opens a smartphone app and inputs personal information such as their health condition, preferences, budget, and emotional state. At this time, a video camera and microphone are used to record voice and facial expression data. An emotion engine is then used to analyze the user's emotional state from this data.

[0897] Example: A user enters information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk," and the app automatically analyzes their current emotions (e.g., "tired").

[0898] Data transmission and check

[0899] The device checks the input information and recorded voice and facial expression data to ensure there are no format errors, and then sends this data to the server.

[0900] Get product data

[0901] The server sends a request to the supermarket's API endpoint to retrieve the recommended product data for that day, such as "Chicken thigh special sale 200 yen / 100g" or "Fresh broccoli 150 yen / stalk."

[0902] Generate recommended recipes

[0903] The server references the user's personal information (preferences, health status, budget) and compares the acquired product data. Furthermore, it uses an emotion engine to generate recommended recipes that take into account the user's emotional state. Specifically, if the user is tired, it recommends easy-to-make recipes, and if the user is happy, it suggests special dishes or new recipes.

[0904] Example: A recipe generation algorithm suggests the following recipes: "Stir-fried chicken thighs and broccoli" and "Mushroom soup."

[0905] Generate optimal menu within budget

[0906] The server selects from the recommended recipes a menu that is feasible within the user's budget, generates a list of ingredients, and compares it with supermarket price information to ensure it fits within the budget.

[0907] Example: A list such as 500g of chicken thigh (1000 yen), 1 stalk of broccoli (150 yen), and 200g of mushrooms (100 yen) is generated.

[0908] Viewing Proposals

[0909] The server sends the optimal menu and ingredient list to the terminal, which displays the received data to the user.

[0910] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and provides a specific list of ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[0911] Prompt Sentence Examples

[0912] "When a user enters personal information into the app, such as 'diabetes,' 'budget of 2,000 yen,' 'likes chicken,' and 'milk allergy,' and records their emotional state as 'tired,' the server accesses the supermarket's API and obtains product data such as 'chicken thighs on sale for 200 yen / 100g' and 'fresh broccoli for 150 yen / stalk.' The server then generates recipes such as 'stir-fried chicken thighs and broccoli' or 'mushroom soup' based on the user's information and the obtained product data, recommends recipes that are easy to make taking into account the user's emotional state, and sends a list of ingredients that fit within the user's budget (500g chicken thighs, one stalk of broccoli, 200g mushrooms) to the device, which then displays it to the user."

[0913] This invention allows users to easily obtain optimal ingredients and recipes that suit their emotional and health conditions, and allows them to shop within their budget. The hardware used includes smartphones and tablet devices, and the software includes a supermarket API, an emotion engine, and a recipe generation algorithm.

[0914] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0915] Step 1: Enter your information

[0916] 1. The user launches the app on their smartphone and an input form is displayed.

[0917] 2. The user inputs their health condition (e.g., "diabetes"), preferences (e.g., "I like chicken"), budget (e.g., "2,000 yen"), and allergy information (e.g., "milk allergy"). They also input their emotional state (e.g., "I'm tired"), or the emotional data is automatically recorded using a video camera or microphone. Specific actions include showing facial expressions to the camera or speaking into the microphone, such as "I'm tired today."

[0918] Input: User's health status, preferences, budget, allergy information, emotional state

[0919] Output: Verified personal information data

[0920] Step 2: Submit and verify data

[0921] 1. The device checks the information entered and checks for formatting errors, for example displaying a warning if the budget field is blank.

[0922] 2. After confirmation, the terminal sends the user's input information and recorded data to the server. The transmission format generally uses the HTTPS protocol, and the data is encrypted.

[0923] Input: Verified personal data

[0924] Output: Data sent to the server

[0925] Step 3: Obtain supermarket data

[0926] 1. The server sends a request to the supermarket API, for example, "GET / api / v1 / products / today_specials".

[0927] 2. The server retrieves the recommended product data for that day and stores it in a database. The retrieved product data includes product name, price, and stock information.

[0928] Input: API request

[0929] Output: Retrieved product data

[0930] Step 4: Generate recommended recipes

[0931] 1. The server retrieves the user's personal information (health status, preferences, budget) from the database.

[0932] 2. Based on the product data acquired by the server, a recipe generation algorithm is used to generate recipe candidates. For example, recipes such as "Stir-fried chicken thighs and broccoli" or "Mushroom soup" are generated.

[0933] 3. The server uses an emotion engine to analyze the user's emotional state and adjust the recipe accordingly. For example, it might recommend easy recipes to a tired user.

[0934] Input: User information data, product data

[0935] Output: Recommended recipe

[0936] Step 5: Generate the optimal menu

[0937] 1. The server selects from the recommended recipes a recipe that is feasible within the user's budget.

[0938] 2. The server generates a list of ingredients needed and adjusts it based on price information. For example, a list might be generated that includes "500g of chicken thighs (1000 yen)," "1 stalk of broccoli (150 yen)," and "200g of mushrooms (100 yen)."

[0939] Input: Recommended recipes, product price information

[0940] Output: Budgeted ingredients list

[0941] Step 6: View the proposal

[0942] 1. The server sends the optimal menu and ingredient list to the device. The sending format is mainly JSON.

[0943] 2. The device displays the received data to the user. Specifically, the app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients.

[0944] Input: Optimal menu, ingredients list

[0945] Output: Information displayed to the user

[0946] Through these steps, users can easily obtain the optimal ingredients and recipes that suit their emotional and health states, and shop efficiently within their budget.

[0947] (Application example 2)

[0948] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0949] Today's consumers want the right ingredients and recipes based on their health status, budget, and preferences, but it is difficult to do so efficiently. Furthermore, because consumers' emotional state is an important factor in ingredient selection, recipe suggestions based on their emotional state are also necessary. In addition, a lack of systems that allow consumers to easily order optimal ingredients has been pointed out. To solve these issues, there is a need for a system that can recommend optimal ingredients and recipes based on a user's overall health status, preferences, budget, and emotional state, and then order food on the spot.

[0950] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0951] In this invention, the server includes: means for a user to input personal information and emotional state; means for transmitting the user's input information and emotional state to the server; means for acquiring product data from each store; means for generating recommended recipes based on the acquired product data and the user's information and emotional state; means for generating an optimal ingredient list taking into account the recommended recipe and the user's budget; means for displaying the optimal ingredient list and recommended recipe to the user; and means for the user to order food based on the displayed ingredient list and recommended recipe. This enables consumers to efficiently select optimal ingredients and recipes that suit their health condition, preferences, budget, and emotional state, and easily order food on the spot.

[0952] "Means for users to input personal information and emotional state" refers to a device or interface that allows a user to input personal information such as their health status, preferences, budget, emotional state, etc.

[0953] "Means for transmitting the information and emotional state input by the user to the server" refers to a communication function for transmitting the information and emotional state input by the user to the server via the Internet or the like.

[0954] "Means of obtaining product data from each store" refers to technology for obtaining information on the day's special sales and recommended products through the APIs of supermarkets and stores.

[0955] "Means for generating recommended recipes based on the acquired product data and the user's information and emotional state" refers to an algorithm or program that generates the optimal recipe for the user based on the product data acquired by the server and the user's input information.

[0956] "Means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget" refers to an algorithm or program that generates an optimal ingredient list that is efficient and fits within the budget based on the generated recommended recipe and the user's budget.

[0957] The term "means for displaying the optimal ingredient list and recommended recipes to the user" refers to an interface for displaying the generated ingredient list and recipes on the user's device.

[0958] "A means for the user to order food based on the displayed ingredient list and recommended recipe" refers to a function that allows the user to order the suggested food as is based on the displayed information.

[0959] The purpose of this invention is to provide a food delivery system that allows users to manage their healthy eating habits. This system suggests optimal ingredients and recipes based on the user's health condition, preferences, budget, and emotional state, and allows the user to order food directly.

[0960] Hardware and Software Use

[0961] The system is implemented using the following hardware and software:

[0962] Smartphone: Used by users to enter information, see suggested recipes and ingredient lists, and order food.

[0963] Cloud server: Stores user input data and combines it with store data to generate optimal recipes and ingredient lists.

[0964] Network: An internet connection to send and receive data between your device and the cloud server.

[0965] Store API: An interface for obtaining the latest product data for each store.

[0966] Emotion analysis engine: Analyzes the user's voice and facial expression data to recognize their emotional state.

[0967] Data processing and calculation

[0968] The server processes data and performs calculations in the following steps.

[0969] 1. Input and transmission of user information: The user uses a smartphone to input information about their health condition, preferences, budget, and emotional state. The input information is then transmitted to the server via the network.

[0970] 2. Product data acquisition: The server uses each store's API to acquire the latest product data, including the price and availability of ingredients.

[0971] 3. Recipe generation: The server generates the optimal recipe for the user based on the acquired product data and the user's input information. The recipe generation algorithm takes into account not only the user's health condition and preferences, but also their emotional state. For example, if the user is "tired," it will suggest an easy recipe, and if the user is "happy," it will suggest a special dish.

[0972] 4. Generate an ingredient list: The optimal ingredient list is generated based on the generated recipe and budget. This ingredient list is adjusted to fit within the budget.

[0973] 5. Displaying and ordering data: The server displays the generated recipe and ingredient list on the user's smartphone. The user can then order food on the spot based on the displayed information.

[0974] Specific example explanation

[0975] As a specific example of operation, a user inputs their health condition (diabetes), budget (2,000 yen), preferences (likes chicken), allergies (milk), and emotional state (tired). The input data is sent from the smartphone device to the server, which then obtains data such as "chicken thigh sale (200 yen / 100g)," "broccoli (150 yen / stalk)," and "mushrooms (100 yen / 200g)" via the supermarket API. The emotion analysis engine analyzes the user's emotion of "tired" and suggests easy-to-make recipes such as "stir-fried chicken thigh and broccoli" and "mushroom soup."

[0976] Examples of prompts to input to a generative AI model include:

[0977] "Suggest the best recipes for a diabetic user who has a budget of 2000 yen, loves chicken, is allergic to milk, and is tired. Prioritize dishes that are as easy to make as possible, and use data from a super API to provide recipes that fit within that budget."

[0978] As described above, the present invention provides optimal ingredients and recipes according to the individual needs of users, and realizes an environment in which food can be easily ordered on the spot.

[0979] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0980] Step 1:

[0981] Enter user information

[0982] Users use their smartphones to input their health status, budget, preferences, allergies, and emotional state into the application, which also provides a function to automatically analyze their emotional state using voice and facial expression data.

[0983] Input: Health condition (e.g., diabetes), budget (e.g., 2,000 yen), preferences (e.g., chicken), allergies (e.g., milk allergy), emotional state (e.g., tired)

[0984] Output: User input data is temporarily stored in the terminal.

[0985] What it does: The user inputs information into a smartphone app, which uses the camera and microphone to analyze voice and facial expressions as needed.

[0986] Step 2:

[0987] User information sent to server

[0988] The terminal checks the entered user information for formatting errors and sends it to the server, where it is stored.

[0989] Input: Data entered by the user

[0990] Output: The checked user data is sent to the server and stored.

[0991] Specific operation: The terminal checks the format of the user-entered data and sends the data to the server via the network.

[0992] Step 3:

[0993] Get product data

[0994] The server uses each store's API to retrieve the latest product data, including product name, price, and stock status.

[0995] Input: API request for each store

[0996] Output: Retrieved product data

[0997] Specific operation: The server sends a request to each store's API to obtain the day's special sale information and recommended product data.

[0998] Step 4:

[0999] Generate recommended recipes

[1000] The server generates recommended recipes based on the acquired product data, user information, and emotional state. This is handled by a recipe generation algorithm.

[1001] Input: User data, store product data

[1002] Output: Recommended recipe

[1003] Specific operation: The recipe generation algorithm generates and selects multiple recipes taking into account the user's health condition, preferences, and emotional state.

[1004] Step 5:

[1005] Generate an ingredient list

[1006] The server generates an optimal ingredient list taking into account the recommended recipe and the user's budget, thereby listing ingredients that can be purchased within the budget.

[1007] Input: Recommended recipe, user budget

[1008] Output: Optimal ingredients list

[1009] Specific operation: The server generates and lists the optimal ingredients list that fits within the budget based on the recommended recipe and store data.

[1010] Step 6:

[1011] View recommended recipes and ingredient lists

[1012] The server sends the generated recommended recipes and optimal ingredient lists to the user's smartphone and displays them, allowing the user to check the recommended recipes.

[1013] Input: Recommended recipes, best ingredient lists

[1014] Output: Display on the user's terminal

[1015] Specific behavior: Data is sent from the server to the user's device and the app displays it.

[1016] Step 7:

[1017] Food ordering

[1018] The user orders food based on the displayed ingredient list and recommended recipes, and the order information is sent to the food delivery service via the server.

[1019] Input: Ingredient list, order request

[1020] Output: Order confirmation and shipping arrangements

[1021] What happens: The user places an order for the ingredients they selected, and the order information is sent to the food delivery service via the server, which then arranges for delivery and confirms the order.

[1022] Through these steps, users will be presented with the best ingredients and recipes that suit their health condition, preferences, budget, and emotional state, and can easily order food on the spot.

[1023] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1024] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1025] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1026] [Third embodiment]

[1027] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1028] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1030] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1031] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1032] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1034] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1035] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1037] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1038] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1039] The system of the present invention aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system is used by users using smartphones or tablet devices and operates in the following manner.

[1040] Enter user information

[1041] 1. Users

[1042] Open the smartphone app and enter your preferences, health status, and budget.

[1043] Example: A user enters information such as "diabetes," "budget 2000 yen," "likes chicken," and "milk allergy."

[1044] 2. Terminal

[1045] Check the information entered to ensure it is formatted correctly.

[1046] After confirmation, it is sent to the server.

[1047] Supermarket data acquisition

[1048] 1. Server

[1049] Send a request to the supermarket's API to get the recommended products for the day.

[1050] Example: Obtain data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[1051] Generate recommended recipes

[1052] 1. Server

[1053] Recommended recipes are generated based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets.

[1054] Based on the user's information, the recipe generation algorithm selects "stir-fried chicken thighs and broccoli" and "mushroom soup" as candidates.

[1055] Generate optimal menu within budget

[1056] 1. Server

[1057] From the recommended recipes, a menu that can be achieved within the user's budget is selected.

[1058] Generate a list of ingredients you need, compare it with supermarket prices, and adjust it to fit within your budget.

[1059] Example: Generates a list containing 500g of chicken thighs, 1 stalk of broccoli, and 200g of mushrooms.

[1060] Viewing Proposals

[1061] 1. Server

[1062] The optimal menu and ingredient list will be sent to your device.

[1063] 2. Terminal

[1064] The received data is displayed to the user.

[1065] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and also displays a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1066] Specific examples

[1067] Enter user information

[1068] The user enters the following information into the app:

[1069] Health Condition: Diabetes

[1070] Budget: 2000 yen

[1071] Favorite food: Chicken

[1072] Allergies: Milk

[1073] Supermarket data acquisition

[1074] The server accesses the supermarket's API and retrieves the following data:

[1075] Chicken thigh special sale (200 yen / 100g)

[1076] Broccoli (150 yen / piece)

[1077] Mushrooms (100 yen / 200g)

[1078] Generate recommended recipes

[1079] The server generates a recipe using the following information:

[1080] User information

[1081] Supermarket recommended product data

[1082] The recipe generation algorithm suggested "stir-fried chicken thighs and broccoli" and "mushroom soup."

[1083] Generate optimal menu within budget

[1084] The server generates a list of ingredients that fit within the budget (2000 yen):

[1085] Chicken thigh 500g (1000 yen)

[1086] 1 stalk of broccoli (150 yen)

[1087] 200g mushrooms (100 yen)

[1088] Viewing Proposals

[1089] The server sends the optimal menu and ingredient list to the terminal.

[1090] The device displays the following information to the user:

[1091] Recommended menu items: Stir-fried chicken thigh and broccoli, mushroom soup

[1092] Ingredients: 500g chicken thigh, 1 stalk of broccoli, 200g mushrooms

[1093] The above is a specific embodiment for carrying out the invention. This system allows users to efficiently select appropriate ingredients, purchase them within their budget, and easily lead a healthy diet.

[1094] The processing flow will be explained below.

[1095] Step 1:

[1096] The user launches the smartphone app and enters personal information such as health status, preferences, budget, etc. For example, the user enters information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk."

[1097] Step 2:

[1098] The terminal checks the entered information to make sure that the data format is correct, and once that is confirmed, sends the data to the server.

[1099] Step 3:

[1100] The server sends a request to the supermarket's API. For example, the server sends a "GET" request to get data about the day's specials and fresh items.

[1101] Step 4:

[1102] The server analyzes and structures the product data it obtains. For example, it organizes information such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[1103] Step 5:

[1104] The server generates recommended recipes based on the user's input information and the acquired product data. For example, the server generates recipes such as "Stir-fried chicken thighs and broccoli" and "Mushroom soup" that meet the conditions of "diabetes," "chicken," and "broccoli."

[1105] Step 6:

[1106] The server creates a specific list of ingredients based on the recommended recipe and the user's budget. For example, the server creates a list such as "500g of chicken thighs," "1 stalk of broccoli," and "200g of mushrooms."

[1107] Step 7:

[1108] The server sends the optimal menu and ingredient list to the terminal. The server sends the recommended recipe and the corresponding ingredient list in data format to the terminal.

[1109] Step 8:

[1110] The device analyzes the received data and displays it to the user. For example, the device might display "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1111] Step 9:

[1112] The user can refer to the app while shopping at the supermarket and purchase products while checking the recommended ingredients list.

[1113] The above is a detailed flow of the processing steps. This system allows users to shop efficiently and healthily.

[1114] Example 1

[1115] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1116] In today's busy lifestyles, it is extremely difficult for users to maintain a healthy diet while shopping efficiently within a budget. In particular, selecting appropriate recipes based on health status and food preferences and purchasing ingredients within a budget requires a lot of time and effort. Conventional methods make these processes cumbersome, making it difficult to create an optimal shopping list.

[1117] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1118] In this invention, the server includes: a means for a user to input personal information; a means for transmitting the user-inputted information to the server; a means for acquiring product data from each store; a means for generating a recommended recipe based on the acquired product data and the user information; a means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; a means for displaying the optimal ingredient list and recommended recipe to the user; a means for using a generative AI model when generating the recommended recipe based on the acquired product data; and a means for using a budget optimization algorithm when generating the optimal ingredient list. This enables users to efficiently obtain optimal recipes and necessary ingredient lists based on their health condition, preferences, and budget.

[1119] A "user" refers to an individual who inputs their own information (health status, preferences, budget, allergies) into the system and receives recipe and ingredient recommendations.

[1120] "Personal Information" refers to information provided by the User, such as health status, preferences, budget, allergies, etc.

[1121] The term "server" refers to a computer system that receives information sent by users, acquires product data from each store, and generates recommended recipes and optimal ingredient lists.

[1122] "Terminal" refers to an electronic device such as a smartphone or tablet on which a user inputs personal information and communicates with a server.

[1123] "Store" refers to a sales facility with which the server communicates to obtain product data.

[1124] "Product data" refers to data such as prices, inventory, and special sale information for ingredients and products offered by each store.

[1125] "Recommended recipe" refers to cooking instructions generated based on the user's personal information and acquired product data.

[1126] "Ingredient list" refers to a list containing the necessary ingredients, their quantities, and their prices, generated taking into account the recommended recipe and the user's budget.

[1127] A "generative AI model" refers to an artificial intelligence algorithm that generates recommended recipes using a user's personal information and product data as input.

[1128] "Budget optimization algorithm" refers to a computational technique used to generate an optimal ingredient list within a user's budget constraints.

[1129] The system of the present invention aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system is used by users using smartphones or tablet devices and operates in the following manner.

[1130] Enter user information

[1131] 1. Users

[1132] Users launch the app on their smartphone or tablet and enter their health status, food preferences, budget, and allergy information, such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk."

[1133] 2. Terminal

[1134] The app on the device checks whether the data entered is in the correct format. If there are no errors, it sends the information to the server. The device uses common hardware such as a smartphone or tablet.

[1135] Supermarket data acquisition

[1136] 1. Server

[1137] The server sends a request to the supermarket's API to retrieve the recommended product data for that day. For example, it accesses the supermarket API endpoint (e.g., https: / / api.supermarket.com / products) and retrieves data such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[1138] Generate recommended recipes

[1139] 1. Server

[1140] The server generates recommended recipes based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets. A generative AI model is used for this process. For example, the following prompt is input to the generative AI model: "Generate recipes using chicken thighs for diabetics."

[1141] Generate optimal menu within budget

[1142] 1. Server

[1143] From the recommended recipes, a menu that can be achieved within the user's budget is selected and a list of necessary ingredients is generated. A budget optimization algorithm is used for this. Specifically, the server combines the generated recommended recipe with supermarket product data to create an ingredient list that fits within the budget, such as 500g of chicken thighs (1,000 yen), one stalk of broccoli (150 yen), and 200g of mushrooms (100 yen).

[1144] Viewing Proposals

[1145] 1. Server

[1146] The optimal menu and ingredient list are sent to the device, for example in JSON format.

[1147] 2. Terminal

[1148] The device analyzes the data received from the server and displays it to the user. The app screen displays, "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup. Required ingredients: 500g chicken thighs (1,000 yen), 1 stalk of broccoli (150 yen), 200g mushrooms (100 yen)."

[1149] As a concrete example, a user inputs the following information: health condition "diabetes," budget "2,000 yen," favorite ingredient "chicken," and allergy "milk." The server accesses a supermarket API to obtain data on "chicken thigh sale (200 yen / 100g)," "broccoli (150 yen / stalk)," and "mushrooms (100 yen / 200g)," and then uses a generative AI model to suggest "stir-fried chicken thighs and broccoli" and "mushroom soup." The server generates an ingredient list (500g of chicken thighs, one stalk of broccoli, and 200g of mushrooms) that fits within the budget and sends it to the device, which displays it to the user. In this way, users can smoothly select ingredients and menu items that meet their criteria and shop efficiently within their budget.

[1150] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1151] Step 1:

[1152] The user enters personal information

[1153] Users launch the app on their smartphone or tablet and enter their health status, food preferences, budget, and allergy information.

[1154] Input: health condition, preferences, budget, allergy information

[1155] Output: Data entered into the terminal

[1156] Specific behavior: The user enters information such as "Diabetes," "Budget 2000 yen," "I like chicken," and "I'm allergic to milk" into form fields using the keyboard.

[1157] Step 2:

[1158] The device checks the input data and sends it to the server

[1159] The app on the device checks whether there are any errors in the format of the data entered.

[1160] Input: Data entered by the user

[1161] Output: Data to send to the server

[1162] Specific behavior: The terminal validates the input fields, and if there are any errors, displays an error message and prompts the user to correct them. If there are no errors, the data is sent to the server.

[1163] Step 3:

[1164] The server retrieves product data from the supermarket API

[1165] The server sends a request to the supermarket's API to retrieve the recommended products for that day.

[1166] Input: Request from server

[1167] Output: Supermarket product data

[1168] Specific operation: The server sends a request to the Super API endpoint (e.g., https: / / api.supermarket.com / products) and receives data such as "Chicken thighs on sale for 200 yen / 100g" and "Fresh broccoli for 150 yen / stalk" as a response.

[1169] Step 4:

[1170] The server generates recommended recipes based on user information and product data.

[1171] The server generates recommended recipes based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets, using a generative AI model.

[1172] Input: User's personal information, supermarket product data

[1173] Output: Recommended recipe

[1174] Specific operation: The server inputs the prompt "Recipes using chicken thighs for diabetics" into the recipe generation AI model, and the model generates recommended recipes such as "Stir-fried chicken thighs and broccoli" and "Mushroom soup."

[1175] Step 5:

[1176] The server will generate the best grocery list that fits within your budget.

[1177] From the recommended recipes, we select a menu that is feasible within the user's budget and generate a list of ingredients, using a budget optimization algorithm.

[1178] Input: Recommended recipes, supermarket product data, user budget

[1179] Output: Optimal ingredients list

[1180] Specific operation: The server combines the generated recommended recipe with supermarket product data to create a list of ingredients that fit within the budget, such as 500g of chicken thighs (1,000 yen), one stalk of broccoli (150 yen), and 200g of mushrooms (100 yen).

[1181] Step 6:

[1182] The server sends the optimal menu and ingredient list to the device.

[1183] The optimal menu and ingredient list will be sent to your device.

[1184] Input: Optimal menu and ingredient list

[1185] Output: Data sent to the terminal

[1186] Specific operation: The server sends the ingredient list and recommended menu items in JSON format to the device.

[1187] Step 7:

[1188] The device displays the optimal menu and ingredient list to the user.

[1189] The received data is displayed to the user.

[1190] Input: Data received from the server

[1191] Output: Information displayed to the user

[1192] Specific operation: The device analyzes the data received from the server and displays on the app screen, "Today's recommended menu is stir-fried chicken thighs and broccoli, and mushroom soup. List of ingredients needed: 500g chicken thighs (1,000 yen), 1 stalk of broccoli (150 yen), 200g mushrooms (100 yen)."

[1193] (Application example 1)

[1194] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1195] Conventional healthy eating support systems can suggest recipes based on the user's preferences and health status, and generate ingredient lists within a budget. However, it is difficult for users to receive real-time advice while shopping in the store. Furthermore, input interfaces are limited to smartphones, which makes them less convenient for users. Therefore, there is a demand for systems with more user-friendly and intuitive interfaces.

[1196] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1197] In this invention, the server includes: a means for a user to input personal information; a means for transmitting the user-input information to the server; a means for acquiring product data from each store; a means for generating a recommended recipe based on the acquired product data and the user information; a means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; a means for displaying the optimal ingredient list and recommended recipe to the user; and a means for displaying the optimal ingredient list and recommended recipe to the user using smart glasses and collecting information via voice input. This enables users to efficiently shop in physical stores while referring to the recommended recipe and ingredient list that reflect their health condition, preferences, and budget in real time.

[1198] Definition of Terms

[1199] The "means by which users input personal information" refers to an interface through which users input information such as their preferences, health status, budget, etc. Examples of such interfaces include smart glasses, smartphones, and tablet devices.

[1200] The "means for transmitting the information input by the user to the server" refers to an interface and communication module for transmitting the information input by the user to the server via a network, including Wi-Fi and data communication modules.

[1201] "Means for obtaining product data from each store" refers to an interface for obtaining data on the day's specials and recommended products from each store, such as a supermarket. Specifically, the store's API or beacon technology is used.

[1202] The "means for generating recommended recipes based on the acquired product data and user information" refers to algorithms and software for automatically generating optimal recipes based on product data acquired from stores and information such as the user's preferences and health condition.

[1203] The "means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget" refers to an algorithm and software for generating an ingredient list that can be purchased within the user's budget based on the recommended recipe.

[1204] The "means for displaying the optimal ingredient list and recommended recipes to the user" refers to a display device for visually presenting the generated optimal ingredient list and recommended recipes to the user, including the display of smart glasses or a smartphone.

[1205] The "means for displaying the optimal ingredient list and recommended recipes to the user using smart glasses and collecting information through voice input" refers to an interface and voice recognition technology for displaying an ingredient list and recipes on the display of smart glasses and accepting voice input from the user.

[1206] MODE FOR CARRYING OUT THE INVENTION

[1207] The present invention provides a support system that helps users to shop efficiently within their budget while maintaining a healthy diet. Specific embodiments of the system will be described in detail below.

[1208] 1. Enter user information

[1209] Users use input interfaces such as smart glasses or smartphones to input personal information such as their health status, preferences, and budget. A voice input interface is also available, allowing users to input information intuitively. This allows users to easily reflect their health status and preferences in the system.

[1210] 2. User Information Submission

[1211] The input information is sent to the server via the smart glasses or smartphone's communication function, using Wi-Fi or a data communication module. Based on the received information, the server starts the process of acquiring data from each store and generating recipes.

[1212] 3. Obtaining data from each store

[1213] The server uses APIs to retrieve daily specials and recommended product data from supermarkets, grocery stores, and other retailers, which can use beacon technology or the store's Wi-Fi. This data is updated in real time, providing users with the latest options.

[1214] 4. Generating recommended recipes

[1215] The server generates recommended recipes based on the acquired product data and the user's personal information. The recipes are generated using an algorithm that takes into account the user's health condition and preferences. For example, a user with diabetes may be suggested low-carb menus, and a recipe using chicken on sale may be generated.

[1216] 5. Generating the optimal ingredient list

[1217] Based on the generated recommended recipes, an optimal list of ingredients that fits within the user's budget is generated. This list is compared with the acquired product data to appropriately select the necessary ingredients. This allows the user to efficiently purchase healthy ingredients within their budget.

[1218] 6. Display of proposals

[1219] The optimal ingredient list and recommended recipes are displayed on the screen of smart glasses or a smartphone. In the case of smart glasses, the ingredient list and recipe are displayed on the screen, allowing users to check them in real time at the time of purchase. Voice input is also possible, further improving convenience.

[1220] Specific examples

[1221] For example, a user puts on smart glasses, enters a supermarket, and speaks the following information:

[1222] Health Condition: Diabetes

[1223] Budget: 2000 yen

[1224] Favorite food: Chicken

[1225] Allergies: Milk

[1226] The server obtains data such as "Chicken thighs on sale for 200 yen / 100g" and "Fresh broccoli for 150 yen / stalk" via the store's API, and generates recipes based on the user's information. The generated recipes are "Stir-fried chicken thighs and broccoli" and "Mushroom soup," and the list of ingredients needed (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms) is displayed on the smart glasses' display.

[1227] Finally, the user can give instructions to the system using the following prompt sentences:

[1228] Create healthy recipes based on your input:

[1229] Health Condition: Diabetes

[1230] Budget: 2000 yen

[1231] Favorite food: Chicken

[1232] Allergies: Milk

[1233] Available ingredients list:

[1234] Chicken thigh special sale 200 yen / 100g

[1235] Broccoli 150 yen / piece

[1236] Mushrooms 100 yen / 200g

[1237] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1238] Program processing steps

[1239] Processing Steps

[1240] Step 1:

[1241] (Processing content)

[1242] The user enters personal information.

[1243] (input)

[1244] Users use smart glasses or smartphones to input personal information such as their health status, preferences, and budget.

[1245] (Data processing, data calculation and output)

[1246] The device collects information using voice recognition and touch input, checks the format for errors, and then sends the information to the server after verification.

[1247] Step 2:

[1248] (Processing content)

[1249] The information input by the user is sent to the server.

[1250] (input)

[1251] The smart glasses or smartphone receives the entered personal information.

[1252] (Data processing, data calculation and output)

[1253] The device's communication module (Wi-Fi or data communication) is used to send the user's input information to the server, which then stores the received information in a database.

[1254] Step 3:

[1255] (Processing content)

[1256] Obtain product data from each store.

[1257] (input)

[1258] Personal information sent by the user to the server.

[1259] (Data processing, data calculation and output)

[1260] The server uses each store's API to obtain the recommended product data for that day. The obtained data includes information such as product name, price, and category, and is stored in a database.

[1261] Step 4:

[1262] (Processing content)

[1263] A recommended recipe is generated based on the acquired product data and the user information.

[1264] (input)

[1265] Product data and user personal information obtained by the server.

[1266] (Data processing, data calculation and output)

[1267] The server uses the generative AI model to generate recommended recipes based on the user's health status and preferences. For example, it might suggest low-carb options to a user with diabetes. The generated recipe information is then passed on to the next processing step.

[1268] Step 5:

[1269] (Processing content)

[1270] An optimal ingredient list is generated taking into consideration the recommended recipe and the user's budget.

[1271] (input)

[1272] Suggested recipes and user budget information.

[1273] (Data processing, data calculation and output)

[1274] The server compares the recommended recipe with the user's budget and generates a list of ingredients that can be purchased within the budget. This calculation also uses price information from the product data to generate the final ingredient list.

[1275] Step 6:

[1276] (Processing content)

[1277] The optimum ingredient list and recommended recipes are displayed to the user.

[1278] (input)

[1279] Best ingredients list and recommended recipes.

[1280] (Data processing, data calculation and output)

[1281] The server converts the generated optimal ingredient list and recommended recipes into a format that can be displayed on the screen of smart glasses or a smartphone, and sends it to the device, which then visually presents the received information to the user.

[1282] Step 7:

[1283] (Processing content)

[1284] The optimal ingredient list and recommended recipes are displayed to the user using smart glasses, and information is collected through voice input.

[1285] (input)

[1286] The best ingredient list and recipe suggestions displayed on smart glasses.

[1287] (Data processing, data calculation and output)

[1288] The user puts on the smart glasses and checks the information displayed on the screen. The user can then give additional instructions or modify the information by voice input. The voice instructions are recognized by the device and, if necessary, retransmitted to the server for processing updates.

[1289] As an example of this process, a user puts on a pair of smart glasses and instructs the system using the following prompt sentence:

[1290] Create healthy recipes based on your input:

[1291] Health Condition: Diabetes

[1292] Budget: 2000 yen

[1293] Favorite food: Chicken

[1294] Allergies: Milk

[1295] Available ingredients list:

[1296] Chicken thigh special sale 200 yen / 100g

[1297] Broccoli 150 yen / piece

[1298] Mushrooms 100 yen / 200g

[1299] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1300] The present invention relates to a system that aims to support users in shopping efficiently within their budget while maintaining a healthy diet, and also suggests optimal recipes taking into account the user's emotional state. This system is used by users using smartphones or tablet devices, and operates in the following manner.

[1301] Enter user information

[1302] 1. Users

[1303] Users open the smartphone app and enter personal information such as their health status, preferences, budget, etc. The app also uses a video camera and microphone to record voice and facial expression data to ascertain the user's emotional state.

[1304] Example: The user can enter information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "milk allergy" along with the emotion they are currently feeling (for example, "tired" or "happy"), or the app can automatically analyze their emotions.

[1305] 2. Terminal

[1306] The entered information and recorded voice and facial expression data are checked to ensure there are no formatting errors. After confirmation, this data is sent to the server.

[1307] Supermarket data acquisition

[1308] 1. Server

[1309] Send a request to the supermarket's API to get the recommended products for the day.

[1310] Example: Obtain data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[1311] Generate recommended recipes

[1312] 1. Server

[1313] Recommended recipes are generated based on the user's personal information (preferences, health status, budget), product data obtained from supermarkets, and the user's emotional state recognized by an emotion engine.

[1314] The recipe generation algorithm selects multiple recipes, such as "stir-fried chicken thighs and broccoli" and "mushroom soup," based on the user's information.

[1315] If the user is tired, the emotion engine will recommend easy recipes or recipes containing ingredients that will lift their spirits, and if the user is happy, it will suggest special dishes or new recipes.

[1316] Generate optimal menu within budget

[1317] 1. Server

[1318] From the recommended recipes, a menu that can be achieved within the user's budget is selected.

[1319] Generate a list of ingredients you need, compare it with supermarket prices, and adjust it to fit within your budget.

[1320] Example: A list might be generated that includes 500g of chicken thighs, 1 stalk of broccoli, and 200g of mushrooms.

[1321] Viewing Proposals

[1322] 1. Server

[1323] The optimal menu and ingredient list will be sent to your device.

[1324] 2. Terminal

[1325] The received data is displayed to the user.

[1326] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and also displays a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1327] Specific examples

[1328] Enter user information

[1329] The user enters the following information into the app:

[1330] Health Condition: Diabetes

[1331] Budget: 2000 yen

[1332] Favorite food: Chicken

[1333] Allergies: Milk

[1334] Emotional state: Tired

[1335] Supermarket data acquisition

[1336] The server accesses the supermarket's API and retrieves the following data:

[1337] Chicken thigh special sale (200 yen / 100g)

[1338] Broccoli (150 yen / piece)

[1339] Mushrooms (100 yen / 200g)

[1340] Generate recommended recipes

[1341] The server generates a recipe using the following information:

[1342] User information

[1343] Supermarket recommended product data

[1344] Emotional state by emotion engine

[1345] The recipe generation algorithm suggests "stir-fried chicken thighs and broccoli" and "mushroom soup," selecting easy-to-make recipes for tired users.

[1346] Generate optimal menu within budget

[1347] The server generates a list of ingredients that fit within the budget (2000 yen):

[1348] Chicken thigh 500g (1000 yen)

[1349] 1 stalk of broccoli (150 yen)

[1350] 200g mushrooms (100 yen)

[1351] Viewing Proposals

[1352] The server sends the optimal menu and ingredient list to the terminal.

[1353] The device displays the following information to the user:

[1354] Recommended menu items: Stir-fried chicken thigh and broccoli, mushroom soup

[1355] Ingredients: 500g chicken thigh, 1 stalk of broccoli, 200g mushrooms

[1356] The above is a specific embodiment for carrying out the invention. This system allows users to select the optimal ingredients for their health and emotional state, purchase them within their budget, and easily lead a healthy and mood-appropriate diet.

[1357] The processing flow will be explained below.

[1358] Step 1:

[1359] The user launches the smartphone app and inputs personal information such as health status, preferences, and budget. In addition, a video camera and microphone are used to record voice and facial expression data. For example, the user inputs information such as "diabetes," "budget of 2,000 yen," "likes chicken," "allergy to milk," and "tired."

[1360] Step 2:

[1361] The device checks the entered information and recorded voice and facial expression data to ensure there are no formatting errors. Once verified, this data is sent to the server.

[1362] Step 3:

[1363] The server sends a request to the supermarket's API to retrieve data on the day's specials and fresh products. For example, the server retrieves data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[1364] Step 4:

[1365] The server analyzes and structures the product data it obtains. For example, it organizes information such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[1366] Step 5:

[1367] The server uses an emotion engine to recognize the user's emotional state, for example, recognizing the emotion "tired" from recorded voice and video facial expressions.

[1368] Step 6:

[1369] The server generates recommended recipes based on the user's personal information, health status, product data obtained from supermarkets, and the user's recognized emotional state. Based on the user's information, the recipe generation algorithm selects easy-to-make recipes for a tired user, such as "stir-fried chicken thighs and broccoli" or "mushroom soup."

[1370] Step 7:

[1371] The server creates a specific ingredient list based on the recommended recipe and the user's budget. For example, it creates a list such as "500g chicken thighs," "1 stalk of broccoli," and "200g mushrooms."

[1372] Step 8:

[1373] The server sends the optimal menu and ingredient list to the terminal. The recommended recipe and the corresponding ingredient list are sent to the terminal in data format.

[1374] Step 9:

[1375] The device analyzes the received data and displays it to the user. The displayed content is "Today's recommended menu is stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1376] Step 10:

[1377] The user can refer to the app while shopping at the supermarket and purchase products while checking the recommended ingredients list.

[1378] This is the detailed flow of the processing steps. This system enables users to shop efficiently and healthily, and also suggests recipes that suit their emotional state, allowing them to lead a more fulfilling diet.

[1379] Example 2

[1380] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1381] Conventional shopping support systems suggest recipes based on the user's health condition, preferences, and budget, but they are unable to consider the user's emotional state. As a result, recipe suggestions that match the user's mood at the time are insufficient, which can lead to reduced user satisfaction. Additionally, the personal information entered by the user may be inaccurate, resulting in reduced suggestion accuracy.

[1382] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting personal information of the user, means for transmitting the information input by the user to the server, means for acquiring product data from each store, means for generating recommended recipes based on the acquired product data and the user information, means for generating an optimal ingredient list taking into account the recommended recipes and the user's budget, means for displaying the optimal ingredient list and recommended recipes to the user, means for recording voice data and facial expression data to analyze the user's emotional state, and means for adjusting the recommended recipes taking into account the emotional state. This enables highly accurate recipe suggestions that also take the user's emotional state into account.

[1383] A "user" is an individual or group that uses the system and inputs information such as health status, preferences, budget, and emotional state.

[1384] "Personal Information" is information entered by a user about a user's particular circumstances and preferences, such as health status, preferences, budget, emotional state, and allergy information.

[1385] The "server" is a computer system that receives information sent by users, acquires data from each store, and generates recommended recipes and ingredient lists.

[1386] "Stores" refer to retail stores such as supermarkets and food retailers, and are entities that provide product data through APIs.

[1387] "Product data" refers to information such as product name, price, and stock status obtained from the store.

[1388] A "recommended recipe" is a recipe for a dish that is suggested to a user based on the user's personal information and product data obtained from a store.

[1389] The "ingredient list" is a list of ingredients and their amounts required to make a recommended recipe.

[1390] "Voice data" is information input by voice from a user, and is data for analyzing the emotional state of the user.

[1391] "Facial expression data" is information based on facial expressions input by the user, and is data for analyzing the emotional state of the user.

[1392] An "emotional state" is a user's psychological or emotional state, including states such as tiredness, joy, anxiety, etc.

[1393] The "emotion engine" is an analysis system that analyzes the user's emotional state from their voice data and facial expression data, and adjusts recommended recipes based on that information.

[1394] "API" stands for Application Programming Interface, and is the interface used by the server to obtain data from each store.

[1395] The present invention is a system that aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system proposes optimal recipes taking into account the user's emotional state and is configured so that the user can use it on a smartphone or tablet device. Details for specifically implementing the present invention are described below.

[1396] Enter user information

[1397] A user opens a smartphone app and inputs personal information such as their health condition, preferences, budget, and emotional state. At this time, a video camera and microphone are used to record voice and facial expression data. An emotion engine is then used to analyze the user's emotional state from this data.

[1398] Example: A user enters information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk," and the app automatically analyzes their current emotions (e.g., "tired").

[1399] Data transmission and check

[1400] The device checks the input information and recorded voice and facial expression data to ensure there are no format errors, and then sends this data to the server.

[1401] Get product data

[1402] The server sends a request to the supermarket's API endpoint to retrieve the recommended product data for that day, such as "Chicken thigh special sale 200 yen / 100g" or "Fresh broccoli 150 yen / stalk."

[1403] Generate recommended recipes

[1404] The server references the user's personal information (preferences, health status, budget) and compares the acquired product data. Furthermore, it uses an emotion engine to generate recommended recipes that take into account the user's emotional state. Specifically, if the user is tired, it recommends easy-to-make recipes, and if the user is happy, it suggests special dishes or new recipes.

[1405] Example: A recipe generation algorithm suggests the following recipes: "Stir-fried chicken thighs and broccoli" and "Mushroom soup."

[1406] Generate optimal menu within budget

[1407] The server selects from the recommended recipes a menu that is feasible within the user's budget, generates a list of ingredients, and compares it with supermarket price information to ensure it fits within the budget.

[1408] Example: A list such as 500g of chicken thigh (1000 yen), 1 stalk of broccoli (150 yen), and 200g of mushrooms (100 yen) is generated.

[1409] Viewing Proposals

[1410] The server sends the optimal menu and ingredient list to the terminal, which displays the received data to the user.

[1411] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and provides a specific list of ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1412] Prompt Sentence Examples

[1413] "When a user enters personal information into the app, such as 'diabetes,' 'budget of 2,000 yen,' 'likes chicken,' and 'milk allergy,' and records their emotional state as 'tired,' the server accesses the supermarket's API and obtains product data such as 'chicken thighs on sale for 200 yen / 100g' and 'fresh broccoli for 150 yen / stalk.' The server then generates recipes such as 'stir-fried chicken thighs and broccoli' or 'mushroom soup' based on the user's information and the obtained product data, recommends recipes that are easy to make taking into account the user's emotional state, and sends a list of ingredients that fit within the user's budget (500g chicken thighs, one stalk of broccoli, 200g mushrooms) to the device, which then displays it to the user."

[1414] This invention allows users to easily obtain optimal ingredients and recipes that suit their emotional and health conditions, and allows them to shop within their budget. The hardware used includes smartphones and tablet devices, and the software includes a supermarket API, an emotion engine, and a recipe generation algorithm.

[1415] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1416] Step 1: Enter your information

[1417] 1. The user launches the app on their smartphone and an input form is displayed.

[1418] 2. The user inputs their health condition (e.g., "diabetes"), preferences (e.g., "I like chicken"), budget (e.g., "2,000 yen"), and allergy information (e.g., "milk allergy"). They also input their emotional state (e.g., "I'm tired"), or the emotional data is automatically recorded using a video camera or microphone. Specific actions include showing facial expressions to the camera or speaking into the microphone, such as "I'm tired today."

[1419] Input: User's health status, preferences, budget, allergy information, emotional state

[1420] Output: Verified personal information data

[1421] Step 2: Submit and verify data

[1422] 1. The device checks the information entered and checks for formatting errors, for example displaying a warning if the budget field is blank.

[1423] 2. After confirmation, the terminal sends the user's input information and recorded data to the server. The transmission format generally uses the HTTPS protocol, and the data is encrypted.

[1424] Input: Verified personal data

[1425] Output: Data sent to the server

[1426] Step 3: Obtain supermarket data

[1427] 1. The server sends a request to the supermarket API, for example, "GET / api / v1 / products / today_specials".

[1428] 2. The server retrieves the recommended product data for that day and stores it in a database. The retrieved product data includes product name, price, and stock information.

[1429] Input: API request

[1430] Output: Retrieved product data

[1431] Step 4: Generate recommended recipes

[1432] 1. The server retrieves the user's personal information (health status, preferences, budget) from the database.

[1433] 2. Based on the product data acquired by the server, a recipe generation algorithm is used to generate recipe candidates. For example, recipes such as "Stir-fried chicken thighs and broccoli" or "Mushroom soup" are generated.

[1434] 3. The server uses an emotion engine to analyze the user's emotional state and adjust the recipe accordingly. For example, it might recommend easy recipes to a tired user.

[1435] Input: User information data, product data

[1436] Output: Recommended recipe

[1437] Step 5: Generate the optimal menu

[1438] 1. The server selects from the recommended recipes a recipe that is feasible within the user's budget.

[1439] 2. The server generates a list of ingredients needed and adjusts it based on price information. For example, a list might be generated that includes "500g of chicken thighs (1000 yen)," "1 stalk of broccoli (150 yen)," and "200g of mushrooms (100 yen)."

[1440] Input: Recommended recipes, product price information

[1441] Output: Budgeted ingredients list

[1442] Step 6: View the proposal

[1443] 1. The server sends the optimal menu and ingredient list to the device. The sending format is mainly JSON.

[1444] 2. The device displays the received data to the user. Specifically, the app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients.

[1445] Input: Optimal menu, ingredients list

[1446] Output: Information displayed to the user

[1447] Through these steps, users can easily obtain the optimal ingredients and recipes that suit their emotional and health states, and shop efficiently within their budget.

[1448] (Application example 2)

[1449] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1450] Today's consumers want the right ingredients and recipes based on their health status, budget, and preferences, but it is difficult to do so efficiently. Furthermore, because consumers' emotional state is an important factor in ingredient selection, recipe suggestions based on their emotional state are also necessary. In addition, a lack of systems that allow consumers to easily order optimal ingredients has been pointed out. To solve these issues, there is a need for a system that can recommend optimal ingredients and recipes based on a user's overall health status, preferences, budget, and emotional state, and then order food on the spot.

[1451] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1452] In this invention, the server includes: means for a user to input personal information and emotional state; means for transmitting the user's input information and emotional state to the server; means for acquiring product data from each store; means for generating recommended recipes based on the acquired product data and the user's information and emotional state; means for generating an optimal ingredient list taking into account the recommended recipe and the user's budget; means for displaying the optimal ingredient list and recommended recipe to the user; and means for the user to order food based on the displayed ingredient list and recommended recipe. This enables consumers to efficiently select optimal ingredients and recipes that suit their health condition, preferences, budget, and emotional state, and easily order food on the spot.

[1453] "Means for users to input personal information and emotional state" refers to a device or interface that allows a user to input personal information such as their health status, preferences, budget, emotional state, etc.

[1454] "Means for transmitting the information and emotional state input by the user to the server" refers to a communication function for transmitting the information and emotional state input by the user to the server via the Internet or the like.

[1455] "Means of obtaining product data from each store" refers to technology for obtaining information on the day's special sales and recommended products through the APIs of supermarkets and stores.

[1456] "Means for generating recommended recipes based on the acquired product data and the user's information and emotional state" refers to an algorithm or program that generates the optimal recipe for the user based on the product data acquired by the server and the user's input information.

[1457] "Means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget" refers to an algorithm or program that generates an optimal ingredient list that is efficient and fits within the budget based on the generated recommended recipe and the user's budget.

[1458] The term "means for displaying the optimal ingredient list and recommended recipes to the user" refers to an interface for displaying the generated ingredient list and recipes on the user's device.

[1459] "A means for the user to order food based on the displayed ingredient list and recommended recipe" refers to a function that allows the user to order the suggested food as is based on the displayed information.

[1460] The purpose of this invention is to provide a food delivery system that allows users to manage their healthy eating habits. This system suggests optimal ingredients and recipes based on the user's health condition, preferences, budget, and emotional state, and allows the user to order food directly.

[1461] Hardware and Software Use

[1462] The system is implemented using the following hardware and software:

[1463] Smartphone: Used by users to enter information, see suggested recipes and ingredient lists, and order food.

[1464] Cloud server: Stores user input data and combines it with store data to generate optimal recipes and ingredient lists.

[1465] Network: An internet connection to send and receive data between your device and the cloud server.

[1466] Store API: An interface for obtaining the latest product data for each store.

[1467] Emotion analysis engine: Analyzes the user's voice and facial expression data to recognize their emotional state.

[1468] Data processing and calculation

[1469] The server processes data and performs calculations in the following steps.

[1470] 1. Input and transmission of user information: The user uses a smartphone to input information about their health condition, preferences, budget, and emotional state. The input information is then transmitted to the server via the network.

[1471] 2. Product data acquisition: The server uses each store's API to acquire the latest product data, including the price and availability of ingredients.

[1472] 3. Recipe generation: The server generates the optimal recipe for the user based on the acquired product data and the user's input information. The recipe generation algorithm takes into account not only the user's health condition and preferences, but also their emotional state. For example, if the user is "tired," it will suggest an easy recipe, and if the user is "happy," it will suggest a special dish.

[1473] 4. Generate an ingredient list: The optimal ingredient list is generated based on the generated recipe and budget. This ingredient list is adjusted to fit within the budget.

[1474] 5. Displaying and ordering data: The server displays the generated recipe and ingredient list on the user's smartphone. The user can then order food on the spot based on the displayed information.

[1475] Specific example explanation

[1476] As a specific example of operation, a user inputs their health condition (diabetes), budget (2,000 yen), preferences (likes chicken), allergies (milk), and emotional state (tired). The input data is sent from the smartphone device to the server, which then obtains data such as "chicken thigh sale (200 yen / 100g)," "broccoli (150 yen / stalk)," and "mushrooms (100 yen / 200g)" via the supermarket API. The emotion analysis engine analyzes the user's emotion of "tired" and suggests easy-to-make recipes such as "stir-fried chicken thigh and broccoli" and "mushroom soup."

[1477] Examples of prompts to input to a generative AI model include:

[1478] "Suggest the best recipes for a diabetic user who has a budget of 2000 yen, loves chicken, is allergic to milk, and is tired. Prioritize dishes that are as easy to make as possible, and use data from a super API to provide recipes that fit within that budget."

[1479] As described above, the present invention provides optimal ingredients and recipes according to the individual needs of users, and realizes an environment in which food can be easily ordered on the spot.

[1480] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1481] Step 1:

[1482] Enter user information

[1483] Users use their smartphones to input their health status, budget, preferences, allergies, and emotional state into the application, which also provides a function to automatically analyze their emotional state using voice and facial expression data.

[1484] Input: Health condition (e.g., diabetes), budget (e.g., 2,000 yen), preferences (e.g., chicken), allergies (e.g., milk allergy), emotional state (e.g., tired)

[1485] Output: User input data is temporarily stored in the terminal.

[1486] What it does: The user inputs information into a smartphone app, which uses the camera and microphone to analyze voice and facial expressions as needed.

[1487] Step 2:

[1488] User information sent to server

[1489] The terminal checks the entered user information for formatting errors and sends it to the server, where it is stored.

[1490] Input: Data entered by the user

[1491] Output: The checked user data is sent to the server and stored.

[1492] Specific operation: The terminal checks the format of the user-entered data and sends the data to the server via the network.

[1493] Step 3:

[1494] Get product data

[1495] The server uses each store's API to retrieve the latest product data, including product name, price, and stock status.

[1496] Input: API request for each store

[1497] Output: Retrieved product data

[1498] Specific operation: The server sends a request to each store's API to obtain the day's special sale information and recommended product data.

[1499] Step 4:

[1500] Generate recommended recipes

[1501] The server generates recommended recipes based on the acquired product data, user information, and emotional state. This is handled by a recipe generation algorithm.

[1502] Input: User data, store product data

[1503] Output: Recommended recipe

[1504] Specific operation: The recipe generation algorithm generates and selects multiple recipes taking into account the user's health condition, preferences, and emotional state.

[1505] Step 5:

[1506] Generate an ingredient list

[1507] The server generates an optimal ingredient list taking into account the recommended recipe and the user's budget, thereby listing ingredients that can be purchased within the budget.

[1508] Input: Recommended recipe, user budget

[1509] Output: Optimal ingredients list

[1510] Specific operation: The server generates and lists the optimal ingredients list that fits within the budget based on the recommended recipe and store data.

[1511] Step 6:

[1512] View recommended recipes and ingredient lists

[1513] The server sends the generated recommended recipes and optimal ingredient lists to the user's smartphone and displays them, allowing the user to check the recommended recipes.

[1514] Input: Recommended recipes, best ingredient lists

[1515] Output: Display on the user's terminal

[1516] Specific behavior: Data is sent from the server to the user's device and the app displays it.

[1517] Step 7:

[1518] Food ordering

[1519] The user orders food based on the displayed ingredient list and recommended recipes, and the order information is sent to the food delivery service via the server.

[1520] Input: Ingredient list, order request

[1521] Output: Order confirmation and shipping arrangements

[1522] What happens: The user places an order for the ingredients they selected, and the order information is sent to the food delivery service via the server, which then arranges for delivery and confirms the order.

[1523] Through these steps, users will be presented with the best ingredients and recipes that suit their health condition, preferences, budget, and emotional state, and can easily order food on the spot.

[1524] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1525] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1526] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1527] [Fourth embodiment]

[1528] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1529] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1530] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1531] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1532] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1533] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1534] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1535] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1536] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1537] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1538] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1539] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1540] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1541] The system of the present invention aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system is used by users using smartphones or tablet devices and operates in the following manner.

[1542] Enter user information

[1543] 1. Users

[1544] Open the smartphone app and enter your preferences, health status, and budget.

[1545] Example: A user enters information such as "diabetes," "budget 2000 yen," "likes chicken," and "milk allergy."

[1546] 2. Terminal

[1547] Check the information entered to ensure it is formatted correctly.

[1548] After confirmation, it is sent to the server.

[1549] Supermarket data acquisition

[1550] 1. Server

[1551] Send a request to the supermarket's API to get the recommended products for the day.

[1552] Example: Obtain data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[1553] Generate recommended recipes

[1554] 1. Server

[1555] Recommended recipes are generated based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets.

[1556] Based on the user's information, the recipe generation algorithm selects "stir-fried chicken thighs and broccoli" and "mushroom soup" as candidates.

[1557] Generate optimal menu within budget

[1558] 1. Server

[1559] From the recommended recipes, a menu that can be achieved within the user's budget is selected.

[1560] Generate a list of ingredients you need, compare it with supermarket prices, and adjust it to fit within your budget.

[1561] Example: Generates a list containing 500g of chicken thighs, 1 stalk of broccoli, and 200g of mushrooms.

[1562] Viewing Proposals

[1563] 1. Server

[1564] The optimal menu and ingredient list will be sent to your device.

[1565] 2. Terminal

[1566] The received data is displayed to the user.

[1567] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and also displays a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1568] Specific examples

[1569] Enter user information

[1570] The user enters the following information into the app:

[1571] Health Condition: Diabetes

[1572] Budget: 2000 yen

[1573] Favorite food: Chicken

[1574] Allergies: Milk

[1575] Supermarket data acquisition

[1576] The server accesses the supermarket's API and retrieves the following data:

[1577] Chicken thigh special sale (200 yen / 100g)

[1578] Broccoli (150 yen / piece)

[1579] Mushrooms (100 yen / 200g)

[1580] Generate recommended recipes

[1581] The server generates a recipe using the following information:

[1582] User information

[1583] Supermarket recommended product data

[1584] The recipe generation algorithm suggested "stir-fried chicken thighs and broccoli" and "mushroom soup."

[1585] Generate optimal menu within budget

[1586] The server generates a list of ingredients that fit within the budget (2000 yen):

[1587] Chicken thigh 500g (1000 yen)

[1588] 1 stalk of broccoli (150 yen)

[1589] 200g mushrooms (100 yen)

[1590] Viewing Proposals

[1591] The server sends the optimal menu and ingredient list to the terminal.

[1592] The device displays the following information to the user:

[1593] Recommended menu items: Stir-fried chicken thigh and broccoli, mushroom soup

[1594] Ingredients: 500g chicken thigh, 1 stalk of broccoli, 200g mushrooms

[1595] The above is a specific embodiment for carrying out the invention. This system allows users to efficiently select appropriate ingredients, purchase them within their budget, and easily lead a healthy diet.

[1596] The processing flow will be explained below.

[1597] Step 1:

[1598] The user launches the smartphone app and enters personal information such as health status, preferences, budget, etc. For example, the user enters information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk."

[1599] Step 2:

[1600] The terminal checks the entered information to make sure that the data format is correct, and once that is confirmed, sends the data to the server.

[1601] Step 3:

[1602] The server sends a request to the supermarket's API. For example, the server sends a "GET" request to get data about the day's specials and fresh items.

[1603] Step 4:

[1604] The server analyzes and structures the product data it obtains. For example, it organizes information such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[1605] Step 5:

[1606] The server generates recommended recipes based on the user's input information and the acquired product data. For example, the server generates recipes such as "Stir-fried chicken thighs and broccoli" and "Mushroom soup" that meet the conditions of "diabetes," "chicken," and "broccoli."

[1607] Step 6:

[1608] The server creates a specific list of ingredients based on the recommended recipe and the user's budget. For example, the server creates a list such as "500g of chicken thighs," "1 stalk of broccoli," and "200g of mushrooms."

[1609] Step 7:

[1610] The server sends the optimal menu and ingredient list to the terminal. The server sends the recommended recipe and the corresponding ingredient list in data format to the terminal.

[1611] Step 8:

[1612] The device analyzes the received data and displays it to the user. For example, the device might display "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1613] Step 9:

[1614] The user can refer to the app while shopping at the supermarket and purchase products while checking the recommended ingredients list.

[1615] The above is a detailed flow of the processing steps. This system allows users to shop efficiently and healthily.

[1616] Example 1

[1617] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1618] In today's busy lifestyles, it is extremely difficult for users to maintain a healthy diet while shopping efficiently within a budget. In particular, selecting appropriate recipes based on health status and food preferences and purchasing ingredients within a budget requires a lot of time and effort. Conventional methods make these processes cumbersome, making it difficult to create an optimal shopping list.

[1619] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1620] In this invention, the server includes: a means for a user to input personal information; a means for transmitting the user-inputted information to the server; a means for acquiring product data from each store; a means for generating a recommended recipe based on the acquired product data and the user information; a means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; a means for displaying the optimal ingredient list and recommended recipe to the user; a means for using a generative AI model when generating the recommended recipe based on the acquired product data; and a means for using a budget optimization algorithm when generating the optimal ingredient list. This enables users to efficiently obtain optimal recipes and necessary ingredient lists based on their health condition, preferences, and budget.

[1621] A "user" refers to an individual who inputs their own information (health status, preferences, budget, allergies) into the system and receives recipe and ingredient recommendations.

[1622] "Personal Information" refers to information provided by the User, such as health status, preferences, budget, allergies, etc.

[1623] The term "server" refers to a computer system that receives information sent by users, acquires product data from each store, and generates recommended recipes and optimal ingredient lists.

[1624] "Terminal" refers to an electronic device such as a smartphone or tablet on which a user inputs personal information and communicates with a server.

[1625] "Store" refers to a sales facility with which the server communicates to obtain product data.

[1626] "Product data" refers to data such as prices, inventory, and special sale information for ingredients and products offered by each store.

[1627] "Recommended recipe" refers to cooking instructions generated based on the user's personal information and acquired product data.

[1628] "Ingredient list" refers to a list containing the necessary ingredients, their quantities, and their prices, generated taking into account the recommended recipe and the user's budget.

[1629] A "generative AI model" refers to an artificial intelligence algorithm that generates recommended recipes using a user's personal information and product data as input.

[1630] "Budget optimization algorithm" refers to a computational technique used to generate an optimal ingredient list within a user's budget constraints.

[1631] The system of the present invention aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system is used by users using smartphones or tablet devices and operates in the following manner.

[1632] Enter user information

[1633] 1. Users

[1634] Users launch the app on their smartphone or tablet and enter their health status, food preferences, budget, and allergy information, such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk."

[1635] 2. Terminal

[1636] The app on the device checks whether the data entered is in the correct format. If there are no errors, it sends the information to the server. The device uses common hardware such as a smartphone or tablet.

[1637] Supermarket data acquisition

[1638] 1. Server

[1639] The server sends a request to the supermarket's API to retrieve the recommended product data for that day. For example, it accesses the supermarket API endpoint (e.g., https: / / api.supermarket.com / products) and retrieves data such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[1640] Generate recommended recipes

[1641] 1. Server

[1642] The server generates recommended recipes based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets. A generative AI model is used for this process. For example, the following prompt is input to the generative AI model: "Generate recipes using chicken thighs for diabetics."

[1643] Generate optimal menu within budget

[1644] 1. Server

[1645] From the recommended recipes, a menu that can be achieved within the user's budget is selected and a list of necessary ingredients is generated. A budget optimization algorithm is used for this. Specifically, the server combines the generated recommended recipe with supermarket product data to create an ingredient list that fits within the budget, such as 500g of chicken thighs (1,000 yen), one stalk of broccoli (150 yen), and 200g of mushrooms (100 yen).

[1646] Viewing Proposals

[1647] 1. Server

[1648] The optimal menu and ingredient list are sent to the device, for example in JSON format.

[1649] 2. Terminal

[1650] The device analyzes the data received from the server and displays it to the user. The app screen displays, "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup. Required ingredients: 500g chicken thighs (1,000 yen), 1 stalk of broccoli (150 yen), 200g mushrooms (100 yen)."

[1651] As a concrete example, a user inputs the following information: health condition "diabetes," budget "2,000 yen," favorite ingredient "chicken," and allergy "milk." The server accesses a supermarket API to obtain data on "chicken thigh sale (200 yen / 100g)," "broccoli (150 yen / stalk)," and "mushrooms (100 yen / 200g)," and then uses a generative AI model to suggest "stir-fried chicken thighs and broccoli" and "mushroom soup." The server generates an ingredient list (500g of chicken thighs, one stalk of broccoli, and 200g of mushrooms) that fits within the budget and sends it to the device, which displays it to the user. In this way, users can smoothly select ingredients and menu items that meet their criteria and shop efficiently within their budget.

[1652] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1653] Step 1:

[1654] The user enters personal information

[1655] Users launch the app on their smartphone or tablet and enter their health status, food preferences, budget, and allergy information.

[1656] Input: health condition, preferences, budget, allergy information

[1657] Output: Data entered into the terminal

[1658] Specific behavior: The user enters information such as "Diabetes," "Budget 2000 yen," "I like chicken," and "I'm allergic to milk" into form fields using the keyboard.

[1659] Step 2:

[1660] The device checks the input data and sends it to the server

[1661] The app on the device checks whether there are any errors in the format of the data entered.

[1662] Input: Data entered by the user

[1663] Output: Data to send to the server

[1664] Specific behavior: The terminal validates the input fields, and if there are any errors, displays an error message and prompts the user to correct them. If there are no errors, the data is sent to the server.

[1665] Step 3:

[1666] The server retrieves product data from the supermarket API

[1667] The server sends a request to the supermarket's API to retrieve the recommended products for that day.

[1668] Input: Request from server

[1669] Output: Supermarket product data

[1670] Specific operation: The server sends a request to the Super API endpoint (e.g., https: / / api.supermarket.com / products) and receives data such as "Chicken thighs on sale for 200 yen / 100g" and "Fresh broccoli for 150 yen / stalk" as a response.

[1671] Step 4:

[1672] The server generates recommended recipes based on user information and product data.

[1673] The server generates recommended recipes based on the user's personal information (preferences, health status, budget) and product data obtained from supermarkets, using a generative AI model.

[1674] Input: User's personal information, supermarket product data

[1675] Output: Recommended recipe

[1676] Specific operation: The server inputs the prompt "Recipes using chicken thighs for diabetics" into the recipe generation AI model, and the model generates recommended recipes such as "Stir-fried chicken thighs and broccoli" and "Mushroom soup."

[1677] Step 5:

[1678] The server will generate the best grocery list that fits within your budget.

[1679] From the recommended recipes, we select a menu that is feasible within the user's budget and generate a list of ingredients, using a budget optimization algorithm.

[1680] Input: Recommended recipes, supermarket product data, user budget

[1681] Output: Optimal ingredients list

[1682] Specific operation: The server combines the generated recommended recipe with supermarket product data to create a list of ingredients that fit within the budget, such as 500g of chicken thighs (1,000 yen), one stalk of broccoli (150 yen), and 200g of mushrooms (100 yen).

[1683] Step 6:

[1684] The server sends the optimal menu and ingredient list to the device.

[1685] The optimal menu and ingredient list will be sent to your device.

[1686] Input: Optimal menu and ingredient list

[1687] Output: Data sent to the terminal

[1688] Specific operation: The server sends the ingredient list and recommended menu items in JSON format to the device.

[1689] Step 7:

[1690] The device displays the optimal menu and ingredient list to the user.

[1691] The received data is displayed to the user.

[1692] Input: Data received from the server

[1693] Output: Information displayed to the user

[1694] Specific operation: The device analyzes the data received from the server and displays on the app screen, "Today's recommended menu is stir-fried chicken thighs and broccoli, and mushroom soup. List of ingredients needed: 500g chicken thighs (1,000 yen), 1 stalk of broccoli (150 yen), 200g mushrooms (100 yen)."

[1695] (Application example 1)

[1696] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1697] Conventional healthy eating support systems can suggest recipes based on the user's preferences and health status, and generate ingredient lists within a budget. However, it is difficult for users to receive real-time advice while shopping in the store. Furthermore, input interfaces are limited to smartphones, which makes them less convenient for users. Therefore, there is a demand for systems with more user-friendly and intuitive interfaces.

[1698] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1699] In this invention, the server includes: a means for a user to input personal information; a means for transmitting the user-input information to the server; a means for acquiring product data from each store; a means for generating a recommended recipe based on the acquired product data and the user information; a means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; a means for displaying the optimal ingredient list and recommended recipe to the user; and a means for displaying the optimal ingredient list and recommended recipe to the user using smart glasses and collecting information via voice input. This enables users to efficiently shop in physical stores while referring to the recommended recipe and ingredient list that reflect their health condition, preferences, and budget in real time.

[1700] Definition of Terms

[1701] The "means by which users input personal information" refers to an interface through which users input information such as their preferences, health status, budget, etc. Examples of such interfaces include smart glasses, smartphones, and tablet devices.

[1702] The "means for transmitting the information input by the user to the server" refers to an interface and communication module for transmitting the information input by the user to the server via a network, including Wi-Fi and data communication modules.

[1703] "Means for obtaining product data from each store" refers to an interface for obtaining data on the day's specials and recommended products from each store, such as a supermarket. Specifically, the store's API or beacon technology is used.

[1704] The "means for generating recommended recipes based on the acquired product data and user information" refers to algorithms and software for automatically generating optimal recipes based on product data acquired from stores and information such as the user's preferences and health condition.

[1705] The "means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget" refers to an algorithm and software for generating an ingredient list that can be purchased within the user's budget based on the recommended recipe.

[1706] The "means for displaying the optimal ingredient list and recommended recipes to the user" refers to a display device for visually presenting the generated optimal ingredient list and recommended recipes to the user, including the display of smart glasses or a smartphone.

[1707] The "means for displaying the optimal ingredient list and recommended recipes to the user using smart glasses and collecting information through voice input" refers to an interface and voice recognition technology for displaying an ingredient list and recipes on the display of smart glasses and accepting voice input from the user.

[1708] MODE FOR CARRYING OUT THE INVENTION

[1709] The present invention provides a support system that helps users to shop efficiently within their budget while maintaining a healthy diet. Specific embodiments of the system will be described in detail below.

[1710] 1. Enter user information

[1711] Users use input interfaces such as smart glasses or smartphones to input personal information such as their health status, preferences, and budget. A voice input interface is also available, allowing users to input information intuitively. This allows users to easily reflect their health status and preferences in the system.

[1712] 2. User Information Submission

[1713] The input information is sent to the server via the smart glasses or smartphone's communication function, using Wi-Fi or a data communication module. Based on the received information, the server starts the process of acquiring data from each store and generating recipes.

[1714] 3. Obtaining data from each store

[1715] The server uses APIs to retrieve daily specials and recommended product data from supermarkets, grocery stores, and other retailers, which can use beacon technology or the store's Wi-Fi. This data is updated in real time, providing users with the latest options.

[1716] 4. Generating recommended recipes

[1717] The server generates recommended recipes based on the acquired product data and the user's personal information. The recipes are generated using an algorithm that takes into account the user's health condition and preferences. For example, a user with diabetes may be suggested low-carb menus, and a recipe using chicken on sale may be generated.

[1718] 5. Generating the optimal ingredient list

[1719] Based on the generated recommended recipes, an optimal list of ingredients that fits within the user's budget is generated. This list is compared with the acquired product data to appropriately select the necessary ingredients. This allows the user to efficiently purchase healthy ingredients within their budget.

[1720] 6. Display of proposals

[1721] The optimal ingredient list and recommended recipes are displayed on the screen of smart glasses or a smartphone. In the case of smart glasses, the ingredient list and recipe are displayed on the screen, allowing users to check them in real time at the time of purchase. Voice input is also possible, further improving convenience.

[1722] Specific examples

[1723] For example, a user puts on smart glasses, enters a supermarket, and speaks the following information:

[1724] Health Condition: Diabetes

[1725] Budget: 2000 yen

[1726] Favorite food: Chicken

[1727] Allergies: Milk

[1728] The server obtains data such as "Chicken thighs on sale for 200 yen / 100g" and "Fresh broccoli for 150 yen / stalk" via the store's API, and generates recipes based on the user's information. The generated recipes are "Stir-fried chicken thighs and broccoli" and "Mushroom soup," and the list of ingredients needed (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms) is displayed on the smart glasses' display.

[1729] Finally, the user can give instructions to the system using the following prompt sentences:

[1730] Create healthy recipes based on your input:

[1731] Health Condition: Diabetes

[1732] Budget: 2000 yen

[1733] Favorite food: Chicken

[1734] Allergies: Milk

[1735] Available ingredients list:

[1736] Chicken thigh special sale 200 yen / 100g

[1737] Broccoli 150 yen / piece

[1738] Mushrooms 100 yen / 200g

[1739] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1740] Program processing steps

[1741] Processing Steps

[1742] Step 1:

[1743] (Processing content)

[1744] The user enters personal information.

[1745] (input)

[1746] Users use smart glasses or smartphones to input personal information such as their health status, preferences, and budget.

[1747] (Data processing, data calculation and output)

[1748] The device collects information using voice recognition and touch input, checks the format for errors, and then sends the information to the server after verification.

[1749] Step 2:

[1750] (Processing content)

[1751] The information input by the user is sent to the server.

[1752] (input)

[1753] The smart glasses or smartphone receives the entered personal information.

[1754] (Data processing, data calculation and output)

[1755] The device's communication module (Wi-Fi or data communication) is used to send the user's input information to the server, which then stores the received information in a database.

[1756] Step 3:

[1757] (Processing content)

[1758] Obtain product data from each store.

[1759] (input)

[1760] Personal information sent by the user to the server.

[1761] (Data processing, data calculation and output)

[1762] The server uses each store's API to obtain the recommended product data for that day. The obtained data includes information such as product name, price, and category, and is stored in a database.

[1763] Step 4:

[1764] (Processing content)

[1765] A recommended recipe is generated based on the acquired product data and the user information.

[1766] (input)

[1767] Product data and user personal information obtained by the server.

[1768] (Data processing, data calculation and output)

[1769] The server uses the generative AI model to generate recommended recipes based on the user's health status and preferences. For example, it might suggest low-carb options to a user with diabetes. The generated recipe information is then passed on to the next processing step.

[1770] Step 5:

[1771] (Processing content)

[1772] An optimal ingredient list is generated taking into consideration the recommended recipe and the user's budget.

[1773] (input)

[1774] Suggested recipes and user budget information.

[1775] (Data processing, data calculation and output)

[1776] The server compares the recommended recipe with the user's budget and generates a list of ingredients that can be purchased within the budget. This calculation also uses price information from the product data to generate the final ingredient list.

[1777] Step 6:

[1778] (Processing content)

[1779] The optimum ingredient list and recommended recipes are displayed to the user.

[1780] (input)

[1781] Best ingredients list and recommended recipes.

[1782] (Data processing, data calculation and output)

[1783] The server converts the generated optimal ingredient list and recommended recipes into a format that can be displayed on the screen of smart glasses or a smartphone, and sends it to the device, which then visually presents the received information to the user.

[1784] Step 7:

[1785] (Processing content)

[1786] The optimal ingredient list and recommended recipes are displayed to the user using smart glasses, and information is collected through voice input.

[1787] (input)

[1788] The best ingredient list and recipe suggestions displayed on smart glasses.

[1789] (Data processing, data calculation and output)

[1790] The user puts on the smart glasses and checks the information displayed on the screen. The user can then give additional instructions or modify the information by voice input. The voice instructions are recognized by the device and, if necessary, retransmitted to the server for processing updates.

[1791] As an example of this process, a user puts on a pair of smart glasses and instructs the system using the following prompt sentence:

[1792] Create healthy recipes based on your input:

[1793] Health Condition: Diabetes

[1794] Budget: 2000 yen

[1795] Favorite food: Chicken

[1796] Allergies: Milk

[1797] Available ingredients list:

[1798] Chicken thigh special sale 200 yen / 100g

[1799] Broccoli 150 yen / piece

[1800] Mushrooms 100 yen / 200g

[1801] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1802] The present invention relates to a system that aims to support users in shopping efficiently within their budget while maintaining a healthy diet, and also suggests optimal recipes taking into account the user's emotional state. This system is used by users using smartphones or tablet devices, and operates in the following manner.

[1803] Enter user information

[1804] 1. Users

[1805] Users open the smartphone app and enter personal information such as their health status, preferences, budget, etc. The app also uses a video camera and microphone to record voice and facial expression data to ascertain the user's emotional state.

[1806] Example: The user can enter information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "milk allergy" along with the emotion they are currently feeling (for example, "tired" or "happy"), or the app can automatically analyze their emotions.

[1807] 2. Terminal

[1808] The entered information and recorded voice and facial expression data are checked to ensure there are no formatting errors. After confirmation, this data is sent to the server.

[1809] Supermarket data acquisition

[1810] 1. Server

[1811] Send a request to the supermarket's API to get the recommended products for the day.

[1812] Example: Obtain data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[1813] Generate recommended recipes

[1814] 1. Server

[1815] Recommended recipes are generated based on the user's personal information (preferences, health status, budget), product data obtained from supermarkets, and the user's emotional state recognized by an emotion engine.

[1816] The recipe generation algorithm selects multiple recipes, such as "stir-fried chicken thighs and broccoli" and "mushroom soup," based on the user's information.

[1817] If the user is tired, the emotion engine will recommend easy recipes or recipes containing ingredients that will lift their spirits, and if the user is happy, it will suggest special dishes or new recipes.

[1818] Generate optimal menu within budget

[1819] 1. Server

[1820] From the recommended recipes, a menu that can be achieved within the user's budget is selected.

[1821] Generate a list of ingredients you need, compare it with supermarket prices, and adjust it to fit within your budget.

[1822] Example: A list might be generated that includes 500g of chicken thighs, 1 stalk of broccoli, and 200g of mushrooms.

[1823] Viewing Proposals

[1824] 1. Server

[1825] The optimal menu and ingredient list will be sent to your device.

[1826] 2. Terminal

[1827] The received data is displayed to the user.

[1828] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and also displays a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1829] Specific examples

[1830] Enter user information

[1831] The user enters the following information into the app:

[1832] Health Condition: Diabetes

[1833] Budget: 2000 yen

[1834] Favorite food: Chicken

[1835] Allergies: Milk

[1836] Emotional state: Tired

[1837] Supermarket data acquisition

[1838] The server accesses the supermarket's API and retrieves the following data:

[1839] Chicken thigh special sale (200 yen / 100g)

[1840] Broccoli (150 yen / piece)

[1841] Mushrooms (100 yen / 200g)

[1842] Generate recommended recipes

[1843] The server generates a recipe using the following information:

[1844] User information

[1845] Supermarket recommended product data

[1846] Emotional state by emotion engine

[1847] The recipe generation algorithm suggests "stir-fried chicken thighs and broccoli" and "mushroom soup," selecting easy-to-make recipes for tired users.

[1848] Generate optimal menu within budget

[1849] The server generates a list of ingredients that fit within the budget (2000 yen):

[1850] Chicken thigh 500g (1000 yen)

[1851] 1 stalk of broccoli (150 yen)

[1852] 200g mushrooms (100 yen)

[1853] Viewing Proposals

[1854] The server sends the optimal menu and ingredient list to the terminal.

[1855] The device displays the following information to the user:

[1856] Recommended menu items: Stir-fried chicken thigh and broccoli, mushroom soup

[1857] Ingredients: 500g chicken thigh, 1 stalk of broccoli, 200g mushrooms

[1858] The above is a specific embodiment for carrying out the invention. This system allows users to select the optimal ingredients for their health and emotional state, purchase them within their budget, and easily lead a healthy and mood-appropriate diet.

[1859] The processing flow will be explained below.

[1860] Step 1:

[1861] The user launches the smartphone app and inputs personal information such as health status, preferences, and budget. In addition, a video camera and microphone are used to record voice and facial expression data. For example, the user inputs information such as "diabetes," "budget of 2,000 yen," "likes chicken," "allergy to milk," and "tired."

[1862] Step 2:

[1863] The device checks the entered information and recorded voice and facial expression data to ensure there are no formatting errors. Once verified, this data is sent to the server.

[1864] Step 3:

[1865] The server sends a request to the supermarket's API to retrieve data on the day's specials and fresh products. For example, the server retrieves data such as "Chicken thigh special sale 200 yen / 100g" and "Fresh broccoli 150 yen / stalk."

[1866] Step 4:

[1867] The server analyzes and structures the product data it obtains. For example, it organizes information such as "Chicken thigh special sale: 200 yen / 100g" and "Fresh broccoli: 150 yen / stalk."

[1868] Step 5:

[1869] The server uses an emotion engine to recognize the user's emotional state, for example, recognizing the emotion "tired" from recorded voice and video facial expressions.

[1870] Step 6:

[1871] The server generates recommended recipes based on the user's personal information, health status, product data obtained from supermarkets, and the user's recognized emotional state. Based on the user's information, the recipe generation algorithm selects easy-to-make recipes for a tired user, such as "stir-fried chicken thighs and broccoli" or "mushroom soup."

[1872] Step 7:

[1873] The server creates a specific ingredient list based on the recommended recipe and the user's budget. For example, it creates a list such as "500g chicken thighs," "1 stalk of broccoli," and "200g mushrooms."

[1874] Step 8:

[1875] The server sends the optimal menu and ingredient list to the terminal. The recommended recipe and the corresponding ingredient list are sent to the terminal in data format.

[1876] Step 9:

[1877] The device analyzes the received data and displays it to the user. The displayed content is "Today's recommended menu is stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1878] Step 10:

[1879] The user can refer to the app while shopping at the supermarket and purchase products while checking the recommended ingredients list.

[1880] This is the detailed flow of the processing steps. This system enables users to shop efficiently and healthily, and also suggests recipes that suit their emotional state, allowing them to lead a more fulfilling diet.

[1881] Example 2

[1882] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1883] Conventional shopping support systems suggest recipes based on the user's health condition, preferences, and budget, but they are unable to consider the user's emotional state. As a result, recipe suggestions that match the user's mood at the time are insufficient, which can lead to reduced user satisfaction. Additionally, the personal information entered by the user may be inaccurate, resulting in reduced suggestion accuracy.

[1884] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting personal information of the user, means for transmitting the information input by the user to the server, means for acquiring product data from each store, means for generating recommended recipes based on the acquired product data and the user information, means for generating an optimal ingredient list taking into account the recommended recipes and the user's budget, means for displaying the optimal ingredient list and recommended recipes to the user, means for recording voice data and facial expression data to analyze the user's emotional state, and means for adjusting the recommended recipes taking into account the emotional state. This enables highly accurate recipe suggestions that also take the user's emotional state into account.

[1885] A "user" is an individual or group that uses the system and inputs information such as health status, preferences, budget, and emotional state.

[1886] "Personal Information" is information entered by a user about a user's particular circumstances and preferences, such as health status, preferences, budget, emotional state, and allergy information.

[1887] The "server" is a computer system that receives information sent by users, acquires data from each store, and generates recommended recipes and ingredient lists.

[1888] "Stores" refer to retail stores such as supermarkets and food retailers, and are entities that provide product data through APIs.

[1889] "Product data" refers to information such as product name, price, and stock status obtained from the store.

[1890] A "recommended recipe" is a recipe for a dish that is suggested to a user based on the user's personal information and product data obtained from a store.

[1891] The "ingredient list" is a list of ingredients and their amounts required to make a recommended recipe.

[1892] "Voice data" is information input by voice from a user, and is data for analyzing the emotional state of the user.

[1893] "Facial expression data" is information based on facial expressions input by the user, and is data for analyzing the emotional state of the user.

[1894] An "emotional state" is a user's psychological or emotional state, including states such as tiredness, joy, anxiety, etc.

[1895] The "emotion engine" is an analysis system that analyzes the user's emotional state from their voice data and facial expression data, and adjusts recommended recipes based on that information.

[1896] "API" stands for Application Programming Interface, and is the interface used by the server to obtain data from each store.

[1897] The present invention is a system that aims to support users in shopping efficiently within their budget while maintaining a healthy diet. This system proposes optimal recipes taking into account the user's emotional state and is configured so that the user can use it on a smartphone or tablet device. Details for specifically implementing the present invention are described below.

[1898] Enter user information

[1899] A user opens a smartphone app and inputs personal information such as their health condition, preferences, budget, and emotional state. At this time, a video camera and microphone are used to record voice and facial expression data. An emotion engine is then used to analyze the user's emotional state from this data.

[1900] Example: A user enters information such as "diabetes," "budget of 2,000 yen," "likes chicken," and "allergy to milk," and the app automatically analyzes their current emotions (e.g., "tired").

[1901] Data transmission and check

[1902] The device checks the input information and recorded voice and facial expression data to ensure there are no format errors, and then sends this data to the server.

[1903] Get product data

[1904] The server sends a request to the supermarket's API endpoint to retrieve the recommended product data for that day, such as "Chicken thigh special sale 200 yen / 100g" or "Fresh broccoli 150 yen / stalk."

[1905] Generate recommended recipes

[1906] The server references the user's personal information (preferences, health status, budget) and compares the acquired product data. Furthermore, it uses an emotion engine to generate recommended recipes that take into account the user's emotional state. Specifically, if the user is tired, it recommends easy-to-make recipes, and if the user is happy, it suggests special dishes or new recipes.

[1907] Example: A recipe generation algorithm suggests the following recipes: "Stir-fried chicken thighs and broccoli" and "Mushroom soup."

[1908] Generate optimal menu within budget

[1909] The server selects from the recommended recipes a menu that is feasible within the user's budget, generates a list of ingredients, and compares it with supermarket price information to ensure it fits within the budget.

[1910] Example: A list such as 500g of chicken thigh (1000 yen), 1 stalk of broccoli (150 yen), and 200g of mushrooms (100 yen) is generated.

[1911] Viewing Proposals

[1912] The server sends the optimal menu and ingredient list to the terminal, which displays the received data to the user.

[1913] Example: The app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," and provides a specific list of ingredients (500g chicken thighs, 1 stalk of broccoli, 200g mushrooms).

[1914] Prompt Sentence Examples

[1915] "When a user enters personal information into the app, such as 'diabetes,' 'budget of 2,000 yen,' 'likes chicken,' and 'milk allergy,' and records their emotional state as 'tired,' the server accesses the supermarket's API and obtains product data such as 'chicken thighs on sale for 200 yen / 100g' and 'fresh broccoli for 150 yen / stalk.' The server then generates recipes such as 'stir-fried chicken thighs and broccoli' or 'mushroom soup' based on the user's information and the obtained product data, recommends recipes that are easy to make taking into account the user's emotional state, and sends a list of ingredients that fit within the user's budget (500g chicken thighs, one stalk of broccoli, 200g mushrooms) to the device, which then displays it to the user."

[1916] This invention allows users to easily obtain optimal ingredients and recipes that suit their emotional and health conditions, and allows them to shop within their budget. The hardware used includes smartphones and tablet devices, and the software includes a supermarket API, an emotion engine, and a recipe generation algorithm.

[1917] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1918] Step 1: Enter your information

[1919] 1. The user launches the app on their smartphone and an input form is displayed.

[1920] 2. The user inputs their health condition (e.g., "diabetes"), preferences (e.g., "I like chicken"), budget (e.g., "2,000 yen"), and allergy information (e.g., "milk allergy"). They also input their emotional state (e.g., "I'm tired"), or the emotional data is automatically recorded using a video camera or microphone. Specific actions include showing facial expressions to the camera or speaking into the microphone, such as "I'm tired today."

[1921] Input: User's health status, preferences, budget, allergy information, emotional state

[1922] Output: Verified personal information data

[1923] Step 2: Submit and verify data

[1924] 1. The device checks the information entered and checks for formatting errors, for example displaying a warning if the budget field is blank.

[1925] 2. After confirmation, the terminal sends the user's input information and recorded data to the server. The transmission format generally uses the HTTPS protocol, and the data is encrypted.

[1926] Input: Verified personal data

[1927] Output: Data sent to the server

[1928] Step 3: Obtain supermarket data

[1929] 1. The server sends a request to the supermarket API, for example, "GET / api / v1 / products / today_specials".

[1930] 2. The server retrieves the recommended product data for that day and stores it in a database. The retrieved product data includes product name, price, and stock information.

[1931] Input: API request

[1932] Output: Retrieved product data

[1933] Step 4: Generate recommended recipes

[1934] 1. The server retrieves the user's personal information (health status, preferences, budget) from the database.

[1935] 2. Based on the product data acquired by the server, a recipe generation algorithm is used to generate recipe candidates. For example, recipes such as "Stir-fried chicken thighs and broccoli" or "Mushroom soup" are generated.

[1936] 3. The server uses an emotion engine to analyze the user's emotional state and adjust the recipe accordingly. For example, it might recommend easy recipes to a tired user.

[1937] Input: User information data, product data

[1938] Output: Recommended recipe

[1939] Step 5: Generate the optimal menu

[1940] 1. The server selects from the recommended recipes a recipe that is feasible within the user's budget.

[1941] 2. The server generates a list of ingredients needed and adjusts it based on price information. For example, a list might be generated that includes "500g of chicken thighs (1000 yen)," "1 stalk of broccoli (150 yen)," and "200g of mushrooms (100 yen)."

[1942] Input: Recommended recipes, product price information

[1943] Output: Budgeted ingredients list

[1944] Step 6: View the proposal

[1945] 1. The server sends the optimal menu and ingredient list to the device. The sending format is mainly JSON.

[1946] 2. The device displays the received data to the user. Specifically, the app displays "Today's recommended menu items are stir-fried chicken thighs and broccoli, and mushroom soup," along with a list of specific ingredients.

[1947] Input: Optimal menu, ingredients list

[1948] Output: Information displayed to the user

[1949] Through these steps, users can easily obtain the optimal ingredients and recipes that suit their emotional and health states, and shop efficiently within their budget.

[1950] (Application example 2)

[1951] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1952] Today's consumers want the right ingredients and recipes based on their health status, budget, and preferences, but it is difficult to do so efficiently. Furthermore, because consumers' emotional state is an important factor in ingredient selection, recipe suggestions based on their emotional state are also necessary. In addition, a lack of systems that allow consumers to easily order optimal ingredients has been pointed out. To solve these issues, there is a need for a system that can recommend optimal ingredients and recipes based on a user's overall health status, preferences, budget, and emotional state, and then order food on the spot.

[1953] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1954] In this invention, the server includes: means for a user to input personal information and emotional state; means for transmitting the user's input information and emotional state to the server; means for acquiring product data from each store; means for generating recommended recipes based on the acquired product data and the user's information and emotional state; means for generating an optimal ingredient list taking into account the recommended recipe and the user's budget; means for displaying the optimal ingredient list and recommended recipe to the user; and means for the user to order food based on the displayed ingredient list and recommended recipe. This enables consumers to efficiently select optimal ingredients and recipes that suit their health condition, preferences, budget, and emotional state, and easily order food on the spot.

[1955] "Means for users to input personal information and emotional state" refers to a device or interface that allows a user to input personal information such as their health status, preferences, budget, emotional state, etc.

[1956] "Means for transmitting the information and emotional state input by the user to the server" refers to a communication function for transmitting the information and emotional state input by the user to the server via the Internet or the like.

[1957] "Means of obtaining product data from each store" refers to technology for obtaining information on the day's special sales and recommended products through the APIs of supermarkets and stores.

[1958] "Means for generating recommended recipes based on the acquired product data and the user's information and emotional state" refers to an algorithm or program that generates the optimal recipe for the user based on the product data acquired by the server and the user's input information.

[1959] "Means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget" refers to an algorithm or program that generates an optimal ingredient list that is efficient and fits within the budget based on the generated recommended recipe and the user's budget.

[1960] The term "means for displaying the optimal ingredient list and recommended recipes to the user" refers to an interface for displaying the generated ingredient list and recipes on the user's device.

[1961] "A means for the user to order food based on the displayed ingredient list and recommended recipe" refers to a function that allows the user to order the suggested food as is based on the displayed information.

[1962] The purpose of this invention is to provide a food delivery system that allows users to manage their healthy eating habits. This system suggests optimal ingredients and recipes based on the user's health condition, preferences, budget, and emotional state, and allows the user to order food directly.

[1963] Hardware and Software Use

[1964] The system is implemented using the following hardware and software:

[1965] Smartphone: Used by users to enter information, see suggested recipes and ingredient lists, and order food.

[1966] Cloud server: Stores user input data and combines it with store data to generate optimal recipes and ingredient lists.

[1967] Network: An internet connection to send and receive data between your device and the cloud server.

[1968] Store API: An interface for obtaining the latest product data for each store.

[1969] Emotion analysis engine: Analyzes the user's voice and facial expression data to recognize their emotional state.

[1970] Data processing and calculation

[1971] The server processes data and performs calculations in the following steps.

[1972] 1. Input and transmission of user information: The user uses a smartphone to input information about their health condition, preferences, budget, and emotional state. The input information is then transmitted to the server via the network.

[1973] 2. Product data acquisition: The server uses each store's API to acquire the latest product data, including the price and availability of ingredients.

[1974] 3. Recipe generation: The server generates the optimal recipe for the user based on the acquired product data and the user's input information. The recipe generation algorithm takes into account not only the user's health condition and preferences, but also their emotional state. For example, if the user is "tired," it will suggest an easy recipe, and if the user is "happy," it will suggest a special dish.

[1975] 4. Generate an ingredient list: The optimal ingredient list is generated based on the generated recipe and budget. This ingredient list is adjusted to fit within the budget.

[1976] 5. Displaying and ordering data: The server displays the generated recipe and ingredient list on the user's smartphone. The user can then order food on the spot based on the displayed information.

[1977] Specific example explanation

[1978] As a specific example of operation, a user inputs their health condition (diabetes), budget (2,000 yen), preferences (likes chicken), allergies (milk), and emotional state (tired). The input data is sent from the smartphone device to the server, which then obtains data such as "chicken thigh sale (200 yen / 100g)," "broccoli (150 yen / stalk)," and "mushrooms (100 yen / 200g)" via the supermarket API. The emotion analysis engine analyzes the user's emotion of "tired" and suggests easy-to-make recipes such as "stir-fried chicken thigh and broccoli" and "mushroom soup."

[1979] Examples of prompts to input to a generative AI model include:

[1980] "Suggest the best recipes for a diabetic user who has a budget of 2000 yen, loves chicken, is allergic to milk, and is tired. Prioritize dishes that are as easy to make as possible, and use data from a super API to provide recipes that fit within that budget."

[1981] As described above, the present invention provides optimal ingredients and recipes according to the individual needs of users, and realizes an environment in which food can be easily ordered on the spot.

[1982] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1983] Step 1:

[1984] Enter user information

[1985] Users use their smartphones to input their health status, budget, preferences, allergies, and emotional state into the application, which also provides a function to automatically analyze their emotional state using voice and facial expression data.

[1986] Input: Health condition (e.g., diabetes), budget (e.g., 2,000 yen), preferences (e.g., chicken), allergies (e.g., milk allergy), emotional state (e.g., tired)

[1987] Output: User input data is temporarily stored in the terminal.

[1988] What it does: The user inputs information into a smartphone app, which uses the camera and microphone to analyze voice and facial expressions as needed.

[1989] Step 2:

[1990] User information sent to server

[1991] The terminal checks the entered user information for formatting errors and sends it to the server, where it is stored.

[1992] Input: Data entered by the user

[1993] Output: The checked user data is sent to the server and stored.

[1994] Specific operation: The terminal checks the format of the user-entered data and sends the data to the server via the network.

[1995] Step 3:

[1996] Get product data

[1997] The server uses each store's API to retrieve the latest product data, including product name, price, and stock status.

[1998] Input: API request for each store

[1999] Output: Retrieved product data

[2000] Specific operation: The server sends a request to each store's API to obtain the day's special sale information and recommended product data.

[2001] Step 4:

[2002] Generate recommended recipes

[2003] The server generates recommended recipes based on the acquired product data, user information, and emotional state. This is handled by a recipe generation algorithm.

[2004] Input: User data, store product data

[2005] Output: Recommended recipe

[2006] Specific operation: The recipe generation algorithm generates and selects multiple recipes taking into account the user's health condition, preferences, and emotional state.

[2007] Step 5:

[2008] Generate an ingredient list

[2009] The server generates an optimal ingredient list taking into account the recommended recipe and the user's budget, thereby listing ingredients that can be purchased within the budget.

[2010] Input: Recommended recipe, user budget

[2011] Output: Optimal ingredients list

[2012] Specific operation: The server generates and lists the optimal ingredients list that fits within the budget based on the recommended recipe and store data.

[2013] Step 6:

[2014] View recommended recipes and ingredient lists

[2015] The server sends the generated recommended recipes and optimal ingredient lists to the user's smartphone and displays them, allowing the user to check the recommended recipes.

[2016] Input: Recommended recipes, best ingredient lists

[2017] Output: Display on the user's terminal

[2018] Specific behavior: Data is sent from the server to the user's device and the app displays it.

[2019] Step 7:

[2020] Food ordering

[2021] The user orders food based on the displayed ingredient list and recommended recipes, and the order information is sent to the food delivery service via the server.

[2022] Input: Ingredient list, order request

[2023] Output: Order confirmation and shipping arrangements

[2024] What happens: The user places an order for the ingredients they selected, and the order information is sent to the food delivery service via the server, which then arranges for delivery and confirms the order.

[2025] Through these steps, users will be presented with the best ingredients and recipes that suit their health condition, preferences, budget, and emotional state, and can easily order food on the spot.

[2026] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2027] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2028] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2029] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2030] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2031] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2032] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2033] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2034] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2035] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2036] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2037] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2038] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2039] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2040] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2041] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2042] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2043] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2044] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2045] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2046] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2047] The following is further disclosed regarding the above embodiment.

[2048] (Claim 1)

[2049] a means for a user to input personal information;

[2050] means for transmitting the information input by the user to a server;

[2051] A means of obtaining product data from each store,

[2052] a means for generating a recommended recipe based on the acquired product data and user information;

[2053] means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget;

[2054] means for displaying the optimal ingredient list and recommended recipes to a user;

[2055] A system including:

[2056] (Claim 2)

[2057] The system according to claim 1, further comprising means for acquiring recommended product data for each store using an API.

[2058] (Claim 3)

[2059] 10. The system of claim 1, further comprising an algorithm that takes into account a user's health status and preferences in generating the recommended recipes.

[2060] "Example 1"

[2061] (Claim 1)

[2062] a means for a user to input personal information;

[2063] means for transmitting the information input by the user to a server;

[2064] A means of obtaining product data from each store,

[2065] a means for generating a recommended recipe based on the acquired product data and user information;

[2066] means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget;

[2067] means for displaying the optimal ingredient list and recommended recipes to a user;

[2068] A means for using a generation AI model when generating a recommended recipe based on the product data acquired by the server;

[2069] means for the server to use a budget optimization algorithm when generating an optimal ingredient list;

[2070] A system including:

[2071] (Claim 2)

[2072] The system according to claim 1, further comprising means for acquiring recommended product data for each store using an API.

[2073] (Claim 3)

[2074] 10. The system of claim 1, further comprising an algorithm that takes into account a user's health status and preferences in generating the recommended recipes.

[2075] "Application Example 1"

[2076] (Claim 1)

[2077] a means for a user to input personal information;

[2078] means for transmitting the information input by the user to a server;

[2079] A means of obtaining product data from each store,

[2080] a means for generating a recommended recipe based on the acquired product data and user information;

[2081] means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget;

[2082] means for displaying the optimal ingredient list and recommended recipes to a user;

[2083] a means for displaying the optimal ingredient list and recommended recipes to a user using smart glasses and collecting information through voice input;

[2084] A system including:

[2085] (Claim 2)

[2086] The system according to claim 1, further comprising means for acquiring recommended product data for each store using an API.

[2087] (Claim 3)

[2088] The system according to claim 1, further comprising an algorithm that takes into account the user's health condition and preferences when generating the recommended recipes, and means for updating store product data in real time.

[2089] "Example 2: Combining Emotion Engines"

[2090] (Claim 1)

[2091] a means for a user to input personal information;

[2092] means for transmitting the information input by the user to a server;

[2093] A means of obtaining product data from each store,

[2094] a means for generating a recommended recipe based on the acquired product data and user information;

[2095] means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget;

[2096] means for displaying the optimal ingredient list and recommended recipes to a user;

[2097] means for recording voice data and facial expression data for analyzing the emotional state of a user;

[2098] means for adjusting the recommended recipes taking into account said emotional state;

[2099] A system including:

[2100] (Claim 2)

[2101] The system according to claim 1, further comprising means for acquiring recommended product data for each store using an API.

[2102] (Claim 3)

[2103] 10. The system of claim 1, further comprising an algorithm that takes into account a user's health status and preferences in generating the recommended recipes.

[2104] "Application example 2 when combining emotion engines"

[2105] (Claim 1)

[2106] a means for the user to input personal information and emotional state;

[2107] means for transmitting the user's input information and emotional state to a server;

[2108] A means of obtaining product data from each store,

[2109] means for generating a recommended recipe based on the acquired product data and the user's information and emotional state;

[2110] means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget;

[2111] means for displaying the optimal ingredient list and recommended recipes to a user;

[2112] a means for the user to order food based on the displayed ingredient list and recommended recipes;

[2113] A system including:

[2114] (Claim 2)

[2115] The system according to claim 1, further comprising means for acquiring recommended product data for each store using an API.

[2116] (Claim 3)

[2117] 10. The system of claim 1, further comprising an algorithm that takes into account a user's health status and preferences in generating the recommended recipes. [Explanation of symbols]

[2118] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for a user to input personal information; means for transmitting the information input by the user to a server; A means of obtaining product data from each store, a means for generating a recommended recipe based on the acquired product data and user information; means for generating an optimal ingredient list taking into consideration the recommended recipe and the user's budget; means for displaying the optimal ingredient list and recommended recipes to a user; A system including:

2. The system according to claim 1, further comprising means for acquiring recommended product data for each store using an API.

3. The system of claim 1 , further comprising an algorithm that takes into account a user's health status and preferences in generating the recommended recipes.

Images