System

Abstract

A system is provided.SOLUTION: A system comprising: first means for registering user information; second means for proposing a menu based on the user information; third means for comparing ingredients necessary for the proposed menu with inventory information of a local store; fourth means for ordering the necessary ingredients via a network; fifth means for acquiring information on ingredients that are overstocked or close to expiration date to reduce food waste; and sixth means for proposing a new menu based on the acquired information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern households, planning daily menus takes time and effort, making it a burden for many people. Food waste is also a major problem at local stores, and managing and disposing of unsold ingredients is costly. There is a need for a system that can solve these problems, make users' lives more convenient, and reduce food waste. [Means for solving the problem]

[0005] The present invention includes a first means for registering the user's family composition, allergy information, religious restrictions, etc., and a second means for proposing optimal menus based on this information. It also includes a third and fourth means for checking inventory information from local stores and enabling the user to order the necessary ingredients online. It also includes a fifth means for acquiring information on ingredients that are overstocked or near their expiration date in order to reduce food waste. This makes it possible to suggest new menus to the user, reducing the burden of creating menus at home, while also reducing food waste at local stores.

[0006] The "first method" is a function that allows users to register personal information such as family composition, allergy information, and religious restrictions.

[0007] The "second method" is a function that uses AI and algorithms to suggest optimal menus based on the user information registered in the first method.

[0008] The "third means" is a function that checks the ingredients needed for the suggested meal plan against the inventory information of local retailers.

[0009] The "fourth means" is a feature that allows users to order the ingredients they need online.

[0010] The "fifth measure" is a function that obtains information on ingredients that are in excess stock or near their expiration date in order to reduce food waste.

[0011] The "sixth method" is a function that suggests new menus based on the food information obtained in the fifth method. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0013] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0014] First, the terms used in the following description will be explained.

[0015] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0016] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0017] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0018] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0020] [First embodiment]

[0021] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0022] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0023] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0024] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0025] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0026] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0027] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0028] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0029] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0031] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0032] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0033] This invention is a system that makes users' lives more convenient and reduces food waste. The system includes a means for users to input and register information such as family composition, allergy information, and religious restrictions, and then suggests optimal menus based on this information. The ingredients needed for the suggested menus are checked against inventory information at local stores, allowing online ordering. To reduce food waste, the system also obtains information on ingredients that are overstocked or nearing their expiration date, and uses this information to suggest new menus to users.

[0034] Program processing

[0035] 1. User information registration

[0036] 1.1 Users

[0037] Launch the app and enter your family composition, allergy information, religious restrictions, etc. Confirm the information you entered and press the "Register" button.

[0038] 1.2 Terminal

[0039] The input information from the user is formatted in JSON format and an HTTP request is generated to be sent to the server.

[0040] 1.3 Server

[0041] The received user information is saved in the database. If the save is successful, a registration completion message is returned to the user.

[0042] 2. Menu suggestions

[0043] 2.1 Server

[0044] User information is retrieved from the database and sent to the AI ​​engine, which then generates a menu based on the user information.

[0045] 2.2 Server

[0046] When a menu proposal is generated, a response is returned to the terminal together with menu information to be proposed to the user.

[0047] 2.3 Terminal

[0048] The received menu information is displayed on the user interface.

[0049] 2.4 Users

[0050] Review the proposed menu, make any necessary changes or modifications, and finalize it.

[0051] 3. Collaboration with local supermarkets and obtaining inventory information

[0052] 3.1 Local supermarket

[0053] Regularly update your store's inventory information (e.g., quantity of salmon, spinach, expiration date) and send it to the server.

[0054] 3.2 Server

[0055] The received inventory information is stored in a database and compared with existing user information to update the inventory status.

[0056] 4. Order ingredients online

[0057] 4.1 Users

[0058] Check the suggested menu and press the "Order" button on the app.

[0059] 4.2 Terminal

[0060] The user's order information (e.g. salmon, spinach, fruit, yogurt) is formatted in JSON format and an HTTP request is generated to send to the server.

[0061] 4.3 Server

[0062] Process the received order information and send the list of ingredients needed to the local supermarket.

[0063] 4.4 Local supermarket

[0064] Based on the received ingredient list, the inventory management system picks up the necessary ingredients and prepares them for delivery.

[0065] 4.5 Server

[0066] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[0067] 5. Recommended ingredients to reduce food waste

[0068] 5.1 Local supermarket

[0069] Information on ingredients that are in excess stock or near their expiration date is uploaded to a server.

[0070] 5.2 Server

[0071] Based on the received inventory information, the AI ​​engine generates new menus using the relevant ingredients and suggests them to the user.

[0072] 5.3 Terminal

[0073] The generated new menu information is displayed on the user interface.

[0074] 5.4 Users

[0075] Check the newly proposed menu and ingredients and place orders as necessary.

[0076] Specific examples

[0077] User: Tanaka family

[0078] 1. User information registration

[0079] The Tanaka family has a wheat allergy, so they entered "wheat" as their allergy information. The family consists of four people: two adults and two children.

[0080] 2. Menu suggestions

[0081] The server suggests gluten-free meals that children can enjoy. For example, the main dish is teriyaki salmon, the side dish is boiled spinach, and the dessert is fruit yogurt.

[0082] 3. Obtaining inventory information

[0083] Local supermarket A sends inventory information to the server. They have plenty of salmon and spinach in stock and want to prioritize selling them because they have a long shelf life.

[0084] 4. Order Confirmation

[0085] The Tanaka family checks the proposed menu and orders ingredients through the app, and the server sends the order information to local supermarket A.

[0086] 5. Recommended ingredients

[0087] Local supermarket A has an excess of tomatoes and broccoli in stock, so it sends that data to the server. The server then suggests a new menu using tomatoes and broccoli. The Tanaka family checks the menu and places an order.

[0088] In this way, the entire system aims to improve user convenience and reduce food waste.

[0089] The processing flow will be explained below.

[0090] Step 1: Register user information

[0091] 1.1 Users

[0092] The user launches the app and enters information such as family composition (e.g., two adults, two children), allergy information (e.g., wheat allergy), religious restrictions (e.g., need for halal-certified food), etc., confirms the information entered, and presses the "Register" button.

[0093] 1.2 Terminal

[0094] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[0095] 1.3 Server

[0096] Parse the received user information and save it in the database. If the save is successful, return a registration completion message to the user.

[0097] Step 2: Menu suggestions

[0098] 2.1 Server

[0099] The database is queried (searched) for user information and sent to an AI engine for processing, which then generates an appropriate menu based on the user information.

[0100] 2.2 Server

[0101] The generated menu information is sent to the user's terminal as a response.

[0102] 2.3 Terminal

[0103] The received menu information is displayed on the user interface.

[0104] 2.4 Users

[0105] Check the presented menu, make any necessary changes or corrections, and finally confirm the menu.

[0106] Step 3: Collaborate with local supermarkets and obtain inventory information

[0107] 3.1 Local supermarket

[0108] Regularly update your store's inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server.

[0109] 3.2 Server

[0110] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[0111] Step 4: Order ingredients online

[0112] 4.1 Users

[0113] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[0114] 4.2 Terminal

[0115] Format the user's order information in JSON format and send an HTTP request to the server.

[0116] 4.3 Server

[0117] The system processes the received order information and sends a list of ingredients needed to a local supermarket, including the type of food, quantity, delivery date and time, etc.

[0118] 4.4 Local supermarket

[0119] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[0120] 4.5 Server

[0121] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[0122] Step 5: Recommended ingredients to reduce food waste

[0123] 5.1 Local supermarket

[0124] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[0125] 5.2 Server

[0126] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[0127] 5.3 Server

[0128] The newly generated menu information is sent to the user's terminal.

[0129] 5.4 Terminal

[0130] The new menu information is displayed in the user interface.

[0131] 5.5 Users

[0132] Check the newly presented menu and ingredients and place orders as necessary.

[0133] Example 1

[0134] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0135] In modern society, managing household menus and reducing food waste are important issues. In particular, existing systems are unable to adequately address the issues of proposing cooking menus that take into account diverse family structures, allergies, and religious restrictions, linking with local retailers' inventory status, and reducing food waste. There is also a need for more efficient ordering procedures and an intuitive user interface.

[0136] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0137] In this invention, the server includes a first means for registering user information, a second means for proposing a menu based on the user information, a third means for comparing ingredients needed for the proposed menu with inventory information from local stores, a fourth means for enabling online ordering of the necessary ingredients, a fifth means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, a sixth means for proposing a new menu based on the acquired food information using a generative AI model, a seventh means for formatting the user information and inventory information from local stores in JSON format and generating an HTTP request, and an eighth means for displaying the information received on the terminal on a user interface. This allows the user to efficiently receive optimal menu suggestions and reduce food waste by linking with inventory information from local stores.

[0138] "User Information" refers to family information, allergy information, religious restrictions, and other personal data entered by the user.

[0139] The "first means" refers to a means for registering user information, and includes a function for saving information entered by the user in a database.

[0140] The "second means" refers to a means of proposing the optimal menu based on user information, and includes a function for generating menus using an AI engine or algorithm.

[0141] The "third means" refers to a means of checking the ingredients needed for the proposed menu against inventory information from local retailers, and includes a function to grasp inventory status and link it to the menu.

[0142] The "fourth means" refers to a means that allows the necessary ingredients to be ordered online, and includes a function to generate order information and send it to the retailer.

[0143] The "fifth means" refers to a means of obtaining information on ingredients that are in excess stock or near their expiration date in order to reduce food waste, and includes a function to receive inventory information from local retailers.

[0144] The "sixth means" refers to a means of using an AI model to generate and propose new menus based on the acquired food information, and includes functions related to generating menus to reduce food waste.

[0145] The "seventh means" refers to a means for formatting user information and local retailer inventory information in JSON format and generating an HTTP request, and includes functions related to data format conversion and request generation.

[0146] The "eighth means" refers to a means for displaying the information received by the terminal on a user interface, and includes a function for providing information intuitively to the user.

[0147] A "generative AI model" refers to an artificial intelligence algorithm or system that generates optimal menu and ingredient suggestions based on user information and inventory information.

[0148] A "prompt" is an instruction given to a generative AI model to obtain a specific output.

[0149] This invention is a system that aims to efficiently suggest optimal menus to users and reduce food waste by linking with inventory information from local retailers. In this example, the roles of the user, terminal, and server are specifically explained. The invention is implemented with the following configuration.

[0150] User input of information

[0151] Users launch the application on their smartphone or computer and enter the necessary information, such as family composition, allergy information, and religious restrictions. This information is saved in the system and becomes the basic data when menu suggestions are made. For example, if a user has a family of four and the father has a wheat allergy, they would enter information such as "family of four," "allergies: wheat," and "no religious restrictions."

[0152] Data formatting and transmission by the terminal

[0153] The device formats the information entered by the user in JSON format, generates an HTTP request, and sends it to the server. The specific software used is an iOS or Android application and a web browser.

[0154] Data processing and storage by server

[0155] The server receives the user information sent from the device and stores it in a database. The stored user information serves as the basis for generating optimal menus. The server often uses MySQL or PostgreSQL as its database management system (DBMS).

[0156] Menu suggestions

[0157] The server retrieves user information from the database and sends it to the generative AI model as a prompt. This AI engine (e.g., GPT-3 or BERT) analyzes the user information and generates the optimal menu that meets the user's criteria. An example of a prompt might be, "Please suggest a menu for a family of four where the father has a wheat allergy."

[0158] Display menu information

[0159] The server sends the generated menu information to the device as a response. The device displays this information on a user interface, providing the user with suggested menus and related ingredient information. Frameworks such as React Native and Flutter may be used for display.

[0160] Get inventory and place orders

[0161] Local stores periodically update their inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server. The server receives this information and stores it in a database. The user can then order the ingredients needed for the proposed meal online, and the server sends the order information to the local store. This also takes into account ingredients that are overstocked or nearing their expiration date.

[0162] New menu proposals to reduce food waste

[0163] The server uses a generative AI model to propose new menus based on information about ingredients that are overstocked or nearing their expiration date. The device displays this information on a user interface, and the user can check the newly proposed menu and ingredient information and place an order if necessary.

[0164] Specific examples

[0165] For example, if the Tanaka family consists of four people and the father has a wheat allergy, the user inputs the wheat allergy information and family composition. The server uses an AI engine to generate a "gluten-free menu that children can enjoy," suggesting "salmon teriyaki" as the main dish, "spinach ohitashi" as a side dish, and "fruit yogurt" as a dessert. The order is then processed based on inventory information from local retailers. If the local retailer sends information that they have excess stock of tomatoes and broccoli, the server will suggest a new menu using those ingredients.

[0166] In this way, the entire system aims to improve user convenience and reduce food waste.

[0167] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0168] Step 1:

[0169] User input of information

[0170] Users launch the application on their smartphone or computer, enter the necessary information such as family composition, allergies, and religious restrictions, and press the "Register" button.

[0171] Input: Family composition, allergy information, religious restrictions

[0172] Output: User information entered

[0173] Specific operation: The user enters each item in the application's input form using text or options. For example, "Family of four" and "Allergy: wheat."

[0174] Step 2:

[0175] Data formatting and transmission by the terminal

[0176] The terminal formats the information entered by the user in JSON format, generates an HTTP request, and sends it to the server.

[0177] Input: User information entered

[0178] Output: JSON formatted data, HTTP request

[0179] Specific operation: The device internally converts the entered text and options into JSON format and sends it as an HTTP POST request to the specified endpoint.

[0180] Step 3:

[0181] Data processing and storage by server

[0182] The server receives the user information sent from the device and stores it in a database. The stored user information becomes the basis for generating the optimal menu.

[0183] Input: User information in JSON format

[0184] Output: User information saved in the database, registration completion message

[0185] Specific operation: The server receives the request, parses it, extracts the user information, executes an INSERT query to the database to save the information, and returns a registration completion message to the device.

[0186] Step 4:

[0187] Server acquires user information and generates menu

[0188] The server retrieves user information from the database and sends it as a prompt to the generative AI model, which then generates the optimal menu based on the user information.

[0189] Input: User information stored in the database

[0190] Output: Generated menu suggestions

[0191] Specific operation: The server obtains user information using an SQL query, generates a prompt saying, "Please suggest a menu for a family of four with a father who has a wheat allergy," and sends it to the AI ​​engine. The AI ​​engine generates a menu and returns it to the server.

[0192] Step 5:

[0193] Server response for menu suggestions

[0194] The server compiles the generated menu information and sends it to the user's terminal as a response.

[0195] Input: Generated menu suggestions

[0196] Output: Response data sent to the device

[0197] Specific operation: The server formats the menu information received from the AI ​​engine and sends it to the terminal as an HTTP response.

[0198] Step 6:

[0199] Menu display on a terminal

[0200] The terminal displays the received menu suggestion information on a user interface.

[0201] Input: Received menu suggestion information

[0202] Output: Menu information displayed in a user interface

[0203] What it does: The device receives the response, parses the JSON, and displays it on the screen by category, such as main dish, side dish, and dessert. For example, "Main dish: Teriyaki salmon."

[0204] Step 7:

[0205] User confirmation and correction

[0206] The user reviews the proposed menu, makes any necessary changes or corrections, and confirms it.

[0207] Input: Menu information displayed in the user interface

[0208] Output: Confirmed menu information

[0209] Specific behavior: The user checks the displayed suggestions, makes individual corrections if necessary, and finally presses the "Confirm" button to confirm the changes.

[0210] Step 8:

[0211] Local retailer inventory updates

[0212] Local stores periodically update their inventory information and send it to the server.

[0213] Input: Inventory information (e.g., quantity of salmon, spinach, expiration date)

[0214] Output: Stock information sent to the server

[0215] What it does: Local retailers use an inventory management system to update their inventory information and periodically send that information to the server.

[0216] Step 9:

[0217] Stock information storage and verification by server

[0218] The server stores the received inventory information in a database and updates the inventory status by comparing it with existing user information.

[0219] Input: Stock information sent to the server

[0220] Output: Updated inventory status

[0221] Specific operation: The server saves the inventory information in a database, compares it with the user information, and updates the stock status of the necessary ingredients.

[0222] Step 10:

[0223] User execution of orders

[0224] The user checks the proposed menu, selects the necessary ingredients, and presses the "Order" button.

[0225] Input: Suggested menu information, user selection

[0226] Output: Order information

[0227] Specific operation: The user selects ingredients based on the menu information, presses the "Order" button, and confirms the order.

[0228] Step 11:

[0229] Terminal-based order request generation

[0230] The terminal formats the order information in JSON format and generates an HTTP request to send to the server.

[0231] Input: User's order information

[0232] Output: JSON order data, HTTP request

[0233] Specific operation: The terminal receives the order information, converts it into JSON format, and then generates an HTTP POST request to send to the server.

[0234] Step 12:

[0235] Server processes order and sends it to local dealer

[0236] The server processes the received order information and sends the required ingredient list to a local retailer.

[0237] Input: Order information in JSON format

[0238] Output: Ingredient list sent to local retailer

[0239] What happens: The server parses the order information, generates a list of ingredients needed, and sends it to the local store.

[0240] Step 13:

[0241] Fulfilling orders from local retailers

[0242] Based on the received ingredient list, local retailers use their inventory management system to pick up ingredients and prepare them for delivery.

[0243] Input: Ingredient list sent from the server

[0244] Output: Picked ingredients, ready for delivery

[0245] What happens: Local store staff check the inventory system, pick up the necessary ingredients, and prepare them for delivery.

[0246] Step 14:

[0247] Order confirmation notification by the server

[0248] The server will send the user an order confirmation email and notify them of the estimated delivery date and time.

[0249] Input: Order information, expected delivery date and time

[0250] Output: Order confirmation email to user

[0251] Specific operation: The server sends a confirmation email to the user based on the order information and estimated delivery date and time.

[0252] Step 15:

[0253] Sending food waste information from local retailers

[0254] Local retailers periodically upload information about ingredients that are in excess stock or near their expiration date to the server.

[0255] Input: Information about ingredients that are overstocked or nearing their expiration date

[0256] Output: Food waste information uploaded to the server

[0257] Specific operation: The local retailer's inventory management system sends information about overstocked or expired products to the server.

[0258] Step 16:

[0259] Server-based new menu generation and proposal

[0260] The server uses an AI model to generate new menus based on the received food waste information and suggests them to the user.

[0261] Input: Food waste information, user information

[0262] Output: New menu suggestion

[0263] Specific operation: The server inputs the information into a generative AI model, generates a menu that takes food waste into consideration, and suggests it to the user.

[0264] Step 17:

[0265] New menu display on terminal

[0266] The terminal displays the generated new menu information on the user interface.

[0267] Input: New menu suggestion

[0268] Output: New menu information displayed in the user interface

[0269] Specific operation: The device receives new menu information and displays it on the screen.

[0270] Step 18:

[0271] User confirmation and new order

[0272] The user can review the newly proposed menu and ingredients and place an order if necessary.

[0273] Input: New menu information

[0274] Output: New order information

[0275] Specific behavior: The user checks the new menu and, if there is anything they like, places an order again.

[0276] (Application example 1)

[0277] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0278] Food waste is becoming a serious problem in modern society. While food not consumed at home is discarded, there is a need to respond quickly to diverse consumer needs. However, previous systems have found it difficult to fully utilize user and inventory information to efficiently propose menus and reduce food waste. In addition, there is a lack of support for users to easily obtain the ingredients they need and reduce food waste.

[0279] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0280] In this invention, the server includes means for registering user information, means for proposing a menu based on the user information, means for checking ingredients needed for the proposed menu against store inventory information, means for enabling online ordering of the necessary ingredients, means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, means for proposing a new menu based on the acquired food information, means for notifying the user of order details based on the proposed menu and local store inventory information, and means for saving the user's order information in a database and forwarding it to the store. This allows the user to receive optimal menu suggestions, efficiently obtain food, and reduce food waste.

[0281] "User information" refers to information necessary for menu suggestions, such as the user's family composition, allergy information, and religious restrictions.

[0282] "Menu suggestion" refers to proposing a meal menu that is generated based on user information.

[0283] "Retailer inventory information" refers to information such as the type, quantity, and expiration date of ingredients held by local retailers or affiliated retailers.

[0284] "Online ordering" refers to the act of a user ordering the necessary ingredients online based on a suggested menu.

[0285] "Food waste" refers to food that is discarded without being consumed at home or in stores.

[0286] "Overstock" refers to a situation where there is excess inventory at retailers that is unlikely to be consumed.

[0287] "Best before" refers to the last day that food remains of good quality and can be safely consumed.

[0288] "Database" refers to an information management system that aggregates and efficiently manages user information, order information, inventory information, etc.

[0289] "Server" refers to a system that processes user information and retailer inventory information and provides services such as menu suggestions and online ordering.

[0290] The present invention is a system for making users' lives more convenient and reducing food waste. This system runs mainly on the user's smartphone and is configured as follows.

[0291] 1. Hardware and Software

[0292] Hardware: Smartphone

[0293] software:

[0294] Application: uses Python and the Flask framework

[0295] Database: MySQL

[0296] AI engine: TensorFlow

[0297] 2. User Information Registration

[0298] The user launches the app and registers by entering information such as family composition, allergies, and religious restrictions. The entered information is converted into JSON format by the device and sent to the server. The server stores this information in a database and notifies the user that registration is complete.

[0299] 3. Menu suggestions

[0300] The server extracts user information from the database and sends it to the TensorFlow model, an AI engine, which generates an optimal menu based on the user information. This menu takes into consideration the user's allergies and religious restrictions. The generated menu is sent from the server to the device and displayed on the user interface.

[0301] 4. Retailer inventory information and online ordering

[0302] The server periodically receives inventory information from local stores and stores this information in a database. When the user confirms the proposed menu and confirms the order, the device formats the order information for the necessary ingredients in JSON format and sends it to the server. The server then forwards this information to the local store and the order is confirmed. The user receives the estimated delivery date and time from the server.

[0303] 5. Reducing food waste

[0304] When local stores send information about ingredients that are overstocked or nearing their expiration date, the server uses this information to generate new menu ideas and suggests them to the user. The user can then check the new menu ideas and order the ingredients if necessary, thereby reducing food waste.

[0305] Specific examples

[0306] For example, in the Tanaka family, the father has a wheat allergy, so "wheat" is registered as allergy information along with the family composition. The server proposes a "gluten-free" menu, checks the inventory information of local stores, and generates a menu including teriyaki salmon, boiled spinach, and fruit yogurt. The Tanaka family orders ingredients based on this menu, and the order is forwarded to the local store. A new menu using tomatoes, which are in excess stock, is also proposed, and the Tanaka family confirms this menu and places an order.

[0307] Prompt Sentence Examples

[0308] "We have a family of four with wheat allergies. Can you suggest a menu?"

[0309] "Please tell me a recipe that uses tomatoes that are close to their expiration date."

[0310] "Please suggest the best menu for tonight's dinner."

[0311] In this way, the entire system aims to improve user convenience and reduce food waste.

[0312] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0313] Step 1:

[0314] Registering user information

[0315] Subject: User

[0316] Users launch the app and enter their family information, allergy information, and religious restrictions, which then collects information about the user's individual dietary restrictions.

[0317] Input: User's family structure, allergy information, religious restrictions, etc.

[0318] Output: User information formatted in JSON format

[0319] Specific operation: When the user enters information, the device formats it into JSON format, generates an HTTP request, and sends it to the server.

[0320] Step 2:

[0321] Saving user information

[0322] Subject: Server

[0323] The server saves the received user information in the database, and if the saving is successful, returns a registration completion message to the user.

[0324] Input: User information in JSON format

[0325] Output: Registration complete message

[0326] Specific operation: The server parses the received user information, generates an SQL query to store it in the database, and then returns a message to the user confirming registration.

[0327] Step 3:

[0328] Menu generation

[0329] Subject: Server

[0330] The server retrieves user information from the database and sends it to the AI ​​engine, which then generates the optimal menu based on the user information.

[0331] Input: User information retrieved from the database

[0332] Output: Generated menu information

[0333] Specific operation: The server inputs user information into the AI ​​engine to obtain predicted menu information, which is then sent to the device for display on the user interface.

[0334] Step 4:

[0335] Menu display

[0336] Subject: Terminal

[0337] The terminal displays the menu information received from the server on the user interface, and the user can check the proposed menu and make corrections or changes.

[0338] Input: Menu information sent from the server

[0339] Output: Menu information displayed in the user interface

[0340] Specific operation: The device parses the received menu information and displays it in a visually easy-to-understand format.

[0341] Step 5:

[0342] Updating retailer inventory

[0343] Subject: Dealer

[0344] The retailer periodically sends inventory information (type of ingredients, quantity, expiration date, etc.) to the server.

[0345] Input: Dealer inventory information

[0346] Output: Updated inventory information on the server

[0347] Specific operation: Inventory information is automatically collected from the retailer's system and sent to the server in JSON format.

[0348] Step 6:

[0349] Confirmation and notification of order details

[0350] Subject: User

[0351] The user checks the proposed menu and confirms the order. The device then formats the order information for the necessary ingredients in JSON format and sends it to the server.

[0352] Input: Order information based on suggested menu

[0353] Output: Order information in JSON format

[0354] Specific operation: When the user confirms the order, the terminal formats the information into JSON format and sends it to the server.

[0355] Step 7:

[0356] Transfer and confirmation of order information

[0357] Subject: Server

[0358] The server processes the received order information, sends the required ingredients list to the local store, and also sends the user an order confirmation email with an estimated delivery date and time.

[0359] Input: Order information in JSON format

[0360] Output: Ingredient list for the retailer and order confirmation email for the user

[0361] Specific operation: The server parses the order information and generates a list of ingredients required by the store's inventory management system. This list is sent to the store, and an order confirmation email is sent to the user.

[0362] Step 8:

[0363] Obtaining information on ingredients that are overstocked or nearing their expiration date

[0364] Subject: Dealer

[0365] The store transmits information about ingredients that are in excess stock or are close to their expiration date to the server.

[0366] Input: Information on ingredients that are overstocked or close to their expiration date

[0367] Output: New inventory information sent to the server

[0368] Specific operation: Information on ingredients that are overstocked or near their expiration date is automatically collected from the retailer's system and sent to the server.

[0369] Step 9:

[0370] New menu suggestions

[0371] Subject: Server

[0372] Based on the received inventory information, the server uses an AI engine to generate new menus and propose them to the user.

[0373] Input: Information on ingredients that are overstocked or close to their expiration date

[0374] Output: New menu information generated

[0375] Specific operation: The server inputs new inventory information into the AI ​​engine and generates new menus to minimize food waste. The generated menu information is sent to the user.

[0376] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0377] This invention provides a system that proposes menus tailored to the user's household and allows them to order the ingredients online in collaboration with local retailers. This system aims to reduce food waste and ease the burden of housework. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it becomes possible to propose menus that are more tailored to the user's needs.

[0378] Program processing

[0379] 1. User information registration

[0380] 1.1 Users

[0381] Launch the app and enter information such as family composition, allergy information, religious restrictions, emotional state, etc. Confirm the information you entered and press the "Register" button.

[0382] 1.2 Terminal

[0383] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[0384] 1.3 Server

[0385] Parse the received user information and save it in the database. If the save is successful, return a registration completion message to the user.

[0386] 2. Menu suggestions

[0387] 2.1 Server

[0388] The database is queried (searched) for user information and sent to the AI ​​engine for processing. The AI ​​engine generates an appropriate menu based on the user information and emotional information from the emotion engine.

[0389] 2.2 Server

[0390] The generated menu information is sent to the user's terminal as a response.

[0391] 2.3 Terminal

[0392] The received menu information is displayed on the user interface.

[0393] 2.4 Users

[0394] Review the proposed menu, make any necessary changes or amendments, and finalize it.

[0395] 3. Collaboration with local supermarkets and obtaining inventory information

[0396] 3.1 Local supermarket

[0397] Your store's inventory information is updated periodically and sent to the server.

[0398] 3.2 Server

[0399] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[0400] 4. Order ingredients online

[0401] 4.1 Users

[0402] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[0403] 4.2 Terminal

[0404] Format the user's order information in JSON format and generate an HTTP request to send to the server.

[0405] 4.3 Server

[0406] The system processes the received order information and sends a list of ingredients needed to the local supermarket, including the type of ingredients, quantity, and delivery date and time.

[0407] 4.4 Local supermarket

[0408] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[0409] 4.5 Server

[0410] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[0411] 5. Recommended ingredients to reduce food waste

[0412] 5.1 Local supermarket

[0413] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[0414] 5.2 Server

[0415] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[0416] 5.3 Server

[0417] The newly generated menu information is sent to the user's terminal.

[0418] 5.4 Terminal

[0419] The new menu information is displayed in the user interface.

[0420] 5.5 Users

[0421] Check the newly presented menu and ingredients and place orders as necessary.

[0422] Introducing the Emotion Engine

[0423] Emotion recognition

[0424] 1. Users

[0425] Users input their daily emotions and moods into the app, which then analyzes their facial expressions and tone of voice to automatically recognize their emotions.

[0426] 2. Terminal

[0427] Emotional information is formatted in JSON format and sent to the server.

[0428] 3. Server

[0429] The received emotional information is stored in a database and sent to the AI ​​engine.

[0430] Emotion-based menu adjustment

[0431] 1. Server

[0432] Based on emotional information, a menu optimal for the user's mood and physical condition is generated.

[0433] For example, if the user is tired, it will suggest easy-to-make dishes, and if the user is feeling energetic, it will suggest menus that allow them to try new dishes.

[0434] Specific examples

[0435] User: Tanaka family

[0436] 1. Registering user information and emotions

[0437] The Tanaka family entered allergy information for all family members, including the fact that the father has a wheat allergy. The emotional information included, "I'm tired today."

[0438] 2. Menu suggestions

[0439] The server suggests gluten-free meals that are easy to make even when you're tired. For example, the main dish is "butter-grilled salmon," the side dish is "spinach namul," and the dessert is "fruit almond tofu."

[0440] 3. Obtaining inventory information

[0441] Local supermarket A sends inventory information to the server. They have plenty of salmon and spinach in stock and want to prioritize selling them because they have a long shelf life.

[0442] 4. Order Confirmation

[0443] The Tanaka family checks the proposed menu and orders ingredients through the app, and the server sends the order information to local supermarket A.

[0444] 5. Recommended ingredients

[0445] Local supermarket A has an excess of tomatoes and broccoli in stock, so it sends that data to the server. The server then suggests a new menu using tomatoes and broccoli. The Tanaka family checks the menu and places an order.

[0446] This allows for more personalized menu suggestions based on the user's emotions and living situation, further improving user convenience.

[0447] The processing flow will be explained below.

[0448] Step 1: Register user information

[0449] 1.1 Users

[0450] Launch the app and enter your family composition (e.g., 2 adults, 2 children), allergy information (e.g., wheat allergy), religious restrictions (e.g., need for halal-certified food), etc. Then, enter your emotional information (e.g., how you feel today is "tired"). Confirm the information you entered and press the "Register" button.

[0451] 1.2 Terminal

[0452] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[0453] 1.3 Server

[0454] Parse the received user information and emotion information and save it in the database. If the save is successful, return a registration completion message to the user.

[0455] Step 2: Menu suggestions

[0456] 2.1 Server

[0457] User information and emotional information are queried (searched) from the database and sent to the AI ​​engine and emotion engine for processing. The AI ​​engine generates an appropriate menu based on the user information and the emotional information from the emotion engine.

[0458] 2.2 Server

[0459] The generated menu information is sent to the user's terminal as a response.

[0460] 2.3 Terminal

[0461] The received menu information is displayed on the user interface.

[0462] 2.4 Users

[0463] Review the proposed menu, make any necessary changes or modifications, and finally confirm the menu.

[0464] Step 3: Collaborate with local supermarkets and obtain inventory information

[0465] 3.1 Local supermarket

[0466] Regularly update your store's inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server.

[0467] 3.2 Server

[0468] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[0469] Step 4: Order ingredients online

[0470] 4.1 Users

[0471] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[0472] 4.2 Terminal

[0473] Format the user's order information in JSON format and generate an HTTP request to send to the server.

[0474] 4.3 Server

[0475] The system processes the received order information and sends a list of ingredients needed to the local supermarket, including the type of ingredients, quantity, and delivery date and time.

[0476] 4.4 Local supermarket

[0477] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[0478] 4.5 Server

[0479] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[0480] Step 5: Recommended ingredients to reduce food waste

[0481] 5.1 Local supermarket

[0482] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[0483] 5.2 Server

[0484] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[0485] 5.3 Server

[0486] The newly generated menu information is sent to the user's terminal.

[0487] 5.4 Terminal

[0488] The new menu information is displayed in the user interface.

[0489] 5.5 Users

[0490] Check the newly presented menu and ingredients and place orders as necessary.

[0491] Specific examples

[0492] User: Tanaka family

[0493] Step 1: Register user information

[0494] 1.1 Users

[0495] The Tanaka family inputs information about all family members, notably registering that the father has a wheat allergy. They also input "tired" as their emotional state for the day.

[0496] 1.2 Terminal

[0497] All input information is converted to JSON format and sent to the server.

[0498] 1.3 Server

[0499] The received information is stored in a database and a registration completion message is returned to the user.

[0500] Step 2: Menu suggestions

[0501] 2.1 Server

[0502] The database is queried for information about the Tanaka family and their emotions, which are then sent to the AI ​​engine and emotion engine. The AI ​​engine then generates "easy-to-make gluten-free meals."

[0503] 2.2 Server

[0504] The generated menu information is sent to the terminal.

[0505] 2.3 Terminal

[0506] The received menu information is displayed on the app screen.

[0507] 2.4 Users

[0508] Review and finalize the proposed menu.

[0509] Step 3: Collaborate with local supermarkets and obtain inventory information

[0510] 3.1 Local supermarket

[0511] Local supermarket A sends inventory information to the server.

[0512] 3.2 Server

[0513] The received inventory information is stored in a database and compared with the Tanaka family's menu information. Specifically, it checks for salmon and spinach, which are in abundant stock.

[0514] Step 4: Order ingredients online

[0515] 4.1 Users

[0516] The Tanaka family checks the proposed menu and presses the "Order" button.

[0517] 4.2 Terminal

[0518] Order information is formatted in JSON format and sent to the server.

[0519] 4.3 Server

[0520] Send order information to local supermarket A.

[0521] 4.4 Local supermarket

[0522] Pick up the necessary ingredients and prepare them for delivery.

[0523] 4.5 Server

[0524] An order confirmation email will be sent to the Tanaka family, informing them of the estimated delivery date and time.

[0525] Step 5: Recommended ingredients to reduce food waste

[0526] 5.1 Local supermarket

[0527] Data on excess tomatoes and broccoli is sent to the server.

[0528] 5.2 Server

[0529] The AI ​​engine generates new menus based on the data sent.

[0530] 5.3 Server

[0531] The generated new menu information is sent to the Tanaka family's terminal.

[0532] 5.4 Terminal

[0533] New menu information will be displayed on the app screen.

[0534] 5.5 Users

[0535] The Tanaka family reviews the new menu and ingredients and places orders as needed.

[0536] In this way, this system proposes optimal menus based on the user's emotions and living situation, and by linking it with online ordering of ingredients and inventory management, it simultaneously achieves convenience and reduces food waste.

[0537] Example 2

[0538] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0539] In modern households, planning daily menus and purchasing ingredients are a significant burden. Furthermore, food waste has become a social issue, necessitating efficient food use. Proposing menus that take into account users' allergies and religious restrictions is particularly difficult, and providing menus that match their emotions and physical condition is also important. However, current systems lack the means to effectively achieve this.

[0540] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0541] In this invention, the server includes means for registering user information, means for proposing menus based on the user information, means for checking ingredients needed for the proposed menu against inventory information, means for enabling the necessary ingredients to be ordered over the Internet, means for acquiring information on ingredients that are overstocked or approaching expiration dates to reduce food waste, means for proposing new menus based on the acquired food information, means for registering user emotion information and adjusting menus based on the emotion information, means for processing and saving the acquired emotion information, and means for saving periodically updated inventory information in a database. This enables personalized menu suggestions based on the user's living situation and emotions, thereby reducing food waste and reducing the burden of housework.

[0542] "User information" is a general term for data about an individual, such as a user's family structure, allergy information, religious restrictions, emotional state, and the like.

[0543] "Menu suggestion" refers to the act of creating and suggesting a menu of dishes suitable for a user based on user information.

[0544] "Inventory information" refers to data that indicates the current quantity, expiration date, and stock status of ingredients and products at a retail store.

[0545] "Means for enabling online ordering" refers to the technological means by which a user can select ingredients and complete an order online.

[0546] "Means for reducing food waste" refers to technological measures to collect information on ingredients that are overstocked or nearing their expiration date, and to make suggestions on how to make effective use of the information.

[0547] "Emotion information" is data that indicates the user's emotional state or mood, and includes information such as "tired" or "well-being."

[0548] A "database" refers to an information management system that systematically organizes and stores user information, inventory information, emotional information, etc.

[0549] An "emotion engine" refers to software or algorithms that analyze users' emotions and make various suggestions and adjustments based on that information.

[0550] This invention provides a system that proposes menus tailored to the user's household and allows them to order the ingredients online in collaboration with local retailers. This system aims to reduce food waste and ease the burden of housework. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to propose menus that are more tailored to the user's needs.

[0551] System Overview

[0552] Registering user information

[0553] The user launches the app and enters information such as family composition, allergy information, religious restrictions, and emotional state. Once the entered information is confirmed, registration is completed by pressing the "Register" button. A smartphone or tablet is recommended as the hardware. A dedicated application that provides the user interface (UI) is used as the software.

[0554] The device converts the entered user information into JSON format and generates an HTTP request to send to the server, ensuring that the user information is accurately transmitted to the server.

[0555] The server analyzes the received user information and stores it in a database. The database uses a standard SQL database, and stores user information organized by field. For example, data such as family composition (father, mother, two children), allergy information (wheat), and emotional state (tired) might be stored.

[0556] Menu suggestions

[0557] The server queries the user information from the database and sends it to the AI ​​engine. The AI ​​engine generates an appropriate menu based on the user information and the emotion information from the emotion engine. A general generative AI model is recommended as the AI ​​engine to use.

[0558] The server sends the generated menu information to the user's terminal as a response.

[0559] The device displays the received menu information on the user interface. For example, the main dish might be "butter-grilled salmon," the side dish "spinach namul," and the dessert "fruit almond tofu."

[0560] The user reviews the proposed menu, makes changes or corrections as necessary, and finally finalizes the menu.

[0561] Collaboration with local supermarkets and acquisition of inventory information

[0562] Local supermarkets regularly update their inventory information and send it to the server, specifically updating the types, quantities, expiration dates, and other information about ingredients in stock.

[0563] The server stores the received inventory information in a database and updates the inventory status by matching it with existing user information and suggested menu items, for example, removing items whose stock has decreased from the database and updating the database with new inventory that has been added.

[0564] Online ordering of ingredients

[0565] The user checks the proposed menu, selects the ingredients they wish to purchase, and presses the "Order" button. For example, the user can select the ingredients they need from the proposed menu using the checkboxes and then press the "Order" button to confirm the order.

[0566] The terminal formats the user's order information in JSON format and generates an HTTP request to send to the server.

[0567] The server processes the received order information and sends a list of ingredients needed to the local supermarket, including the type, quantity, and delivery date and time.

[0568] Based on the received ingredient list, the local supermarket will select the necessary ingredients from their inventory and prepare them for delivery.

[0569] The server will send the user an order confirmation email and notify them of the estimated delivery date and time.

[0570] Recommended ingredients to reduce food waste

[0571] Local supermarkets regularly update information about ingredients that are overstocked or nearing their expiration date and send it to the server.

[0572] Based on the received inventory information, the server uses an AI engine to generate new menu items using the relevant ingredients. For example, it generates a menu item such as "Tomato and Broccoli Salad" using tomatoes and broccoli that are in overstock.

[0573] The server transmits the newly generated menu information to the user's terminal.

[0574] The device displays the new menu information on the user interface. Specifically, the device displays the newly proposed menu on the screen so that the user can confirm it.

[0575] The user checks the newly presented menu and ingredients and places an order if necessary. For example, the user selects an item that interests them from the newly proposed menu and orders ingredients.

[0576] Introducing the Emotion Engine

[0577] Users input their daily emotions and moods into the app, and the app analyzes their facial expressions and tone of voice to automatically recognize their emotions. For example, it uses the smartphone's camera and microphone to analyze the user's facial expressions and voice to determine whether they are "tired" or "energetic."

[0578] The device formats the emotional information in JSON format and sends it to the server.

[0579] The server stores the received emotional information in a database and sends it to the AI ​​engine.

[0580] The server uses this emotional information to generate a menu that best suits the user's mood and physical condition. For example, if the user is tired, it will suggest easy-to-make dishes, and if the user is feeling energetic, it will suggest a menu that encourages them to try new dishes.

[0581] Specific examples

[0582] Prompt Sentence Examples

[0583] Prompt: "Taking into account my family's allergies, suggest some easy gluten-free meal suggestions for a tiring day."

[0584] In the case of the Tanaka family, they enter allergy information for each family member, and register that the father has a wheat allergy. They then enter "I'm tired today" as their emotional information. The server then suggests gluten-free meals that are easy to make even when you're tired. For example, it suggests "butter-grilled salmon" as the main dish, "spinach namul" as the side dish, and "fruit almond tofu" as the dessert.

[0585] This will enable more personalized menu suggestions based on the user's emotions and living situation, further improving user convenience.

[0586] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0587] Step 1:

[0588] The user launches the app and enters information such as family composition, allergy information, religious restrictions, emotional state, etc. After confirming the information entered, the user presses the "Register" button. This obtains the user information as input.

[0589] Step 2:

[0590] The device converts the information entered by the user into JSON format. For example, "Family composition: father, mother, two children," "Allergy information: wheat," and "Emotional state: tired" are generated as JSON data. An HTTP request is generated to send this JSON data to the server.

[0591] Step 3:

[0592] The server analyzes the received user information. It parses the received JSON data, breaks it down into database tables corresponding to each field, and saves them. For example, family structure is saved in the user_family table, wheat allergy in the user_allergy table, and emotional state in the user_emotion table. It returns a message indicating that the save was successful.

[0593] Step 4:

[0594] The server queries the database for user information and sends it to the AI ​​engine. The AI ​​engine uses the user information and emotional information obtained from this query as input and performs data calculations to generate the optimal menu for the user. As a specific example, it generates a "gluten-free menu that is easy to make even when you're tired."

[0595] Step 5:

[0596] The server receives the menu information generated by the AI ​​engine and sends it to the user's device as a response. This response includes the specific menu (e.g., main dish "butter-grilled salmon," side dish "spinach namul," and dessert "almond jelly with fruit").

[0597] Step 6:

[0598] The device displays the received menu information on a user interface, allowing the user to visually confirm each menu item (main dish, side dish, dessert, etc.), for example, by displaying a list of ingredients and instructions for each menu item.

[0599] Step 7:

[0600] The user checks the proposed menu and makes any necessary changes or corrections. Finally, the user confirms the menu. The confirmed menu information is resent from the device to the server in JSON format.

[0601] Step 8:

[0602] The local supermarket periodically updates its inventory information and sends it to the server. Specifically, it updates the type, quantity, expiration date, etc. of ingredients in stock. This inventory information is passed to the server as input.

[0603] Step 9:

[0604] The server stores the received inventory information in a database. It updates the inventory status by comparing it with existing user information and menu information. For example, it processes the data by removing items whose inventory has decreased from the database and adding new inventory.

[0605] Step 10:

[0606] The user checks the proposed menu, selects the ingredients they wish to purchase, and presses the "Order" button, which obtains the selected ingredients as input.

[0607] Step 11:

[0608] The device formats the user's order information in JSON format and generates an HTTP request to send to the server. For example, the order information might be formatted as "2 slices of salmon, 1 bunch of spinach, and all ingredients for almond tofu."

[0609] Step 12:

[0610] The server processes the received order information and sends the required ingredient list to the local supermarket. The order information includes the type of ingredient, quantity, and delivery date and time. This allows the local supermarket to input the ingredient list.

[0611] Step 13:

[0612] Based on the received ingredient list, the local supermarket will pick the necessary ingredients from their inventory and prepare for delivery. Specifically, they will pick up the ingredients from their inventory, pack them, and hand them over to the delivery person.

[0613] Step 14:

[0614] The server will then send the user an order confirmation email with the estimated delivery date and time, allowing the user to confirm the order details and delivery date and time.

[0615] Step 15:

[0616] Local supermarkets periodically update the server with information about ingredients that are overstocked or nearing their expiration date, and this data is also passed to the server as input.

[0617] Step 16:

[0618] Based on the received inventory information, the server uses an AI engine to generate a new menu using the relevant ingredients. For example, it performs data calculations to generate a "tomato and broccoli salad."

[0619] Step 17:

[0620] The server sends the newly generated menu information to the user's terminal, which then outputs the specific menu information.

[0621] Step 18:

[0622] The device displays the new menu information on the user interface. Specifically, the device displays the new menu on the screen so that the user can check it.

[0623] Step 19:

[0624] The user checks the newly presented menu and ingredients and places an order if necessary, which inputs the next purchase information.

[0625] Prompt example - text format

[0626] Prompt: "Taking into account my family's allergies, suggest some easy gluten-free meal suggestions for a tiring day."

[0627] (Application example 2)

[0628] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0629] The purpose of this invention is to improve the efficiency of meal planning and procurement in daily household life and reduce food waste. Another objective is to provide personalized service through menu suggestions based on the user's emotional state, thereby improving user convenience and satisfaction.

[0630] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering user information, means for proposing a menu based on the user information, means for checking ingredients needed for the proposed menu against inventory information of local stores, means for enabling online ordering of the necessary ingredients, means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, means for proposing a new menu based on the acquired food information, means for acquiring user emotional information, and means for adjusting the menu based on the acquired emotional information. This enables personalized menu suggestions based on the user's household situation and emotional state, efficient procurement of ingredients, and reduction of food waste.

[0631] "Means for registering user information" is a function for collecting individual information such as the user's family structure, allergy information, religious restrictions, emotional state, etc., and storing it within the system.

[0632] The "means for suggesting a menu" is a function for generating and suggesting an appropriate cooking menu based on the user's individual information.

[0633] The "means of checking ingredients against local retailer inventory information" is a function for checking whether the ingredients required for the proposed menu are in stock at affiliated local retailers.

[0634] The "means for enabling online ordering of ingredients" is a function that supports the process from when a user orders the ingredients they need online until the order is completed.

[0635] The "means for obtaining information on ingredients that are in excess of stock or are close to their expiration date" is a function that receives information from local retailers about ingredients that are in excess of stock or are close to their expiration date, and makes that information available within the system.

[0636] The "means for proposing new menus" is a function for generating and proposing new cooking menus based on information about ingredients that are in excess stock or near their expiration date.

[0637] The "means for acquiring user's emotional information" is a function for collecting the user's emotional state through the user's facial expression, tone of voice, or manual input, and storing it in the system.

[0638] The "means for adjusting menus based on emotional information" is a function for generating and suggesting a cooking menu that is most suitable for the user's mood and physical condition, taking into consideration the collected emotional information of the user.

[0639] A system for implementing the present invention is configured as follows.

[0640] First, the user enters information about their household (family composition, allergies, religious restrictions, emotional state, etc.) through a smartphone app. Once the user enters this information, it is converted into JSON format and sent to the server as an HTTP request. After receiving this information, the server analyzes it and stores it in a database.

[0641] Next, the server uses an AI engine to generate an appropriate menu based on the saved user information. This menu suggestion takes the user's emotional information into consideration to provide the optimal dish menu. At this time, the emotion engine can analyze the user's facial expressions and tone of voice to automatically recognize emotions. Users can also manually input emotional information.

[0642] Once the menu is decided, the server sends it to the user's device as a response. The user can then review the proposed menu, make any necessary changes or corrections, and finally confirm it. The information on ingredients needed for the confirmed menu is checked against the inventory information of local retailers. Inventory information is periodically updated by the local supermarket and sent to the server.

[0643] When a user wants to order ingredients, they can place an order online using a smartphone app. This order information is sent to a server, and based on the received information, a list of ingredients needed is sent to the local supermarket. The supermarket then picks the necessary ingredients from the received list and prepares them for delivery. In addition, from the perspective of reducing food waste, information about ingredients that are in excess or near their expiration date is also sent to the server, and new menu suggestions are made based on this information. This contributes to reducing food waste.

[0644] As a concrete example, consider the following scenario.

[0645] User: A household

[0646] 1. User information registration: The family enters allergy information for all family members, and registers that the mother is allergic to shellfish. The family also enters emotional information such as "I feel good today."

[0647] 2. Menu Suggestion: The AI ​​engine generates a menu that does not contain shellfish and is perfect for a day when you feel like it. The main dish is "chicken teriyaki," the side dish is "kinpira gobo" (stir-fried burdock root), and the dessert is "matcha ice cream."

[0648] 3. Obtaining inventory information: Local supermarkets send inventory information to verify that the suggested ingredients are in stock.

[0649] 4. Order confirmation: The user places an online order for the ingredients they need through the app. The server sends the order information to the local supermarket, which then picks up the ingredients and prepares them for delivery.

[0650] Example prompt sentence:

[0651] "User information: Mother is allergic to shellfish. Mood today: Good."

[0652] By introducing this system, personalized menu suggestions based on the user's household situation and emotional state will be possible, as well as efficient procurement of ingredients and reduction of food waste.

[0653] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0654] Step 1:

[0655] A user launches the smartphone app and enters information such as family composition, allergy information, religious restrictions, and emotional state. The entered information is converted to JSON format on the device and sent to the server as an HTTP request. The input is user information, and the output is JSON format data.

[0656] Step 2:

[0657] The server parses the received JSON-formatted user information and saves it in the database. Specifically, the server issues an SQL command to the database to save the user information. The input is JSON-formatted user information, and the output is a message indicating that the information has been saved to the database.

[0658] Step 3:

[0659] The user inputs emotional information. Alternatively, the device automatically acquires emotional information by analyzing the user's facial expressions and tone of voice. The emotional information is converted to JSON format on the device and sent to the server. The input is the user's emotional information, and the output is JSON format data.

[0660] Step 4:

[0661] The server analyzes the received emotion information and stores it in a database. Specifically, the server issues an SQL command to the database to save the emotion information. The input is emotion information in JSON format, and the output is a message indicating that the information has been saved to the database.

[0662] Step 5:

[0663] The server retrieves user information and emotional information from the database and sends it to the AI ​​engine. The AI ​​engine generates the optimal menu based on this information. User information and emotional information are input into the AI ​​engine's internal processing, which outputs the optimal menu based on that information. The input is user information and emotional information, and the output is the generated menu information.

[0664] Step 6:

[0665] The server sends the generated menu information to the user's device as a response. The device displays the received menu information on the user interface. The input is the generated menu information, and the output is the menu information displayed on the user's device.

[0666] Step 7:

[0667] The user checks the proposed menu, makes changes or corrections as necessary, and finally confirms it. The confirmed menu information is sent from the terminal to the server. The input is the user's modified or confirmed menu information, and the output is the confirmed menu information sent to the server.

[0668] Step 8:

[0669] The server checks the confirmed menu information against the inventory information of affiliated local stores. The inventory information, which is periodically updated by the local stores, is stored in the server's database. The input is the confirmed menu information and inventory information, and the output is the inventory check result.

[0670] Step 9:

[0671] When a user orders ingredients online using the app, the device sends the order information in JSON format to the server. The input is the user's order information, and the output is JSON format data.

[0672] Step 10:

[0673] The server receives the order information and sends the required ingredient list to the local store. The local store picks up the required ingredients and prepares the delivery. The input is the user's order information, and the output is the ingredient list sent to the local store.

[0674] Step 11:

[0675] To reduce food waste, the server receives information about ingredients that are overstocked or close to their expiration date. Based on this information, a new menu is generated. The input is the information about ingredients that are overstocked or close to their expiration date, and the output is the generated new menu information.

[0676] Step 12:

[0677] The server sends the newly generated menu information to the user's device. The device displays the received menu information on the user interface. The input is the newly generated menu information, and the output is the menu information displayed on the user's device.

[0678] In this way, specific input, data processing, and output are carried out at each processing step, resulting in personalized menu suggestions based on the user's household situation and emotional state, efficient procurement of ingredients, and reduced food waste.

[0679] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0680] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0681] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0682] [Second embodiment]

[0683] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0684] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0685] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0686] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0687] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0688] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0689] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0690] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0691] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0692] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0693] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0694] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0695] This invention is a system that makes users' lives more convenient and reduces food waste. The system includes a means for users to input and register information such as family composition, allergy information, and religious restrictions, and then suggests optimal menus based on this information. The ingredients needed for the suggested menus are checked against inventory information at local stores, allowing online ordering. To reduce food waste, the system also obtains information on ingredients that are overstocked or nearing their expiration date, and uses this information to suggest new menus to users.

[0696] Program processing

[0697] 1. User information registration

[0698] 1.1 Users

[0699] Launch the app and enter your family composition, allergy information, religious restrictions, etc. Confirm the information you entered and press the "Register" button.

[0700] 1.2 Terminal

[0701] The input information from the user is formatted in JSON format and an HTTP request is generated to be sent to the server.

[0702] 1.3 Server

[0703] The received user information is saved in the database. If the save is successful, a registration completion message is returned to the user.

[0704] 2. Menu suggestions

[0705] 2.1 Server

[0706] User information is retrieved from the database and sent to the AI ​​engine, which then generates a menu based on the user information.

[0707] 2.2 Server

[0708] When a menu proposal is generated, a response is returned to the terminal together with menu information to be proposed to the user.

[0709] 2.3 Terminal

[0710] The received menu information is displayed on the user interface.

[0711] 2.4 Users

[0712] Review the proposed menu, make any necessary changes or modifications, and finalize it.

[0713] 3. Collaboration with local supermarkets and obtaining inventory information

[0714] 3.1 Local supermarket

[0715] Regularly update your store's inventory information (e.g., quantity of salmon, spinach, expiration date) and send it to the server.

[0716] 3.2 Server

[0717] The received inventory information is stored in a database and compared with existing user information to update the inventory status.

[0718] 4. Order ingredients online

[0719] 4.1 Users

[0720] Check the suggested menu and press the "Order" button on the app.

[0721] 4.2 Terminal

[0722] The user's order information (e.g. salmon, spinach, fruit, yogurt) is formatted in JSON format and an HTTP request is generated to send to the server.

[0723] 4.3 Server

[0724] Process the received order information and send the list of ingredients needed to the local supermarket.

[0725] 4.4 Local supermarket

[0726] Based on the received ingredient list, the inventory management system picks up the necessary ingredients and prepares them for delivery.

[0727] 4.5 Server

[0728] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[0729] 5. Recommended ingredients to reduce food waste

[0730] 5.1 Local supermarket

[0731] Information on ingredients that are in excess stock or near their expiration date is uploaded to a server.

[0732] 5.2 Server

[0733] Based on the received inventory information, the AI ​​engine generates new menus using the relevant ingredients and suggests them to the user.

[0734] 5.3 Terminal

[0735] The generated new menu information is displayed on the user interface.

[0736] 5.4 Users

[0737] Check the newly proposed menu and ingredients and place orders as necessary.

[0738] Specific examples

[0739] User: Tanaka family

[0740] 1. User information registration

[0741] The Tanaka family has a wheat allergy, so they entered "wheat" as their allergy information. The family consists of four people: two adults and two children.

[0742] 2. Menu suggestions

[0743] The server suggests gluten-free meals that children can enjoy. For example, the main dish is teriyaki salmon, the side dish is boiled spinach, and the dessert is fruit yogurt.

[0744] 3. Obtaining inventory information

[0745] Local supermarket A sends inventory information to the server. They have plenty of salmon and spinach in stock and want to prioritize selling them because they have a long shelf life.

[0746] 4. Order Confirmation

[0747] The Tanaka family checks the proposed menu and orders ingredients through the app, and the server sends the order information to local supermarket A.

[0748] 5. Recommended ingredients

[0749] Local supermarket A has an excess of tomatoes and broccoli in stock, so it sends that data to the server. The server then suggests a new menu using tomatoes and broccoli. The Tanaka family checks the menu and places an order.

[0750] In this way, the entire system aims to improve user convenience and reduce food waste.

[0751] The processing flow will be explained below.

[0752] Step 1: Register user information

[0753] 1.1 Users

[0754] The user launches the app and enters information such as family composition (e.g., two adults, two children), allergy information (e.g., wheat allergy), religious restrictions (e.g., need for halal-certified food), etc., confirms the information entered, and presses the "Register" button.

[0755] 1.2 Terminal

[0756] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[0757] 1.3 Server

[0758] Parse the received user information and save it in the database. If the save is successful, return a registration completion message to the user.

[0759] Step 2: Menu suggestions

[0760] 2.1 Server

[0761] The database is queried (searched) for user information and sent to an AI engine for processing, which then generates an appropriate menu based on the user information.

[0762] 2.2 Server

[0763] The generated menu information is sent to the user's terminal as a response.

[0764] 2.3 Terminal

[0765] The received menu information is displayed on the user interface.

[0766] 2.4 Users

[0767] Check the presented menu, make any necessary changes or corrections, and finally confirm the menu.

[0768] Step 3: Collaborate with local supermarkets and obtain inventory information

[0769] 3.1 Local supermarket

[0770] Regularly update your store's inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server.

[0771] 3.2 Server

[0772] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[0773] Step 4: Order ingredients online

[0774] 4.1 Users

[0775] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[0776] 4.2 Terminal

[0777] Format the user's order information in JSON format and send an HTTP request to the server.

[0778] 4.3 Server

[0779] The system processes the received order information and sends a list of ingredients needed to a local supermarket, including the type of food, quantity, delivery date and time, etc.

[0780] 4.4 Local supermarket

[0781] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[0782] 4.5 Server

[0783] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[0784] Step 5: Recommended ingredients to reduce food waste

[0785] 5.1 Local supermarket

[0786] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[0787] 5.2 Server

[0788] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[0789] 5.3 Server

[0790] The newly generated menu information is sent to the user's terminal.

[0791] 5.4 Terminal

[0792] The new menu information is displayed in the user interface.

[0793] 5.5 Users

[0794] Check the newly presented menu and ingredients and place orders as necessary.

[0795] Example 1

[0796] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0797] In modern society, managing household menus and reducing food waste are important issues. In particular, existing systems are unable to adequately address the issues of proposing cooking menus that take into account diverse family structures, allergies, and religious restrictions, linking with local retailers' inventory status, and reducing food waste. There is also a need for more efficient ordering procedures and an intuitive user interface.

[0798] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0799] In this invention, the server includes a first means for registering user information, a second means for proposing a menu based on the user information, a third means for comparing ingredients needed for the proposed menu with inventory information from local stores, a fourth means for enabling online ordering of the necessary ingredients, a fifth means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, a sixth means for proposing a new menu based on the acquired food information using a generative AI model, a seventh means for formatting the user information and inventory information from local stores in JSON format and generating an HTTP request, and an eighth means for displaying the information received on the terminal on a user interface. This allows the user to efficiently receive optimal menu suggestions and reduce food waste by linking with inventory information from local stores.

[0800] "User Information" refers to family information, allergy information, religious restrictions, and other personal data entered by the user.

[0801] The "first means" refers to a means for registering user information, and includes a function for saving information entered by the user in a database.

[0802] The "second means" refers to a means of proposing the optimal menu based on user information, and includes a function for generating menus using an AI engine or algorithm.

[0803] The "third means" refers to a means of checking the ingredients needed for the proposed menu against inventory information from local retailers, and includes a function to grasp inventory status and link it to the menu.

[0804] The "fourth means" refers to a means that allows the necessary ingredients to be ordered online, and includes a function to generate order information and send it to the retailer.

[0805] The "fifth means" refers to a means of obtaining information on ingredients that are in excess stock or near their expiration date in order to reduce food waste, and includes a function to receive inventory information from local retailers.

[0806] The "sixth means" refers to a means of using an AI model to generate and propose new menus based on the acquired food information, and includes functions related to generating menus to reduce food waste.

[0807] The "seventh means" refers to a means for formatting user information and local retailer inventory information in JSON format and generating an HTTP request, and includes functions related to data format conversion and request generation.

[0808] The "eighth means" refers to a means for displaying the information received by the terminal on a user interface, and includes a function for providing information intuitively to the user.

[0809] A "generative AI model" refers to an artificial intelligence algorithm or system that generates optimal menu and ingredient suggestions based on user information and inventory information.

[0810] A "prompt" is an instruction given to a generative AI model to obtain a specific output.

[0811] This invention is a system that aims to efficiently suggest optimal menus to users and reduce food waste by linking with inventory information from local retailers. In this example, the roles of the user, terminal, and server are specifically explained. The invention is implemented with the following configuration.

[0812] User input of information

[0813] Users launch the application on their smartphone or computer and enter the necessary information, such as family composition, allergy information, and religious restrictions. This information is saved in the system and becomes the basic data when menu suggestions are made. For example, if a user has a family of four and the father has a wheat allergy, they would enter information such as "family of four," "allergies: wheat," and "no religious restrictions."

[0814] Data formatting and transmission by the terminal

[0815] The device formats the information entered by the user in JSON format, generates an HTTP request, and sends it to the server. The specific software used is an iOS or Android application and a web browser.

[0816] Data processing and storage by server

[0817] The server receives the user information sent from the device and stores it in a database. The stored user information serves as the basis for generating optimal menus. The server often uses MySQL or PostgreSQL as its database management system (DBMS).

[0818] Menu suggestions

[0819] The server retrieves user information from the database and sends it to the generative AI model as a prompt. This AI engine (e.g., GPT-3 or BERT) analyzes the user information and generates the optimal menu that meets the user's criteria. An example of a prompt might be, "Please suggest a menu for a family of four where the father has a wheat allergy."

[0820] Display menu information

[0821] The server sends the generated menu information to the device as a response. The device displays this information on a user interface, providing the user with suggested menus and related ingredient information. Frameworks such as React Native and Flutter may be used for display.

[0822] Get inventory and place orders

[0823] Local stores periodically update their inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server. The server receives this information and stores it in a database. The user can then order the ingredients needed for the proposed meal online, and the server sends the order information to the local store. This also takes into account ingredients that are overstocked or nearing their expiration date.

[0824] New menu proposals to reduce food waste

[0825] The server uses a generative AI model to propose new menus based on information about ingredients that are overstocked or nearing their expiration date. The device displays this information on a user interface, and the user can check the newly proposed menu and ingredient information and place an order if necessary.

[0826] Specific examples

[0827] For example, if the Tanaka family consists of four people and the father has a wheat allergy, the user inputs the wheat allergy information and family composition. The server uses an AI engine to generate a "gluten-free menu that children can enjoy," suggesting "salmon teriyaki" as the main dish, "spinach ohitashi" as a side dish, and "fruit yogurt" as a dessert. The order is then processed based on inventory information from local retailers. If the local retailer sends information that they have excess stock of tomatoes and broccoli, the server will suggest a new menu using those ingredients.

[0828] In this way, the entire system aims to improve user convenience and reduce food waste.

[0829] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0830] Step 1:

[0831] User input of information

[0832] Users launch the application on their smartphone or computer, enter the necessary information such as family composition, allergies, and religious restrictions, and press the "Register" button.

[0833] Input: Family composition, allergy information, religious restrictions

[0834] Output: User information entered

[0835] Specific operation: The user enters each item in the application's input form using text or options. For example, "Family of four" and "Allergy: wheat."

[0836] Step 2:

[0837] Data formatting and transmission by the terminal

[0838] The terminal formats the information entered by the user in JSON format, generates an HTTP request, and sends it to the server.

[0839] Input: User information entered

[0840] Output: JSON formatted data, HTTP request

[0841] Specific operation: The device internally converts the entered text and options into JSON format and sends it as an HTTP POST request to the specified endpoint.

[0842] Step 3:

[0843] Data processing and storage by server

[0844] The server receives the user information sent from the device and stores it in a database. The stored user information becomes the basis for generating the optimal menu.

[0845] Input: User information in JSON format

[0846] Output: User information saved in the database, registration completion message

[0847] Specific operation: The server receives the request, parses it, extracts the user information, executes an INSERT query to the database to save the information, and returns a registration completion message to the device.

[0848] Step 4:

[0849] Server acquires user information and generates menu

[0850] The server retrieves user information from the database and sends it as a prompt to the generative AI model, which then generates the optimal menu based on the user information.

[0851] Input: User information stored in the database

[0852] Output: Generated menu suggestions

[0853] Specific operation: The server obtains user information using an SQL query, generates a prompt saying, "Please suggest a menu for a family of four with a father who has a wheat allergy," and sends it to the AI ​​engine. The AI ​​engine generates a menu and returns it to the server.

[0854] Step 5:

[0855] Server response for menu suggestions

[0856] The server compiles the generated menu information and sends it to the user's terminal as a response.

[0857] Input: Generated menu suggestions

[0858] Output: Response data sent to the device

[0859] Specific operation: The server formats the menu information received from the AI ​​engine and sends it to the terminal as an HTTP response.

[0860] Step 6:

[0861] Menu display on a terminal

[0862] The terminal displays the received menu suggestion information on a user interface.

[0863] Input: Received menu suggestion information

[0864] Output: Menu information displayed in a user interface

[0865] What it does: The device receives the response, parses the JSON, and displays it on the screen by category, such as main dish, side dish, and dessert. For example, "Main dish: Teriyaki salmon."

[0866] Step 7:

[0867] User confirmation and correction

[0868] The user reviews the proposed menu, makes any necessary changes or corrections, and confirms it.

[0869] Input: Menu information displayed in the user interface

[0870] Output: Confirmed menu information

[0871] Specific behavior: The user checks the displayed suggestions, makes individual corrections if necessary, and finally presses the "Confirm" button to confirm the changes.

[0872] Step 8:

[0873] Local retailer inventory updates

[0874] Local stores periodically update their inventory information and send it to the server.

[0875] Input: Inventory information (e.g., quantity of salmon, spinach, expiration date)

[0876] Output: Stock information sent to the server

[0877] What it does: Local retailers use an inventory management system to update their inventory information and periodically send that information to the server.

[0878] Step 9:

[0879] Stock information storage and verification by server

[0880] The server stores the received inventory information in a database and updates the inventory status by comparing it with existing user information.

[0881] Input: Stock information sent to the server

[0882] Output: Updated inventory status

[0883] Specific operation: The server saves the inventory information in a database, compares it with the user information, and updates the stock status of the necessary ingredients.

[0884] Step 10:

[0885] User execution of orders

[0886] The user checks the proposed menu, selects the necessary ingredients, and presses the "Order" button.

[0887] Input: Suggested menu information, user selection

[0888] Output: Order information

[0889] Specific operation: The user selects ingredients based on the menu information, presses the "Order" button, and confirms the order.

[0890] Step 11:

[0891] Terminal-based order request generation

[0892] The terminal formats the order information in JSON format and generates an HTTP request to send to the server.

[0893] Input: User's order information

[0894] Output: JSON order data, HTTP request

[0895] Specific operation: The terminal receives the order information, converts it into JSON format, and then generates an HTTP POST request to send to the server.

[0896] Step 12:

[0897] Server processes order and sends it to local dealer

[0898] The server processes the received order information and sends the required ingredient list to a local retailer.

[0899] Input: Order information in JSON format

[0900] Output: Ingredient list sent to local retailer

[0901] What happens: The server parses the order information, generates a list of ingredients needed, and sends it to the local store.

[0902] Step 13:

[0903] Fulfilling orders from local retailers

[0904] Based on the received ingredient list, local retailers use their inventory management system to pick up ingredients and prepare them for delivery.

[0905] Input: Ingredient list sent from the server

[0906] Output: Picked ingredients, ready for delivery

[0907] What happens: Local store staff check the inventory system, pick up the necessary ingredients, and prepare them for delivery.

[0908] Step 14:

[0909] Order confirmation notification by the server

[0910] The server will send the user an order confirmation email and notify them of the estimated delivery date and time.

[0911] Input: Order information, expected delivery date and time

[0912] Output: Order confirmation email to user

[0913] Specific operation: The server sends a confirmation email to the user based on the order information and estimated delivery date and time.

[0914] Step 15:

[0915] Sending food waste information from local retailers

[0916] Local retailers periodically upload information about ingredients that are in excess stock or near their expiration date to the server.

[0917] Input: Information about ingredients that are overstocked or nearing their expiration date

[0918] Output: Food waste information uploaded to the server

[0919] Specific operation: The local retailer's inventory management system sends information about overstocked or expired products to the server.

[0920] Step 16:

[0921] Server-based new menu generation and proposal

[0922] The server uses an AI model to generate new menus based on the received food waste information and suggests them to the user.

[0923] Input: Food waste information, user information

[0924] Output: New menu suggestion

[0925] Specific operation: The server inputs the information into a generative AI model, generates a menu that takes food waste into consideration, and suggests it to the user.

[0926] Step 17:

[0927] New menu display on terminal

[0928] The terminal displays the generated new menu information on the user interface.

[0929] Input: New menu suggestion

[0930] Output: New menu information displayed in the user interface

[0931] Specific operation: The device receives new menu information and displays it on the screen.

[0932] Step 18:

[0933] User confirmation and new order

[0934] The user can review the newly proposed menu and ingredients and place an order if necessary.

[0935] Input: New menu information

[0936] Output: New order information

[0937] Specific behavior: The user checks the new menu and, if there is anything they like, places an order again.

[0938] (Application example 1)

[0939] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0940] Food waste is becoming a serious problem in modern society. While food not consumed at home is discarded, there is a need to respond quickly to diverse consumer needs. However, previous systems have found it difficult to fully utilize user and inventory information to efficiently propose menus and reduce food waste. In addition, there is a lack of support for users to easily obtain the ingredients they need and reduce food waste.

[0941] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0942] In this invention, the server includes means for registering user information, means for proposing a menu based on the user information, means for checking ingredients needed for the proposed menu against store inventory information, means for enabling online ordering of the necessary ingredients, means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, means for proposing a new menu based on the acquired food information, means for notifying the user of order details based on the proposed menu and local store inventory information, and means for saving the user's order information in a database and forwarding it to the store. This allows the user to receive optimal menu suggestions, efficiently obtain food, and reduce food waste.

[0943] "User information" refers to information necessary for menu suggestions, such as the user's family composition, allergy information, and religious restrictions.

[0944] "Menu suggestion" refers to proposing a meal menu that is generated based on user information.

[0945] "Retailer inventory information" refers to information such as the type, quantity, and expiration date of ingredients held by local retailers or affiliated retailers.

[0946] "Online ordering" refers to the act of a user ordering the necessary ingredients online based on a suggested menu.

[0947] "Food waste" refers to food that is discarded without being consumed at home or in stores.

[0948] "Overstock" refers to a situation where there is excess inventory at retailers that is unlikely to be consumed.

[0949] "Best before" refers to the last day that food remains of good quality and can be safely consumed.

[0950] "Database" refers to an information management system that aggregates and efficiently manages user information, order information, inventory information, etc.

[0951] "Server" refers to a system that processes user information and retailer inventory information and provides services such as menu suggestions and online ordering.

[0952] The present invention is a system for making users' lives more convenient and reducing food waste. This system runs mainly on the user's smartphone and is configured as follows.

[0953] 1. Hardware and Software

[0954] Hardware: Smartphone

[0955] software:

[0956] Application: uses Python and the Flask framework

[0957] Database: MySQL

[0958] AI engine: TensorFlow

[0959] 2. User Information Registration

[0960] The user launches the app and registers by entering information such as family composition, allergies, and religious restrictions. The entered information is converted into JSON format by the device and sent to the server. The server stores this information in a database and notifies the user that registration is complete.

[0961] 3. Menu suggestions

[0962] The server extracts user information from the database and sends it to the TensorFlow model, an AI engine, which generates an optimal menu based on the user information. This menu takes into consideration the user's allergies and religious restrictions. The generated menu is sent from the server to the device and displayed on the user interface.

[0963] 4. Retailer inventory information and online ordering

[0964] The server periodically receives inventory information from local stores and stores this information in a database. When the user confirms the proposed menu and confirms the order, the device formats the order information for the necessary ingredients in JSON format and sends it to the server. The server then forwards this information to the local store and the order is confirmed. The user receives the estimated delivery date and time from the server.

[0965] 5. Reducing food waste

[0966] When local stores send information about ingredients that are overstocked or nearing their expiration date, the server uses this information to generate new menu ideas and suggests them to the user. The user can then check the new menu ideas and order the ingredients if necessary, thereby reducing food waste.

[0967] Specific examples

[0968] For example, in the Tanaka family, the father has a wheat allergy, so "wheat" is registered as allergy information along with the family composition. The server proposes a "gluten-free" menu, checks the inventory information of local stores, and generates a menu including teriyaki salmon, boiled spinach, and fruit yogurt. The Tanaka family orders ingredients based on this menu, and the order is forwarded to the local store. A new menu using tomatoes, which are in excess stock, is also proposed, and the Tanaka family confirms this menu and places an order.

[0969] Prompt Sentence Examples

[0970] "We have a family of four with wheat allergies. Can you suggest a menu?"

[0971] "Please tell me a recipe that uses tomatoes that are close to their expiration date."

[0972] "Please suggest the best menu for tonight's dinner."

[0973] In this way, the entire system aims to improve user convenience and reduce food waste.

[0974] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0975] Step 1:

[0976] Registering user information

[0977] Subject: User

[0978] Users launch the app and enter their family information, allergy information, and religious restrictions, which then collects information about the user's individual dietary restrictions.

[0979] Input: User's family structure, allergy information, religious restrictions, etc.

[0980] Output: User information formatted in JSON format

[0981] Specific operation: When the user enters information, the device formats it into JSON format, generates an HTTP request, and sends it to the server.

[0982] Step 2:

[0983] Saving user information

[0984] Subject: Server

[0985] The server saves the received user information in the database, and if the saving is successful, returns a registration completion message to the user.

[0986] Input: User information in JSON format

[0987] Output: Registration complete message

[0988] Specific operation: The server parses the received user information, generates an SQL query to store it in the database, and then returns a message to the user confirming registration.

[0989] Step 3:

[0990] Menu generation

[0991] Subject: Server

[0992] The server retrieves user information from the database and sends it to the AI ​​engine, which then generates the optimal menu based on the user information.

[0993] Input: User information retrieved from the database

[0994] Output: Generated menu information

[0995] Specific operation: The server inputs user information into the AI ​​engine to obtain predicted menu information, which is then sent to the device for display on the user interface.

[0996] Step 4:

[0997] Menu display

[0998] Subject: Terminal

[0999] The terminal displays the menu information received from the server on the user interface, and the user can check the proposed menu and make corrections or changes.

[1000] Input: Menu information sent from the server

[1001] Output: Menu information displayed in the user interface

[1002] Specific operation: The device parses the received menu information and displays it in a visually easy-to-understand format.

[1003] Step 5:

[1004] Updating retailer inventory

[1005] Subject: Dealer

[1006] The retailer periodically sends inventory information (type of ingredients, quantity, expiration date, etc.) to the server.

[1007] Input: Dealer inventory information

[1008] Output: Updated inventory information on the server

[1009] Specific operation: Inventory information is automatically collected from the retailer's system and sent to the server in JSON format.

[1010] Step 6:

[1011] Confirmation and notification of order details

[1012] Subject: User

[1013] The user checks the proposed menu and confirms the order. The device then formats the order information for the necessary ingredients in JSON format and sends it to the server.

[1014] Input: Order information based on suggested menu

[1015] Output: Order information in JSON format

[1016] Specific operation: When the user confirms the order, the terminal formats the information into JSON format and sends it to the server.

[1017] Step 7:

[1018] Transfer and confirmation of order information

[1019] Subject: Server

[1020] The server processes the received order information, sends the required ingredients list to the local store, and also sends the user an order confirmation email with an estimated delivery date and time.

[1021] Input: Order information in JSON format

[1022] Output: Ingredient list for the retailer and order confirmation email for the user

[1023] Specific operation: The server parses the order information and generates a list of ingredients required by the store's inventory management system. This list is sent to the store, and an order confirmation email is sent to the user.

[1024] Step 8:

[1025] Obtaining information on ingredients that are overstocked or nearing their expiration date

[1026] Subject: Dealer

[1027] The store transmits information about ingredients that are in excess stock or are close to their expiration date to the server.

[1028] Input: Information on ingredients that are overstocked or close to their expiration date

[1029] Output: New inventory information sent to the server

[1030] Specific operation: Information on ingredients that are overstocked or near their expiration date is automatically collected from the retailer's system and sent to the server.

[1031] Step 9:

[1032] New menu suggestions

[1033] Subject: Server

[1034] Based on the received inventory information, the server uses an AI engine to generate new menus and propose them to the user.

[1035] Input: Information on ingredients that are overstocked or close to their expiration date

[1036] Output: New menu information generated

[1037] Specific operation: The server inputs new inventory information into the AI ​​engine and generates new menus to minimize food waste. The generated menu information is sent to the user.

[1038] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1039] This invention provides a system that proposes menus tailored to the user's household and allows them to order the ingredients online in collaboration with local retailers. This system aims to reduce food waste and ease the burden of housework. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it becomes possible to propose menus that are more tailored to the user's needs.

[1040] Program processing

[1041] 1. User information registration

[1042] 1.1 Users

[1043] Launch the app and enter information such as family composition, allergy information, religious restrictions, emotional state, etc. Confirm the information you entered and press the "Register" button.

[1044] 1.2 Terminal

[1045] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[1046] 1.3 Server

[1047] Parse the received user information and save it in the database. If the save is successful, return a registration completion message to the user.

[1048] 2. Menu suggestions

[1049] 2.1 Server

[1050] The database is queried (searched) for user information and sent to the AI ​​engine for processing. The AI ​​engine generates an appropriate menu based on the user information and emotional information from the emotion engine.

[1051] 2.2 Server

[1052] The generated menu information is sent to the user's terminal as a response.

[1053] 2.3 Terminal

[1054] The received menu information is displayed on the user interface.

[1055] 2.4 Users

[1056] Review the proposed menu, make any necessary changes or amendments, and finalize it.

[1057] 3. Collaboration with local supermarkets and obtaining inventory information

[1058] 3.1 Local supermarket

[1059] Your store's inventory information is updated periodically and sent to the server.

[1060] 3.2 Server

[1061] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[1062] 4. Order ingredients online

[1063] 4.1 Users

[1064] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[1065] 4.2 Terminal

[1066] Format the user's order information in JSON format and generate an HTTP request to send to the server.

[1067] 4.3 Server

[1068] The system processes the received order information and sends a list of ingredients needed to the local supermarket, including the type of ingredients, quantity, and delivery date and time.

[1069] 4.4 Local supermarket

[1070] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[1071] 4.5 Server

[1072] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[1073] 5. Recommended ingredients to reduce food waste

[1074] 5.1 Local supermarket

[1075] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[1076] 5.2 Server

[1077] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[1078] 5.3 Server

[1079] The newly generated menu information is sent to the user's terminal.

[1080] 5.4 Terminal

[1081] The new menu information is displayed in the user interface.

[1082] 5.5 Users

[1083] Check the newly presented menu and ingredients and place orders as necessary.

[1084] Introducing the Emotion Engine

[1085] Emotion recognition

[1086] 1. Users

[1087] Users input their daily emotions and moods into the app, which then analyzes their facial expressions and tone of voice to automatically recognize their emotions.

[1088] 2. Terminal

[1089] Emotional information is formatted in JSON format and sent to the server.

[1090] 3. Server

[1091] The received emotional information is stored in a database and sent to the AI ​​engine.

[1092] Emotion-based menu adjustment

[1093] 1. Server

[1094] Based on emotional information, a menu optimal for the user's mood and physical condition is generated.

[1095] For example, if the user is tired, it will suggest easy-to-make dishes, and if the user is feeling energetic, it will suggest menus that allow them to try new dishes.

[1096] Specific examples

[1097] User: Tanaka family

[1098] 1. Registering user information and emotions

[1099] The Tanaka family entered allergy information for all family members, including the fact that the father has a wheat allergy. The emotional information included, "I'm tired today."

[1100] 2. Menu suggestions

[1101] The server suggests gluten-free meals that are easy to make even when you're tired. For example, the main dish is "butter-grilled salmon," the side dish is "spinach namul," and the dessert is "fruit almond tofu."

[1102] 3. Obtaining inventory information

[1103] Local supermarket A sends inventory information to the server. They have plenty of salmon and spinach in stock and want to prioritize selling them because they have a long shelf life.

[1104] 4. Order Confirmation

[1105] The Tanaka family checks the proposed menu and orders ingredients through the app, and the server sends the order information to local supermarket A.

[1106] 5. Recommended ingredients

[1107] Local supermarket A has an excess of tomatoes and broccoli in stock, so it sends that data to the server. The server then suggests a new menu using tomatoes and broccoli. The Tanaka family checks the menu and places an order.

[1108] This allows for more personalized menu suggestions based on the user's emotions and living situation, further improving user convenience.

[1109] The processing flow will be explained below.

[1110] Step 1: Register user information

[1111] 1.1 Users

[1112] Launch the app and enter your family composition (e.g., 2 adults, 2 children), allergy information (e.g., wheat allergy), religious restrictions (e.g., need for halal-certified food), etc. Then, enter your emotional information (e.g., how you feel today is "tired"). Confirm the information you entered and press the "Register" button.

[1113] 1.2 Terminal

[1114] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[1115] 1.3 Server

[1116] Parse the received user information and emotion information and save it in the database. If the save is successful, return a registration completion message to the user.

[1117] Step 2: Menu suggestions

[1118] 2.1 Server

[1119] User information and emotional information are queried (searched) from the database and sent to the AI ​​engine and emotion engine for processing. The AI ​​engine generates an appropriate menu based on the user information and the emotional information from the emotion engine.

[1120] 2.2 Server

[1121] The generated menu information is sent to the user's terminal as a response.

[1122] 2.3 Terminal

[1123] The received menu information is displayed on the user interface.

[1124] 2.4 Users

[1125] Review the proposed menu, make any necessary changes or modifications, and finally confirm the menu.

[1126] Step 3: Collaborate with local supermarkets and obtain inventory information

[1127] 3.1 Local supermarket

[1128] Regularly update your store's inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server.

[1129] 3.2 Server

[1130] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[1131] Step 4: Order ingredients online

[1132] 4.1 Users

[1133] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[1134] 4.2 Terminal

[1135] Format the user's order information in JSON format and generate an HTTP request to send to the server.

[1136] 4.3 Server

[1137] The system processes the received order information and sends a list of ingredients needed to the local supermarket, including the type of ingredients, quantity, and delivery date and time.

[1138] 4.4 Local supermarket

[1139] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[1140] 4.5 Server

[1141] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[1142] Step 5: Recommended ingredients to reduce food waste

[1143] 5.1 Local supermarket

[1144] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[1145] 5.2 Server

[1146] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[1147] 5.3 Server

[1148] The newly generated menu information is sent to the user's terminal.

[1149] 5.4 Terminal

[1150] The new menu information is displayed in the user interface.

[1151] 5.5 Users

[1152] Check the newly presented menu and ingredients and place orders as necessary.

[1153] Specific examples

[1154] User: Tanaka family

[1155] Step 1: Register user information

[1156] 1.1 Users

[1157] The Tanaka family inputs information about all family members, notably registering that the father has a wheat allergy. They also input "tired" as their emotional state for the day.

[1158] 1.2 Terminal

[1159] All input information is converted to JSON format and sent to the server.

[1160] 1.3 Server

[1161] The received information is stored in a database and a registration completion message is returned to the user.

[1162] Step 2: Menu suggestions

[1163] 2.1 Server

[1164] The database is queried for information about the Tanaka family and their emotions, which are then sent to the AI ​​engine and emotion engine. The AI ​​engine then generates "easy-to-make gluten-free meals."

[1165] 2.2 Server

[1166] The generated menu information is sent to the terminal.

[1167] 2.3 Terminal

[1168] The received menu information is displayed on the app screen.

[1169] 2.4 Users

[1170] Review and finalize the proposed menu.

[1171] Step 3: Collaborate with local supermarkets and obtain inventory information

[1172] 3.1 Local supermarket

[1173] Local supermarket A sends inventory information to the server.

[1174] 3.2 Server

[1175] The received inventory information is stored in a database and compared with the Tanaka family's menu information. Specifically, it checks for salmon and spinach, which are in abundant stock.

[1176] Step 4: Order ingredients online

[1177] 4.1 Users

[1178] The Tanaka family checks the proposed menu and presses the "Order" button.

[1179] 4.2 Terminal

[1180] Order information is formatted in JSON format and sent to the server.

[1181] 4.3 Server

[1182] Send order information to local supermarket A.

[1183] 4.4 Local supermarket

[1184] Pick up the necessary ingredients and prepare them for delivery.

[1185] 4.5 Server

[1186] An order confirmation email will be sent to the Tanaka family, informing them of the estimated delivery date and time.

[1187] Step 5: Recommended ingredients to reduce food waste

[1188] 5.1 Local supermarket

[1189] Data on excess tomatoes and broccoli is sent to the server.

[1190] 5.2 Server

[1191] The AI ​​engine generates new menus based on the data sent.

[1192] 5.3 Server

[1193] The generated new menu information is sent to the Tanaka family's terminal.

[1194] 5.4 Terminal

[1195] New menu information will be displayed on the app screen.

[1196] 5.5 Users

[1197] The Tanaka family reviews the new menu and ingredients and places orders as needed.

[1198] In this way, this system proposes optimal menus based on the user's emotions and living situation, and by linking it with online ordering of ingredients and inventory management, it simultaneously achieves convenience and reduces food waste.

[1199] Example 2

[1200] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1201] In modern households, planning daily menus and purchasing ingredients are a significant burden. Furthermore, food waste has become a social issue, necessitating efficient food use. Proposing menus that take into account users' allergies and religious restrictions is particularly difficult, and providing menus that match their emotions and physical condition is also important. However, current systems lack the means to effectively achieve this.

[1202] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1203] In this invention, the server includes means for registering user information, means for proposing menus based on the user information, means for checking ingredients needed for the proposed menu against inventory information, means for enabling the necessary ingredients to be ordered over the Internet, means for acquiring information on ingredients that are overstocked or approaching expiration dates to reduce food waste, means for proposing new menus based on the acquired food information, means for registering user emotion information and adjusting menus based on the emotion information, means for processing and saving the acquired emotion information, and means for saving periodically updated inventory information in a database. This enables personalized menu suggestions based on the user's living situation and emotions, thereby reducing food waste and reducing the burden of housework.

[1204] "User information" is a general term for data about an individual, such as a user's family structure, allergy information, religious restrictions, emotional state, and the like.

[1205] "Menu suggestion" refers to the act of creating and suggesting a menu of dishes suitable for a user based on user information.

[1206] "Inventory information" refers to data that indicates the current quantity, expiration date, and stock status of ingredients and products at a retail store.

[1207] "Means for enabling online ordering" refers to the technological means by which a user can select ingredients and complete an order online.

[1208] "Means for reducing food waste" refers to technological measures to collect information on ingredients that are overstocked or nearing their expiration date, and to make suggestions on how to make effective use of the information.

[1209] "Emotion information" is data that indicates the user's emotional state or mood, and includes information such as "tired" or "well-being."

[1210] A "database" refers to an information management system that systematically organizes and stores user information, inventory information, emotional information, etc.

[1211] An "emotion engine" refers to software or algorithms that analyze users' emotions and make various suggestions and adjustments based on that information.

[1212] This invention provides a system that proposes menus tailored to the user's household and allows them to order the ingredients online in collaboration with local retailers. This system aims to reduce food waste and ease the burden of housework. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to propose menus that are more tailored to the user's needs.

[1213] System Overview

[1214] Registering user information

[1215] The user launches the app and enters information such as family composition, allergy information, religious restrictions, and emotional state. Once the entered information is confirmed, registration is completed by pressing the "Register" button. A smartphone or tablet is recommended as the hardware. A dedicated application that provides the user interface (UI) is used as the software.

[1216] The device converts the entered user information into JSON format and generates an HTTP request to send to the server, ensuring that the user information is accurately transmitted to the server.

[1217] The server analyzes the received user information and stores it in a database. The database uses a standard SQL database, and stores user information organized by field. For example, data such as family composition (father, mother, two children), allergy information (wheat), and emotional state (tired) might be stored.

[1218] Menu suggestions

[1219] The server queries the user information from the database and sends it to the AI ​​engine. The AI ​​engine generates an appropriate menu based on the user information and the emotion information from the emotion engine. A general generative AI model is recommended as the AI ​​engine to use.

[1220] The server sends the generated menu information to the user's terminal as a response.

[1221] The device displays the received menu information on the user interface. For example, the main dish might be "butter-grilled salmon," the side dish "spinach namul," and the dessert "fruit almond tofu."

[1222] The user reviews the proposed menu, makes changes or corrections as necessary, and finally finalizes the menu.

[1223] Collaboration with local supermarkets and acquisition of inventory information

[1224] Local supermarkets regularly update their inventory information and send it to the server, specifically updating the types, quantities, expiration dates, and other information about ingredients in stock.

[1225] The server stores the received inventory information in a database and updates the inventory status by matching it with existing user information and suggested menu items, for example, removing items whose stock has decreased from the database and updating the database with new inventory that has been added.

[1226] Online ordering of ingredients

[1227] The user checks the proposed menu, selects the ingredients they wish to purchase, and presses the "Order" button. For example, the user can select the ingredients they need from the proposed menu using the checkboxes and then press the "Order" button to confirm the order.

[1228] The terminal formats the user's order information in JSON format and generates an HTTP request to send to the server.

[1229] The server processes the received order information and sends a list of ingredients needed to the local supermarket, including the type, quantity, and delivery date and time.

[1230] Based on the received ingredient list, the local supermarket will select the necessary ingredients from their inventory and prepare them for delivery.

[1231] The server will send the user an order confirmation email and notify them of the estimated delivery date and time.

[1232] Recommended ingredients to reduce food waste

[1233] Local supermarkets regularly update information about ingredients that are overstocked or nearing their expiration date and send it to the server.

[1234] Based on the received inventory information, the server uses an AI engine to generate new menu items using the relevant ingredients. For example, it generates a menu item such as "Tomato and Broccoli Salad" using tomatoes and broccoli that are in overstock.

[1235] The server transmits the newly generated menu information to the user's terminal.

[1236] The device displays the new menu information on the user interface. Specifically, the device displays the newly proposed menu on the screen so that the user can confirm it.

[1237] The user checks the newly presented menu and ingredients and places an order if necessary. For example, the user selects an item that interests them from the newly proposed menu and orders ingredients.

[1238] Introducing the Emotion Engine

[1239] Users input their daily emotions and moods into the app, and the app analyzes their facial expressions and tone of voice to automatically recognize their emotions. For example, it uses the smartphone's camera and microphone to analyze the user's facial expressions and voice to determine whether they are "tired" or "energetic."

[1240] The device formats the emotional information in JSON format and sends it to the server.

[1241] The server stores the received emotional information in a database and sends it to the AI ​​engine.

[1242] The server uses this emotional information to generate a menu that best suits the user's mood and physical condition. For example, if the user is tired, it will suggest easy-to-make dishes, and if the user is feeling energetic, it will suggest a menu that encourages them to try new dishes.

[1243] Specific examples

[1244] Prompt Sentence Examples

[1245] Prompt: "Taking into account my family's allergies, suggest some easy gluten-free meal suggestions for a tiring day."

[1246] In the case of the Tanaka family, they enter allergy information for each family member, and register that the father has a wheat allergy. They then enter "I'm tired today" as their emotional information. The server then suggests gluten-free meals that are easy to make even when you're tired. For example, it suggests "butter-grilled salmon" as the main dish, "spinach namul" as the side dish, and "fruit almond tofu" as the dessert.

[1247] This will enable more personalized menu suggestions based on the user's emotions and living situation, further improving user convenience.

[1248] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1249] Step 1:

[1250] The user launches the app and enters information such as family composition, allergy information, religious restrictions, emotional state, etc. After confirming the information entered, the user presses the "Register" button. This obtains the user information as input.

[1251] Step 2:

[1252] The device converts the information entered by the user into JSON format. For example, "Family composition: father, mother, two children," "Allergy information: wheat," and "Emotional state: tired" are generated as JSON data. An HTTP request is generated to send this JSON data to the server.

[1253] Step 3:

[1254] The server analyzes the received user information. It parses the received JSON data, breaks it down into database tables corresponding to each field, and saves them. For example, family structure is saved in the user_family table, wheat allergy in the user_allergy table, and emotional state in the user_emotion table. It returns a message indicating that the save was successful.

[1255] Step 4:

[1256] The server queries the database for user information and sends it to the AI ​​engine. The AI ​​engine uses the user information and emotional information obtained from this query as input and performs data calculations to generate the optimal menu for the user. As a specific example, it generates a "gluten-free menu that is easy to make even when you're tired."

[1257] Step 5:

[1258] The server receives the menu information generated by the AI ​​engine and sends it to the user's device as a response. This response includes the specific menu (e.g., main dish "butter-grilled salmon," side dish "spinach namul," and dessert "almond jelly with fruit").

[1259] Step 6:

[1260] The device displays the received menu information on a user interface, allowing the user to visually confirm each menu item (main dish, side dish, dessert, etc.), for example, by displaying a list of ingredients and instructions for each menu item.

[1261] Step 7:

[1262] The user checks the proposed menu and makes any necessary changes or corrections. Finally, the user confirms the menu. The confirmed menu information is resent from the device to the server in JSON format.

[1263] Step 8:

[1264] The local supermarket periodically updates its inventory information and sends it to the server. Specifically, it updates the type, quantity, expiration date, etc. of ingredients in stock. This inventory information is passed to the server as input.

[1265] Step 9:

[1266] The server stores the received inventory information in a database. It updates the inventory status by comparing it with existing user information and menu information. For example, it processes the data by removing items whose inventory has decreased from the database and adding new inventory.

[1267] Step 10:

[1268] The user checks the proposed menu, selects the ingredients they wish to purchase, and presses the "Order" button, which obtains the selected ingredients as input.

[1269] Step 11:

[1270] The device formats the user's order information in JSON format and generates an HTTP request to send to the server. For example, the order information might be formatted as "2 slices of salmon, 1 bunch of spinach, and all ingredients for almond tofu."

[1271] Step 12:

[1272] The server processes the received order information and sends the required ingredient list to the local supermarket. The order information includes the type of ingredient, quantity, and delivery date and time. This allows the local supermarket to input the ingredient list.

[1273] Step 13:

[1274] Based on the received ingredient list, the local supermarket will pick the necessary ingredients from their inventory and prepare for delivery. Specifically, they will pick up the ingredients from their inventory, pack them, and hand them over to the delivery person.

[1275] Step 14:

[1276] The server will then send the user an order confirmation email with the estimated delivery date and time, allowing the user to confirm the order details and delivery date and time.

[1277] Step 15:

[1278] Local supermarkets periodically update the server with information about ingredients that are overstocked or nearing their expiration date, and this data is also passed to the server as input.

[1279] Step 16:

[1280] Based on the received inventory information, the server uses an AI engine to generate a new menu using the relevant ingredients. For example, it performs data calculations to generate a "tomato and broccoli salad."

[1281] Step 17:

[1282] The server sends the newly generated menu information to the user's terminal, which then outputs the specific menu information.

[1283] Step 18:

[1284] The device displays the new menu information on the user interface. Specifically, the device displays the new menu on the screen so that the user can check it.

[1285] Step 19:

[1286] The user checks the newly presented menu and ingredients and places an order if necessary, which inputs the next purchase information.

[1287] Prompt example - text format

[1288] Prompt: "Taking into account my family's allergies, suggest some easy gluten-free meal suggestions for a tiring day."

[1289] (Application example 2)

[1290] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1291] The purpose of this invention is to improve the efficiency of meal planning and procurement in daily household life and reduce food waste. Another objective is to provide personalized service through menu suggestions based on the user's emotional state, thereby improving user convenience and satisfaction.

[1292] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering user information, means for proposing a menu based on the user information, means for checking ingredients needed for the proposed menu against inventory information of local stores, means for enabling online ordering of the necessary ingredients, means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, means for proposing a new menu based on the acquired food information, means for acquiring user emotional information, and means for adjusting the menu based on the acquired emotional information. This enables personalized menu suggestions based on the user's household situation and emotional state, efficient procurement of ingredients, and reduction of food waste.

[1293] "Means for registering user information" is a function for collecting individual information such as the user's family structure, allergy information, religious restrictions, emotional state, etc., and storing it within the system.

[1294] The "means for suggesting a menu" is a function for generating and suggesting an appropriate cooking menu based on the user's individual information.

[1295] The "means of checking ingredients against local retailer inventory information" is a function for checking whether the ingredients required for the proposed menu are in stock at affiliated local retailers.

[1296] The "means for enabling online ordering of ingredients" is a function that supports the process from when a user orders the ingredients they need online until the order is completed.

[1297] The "means for obtaining information on ingredients that are in excess of stock or are close to their expiration date" is a function that receives information from local retailers about ingredients that are in excess of stock or are close to their expiration date, and makes that information available within the system.

[1298] The "means for proposing new menus" is a function for generating and proposing new cooking menus based on information about ingredients that are in excess stock or near their expiration date.

[1299] The "means for acquiring user's emotional information" is a function for collecting the user's emotional state through the user's facial expression, tone of voice, or manual input, and storing it in the system.

[1300] The "means for adjusting menus based on emotional information" is a function for generating and suggesting a cooking menu that is most suitable for the user's mood and physical condition, taking into consideration the collected emotional information of the user.

[1301] A system for implementing the present invention is configured as follows.

[1302] First, the user enters information about their household (family composition, allergies, religious restrictions, emotional state, etc.) through a smartphone app. Once the user enters this information, it is converted into JSON format and sent to the server as an HTTP request. After receiving this information, the server analyzes it and stores it in a database.

[1303] Next, the server uses an AI engine to generate an appropriate menu based on the saved user information. This menu suggestion takes the user's emotional information into consideration to provide the optimal dish menu. At this time, the emotion engine can analyze the user's facial expressions and tone of voice to automatically recognize emotions. Users can also manually input emotional information.

[1304] Once the menu is decided, the server sends it to the user's device as a response. The user can then review the proposed menu, make any necessary changes or corrections, and finally confirm it. The information on ingredients needed for the confirmed menu is checked against the inventory information of local retailers. Inventory information is periodically updated by the local supermarket and sent to the server.

[1305] When a user wants to order ingredients, they can place an order online using a smartphone app. This order information is sent to a server, and based on the received information, a list of ingredients needed is sent to the local supermarket. The supermarket then picks the necessary ingredients from the received list and prepares them for delivery. In addition, from the perspective of reducing food waste, information about ingredients that are in excess or near their expiration date is also sent to the server, and new menu suggestions are made based on this information. This contributes to reducing food waste.

[1306] As a concrete example, consider the following scenario.

[1307] User: A household

[1308] 1. User information registration: The family enters allergy information for all family members, and registers that the mother is allergic to shellfish. The family also enters emotional information such as "I feel good today."

[1309] 2. Menu Suggestion: The AI ​​engine generates a menu that does not contain shellfish and is perfect for a day when you feel like it. The main dish is "chicken teriyaki," the side dish is "kinpira gobo" (stir-fried burdock root), and the dessert is "matcha ice cream."

[1310] 3. Obtaining inventory information: Local supermarkets send inventory information to verify that the suggested ingredients are in stock.

[1311] 4. Order confirmation: The user places an online order for the ingredients they need through the app. The server sends the order information to the local supermarket, which then picks up the ingredients and prepares them for delivery.

[1312] Example prompt sentence:

[1313] "User information: Mother is allergic to shellfish. Mood today: Good."

[1314] By introducing this system, personalized menu suggestions based on the user's household situation and emotional state will be possible, as well as efficient procurement of ingredients and reduction of food waste.

[1315] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1316] Step 1:

[1317] A user launches the smartphone app and enters information such as family composition, allergy information, religious restrictions, and emotional state. The entered information is converted to JSON format on the device and sent to the server as an HTTP request. The input is user information, and the output is JSON format data.

[1318] Step 2:

[1319] The server parses the received JSON-formatted user information and saves it in the database. Specifically, the server issues an SQL command to the database to save the user information. The input is JSON-formatted user information, and the output is a message indicating that the information has been saved to the database.

[1320] Step 3:

[1321] The user inputs emotional information. Alternatively, the device automatically acquires emotional information by analyzing the user's facial expressions and tone of voice. The emotional information is converted to JSON format on the device and sent to the server. The input is the user's emotional information, and the output is JSON format data.

[1322] Step 4:

[1323] The server analyzes the received emotion information and stores it in a database. Specifically, the server issues an SQL command to the database to save the emotion information. The input is emotion information in JSON format, and the output is a message indicating that the information has been saved to the database.

[1324] Step 5:

[1325] The server retrieves user information and emotional information from the database and sends it to the AI ​​engine. The AI ​​engine generates the optimal menu based on this information. User information and emotional information are input into the AI ​​engine's internal processing, which outputs the optimal menu based on that information. The input is user information and emotional information, and the output is the generated menu information.

[1326] Step 6:

[1327] The server sends the generated menu information to the user's device as a response. The device displays the received menu information on the user interface. The input is the generated menu information, and the output is the menu information displayed on the user's device.

[1328] Step 7:

[1329] The user checks the proposed menu, makes changes or corrections as necessary, and finally confirms it. The confirmed menu information is sent from the terminal to the server. The input is the user's modified or confirmed menu information, and the output is the confirmed menu information sent to the server.

[1330] Step 8:

[1331] The server checks the confirmed menu information against the inventory information of affiliated local stores. The inventory information, which is periodically updated by the local stores, is stored in the server's database. The input is the confirmed menu information and inventory information, and the output is the inventory check result.

[1332] Step 9:

[1333] When a user orders ingredients online using the app, the device sends the order information in JSON format to the server. The input is the user's order information, and the output is JSON format data.

[1334] Step 10:

[1335] The server receives the order information and sends the required ingredient list to the local store. The local store picks up the required ingredients and prepares the delivery. The input is the user's order information, and the output is the ingredient list sent to the local store.

[1336] Step 11:

[1337] To reduce food waste, the server receives information about ingredients that are overstocked or close to their expiration date. Based on this information, a new menu is generated. The input is the information about ingredients that are overstocked or close to their expiration date, and the output is the generated new menu information.

[1338] Step 12:

[1339] The server sends the newly generated menu information to the user's device. The device displays the received menu information on the user interface. The input is the newly generated menu information, and the output is the menu information displayed on the user's device.

[1340] In this way, specific input, data processing, and output are carried out at each processing step, resulting in personalized menu suggestions based on the user's household situation and emotional state, efficient procurement of ingredients, and reduced food waste.

[1341] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1342] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1343] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1344] [Third embodiment]

[1345] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1346] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1347] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1348] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1349] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1350] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1351] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1352] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1353] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1354] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1355] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1356] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1357] This invention is a system that makes users' lives more convenient and reduces food waste. The system includes a means for users to input and register information such as family composition, allergy information, and religious restrictions, and then suggests optimal menus based on this information. The ingredients needed for the suggested menus are checked against inventory information at local stores, allowing online ordering. To reduce food waste, the system also obtains information on ingredients that are overstocked or nearing their expiration date, and uses this information to suggest new menus to users.

[1358] Program processing

[1359] 1. User information registration

[1360] 1.1 Users

[1361] Launch the app and enter your family composition, allergy information, religious restrictions, etc. Confirm the information you entered and press the "Register" button.

[1362] 1.2 Terminal

[1363] The input information from the user is formatted in JSON format and an HTTP request is generated to be sent to the server.

[1364] 1.3 Server

[1365] The received user information is saved in the database. If the save is successful, a registration completion message is returned to the user.

[1366] 2. Menu suggestions

[1367] 2.1 Server

[1368] User information is retrieved from the database and sent to the AI ​​engine, which then generates a menu based on the user information.

[1369] 2.2 Server

[1370] When a menu proposal is generated, a response is returned to the terminal together with menu information to be proposed to the user.

[1371] 2.3 Terminal

[1372] The received menu information is displayed on the user interface.

[1373] 2.4 Users

[1374] Review the proposed menu, make any necessary changes or modifications, and finalize it.

[1375] 3. Collaboration with local supermarkets and obtaining inventory information

[1376] 3.1 Local supermarket

[1377] Regularly update your store's inventory information (e.g., quantity of salmon, spinach, expiration date) and send it to the server.

[1378] 3.2 Server

[1379] The received inventory information is stored in a database and compared with existing user information to update the inventory status.

[1380] 4. Order ingredients online

[1381] 4.1 Users

[1382] Check the suggested menu and press the "Order" button on the app.

[1383] 4.2 Terminal

[1384] The user's order information (e.g. salmon, spinach, fruit, yogurt) is formatted in JSON format and an HTTP request is generated to send to the server.

[1385] 4.3 Server

[1386] Process the received order information and send the list of ingredients needed to the local supermarket.

[1387] 4.4 Local supermarket

[1388] Based on the received ingredient list, the inventory management system picks up the necessary ingredients and prepares them for delivery.

[1389] 4.5 Server

[1390] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[1391] 5. Recommended ingredients to reduce food waste

[1392] 5.1 Local supermarket

[1393] Information on ingredients that are in excess stock or near their expiration date is uploaded to a server.

[1394] 5.2 Server

[1395] Based on the received inventory information, the AI ​​engine generates new menus using the relevant ingredients and suggests them to the user.

[1396] 5.3 Terminal

[1397] The generated new menu information is displayed on the user interface.

[1398] 5.4 Users

[1399] Check the newly proposed menu and ingredients and place orders as necessary.

[1400] Specific examples

[1401] User: Tanaka family

[1402] 1. User information registration

[1403] The Tanaka family has a wheat allergy, so they entered "wheat" as their allergy information. The family consists of four people: two adults and two children.

[1404] 2. Menu suggestions

[1405] The server suggests gluten-free meals that children can enjoy. For example, the main dish is teriyaki salmon, the side dish is boiled spinach, and the dessert is fruit yogurt.

[1406] 3. Obtaining inventory information

[1407] Local supermarket A sends inventory information to the server. They have plenty of salmon and spinach in stock and want to prioritize selling them because they have a long shelf life.

[1408] 4. Order Confirmation

[1409] The Tanaka family checks the proposed menu and orders ingredients through the app, and the server sends the order information to local supermarket A.

[1410] 5. Recommended ingredients

[1411] Local supermarket A has an excess of tomatoes and broccoli in stock, so it sends that data to the server. The server then suggests a new menu using tomatoes and broccoli. The Tanaka family checks the menu and places an order.

[1412] In this way, the entire system aims to improve user convenience and reduce food waste.

[1413] The processing flow will be explained below.

[1414] Step 1: Register user information

[1415] 1.1 Users

[1416] The user launches the app and enters information such as family composition (e.g., two adults, two children), allergy information (e.g., wheat allergy), religious restrictions (e.g., need for halal-certified food), etc., confirms the information entered, and presses the "Register" button.

[1417] 1.2 Terminal

[1418] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[1419] 1.3 Server

[1420] Parse the received user information and save it in the database. If the save is successful, return a registration completion message to the user.

[1421] Step 2: Menu suggestions

[1422] 2.1 Server

[1423] The database is queried (searched) for user information and sent to an AI engine for processing, which then generates an appropriate menu based on the user information.

[1424] 2.2 Server

[1425] The generated menu information is sent to the user's terminal as a response.

[1426] 2.3 Terminal

[1427] The received menu information is displayed on the user interface.

[1428] 2.4 Users

[1429] Check the presented menu, make any necessary changes or corrections, and finally confirm the menu.

[1430] Step 3: Collaborate with local supermarkets and obtain inventory information

[1431] 3.1 Local supermarket

[1432] Regularly update your store's inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server.

[1433] 3.2 Server

[1434] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[1435] Step 4: Order ingredients online

[1436] 4.1 Users

[1437] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[1438] 4.2 Terminal

[1439] Format the user's order information in JSON format and send an HTTP request to the server.

[1440] 4.3 Server

[1441] The system processes the received order information and sends a list of ingredients needed to a local supermarket, including the type of food, quantity, delivery date and time, etc.

[1442] 4.4 Local supermarket

[1443] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[1444] 4.5 Server

[1445] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[1446] Step 5: Recommended ingredients to reduce food waste

[1447] 5.1 Local supermarket

[1448] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[1449] 5.2 Server

[1450] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[1451] 5.3 Server

[1452] The newly generated menu information is sent to the user's terminal.

[1453] 5.4 Terminal

[1454] The new menu information is displayed in the user interface.

[1455] 5.5 Users

[1456] Check the newly presented menu and ingredients and place orders as necessary.

[1457] Example 1

[1458] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1459] In modern society, managing household menus and reducing food waste are important issues. In particular, existing systems are unable to adequately address the issues of proposing cooking menus that take into account diverse family structures, allergies, and religious restrictions, linking with local retailers' inventory status, and reducing food waste. There is also a need for more efficient ordering procedures and an intuitive user interface.

[1460] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1461] In this invention, the server includes a first means for registering user information, a second means for proposing a menu based on the user information, a third means for comparing ingredients needed for the proposed menu with inventory information from local stores, a fourth means for enabling online ordering of the necessary ingredients, a fifth means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, a sixth means for proposing a new menu based on the acquired food information using a generative AI model, a seventh means for formatting the user information and inventory information from local stores in JSON format and generating an HTTP request, and an eighth means for displaying the information received on the terminal on a user interface. This allows the user to efficiently receive optimal menu suggestions and reduce food waste by linking with inventory information from local stores.

[1462] "User Information" refers to family information, allergy information, religious restrictions, and other personal data entered by the user.

[1463] The "first means" refers to a means for registering user information, and includes a function for saving information entered by the user in a database.

[1464] The "second means" refers to a means of proposing the optimal menu based on user information, and includes a function for generating menus using an AI engine or algorithm.

[1465] The "third means" refers to a means of checking the ingredients needed for the proposed menu against inventory information from local retailers, and includes a function to grasp inventory status and link it to the menu.

[1466] The "fourth means" refers to a means that allows the necessary ingredients to be ordered online, and includes a function to generate order information and send it to the retailer.

[1467] The "fifth means" refers to a means of obtaining information on ingredients that are in excess stock or near their expiration date in order to reduce food waste, and includes a function to receive inventory information from local retailers.

[1468] The "sixth means" refers to a means of using an AI model to generate and propose new menus based on the acquired food information, and includes functions related to generating menus to reduce food waste.

[1469] The "seventh means" refers to a means for formatting user information and local retailer inventory information in JSON format and generating an HTTP request, and includes functions related to data format conversion and request generation.

[1470] The "eighth means" refers to a means for displaying the information received by the terminal on a user interface, and includes a function for providing information intuitively to the user.

[1471] A "generative AI model" refers to an artificial intelligence algorithm or system that generates optimal menu and ingredient suggestions based on user information and inventory information.

[1472] A "prompt" is an instruction given to a generative AI model to obtain a specific output.

[1473] This invention is a system that aims to efficiently suggest optimal menus to users and reduce food waste by linking with inventory information from local retailers. In this example, the roles of the user, terminal, and server are specifically explained. The invention is implemented with the following configuration.

[1474] User input of information

[1475] Users launch the application on their smartphone or computer and enter the necessary information, such as family composition, allergy information, and religious restrictions. This information is saved in the system and becomes the basic data when menu suggestions are made. For example, if a user has a family of four and the father has a wheat allergy, they would enter information such as "family of four," "allergies: wheat," and "no religious restrictions."

[1476] Data formatting and transmission by the terminal

[1477] The device formats the information entered by the user in JSON format, generates an HTTP request, and sends it to the server. The specific software used is an iOS or Android application and a web browser.

[1478] Data processing and storage by server

[1479] The server receives the user information sent from the device and stores it in a database. The stored user information serves as the basis for generating optimal menus. The server often uses MySQL or PostgreSQL as its database management system (DBMS).

[1480] Menu suggestions

[1481] The server retrieves user information from the database and sends it to the generative AI model as a prompt. This AI engine (e.g., GPT-3 or BERT) analyzes the user information and generates the optimal menu that meets the user's criteria. An example of a prompt might be, "Please suggest a menu for a family of four where the father has a wheat allergy."

[1482] Display menu information

[1483] The server sends the generated menu information to the device as a response. The device displays this information on a user interface, providing the user with suggested menus and related ingredient information. Frameworks such as React Native and Flutter may be used for display.

[1484] Get inventory and place orders

[1485] Local stores periodically update their inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server. The server receives this information and stores it in a database. The user can then order the ingredients needed for the proposed meal online, and the server sends the order information to the local store. This also takes into account ingredients that are overstocked or nearing their expiration date.

[1486] New menu proposals to reduce food waste

[1487] The server uses a generative AI model to propose new menus based on information about ingredients that are overstocked or nearing their expiration date. The device displays this information on a user interface, and the user can check the newly proposed menu and ingredient information and place an order if necessary.

[1488] Specific examples

[1489] For example, if the Tanaka family consists of four people and the father has a wheat allergy, the user inputs the wheat allergy information and family composition. The server uses an AI engine to generate a "gluten-free menu that children can enjoy," suggesting "salmon teriyaki" as the main dish, "spinach ohitashi" as a side dish, and "fruit yogurt" as a dessert. The order is then processed based on inventory information from local retailers. If the local retailer sends information that they have excess stock of tomatoes and broccoli, the server will suggest a new menu using those ingredients.

[1490] In this way, the entire system aims to improve user convenience and reduce food waste.

[1491] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1492] Step 1:

[1493] User input of information

[1494] Users launch the application on their smartphone or computer, enter the necessary information such as family composition, allergies, and religious restrictions, and press the "Register" button.

[1495] Input: Family composition, allergy information, religious restrictions

[1496] Output: User information entered

[1497] Specific operation: The user enters each item in the application's input form using text or options. For example, "Family of four" and "Allergy: wheat."

[1498] Step 2:

[1499] Data formatting and transmission by the terminal

[1500] The terminal formats the information entered by the user in JSON format, generates an HTTP request, and sends it to the server.

[1501] Input: User information entered

[1502] Output: JSON formatted data, HTTP request

[1503] Specific operation: The device internally converts the entered text and options into JSON format and sends it as an HTTP POST request to the specified endpoint.

[1504] Step 3:

[1505] Data processing and storage by server

[1506] The server receives the user information sent from the device and stores it in a database. The stored user information becomes the basis for generating the optimal menu.

[1507] Input: User information in JSON format

[1508] Output: User information saved in the database, registration completion message

[1509] Specific operation: The server receives the request, parses it, extracts the user information, executes an INSERT query to the database to save the information, and returns a registration completion message to the device.

[1510] Step 4:

[1511] Server acquires user information and generates menu

[1512] The server retrieves user information from the database and sends it as a prompt to the generative AI model, which then generates the optimal menu based on the user information.

[1513] Input: User information stored in the database

[1514] Output: Generated menu suggestions

[1515] Specific operation: The server obtains user information using an SQL query, generates a prompt saying, "Please suggest a menu for a family of four with a father who has a wheat allergy," and sends it to the AI ​​engine. The AI ​​engine generates a menu and returns it to the server.

[1516] Step 5:

[1517] Server response for menu suggestions

[1518] The server compiles the generated menu information and sends it to the user's terminal as a response.

[1519] Input: Generated menu suggestions

[1520] Output: Response data sent to the device

[1521] Specific operation: The server formats the menu information received from the AI ​​engine and sends it to the terminal as an HTTP response.

[1522] Step 6:

[1523] Menu display on a terminal

[1524] The terminal displays the received menu suggestion information on a user interface.

[1525] Input: Received menu suggestion information

[1526] Output: Menu information displayed in a user interface

[1527] What it does: The device receives the response, parses the JSON, and displays it on the screen by category, such as main dish, side dish, and dessert. For example, "Main dish: Teriyaki salmon."

[1528] Step 7:

[1529] User confirmation and correction

[1530] The user reviews the proposed menu, makes any necessary changes or corrections, and confirms it.

[1531] Input: Menu information displayed in the user interface

[1532] Output: Confirmed menu information

[1533] Specific behavior: The user checks the displayed suggestions, makes individual corrections if necessary, and finally presses the "Confirm" button to confirm the changes.

[1534] Step 8:

[1535] Local retailer inventory updates

[1536] Local stores periodically update their inventory information and send it to the server.

[1537] Input: Inventory information (e.g., quantity of salmon, spinach, expiration date)

[1538] Output: Stock information sent to the server

[1539] What it does: Local retailers use an inventory management system to update their inventory information and periodically send that information to the server.

[1540] Step 9:

[1541] Stock information storage and verification by server

[1542] The server stores the received inventory information in a database and updates the inventory status by comparing it with existing user information.

[1543] Input: Stock information sent to the server

[1544] Output: Updated inventory status

[1545] Specific operation: The server saves the inventory information in a database, compares it with the user information, and updates the stock status of the necessary ingredients.

[1546] Step 10:

[1547] User execution of orders

[1548] The user checks the proposed menu, selects the necessary ingredients, and presses the "Order" button.

[1549] Input: Suggested menu information, user selection

[1550] Output: Order information

[1551] Specific operation: The user selects ingredients based on the menu information, presses the "Order" button, and confirms the order.

[1552] Step 11:

[1553] Terminal-based order request generation

[1554] The terminal formats the order information in JSON format and generates an HTTP request to send to the server.

[1555] Input: User's order information

[1556] Output: JSON order data, HTTP request

[1557] Specific operation: The terminal receives the order information, converts it into JSON format, and then generates an HTTP POST request to send to the server.

[1558] Step 12:

[1559] Server processes order and sends it to local dealer

[1560] The server processes the received order information and sends the required ingredient list to a local retailer.

[1561] Input: Order information in JSON format

[1562] Output: Ingredient list sent to local retailer

[1563] What happens: The server parses the order information, generates a list of ingredients needed, and sends it to the local store.

[1564] Step 13:

[1565] Fulfilling orders from local retailers

[1566] Based on the received ingredient list, local retailers use their inventory management system to pick up ingredients and prepare them for delivery.

[1567] Input: Ingredient list sent from the server

[1568] Output: Picked ingredients, ready for delivery

[1569] What happens: Local store staff check the inventory system, pick up the necessary ingredients, and prepare them for delivery.

[1570] Step 14:

[1571] Order confirmation notification by the server

[1572] The server will send the user an order confirmation email and notify them of the estimated delivery date and time.

[1573] Input: Order information, expected delivery date and time

[1574] Output: Order confirmation email to user

[1575] Specific operation: The server sends a confirmation email to the user based on the order information and estimated delivery date and time.

[1576] Step 15:

[1577] Sending food waste information from local retailers

[1578] Local retailers periodically upload information about ingredients that are in excess stock or near their expiration date to the server.

[1579] Input: Information about ingredients that are overstocked or nearing their expiration date

[1580] Output: Food waste information uploaded to the server

[1581] Specific operation: The local retailer's inventory management system sends information about overstocked or expired products to the server.

[1582] Step 16:

[1583] Server-based new menu generation and proposal

[1584] The server uses an AI model to generate new menus based on the received food waste information and suggests them to the user.

[1585] Input: Food waste information, user information

[1586] Output: New menu suggestion

[1587] Specific operation: The server inputs the information into a generative AI model, generates a menu that takes food waste into consideration, and suggests it to the user.

[1588] Step 17:

[1589] New menu display on terminal

[1590] The terminal displays the generated new menu information on the user interface.

[1591] Input: New menu suggestion

[1592] Output: New menu information displayed in the user interface

[1593] Specific operation: The device receives new menu information and displays it on the screen.

[1594] Step 18:

[1595] User confirmation and new order

[1596] The user can review the newly proposed menu and ingredients and place an order if necessary.

[1597] Input: New menu information

[1598] Output: New order information

[1599] Specific behavior: The user checks the new menu and, if there is anything they like, places an order again.

[1600] (Application example 1)

[1601] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1602] Food waste is becoming a serious problem in modern society. While food not consumed at home is discarded, there is a need to respond quickly to diverse consumer needs. However, previous systems have found it difficult to fully utilize user and inventory information to efficiently propose menus and reduce food waste. In addition, there is a lack of support for users to easily obtain the ingredients they need and reduce food waste.

[1603] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1604] In this invention, the server includes means for registering user information, means for proposing a menu based on the user information, means for checking ingredients needed for the proposed menu against store inventory information, means for enabling online ordering of the necessary ingredients, means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, means for proposing a new menu based on the acquired food information, means for notifying the user of order details based on the proposed menu and local store inventory information, and means for saving the user's order information in a database and forwarding it to the store. This allows the user to receive optimal menu suggestions, efficiently obtain food, and reduce food waste.

[1605] "User information" refers to information necessary for menu suggestions, such as the user's family composition, allergy information, and religious restrictions.

[1606] "Menu suggestion" refers to proposing a meal menu that is generated based on user information.

[1607] "Retailer inventory information" refers to information such as the type, quantity, and expiration date of ingredients held by local retailers or affiliated retailers.

[1608] "Online ordering" refers to the act of a user ordering the necessary ingredients online based on a suggested menu.

[1609] "Food waste" refers to food that is discarded without being consumed at home or in stores.

[1610] "Overstock" refers to a situation where there is excess inventory at retailers that is unlikely to be consumed.

[1611] "Best before" refers to the last day that food remains of good quality and can be safely consumed.

[1612] "Database" refers to an information management system that aggregates and efficiently manages user information, order information, inventory information, etc.

[1613] "Server" refers to a system that processes user information and retailer inventory information and provides services such as menu suggestions and online ordering.

[1614] The present invention is a system for making users' lives more convenient and reducing food waste. This system runs mainly on the user's smartphone and is configured as follows.

[1615] 1. Hardware and Software

[1616] Hardware: Smartphone

[1617] software:

[1618] Application: uses Python and the Flask framework

[1619] Database: MySQL

[1620] AI engine: TensorFlow

[1621] 2. User Information Registration

[1622] The user launches the app and registers by entering information such as family composition, allergies, and religious restrictions. The entered information is converted into JSON format by the device and sent to the server. The server stores this information in a database and notifies the user that registration is complete.

[1623] 3. Menu suggestions

[1624] The server extracts user information from the database and sends it to the TensorFlow model, an AI engine, which generates an optimal menu based on the user information. This menu takes into consideration the user's allergies and religious restrictions. The generated menu is sent from the server to the device and displayed on the user interface.

[1625] 4. Retailer inventory information and online ordering

[1626] The server periodically receives inventory information from local stores and stores this information in a database. When the user confirms the proposed menu and confirms the order, the device formats the order information for the necessary ingredients in JSON format and sends it to the server. The server then forwards this information to the local store and the order is confirmed. The user receives the estimated delivery date and time from the server.

[1627] 5. Reducing food waste

[1628] When local stores send information about ingredients that are overstocked or nearing their expiration date, the server uses this information to generate new menu ideas and suggests them to the user. The user can then check the new menu ideas and order the ingredients if necessary, thereby reducing food waste.

[1629] Specific examples

[1630] For example, in the Tanaka family, the father has a wheat allergy, so "wheat" is registered as allergy information along with the family composition. The server proposes a "gluten-free" menu, checks the inventory information of local stores, and generates a menu including teriyaki salmon, boiled spinach, and fruit yogurt. The Tanaka family orders ingredients based on this menu, and the order is forwarded to the local store. A new menu using tomatoes, which are in excess stock, is also proposed, and the Tanaka family confirms this menu and places an order.

[1631] Prompt Sentence Examples

[1632] "We have a family of four with wheat allergies. Can you suggest a menu?"

[1633] "Please tell me a recipe that uses tomatoes that are close to their expiration date."

[1634] "Please suggest the best menu for tonight's dinner."

[1635] In this way, the entire system aims to improve user convenience and reduce food waste.

[1636] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1637] Step 1:

[1638] Registering user information

[1639] Subject: User

[1640] Users launch the app and enter their family information, allergy information, and religious restrictions, which then collects information about the user's individual dietary restrictions.

[1641] Input: User's family structure, allergy information, religious restrictions, etc.

[1642] Output: User information formatted in JSON format

[1643] Specific operation: When the user enters information, the device formats it into JSON format, generates an HTTP request, and sends it to the server.

[1644] Step 2:

[1645] Saving user information

[1646] Subject: Server

[1647] The server saves the received user information in the database, and if the saving is successful, returns a registration completion message to the user.

[1648] Input: User information in JSON format

[1649] Output: Registration complete message

[1650] Specific operation: The server parses the received user information, generates an SQL query to store it in the database, and then returns a message to the user confirming registration.

[1651] Step 3:

[1652] Menu generation

[1653] Subject: Server

[1654] The server retrieves user information from the database and sends it to the AI ​​engine, which then generates the optimal menu based on the user information.

[1655] Input: User information retrieved from the database

[1656] Output: Generated menu information

[1657] Specific operation: The server inputs user information into the AI ​​engine to obtain predicted menu information, which is then sent to the device for display on the user interface.

[1658] Step 4:

[1659] Menu display

[1660] Subject: Terminal

[1661] The terminal displays the menu information received from the server on the user interface, and the user can check the proposed menu and make corrections or changes.

[1662] Input: Menu information sent from the server

[1663] Output: Menu information displayed in the user interface

[1664] Specific operation: The device parses the received menu information and displays it in a visually easy-to-understand format.

[1665] Step 5:

[1666] Updating retailer inventory

[1667] Subject: Dealer

[1668] The retailer periodically sends inventory information (type of ingredients, quantity, expiration date, etc.) to the server.

[1669] Input: Dealer inventory information

[1670] Output: Updated inventory information on the server

[1671] Specific operation: Inventory information is automatically collected from the retailer's system and sent to the server in JSON format.

[1672] Step 6:

[1673] Confirmation and notification of order details

[1674] Subject: User

[1675] The user checks the proposed menu and confirms the order. The device then formats the order information for the necessary ingredients in JSON format and sends it to the server.

[1676] Input: Order information based on suggested menu

[1677] Output: Order information in JSON format

[1678] Specific operation: When the user confirms the order, the terminal formats the information into JSON format and sends it to the server.

[1679] Step 7:

[1680] Transfer and confirmation of order information

[1681] Subject: Server

[1682] The server processes the received order information, sends the required ingredients list to the local store, and also sends the user an order confirmation email with an estimated delivery date and time.

[1683] Input: Order information in JSON format

[1684] Output: Ingredient list for the retailer and order confirmation email for the user

[1685] Specific operation: The server parses the order information and generates a list of ingredients required by the store's inventory management system. This list is sent to the store, and an order confirmation email is sent to the user.

[1686] Step 8:

[1687] Obtaining information on ingredients that are overstocked or nearing their expiration date

[1688] Subject: Dealer

[1689] The store transmits information about ingredients that are in excess stock or are close to their expiration date to the server.

[1690] Input: Information on ingredients that are overstocked or close to their expiration date

[1691] Output: New inventory information sent to the server

[1692] Specific operation: Information on ingredients that are overstocked or near their expiration date is automatically collected from the retailer's system and sent to the server.

[1693] Step 9:

[1694] New menu suggestions

[1695] Subject: Server

[1696] Based on the received inventory information, the server uses an AI engine to generate new menus and propose them to the user.

[1697] Input: Information on ingredients that are overstocked or close to their expiration date

[1698] Output: New menu information generated

[1699] Specific operation: The server inputs new inventory information into the AI ​​engine and generates new menus to minimize food waste. The generated menu information is sent to the user.

[1700] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1701] This invention provides a system that proposes menus tailored to the user's household and allows them to order the ingredients online in collaboration with local retailers. This system aims to reduce food waste and ease the burden of housework. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it becomes possible to propose menus that are more tailored to the user's needs.

[1702] Program processing

[1703] 1. User information registration

[1704] 1.1 Users

[1705] Launch the app and enter information such as family composition, allergy information, religious restrictions, emotional state, etc. Confirm the information you entered and press the "Register" button.

[1706] 1.2 Terminal

[1707] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[1708] 1.3 Server

[1709] Parse the received user information and save it in the database. If the save is successful, return a registration completion message to the user.

[1710] 2. Menu suggestions

[1711] 2.1 Server

[1712] The database is queried (searched) for user information and sent to the AI ​​engine for processing. The AI ​​engine generates an appropriate menu based on the user information and emotional information from the emotion engine.

[1713] 2.2 Server

[1714] The generated menu information is sent to the user's terminal as a response.

[1715] 2.3 Terminal

[1716] The received menu information is displayed on the user interface.

[1717] 2.4 Users

[1718] Review the proposed menu, make any necessary changes or amendments, and finalize it.

[1719] 3. Collaboration with local supermarkets and obtaining inventory information

[1720] 3.1 Local supermarket

[1721] Your store's inventory information is updated periodically and sent to the server.

[1722] 3.2 Server

[1723] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[1724] 4. Order ingredients online

[1725] 4.1 Users

[1726] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[1727] 4.2 Terminal

[1728] Format the user's order information in JSON format and generate an HTTP request to send to the server.

[1729] 4.3 Server

[1730] The system processes the received order information and sends a list of ingredients needed to the local supermarket, including the type of ingredients, quantity, and delivery date and time.

[1731] 4.4 Local supermarket

[1732] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[1733] 4.5 Server

[1734] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[1735] 5. Recommended ingredients to reduce food waste

[1736] 5.1 Local supermarket

[1737] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[1738] 5.2 Server

[1739] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[1740] 5.3 Server

[1741] The newly generated menu information is sent to the user's terminal.

[1742] 5.4 Terminal

[1743] The new menu information is displayed in the user interface.

[1744] 5.5 Users

[1745] Check the newly presented menu and ingredients and place orders as necessary.

[1746] Introducing the Emotion Engine

[1747] Emotion recognition

[1748] 1. Users

[1749] Users input their daily emotions and moods into the app, which then analyzes their facial expressions and tone of voice to automatically recognize their emotions.

[1750] 2. Terminal

[1751] Emotional information is formatted in JSON format and sent to the server.

[1752] 3. Server

[1753] The received emotional information is stored in a database and sent to the AI ​​engine.

[1754] Emotion-based menu adjustment

[1755] 1. Server

[1756] Based on emotional information, a menu optimal for the user's mood and physical condition is generated.

[1757] For example, if the user is tired, it will suggest easy-to-make dishes, and if the user is feeling energetic, it will suggest menus that allow them to try new dishes.

[1758] Specific examples

[1759] User: Tanaka family

[1760] 1. Registering user information and emotions

[1761] The Tanaka family entered allergy information for all family members, including the fact that the father has a wheat allergy. The emotional information included, "I'm tired today."

[1762] 2. Menu suggestions

[1763] The server suggests gluten-free meals that are easy to make even when you're tired. For example, the main dish is "butter-grilled salmon," the side dish is "spinach namul," and the dessert is "fruit almond tofu."

[1764] 3. Obtaining inventory information

[1765] Local supermarket A sends inventory information to the server. They have plenty of salmon and spinach in stock and want to prioritize selling them because they have a long shelf life.

[1766] 4. Order Confirmation

[1767] The Tanaka family checks the proposed menu and orders ingredients through the app, and the server sends the order information to local supermarket A.

[1768] 5. Recommended ingredients

[1769] Local supermarket A has an excess of tomatoes and broccoli in stock, so it sends that data to the server. The server then suggests a new menu using tomatoes and broccoli. The Tanaka family checks the menu and places an order.

[1770] This allows for more personalized menu suggestions based on the user's emotions and living situation, further improving user convenience.

[1771] The processing flow will be explained below.

[1772] Step 1: Register user information

[1773] 1.1 Users

[1774] Launch the app and enter your family composition (e.g., 2 adults, 2 children), allergy information (e.g., wheat allergy), religious restrictions (e.g., need for halal-certified food), etc. Then, enter your emotional information (e.g., how you feel today is "tired"). Confirm the information you entered and press the "Register" button.

[1775] 1.2 Terminal

[1776] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[1777] 1.3 Server

[1778] Parse the received user information and emotion information and save it in the database. If the save is successful, return a registration completion message to the user.

[1779] Step 2: Menu suggestions

[1780] 2.1 Server

[1781] User information and emotional information are queried (searched) from the database and sent to the AI ​​engine and emotion engine for processing. The AI ​​engine generates an appropriate menu based on the user information and the emotional information from the emotion engine.

[1782] 2.2 Server

[1783] The generated menu information is sent to the user's terminal as a response.

[1784] 2.3 Terminal

[1785] The received menu information is displayed on the user interface.

[1786] 2.4 Users

[1787] Review the proposed menu, make any necessary changes or modifications, and finally confirm the menu.

[1788] Step 3: Collaborate with local supermarkets and obtain inventory information

[1789] 3.1 Local supermarket

[1790] Regularly update your store's inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server.

[1791] 3.2 Server

[1792] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[1793] Step 4: Order ingredients online

[1794] 4.1 Users

[1795] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[1796] 4.2 Terminal

[1797] Format the user's order information in JSON format and generate an HTTP request to send to the server.

[1798] 4.3 Server

[1799] The system processes the received order information and sends a list of ingredients needed to the local supermarket, including the type of ingredients, quantity, and delivery date and time.

[1800] 4.4 Local supermarket

[1801] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[1802] 4.5 Server

[1803] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[1804] Step 5: Recommended ingredients to reduce food waste

[1805] 5.1 Local supermarket

[1806] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[1807] 5.2 Server

[1808] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[1809] 5.3 Server

[1810] The newly generated menu information is sent to the user's terminal.

[1811] 5.4 Terminal

[1812] The new menu information is displayed in the user interface.

[1813] 5.5 Users

[1814] Check the newly presented menu and ingredients and place orders as necessary.

[1815] Specific examples

[1816] User: Tanaka family

[1817] Step 1: Register user information

[1818] 1.1 Users

[1819] The Tanaka family inputs information about all family members, notably registering that the father has a wheat allergy. They also input "tired" as their emotional state for the day.

[1820] 1.2 Terminal

[1821] All input information is converted to JSON format and sent to the server.

[1822] 1.3 Server

[1823] The received information is stored in a database and a registration completion message is returned to the user.

[1824] Step 2: Menu suggestions

[1825] 2.1 Server

[1826] The database is queried for information about the Tanaka family and their emotions, which are then sent to the AI ​​engine and emotion engine. The AI ​​engine then generates "easy-to-make gluten-free meals."

[1827] 2.2 Server

[1828] The generated menu information is sent to the terminal.

[1829] 2.3 Terminal

[1830] The received menu information is displayed on the app screen.

[1831] 2.4 Users

[1832] Review and finalize the proposed menu.

[1833] Step 3: Collaborate with local supermarkets and obtain inventory information

[1834] 3.1 Local supermarket

[1835] Local supermarket A sends inventory information to the server.

[1836] 3.2 Server

[1837] The received inventory information is stored in a database and compared with the Tanaka family's menu information. Specifically, it checks for salmon and spinach, which are in abundant stock.

[1838] Step 4: Order ingredients online

[1839] 4.1 Users

[1840] The Tanaka family checks the proposed menu and presses the "Order" button.

[1841] 4.2 Terminal

[1842] Order information is formatted in JSON format and sent to the server.

[1843] 4.3 Server

[1844] Send order information to local supermarket A.

[1845] 4.4 Local supermarket

[1846] Pick up the necessary ingredients and prepare them for delivery.

[1847] 4.5 Server

[1848] An order confirmation email will be sent to the Tanaka family, informing them of the estimated delivery date and time.

[1849] Step 5: Recommended ingredients to reduce food waste

[1850] 5.1 Local supermarket

[1851] Data on excess tomatoes and broccoli is sent to the server.

[1852] 5.2 Server

[1853] The AI ​​engine generates new menus based on the data sent.

[1854] 5.3 Server

[1855] The generated new menu information is sent to the Tanaka family's terminal.

[1856] 5.4 Terminal

[1857] New menu information will be displayed on the app screen.

[1858] 5.5 Users

[1859] The Tanaka family reviews the new menu and ingredients and places orders as needed.

[1860] In this way, this system proposes optimal menus based on the user's emotions and living situation, and by linking it with online ordering of ingredients and inventory management, it simultaneously achieves convenience and reduces food waste.

[1861] Example 2

[1862] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1863] In modern households, planning daily menus and purchasing ingredients are a significant burden. Furthermore, food waste has become a social issue, necessitating efficient food use. Proposing menus that take into account users' allergies and religious restrictions is particularly difficult, and providing menus that match their emotions and physical condition is also important. However, current systems lack the means to effectively achieve this.

[1864] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1865] In this invention, the server includes means for registering user information, means for proposing menus based on the user information, means for checking ingredients needed for the proposed menu against inventory information, means for enabling the necessary ingredients to be ordered over the Internet, means for acquiring information on ingredients that are overstocked or approaching expiration dates to reduce food waste, means for proposing new menus based on the acquired food information, means for registering user emotion information and adjusting menus based on the emotion information, means for processing and saving the acquired emotion information, and means for saving periodically updated inventory information in a database. This enables personalized menu suggestions based on the user's living situation and emotions, thereby reducing food waste and reducing the burden of housework.

[1866] "User information" is a general term for data about an individual, such as a user's family structure, allergy information, religious restrictions, emotional state, and the like.

[1867] "Menu suggestion" refers to the act of creating and suggesting a menu of dishes suitable for a user based on user information.

[1868] "Inventory information" refers to data that indicates the current quantity, expiration date, and stock status of ingredients and products at a retail store.

[1869] "Means for enabling online ordering" refers to the technological means by which a user can select ingredients and complete an order online.

[1870] "Means for reducing food waste" refers to technological measures to collect information on ingredients that are overstocked or nearing their expiration date, and to make suggestions on how to make effective use of the information.

[1871] "Emotion information" is data that indicates the user's emotional state or mood, and includes information such as "tired" or "well-being."

[1872] A "database" refers to an information management system that systematically organizes and stores user information, inventory information, emotional information, etc.

[1873] An "emotion engine" refers to software or algorithms that analyze users' emotions and make various suggestions and adjustments based on that information.

[1874] This invention provides a system that proposes menus tailored to the user's household and allows them to order the ingredients online in collaboration with local retailers. This system aims to reduce food waste and ease the burden of housework. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to propose menus that are more tailored to the user's needs.

[1875] System Overview

[1876] Registering user information

[1877] The user launches the app and enters information such as family composition, allergy information, religious restrictions, and emotional state. Once the entered information is confirmed, registration is completed by pressing the "Register" button. A smartphone or tablet is recommended as the hardware. A dedicated application that provides the user interface (UI) is used as the software.

[1878] The device converts the entered user information into JSON format and generates an HTTP request to send to the server, ensuring that the user information is accurately transmitted to the server.

[1879] The server analyzes the received user information and stores it in a database. The database uses a standard SQL database, and stores user information organized by field. For example, data such as family composition (father, mother, two children), allergy information (wheat), and emotional state (tired) might be stored.

[1880] Menu suggestions

[1881] The server queries the user information from the database and sends it to the AI ​​engine. The AI ​​engine generates an appropriate menu based on the user information and the emotion information from the emotion engine. A general generative AI model is recommended as the AI ​​engine to use.

[1882] The server sends the generated menu information to the user's terminal as a response.

[1883] The device displays the received menu information on the user interface. For example, the main dish might be "butter-grilled salmon," the side dish "spinach namul," and the dessert "fruit almond tofu."

[1884] The user reviews the proposed menu, makes changes or corrections as necessary, and finally finalizes the menu.

[1885] Collaboration with local supermarkets and acquisition of inventory information

[1886] Local supermarkets regularly update their inventory information and send it to the server, specifically updating the types, quantities, expiration dates, and other information about ingredients in stock.

[1887] The server stores the received inventory information in a database and updates the inventory status by matching it with existing user information and suggested menu items, for example, removing items whose stock has decreased from the database and updating the database with new inventory that has been added.

[1888] Online ordering of ingredients

[1889] The user checks the proposed menu, selects the ingredients they wish to purchase, and presses the "Order" button. For example, the user can select the ingredients they need from the proposed menu using the checkboxes and then press the "Order" button to confirm the order.

[1890] The terminal formats the user's order information in JSON format and generates an HTTP request to send to the server.

[1891] The server processes the received order information and sends a list of ingredients needed to the local supermarket, including the type, quantity, and delivery date and time.

[1892] Based on the received ingredient list, the local supermarket will select the necessary ingredients from their inventory and prepare them for delivery.

[1893] The server will send the user an order confirmation email and notify them of the estimated delivery date and time.

[1894] Recommended ingredients to reduce food waste

[1895] Local supermarkets regularly update information about ingredients that are overstocked or nearing their expiration date and send it to the server.

[1896] Based on the received inventory information, the server uses an AI engine to generate new menu items using the relevant ingredients. For example, it generates a menu item such as "Tomato and Broccoli Salad" using tomatoes and broccoli that are in overstock.

[1897] The server transmits the newly generated menu information to the user's terminal.

[1898] The device displays the new menu information on the user interface. Specifically, the device displays the newly proposed menu on the screen so that the user can confirm it.

[1899] The user checks the newly presented menu and ingredients and places an order if necessary. For example, the user selects an item that interests them from the newly proposed menu and orders ingredients.

[1900] Introducing the Emotion Engine

[1901] Users input their daily emotions and moods into the app, and the app analyzes their facial expressions and tone of voice to automatically recognize their emotions. For example, it uses the smartphone's camera and microphone to analyze the user's facial expressions and voice to determine whether they are "tired" or "energetic."

[1902] The device formats the emotional information in JSON format and sends it to the server.

[1903] The server stores the received emotional information in a database and sends it to the AI ​​engine.

[1904] The server uses this emotional information to generate a menu that best suits the user's mood and physical condition. For example, if the user is tired, it will suggest easy-to-make dishes, and if the user is feeling energetic, it will suggest a menu that encourages them to try new dishes.

[1905] Specific examples

[1906] Prompt Sentence Examples

[1907] Prompt: "Taking into account my family's allergies, suggest some easy gluten-free meal suggestions for a tiring day."

[1908] In the case of the Tanaka family, they enter allergy information for each family member, and register that the father has a wheat allergy. They then enter "I'm tired today" as their emotional information. The server then suggests gluten-free meals that are easy to make even when you're tired. For example, it suggests "butter-grilled salmon" as the main dish, "spinach namul" as the side dish, and "fruit almond tofu" as the dessert.

[1909] This will enable more personalized menu suggestions based on the user's emotions and living situation, further improving user convenience.

[1910] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1911] Step 1:

[1912] The user launches the app and enters information such as family composition, allergy information, religious restrictions, emotional state, etc. After confirming the information entered, the user presses the "Register" button. This obtains the user information as input.

[1913] Step 2:

[1914] The device converts the information entered by the user into JSON format. For example, "Family composition: father, mother, two children," "Allergy information: wheat," and "Emotional state: tired" are generated as JSON data. An HTTP request is generated to send this JSON data to the server.

[1915] Step 3:

[1916] The server analyzes the received user information. It parses the received JSON data, breaks it down into database tables corresponding to each field, and saves them. For example, family structure is saved in the user_family table, wheat allergy in the user_allergy table, and emotional state in the user_emotion table. It returns a message indicating that the save was successful.

[1917] Step 4:

[1918] The server queries the database for user information and sends it to the AI ​​engine. The AI ​​engine uses the user information and emotional information obtained from this query as input and performs data calculations to generate the optimal menu for the user. As a specific example, it generates a "gluten-free menu that is easy to make even when you're tired."

[1919] Step 5:

[1920] The server receives the menu information generated by the AI ​​engine and sends it to the user's device as a response. This response includes the specific menu (e.g., main dish "butter-grilled salmon," side dish "spinach namul," and dessert "almond jelly with fruit").

[1921] Step 6:

[1922] The device displays the received menu information on a user interface, allowing the user to visually confirm each menu item (main dish, side dish, dessert, etc.), for example, by displaying a list of ingredients and instructions for each menu item.

[1923] Step 7:

[1924] The user checks the proposed menu and makes any necessary changes or corrections. Finally, the user confirms the menu. The confirmed menu information is resent from the device to the server in JSON format.

[1925] Step 8:

[1926] The local supermarket periodically updates its inventory information and sends it to the server. Specifically, it updates the type, quantity, expiration date, etc. of ingredients in stock. This inventory information is passed to the server as input.

[1927] Step 9:

[1928] The server stores the received inventory information in a database. It updates the inventory status by comparing it with existing user information and menu information. For example, it processes the data by removing items whose inventory has decreased from the database and adding new inventory.

[1929] Step 10:

[1930] The user checks the proposed menu, selects the ingredients they wish to purchase, and presses the "Order" button, which obtains the selected ingredients as input.

[1931] Step 11:

[1932] The device formats the user's order information in JSON format and generates an HTTP request to send to the server. For example, the order information might be formatted as "2 slices of salmon, 1 bunch of spinach, and all ingredients for almond tofu."

[1933] Step 12:

[1934] The server processes the received order information and sends the required ingredient list to the local supermarket. The order information includes the type of ingredient, quantity, and delivery date and time. This allows the local supermarket to input the ingredient list.

[1935] Step 13:

[1936] Based on the received ingredient list, the local supermarket will pick the necessary ingredients from their inventory and prepare for delivery. Specifically, they will pick up the ingredients from their inventory, pack them, and hand them over to the delivery person.

[1937] Step 14:

[1938] The server will then send the user an order confirmation email with the estimated delivery date and time, allowing the user to confirm the order details and delivery date and time.

[1939] Step 15:

[1940] Local supermarkets periodically update the server with information about ingredients that are overstocked or nearing their expiration date, and this data is also passed to the server as input.

[1941] Step 16:

[1942] Based on the received inventory information, the server uses an AI engine to generate a new menu using the relevant ingredients. For example, it performs data calculations to generate a "tomato and broccoli salad."

[1943] Step 17:

[1944] The server sends the newly generated menu information to the user's terminal, which then outputs the specific menu information.

[1945] Step 18:

[1946] The device displays the new menu information on the user interface. Specifically, the device displays the new menu on the screen so that the user can check it.

[1947] Step 19:

[1948] The user checks the newly presented menu and ingredients and places an order if necessary, which inputs the next purchase information.

[1949] Prompt example - text format

[1950] Prompt: "Taking into account my family's allergies, suggest some easy gluten-free meal suggestions for a tiring day."

[1951] (Application example 2)

[1952] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1953] The purpose of this invention is to improve the efficiency of meal planning and procurement in daily household life and reduce food waste. Another objective is to provide personalized service through menu suggestions based on the user's emotional state, thereby improving user convenience and satisfaction.

[1954] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering user information, means for proposing a menu based on the user information, means for checking ingredients needed for the proposed menu against inventory information of local stores, means for enabling online ordering of the necessary ingredients, means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, means for proposing a new menu based on the acquired food information, means for acquiring user emotional information, and means for adjusting the menu based on the acquired emotional information. This enables personalized menu suggestions based on the user's household situation and emotional state, efficient procurement of ingredients, and reduction of food waste.

[1955] "Means for registering user information" is a function for collecting individual information such as the user's family structure, allergy information, religious restrictions, emotional state, etc., and storing it within the system.

[1956] The "means for suggesting a menu" is a function for generating and suggesting an appropriate cooking menu based on the user's individual information.

[1957] The "means of checking ingredients against local retailer inventory information" is a function for checking whether the ingredients required for the proposed menu are in stock at affiliated local retailers.

[1958] The "means for enabling online ordering of ingredients" is a function that supports the process from when a user orders the ingredients they need online until the order is completed.

[1959] The "means for obtaining information on ingredients that are in excess of stock or are close to their expiration date" is a function that receives information from local retailers about ingredients that are in excess of stock or are close to their expiration date, and makes that information available within the system.

[1960] The "means for proposing new menus" is a function for generating and proposing new cooking menus based on information about ingredients that are in excess stock or near their expiration date.

[1961] The "means for acquiring user's emotional information" is a function for collecting the user's emotional state through the user's facial expression, tone of voice, or manual input, and storing it in the system.

[1962] The "means for adjusting menus based on emotional information" is a function for generating and suggesting a cooking menu that is most suitable for the user's mood and physical condition, taking into consideration the collected emotional information of the user.

[1963] A system for implementing the present invention is configured as follows.

[1964] First, the user enters information about their household (family composition, allergies, religious restrictions, emotional state, etc.) through a smartphone app. Once the user enters this information, it is converted into JSON format and sent to the server as an HTTP request. After receiving this information, the server analyzes it and stores it in a database.

[1965] Next, the server uses an AI engine to generate an appropriate menu based on the saved user information. This menu suggestion takes the user's emotional information into consideration to provide the optimal dish menu. At this time, the emotion engine can analyze the user's facial expressions and tone of voice to automatically recognize emotions. Users can also manually input emotional information.

[1966] Once the menu is decided, the server sends it to the user's device as a response. The user can then review the proposed menu, make any necessary changes or corrections, and finally confirm it. The information on ingredients needed for the confirmed menu is checked against the inventory information of local retailers. Inventory information is periodically updated by the local supermarket and sent to the server.

[1967] When a user wants to order ingredients, they can place an order online using a smartphone app. This order information is sent to a server, and based on the received information, a list of ingredients needed is sent to the local supermarket. The supermarket then picks the necessary ingredients from the received list and prepares them for delivery. In addition, from the perspective of reducing food waste, information about ingredients that are in excess or near their expiration date is also sent to the server, and new menu suggestions are made based on this information. This contributes to reducing food waste.

[1968] As a concrete example, consider the following scenario.

[1969] User: A household

[1970] 1. User information registration: The family enters allergy information for all family members, and registers that the mother is allergic to shellfish. The family also enters emotional information such as "I feel good today."

[1971] 2. Menu Suggestion: The AI ​​engine generates a menu that does not contain shellfish and is perfect for a day when you feel like it. The main dish is "chicken teriyaki," the side dish is "kinpira gobo" (stir-fried burdock root), and the dessert is "matcha ice cream."

[1972] 3. Obtaining inventory information: Local supermarkets send inventory information to verify that the suggested ingredients are in stock.

[1973] 4. Order confirmation: The user places an online order for the ingredients they need through the app. The server sends the order information to the local supermarket, which then picks up the ingredients and prepares them for delivery.

[1974] Example prompt sentence:

[1975] "User information: Mother is allergic to shellfish. Mood today: Good."

[1976] By introducing this system, personalized menu suggestions based on the user's household situation and emotional state will be possible, as well as efficient procurement of ingredients and reduction of food waste.

[1977] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1978] Step 1:

[1979] A user launches the smartphone app and enters information such as family composition, allergy information, religious restrictions, and emotional state. The entered information is converted to JSON format on the device and sent to the server as an HTTP request. The input is user information, and the output is JSON format data.

[1980] Step 2:

[1981] The server parses the received JSON-formatted user information and saves it in the database. Specifically, the server issues an SQL command to the database to save the user information. The input is JSON-formatted user information, and the output is a message indicating that the information has been saved to the database.

[1982] Step 3:

[1983] The user inputs emotional information. Alternatively, the device automatically acquires emotional information by analyzing the user's facial expressions and tone of voice. The emotional information is converted to JSON format on the device and sent to the server. The input is the user's emotional information, and the output is JSON format data.

[1984] Step 4:

[1985] The server analyzes the received emotion information and stores it in a database. Specifically, the server issues an SQL command to the database to save the emotion information. The input is emotion information in JSON format, and the output is a message indicating that the information has been saved to the database.

[1986] Step 5:

[1987] The server retrieves user information and emotional information from the database and sends it to the AI ​​engine. The AI ​​engine generates the optimal menu based on this information. User information and emotional information are input into the AI ​​engine's internal processing, which outputs the optimal menu based on that information. The input is user information and emotional information, and the output is the generated menu information.

[1988] Step 6:

[1989] The server sends the generated menu information to the user's device as a response. The device displays the received menu information on the user interface. The input is the generated menu information, and the output is the menu information displayed on the user's device.

[1990] Step 7:

[1991] The user checks the proposed menu, makes changes or corrections as necessary, and finally confirms it. The confirmed menu information is sent from the terminal to the server. The input is the user's modified or confirmed menu information, and the output is the confirmed menu information sent to the server.

[1992] Step 8:

[1993] The server checks the confirmed menu information against the inventory information of affiliated local stores. The inventory information, which is periodically updated by the local stores, is stored in the server's database. The input is the confirmed menu information and inventory information, and the output is the inventory check result.

[1994] Step 9:

[1995] When a user orders ingredients online using the app, the device sends the order information in JSON format to the server. The input is the user's order information, and the output is JSON format data.

[1996] Step 10:

[1997] The server receives the order information and sends the required ingredient list to the local store. The local store picks up the required ingredients and prepares the delivery. The input is the user's order information, and the output is the ingredient list sent to the local store.

[1998] Step 11:

[1999] To reduce food waste, the server receives information about ingredients that are overstocked or close to their expiration date. Based on this information, a new menu is generated. The input is the information about ingredients that are overstocked or close to their expiration date, and the output is the generated new menu information.

[2000] Step 12:

[2001] The server sends the newly generated menu information to the user's device. The device displays the received menu information on the user interface. The input is the newly generated menu information, and the output is the menu information displayed on the user's device.

[2002] In this way, specific input, data processing, and output are carried out at each processing step, resulting in personalized menu suggestions based on the user's household situation and emotional state, efficient procurement of ingredients, and reduced food waste.

[2003] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2004] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2005] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2006] [Fourth embodiment]

[2007] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2008] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2009] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2010] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2011] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2012] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2013] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2014] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2015] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2016] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2017] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2018] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2019] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2020] This invention is a system that makes users' lives more convenient and reduces food waste. The system includes a means for users to input and register information such as family composition, allergy information, and religious restrictions, and then suggests optimal menus based on this information. The ingredients needed for the suggested menus are checked against inventory information at local stores, allowing online ordering. To reduce food waste, the system also obtains information on ingredients that are overstocked or nearing their expiration date, and uses this information to suggest new menus to users.

[2021] Program processing

[2022] 1. User information registration

[2023] 1.1 Users

[2024] Launch the app and enter your family composition, allergy information, religious restrictions, etc. Confirm the information you entered and press the "Register" button.

[2025] 1.2 Terminal

[2026] The input information from the user is formatted in JSON format and an HTTP request is generated to be sent to the server.

[2027] 1.3 Server

[2028] The received user information is saved in the database. If the save is successful, a registration completion message is returned to the user.

[2029] 2. Menu suggestions

[2030] 2.1 Server

[2031] User information is retrieved from the database and sent to the AI ​​engine, which then generates a menu based on the user information.

[2032] 2.2 Server

[2033] When a menu proposal is generated, a response is returned to the terminal together with menu information to be proposed to the user.

[2034] 2.3 Terminal

[2035] The received menu information is displayed on the user interface.

[2036] 2.4 Users

[2037] Review the proposed menu, make any necessary changes or modifications, and finalize it.

[2038] 3. Collaboration with local supermarkets and obtaining inventory information

[2039] 3.1 Local supermarket

[2040] Regularly update your store's inventory information (e.g., quantity of salmon, spinach, expiration date) and send it to the server.

[2041] 3.2 Server

[2042] The received inventory information is stored in a database and compared with existing user information to update the inventory status.

[2043] 4. Order ingredients online

[2044] 4.1 Users

[2045] Check the suggested menu and press the "Order" button on the app.

[2046] 4.2 Terminal

[2047] The user's order information (e.g. salmon, spinach, fruit, yogurt) is formatted in JSON format and an HTTP request is generated to send to the server.

[2048] 4.3 Server

[2049] Process the received order information and send the list of ingredients needed to the local supermarket.

[2050] 4.4 Local supermarket

[2051] Based on the received ingredient list, the inventory management system picks up the necessary ingredients and prepares them for delivery.

[2052] 4.5 Server

[2053] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[2054] 5. Recommended ingredients to reduce food waste

[2055] 5.1 Local supermarket

[2056] Information on ingredients that are in excess stock or near their expiration date is uploaded to a server.

[2057] 5.2 Server

[2058] Based on the received inventory information, the AI ​​engine generates new menus using the relevant ingredients and suggests them to the user.

[2059] 5.3 Terminal

[2060] The generated new menu information is displayed on the user interface.

[2061] 5.4 Users

[2062] Check the newly proposed menu and ingredients and place orders as necessary.

[2063] Specific examples

[2064] User: Tanaka family

[2065] 1. User information registration

[2066] The Tanaka family has a wheat allergy, so they entered "wheat" as their allergy information. The family consists of four people: two adults and two children.

[2067] 2. Menu suggestions

[2068] The server suggests gluten-free meals that children can enjoy. For example, the main dish is teriyaki salmon, the side dish is boiled spinach, and the dessert is fruit yogurt.

[2069] 3. Obtaining inventory information

[2070] Local supermarket A sends inventory information to the server. They have plenty of salmon and spinach in stock and want to prioritize selling them because they have a long shelf life.

[2071] 4. Order Confirmation

[2072] The Tanaka family checks the proposed menu and orders ingredients through the app, and the server sends the order information to local supermarket A.

[2073] 5. Recommended ingredients

[2074] Local supermarket A has an excess of tomatoes and broccoli in stock, so it sends that data to the server. The server then suggests a new menu using tomatoes and broccoli. The Tanaka family checks the menu and places an order.

[2075] In this way, the entire system aims to improve user convenience and reduce food waste.

[2076] The processing flow will be explained below.

[2077] Step 1: Register user information

[2078] 1.1 Users

[2079] The user launches the app and enters information such as family composition (e.g., two adults, two children), allergy information (e.g., wheat allergy), religious restrictions (e.g., need for halal-certified food), etc., confirms the information entered, and presses the "Register" button.

[2080] 1.2 Terminal

[2081] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[2082] 1.3 Server

[2083] Parse the received user information and save it in the database. If the save is successful, return a registration completion message to the user.

[2084] Step 2: Menu suggestions

[2085] 2.1 Server

[2086] The database is queried (searched) for user information and sent to an AI engine for processing, which then generates an appropriate menu based on the user information.

[2087] 2.2 Server

[2088] The generated menu information is sent to the user's terminal as a response.

[2089] 2.3 Terminal

[2090] The received menu information is displayed on the user interface.

[2091] 2.4 Users

[2092] Check the presented menu, make any necessary changes or corrections, and finally confirm the menu.

[2093] Step 3: Collaborate with local supermarkets and obtain inventory information

[2094] 3.1 Local supermarket

[2095] Regularly update your store's inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server.

[2096] 3.2 Server

[2097] The received inventory information is stored in a database and compared with existing user information and suggested menus to update the inventory status.

[2098] Step 4: Order ingredients online

[2099] 4.1 Users

[2100] Check the suggested menu, select the ingredients you want to purchase, and press the "Order" button.

[2101] 4.2 Terminal

[2102] Format the user's order information in JSON format and send an HTTP request to the server.

[2103] 4.3 Server

[2104] The system processes the received order information and sends a list of ingredients needed to a local supermarket, including the type of food, quantity, delivery date and time, etc.

[2105] 4.4 Local supermarket

[2106] Based on the received ingredient list, the necessary ingredients are picked from inventory and prepared for delivery.

[2107] 4.5 Server

[2108] An order confirmation email is sent to the user, notifying them of the estimated delivery date and time.

[2109] Step 5: Recommended ingredients to reduce food waste

[2110] 5.1 Local supermarket

[2111] Information on ingredients that are in excess of stock or are close to their expiration date is periodically updated and transmitted to the server.

[2112] 5.2 Server

[2113] Based on the received inventory information, the AI ​​engine generates a new menu using the relevant ingredients.

[2114] 5.3 Server

[2115] The newly generated menu information is sent to the user's terminal.

[2116] 5.4 Terminal

[2117] The new menu information is displayed in the user interface.

[2118] 5.5 Users

[2119] Check the newly presented menu and ingredients and place orders as necessary.

[2120] Example 1

[2121] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2122] In modern society, managing household menus and reducing food waste are important issues. In particular, existing systems are unable to adequately address the issues of proposing cooking menus that take into account diverse family structures, allergies, and religious restrictions, linking with local retailers' inventory status, and reducing food waste. There is also a need for more efficient ordering procedures and an intuitive user interface.

[2123] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2124] In this invention, the server includes a first means for registering user information, a second means for proposing a menu based on the user information, a third means for comparing ingredients needed for the proposed menu with inventory information from local stores, a fourth means for enabling online ordering of the necessary ingredients, a fifth means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, a sixth means for proposing a new menu based on the acquired food information using a generative AI model, a seventh means for formatting the user information and inventory information from local stores in JSON format and generating an HTTP request, and an eighth means for displaying the information received on the terminal on a user interface. This allows the user to efficiently receive optimal menu suggestions and reduce food waste by linking with inventory information from local stores.

[2125] "User Information" refers to family information, allergy information, religious restrictions, and other personal data entered by the user.

[2126] The "first means" refers to a means for registering user information, and includes a function for saving information entered by the user in a database.

[2127] The "second means" refers to a means of proposing the optimal menu based on user information, and includes a function for generating menus using an AI engine or algorithm.

[2128] The "third means" refers to a means of checking the ingredients needed for the proposed menu against inventory information from local retailers, and includes a function to grasp inventory status and link it to the menu.

[2129] The "fourth means" refers to a means that allows the necessary ingredients to be ordered online, and includes a function to generate order information and send it to the retailer.

[2130] The "fifth means" refers to a means of obtaining information on ingredients that are in excess stock or near their expiration date in order to reduce food waste, and includes a function to receive inventory information from local retailers.

[2131] The "sixth means" refers to a means of using an AI model to generate and propose new menus based on the acquired food information, and includes functions related to generating menus to reduce food waste.

[2132] The "seventh means" refers to a means for formatting user information and local retailer inventory information in JSON format and generating an HTTP request, and includes functions related to data format conversion and request generation.

[2133] The "eighth means" refers to a means for displaying the information received by the terminal on a user interface, and includes a function for providing information intuitively to the user.

[2134] A "generative AI model" refers to an artificial intelligence algorithm or system that generates optimal menu and ingredient suggestions based on user information and inventory information.

[2135] A "prompt" is an instruction given to a generative AI model to obtain a specific output.

[2136] This invention is a system that aims to efficiently suggest optimal menus to users and reduce food waste by linking with inventory information from local retailers. In this example, the roles of the user, terminal, and server are specifically explained. The invention is implemented with the following configuration.

[2137] User input of information

[2138] Users launch the application on their smartphone or computer and enter the necessary information, such as family composition, allergy information, and religious restrictions. This information is saved in the system and becomes the basic data when menu suggestions are made. For example, if a user has a family of four and the father has a wheat allergy, they would enter information such as "family of four," "allergies: wheat," and "no religious restrictions."

[2139] Data formatting and transmission by the terminal

[2140] The device formats the information entered by the user in JSON format, generates an HTTP request, and sends it to the server. The specific software used is an iOS or Android application and a web browser.

[2141] Data processing and storage by server

[2142] The server receives the user information sent from the device and stores it in a database. The stored user information serves as the basis for generating optimal menus. The server often uses MySQL or PostgreSQL as its database management system (DBMS).

[2143] Menu suggestions

[2144] The server retrieves user information from the database and sends it to the generative AI model as a prompt. This AI engine (e.g., GPT-3 or BERT) analyzes the user information and generates the optimal menu that meets the user's criteria. An example of a prompt might be, "Please suggest a menu for a family of four where the father has a wheat allergy."

[2145] Display menu information

[2146] The server sends the generated menu information to the device as a response. The device displays this information on a user interface, providing the user with suggested menus and related ingredient information. Frameworks such as React Native and Flutter may be used for display.

[2147] Get inventory and place orders

[2148] Local stores periodically update their inventory information (e.g., quantity and expiration date of salmon and spinach) and send it to the server. The server receives this information and stores it in a database. The user can then order the ingredients needed for the proposed meal online, and the server sends the order information to the local store. This also takes into account ingredients that are overstocked or nearing their expiration date.

[2149] New menu proposals to reduce food waste

[2150] The server uses a generative AI model to propose new menus based on information about ingredients that are overstocked or nearing their expiration date. The device displays this information on a user interface, and the user can check the newly proposed menu and ingredient information and place an order if necessary.

[2151] Specific examples

[2152] For example, if the Tanaka family consists of four people and the father has a wheat allergy, the user inputs the wheat allergy information and family composition. The server uses an AI engine to generate a "gluten-free menu that children can enjoy," suggesting "salmon teriyaki" as the main dish, "spinach ohitashi" as a side dish, and "fruit yogurt" as a dessert. The order is then processed based on inventory information from local retailers. If the local retailer sends information that they have excess stock of tomatoes and broccoli, the server will suggest a new menu using those ingredients.

[2153] In this way, the entire system aims to improve user convenience and reduce food waste.

[2154] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2155] Step 1:

[2156] User input of information

[2157] Users launch the application on their smartphone or computer, enter the necessary information such as family composition, allergies, and religious restrictions, and press the "Register" button.

[2158] Input: Family composition, allergy information, religious restrictions

[2159] Output: User information entered

[2160] Specific operation: The user enters each item in the application's input form using text or options. For example, "Family of four" and "Allergy: wheat."

[2161] Step 2:

[2162] Data formatting and transmission by the terminal

[2163] The terminal formats the information entered by the user in JSON format, generates an HTTP request, and sends it to the server.

[2164] Input: User information entered

[2165] Output: JSON formatted data, HTTP request

[2166] Specific operation: The device internally converts the entered text and options into JSON format and sends it as an HTTP POST request to the specified endpoint.

[2167] Step 3:

[2168] Data processing and storage by server

[2169] The server receives the user information sent from the device and stores it in a database. The stored user information becomes the basis for generating the optimal menu.

[2170] Input: User information in JSON format

[2171] Output: User information saved in the database, registration completion message

[2172] Specific operation: The server receives the request, parses it, extracts the user information, executes an INSERT query to the database to save the information, and returns a registration completion message to the device.

[2173] Step 4:

[2174] Server acquires user information and generates menu

[2175] The server retrieves user information from the database and sends it as a prompt to the generative AI model, which then generates the optimal menu based on the user information.

[2176] Input: User information stored in the database

[2177] Output: Generated menu suggestions

[2178] Specific operation: The server obtains user information using an SQL query, generates a prompt saying, "Please suggest a menu for a family of four with a father who has a wheat allergy," and sends it to the AI ​​engine. The AI ​​engine generates a menu and returns it to the server.

[2179] Step 5:

[2180] Server response for menu suggestions

[2181] The server compiles the generated menu information and sends it to the user's terminal as a response.

[2182] Input: Generated menu suggestions

[2183] Output: Response data sent to the device

[2184] Specific operation: The server formats the menu information received from the AI ​​engine and sends it to the terminal as an HTTP response.

[2185] Step 6:

[2186] Menu display on a terminal

[2187] The terminal displays the received menu suggestion information on a user interface.

[2188] Input: Received menu suggestion information

[2189] Output: Menu information displayed in a user interface

[2190] What it does: The device receives the response, parses the JSON, and displays it on the screen by category, such as main dish, side dish, and dessert. For example, "Main dish: Teriyaki salmon."

[2191] Step 7:

[2192] User confirmation and correction

[2193] The user reviews the proposed menu, makes any necessary changes or corrections, and confirms it.

[2194] Input: Menu information displayed in the user interface

[2195] Output: Confirmed menu information

[2196] Specific behavior: The user checks the displayed suggestions, makes individual corrections if necessary, and finally presses the "Confirm" button to confirm the changes.

[2197] Step 8:

[2198] Local retailer inventory updates

[2199] Local stores periodically update their inventory information and send it to the server.

[2200] Input: Inventory information (e.g., quantity of salmon, spinach, expiration date)

[2201] Output: Stock information sent to the server

[2202] What it does: Local retailers use an inventory management system to update their inventory information and periodically send that information to the server.

[2203] Step 9:

[2204] Stock information storage and verification by server

[2205] The server stores the received inventory information in a database and updates the inventory status by comparing it with existing user information.

[2206] Input: Stock information sent to the server

[2207] Output: Updated inventory status

[2208] Specific operation: The server saves the inventory information in a database, compares it with the user information, and updates the stock status of the necessary ingredients.

[2209] Step 10:

[2210] User execution of orders

[2211] The user checks the proposed menu, selects the necessary ingredients, and presses the "Order" button.

[2212] Input: Suggested menu information, user selection

[2213] Output: Order information

[2214] Specific operation: The user selects ingredients based on the menu information, presses the "Order" button, and confirms the order.

[2215] Step 11:

[2216] Terminal-based order request generation

[2217] The terminal formats the order information in JSON format and generates an HTTP request to send to the server.

[2218] Input: User's order information

[2219] Output: JSON order data, HTTP request

[2220] Specific operation: The terminal receives the order information, converts it into JSON format, and then generates an HTTP POST request to send to the server.

[2221] Step 12:

[2222] Server processes order and sends it to local dealer

[2223] The server processes the received order information and sends the required ingredient list to a local retailer.

[2224] Input: Order information in JSON format

[2225] Output: Ingredient list sent to local retailer

[2226] What happens: The server parses the order information, generates a list of ingredients needed, and sends it to the local store.

[2227] Step 13:

[2228] Fulfilling orders from local retailers

[2229] Based on the received ingredient list, local retailers use their inventory management system to pick up ingredients and prepare them for delivery.

[2230] Input: Ingredient list sent from the server

[2231] Output: Picked ingredients, ready for delivery

[2232] What happens: Local store staff check the inventory system, pick up the necessary ingredients, and prepare them for delivery.

[2233] Step 14:

[2234] Order confirmation notification by the server

[2235] The server will send the user an order confirmation email and notify them of the estimated delivery date and time.

[2236] Input: Order information, expected delivery date and time

[2237] Output: Order confirmation email to user

[2238] Specific operation: The server sends a confirmation email to the user based on the order information and estimated delivery date and time.

[2239] Step 15:

[2240] Sending food waste information from local retailers

[2241] Local retailers periodically upload information about ingredients that are in excess stock or near their expiration date to the server.

[2242] Input: Information about ingredients that are overstocked or nearing their expiration date

[2243] Output: Food waste information uploaded to the server

[2244] Specific operation: The local retailer's inventory management system sends information about overstocked or expired products to the server.

[2245] Step 16:

[2246] Server-based new menu generation and proposal

[2247] The server uses an AI model to generate new menus based on the received food waste information and suggests them to the user.

[2248] Input: Food waste information, user information

[2249] Output: New menu suggestion

[2250] Specific operation: The server inputs the information into a generative AI model, generates a menu that takes food waste into consideration, and suggests it to the user.

[2251] Step 17:

[2252] New menu display on terminal

[2253] The terminal displays the generated new menu information on the user interface.

[2254] Input: New menu suggestion

[2255] Output: New menu information displayed in the user interface

[2256] Specific operation: The device receives new menu information and displays it on the screen.

[2257] Step 18:

[2258] User confirmation and new order

[2259] The user can review the newly proposed menu and ingredients and place an order if necessary.

[2260] Input: New menu information

[2261] Output: New order information

[2262] Specific behavior: The user checks the new menu and, if there is anything they like, places an order again.

[2263] (Application example 1)

[2264] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2265] Food waste is becoming a serious problem in modern society. While food not consumed at home is discarded, there is a need to respond quickly to diverse consumer needs. However, previous systems have found it difficult to fully utilize user and inventory information to efficiently propose menus and reduce food waste. In addition, there is a lack of support for users to easily obtain the ingredients they need and reduce food waste.

[2266] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2267] In this invention, the server includes means for registering user information, means for proposing a menu based on the user information, means for checking ingredients needed for the proposed menu against store inventory information, means for enabling online ordering of the necessary ingredients, means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste, means for proposing a new menu based on the acquired food information, means for notifying the user of order details based on the proposed menu and local store inventory information, and means for saving the user's order information in a database and forwarding it to the store. This allows the user to receive optimal menu suggestions, efficiently obtain food, and reduce food waste.

[2268] "User information" refers to information necessary for menu suggestions, such as the user's family composition, allergy information, and religious restrictions.

[2269] "Menu suggestion" refers to proposing a meal menu that is generated based on user information.

[2270] "Retailer inventory information" refers to information such as the type, quantity, and expiration date of ingredients held by local retailers or affiliated retailers.

[2271] "Online ordering" refers to the act of a user ordering the necessary ingredients online based on a suggested menu.

[2272] "Food waste" refers to food that is discarded without being consumed at home or in stores.

[2273] "Overstock" refers to a situation where there is excess inventory at retailers that is unlikely to be consumed.

[2274] "Best before" refers to the last day that food remains of good quality and can be safely consumed.

[2275] "Database" refers to an information management system that aggregates and efficiently manages user information, order information, inventory information, etc.

[2276] "Server" refers to a system that processes user information and retailer inventory information and provides services such as menu suggestions and online ordering.

[2277] The present invention is a system for making users' lives more convenient and reducing food waste. This system runs mainly on the user's smartphone and is configured as follows.

[2278] 1. Hardware and Software

[2279] Hardware: Smartphone

[2280] software:

[2281] Application: uses Python and the Flask framework

[2282] Database: MySQL

[2283] AI engine: TensorFlow

[2284] 2. User Information Registration

[2285] The user launches the app and registers by entering information such as family composition, allergies, and religious restrictions. The entered information is converted into JSON format by the device and sent to the server. The server stores this information in a database and notifies the user that registration is complete.

[2286] 3. Menu suggestions

[2287] The server extracts user information from the database and sends it to the TensorFlow model, an AI engine, which generates an optimal menu based on the user information. This menu takes into consideration the user's allergies and religious restrictions. The generated menu is sent from the server to the device and displayed on the user interface.

[2288] 4. Retailer inventory information and online ordering

[2289] The server periodically receives inventory information from local stores and stores this information in a database. When the user confirms the proposed menu and confirms the order, the device formats the order information for the necessary ingredients in JSON format and sends it to the server. The server then forwards this information to the local store and the order is confirmed. The user receives the estimated delivery date and time from the server.

[2290] 5. Reducing food waste

[2291] When local stores send information about ingredients that are overstocked or nearing their expiration date, the server uses this information to generate new menu ideas and suggests them to the user. The user can then check the new menu ideas and order the ingredients if necessary, thereby reducing food waste.

[2292] Specific examples

[2293] For example, in the Tanaka family, the father has a wheat allergy, so "wheat" is registered as allergy information along with the family composition. The server proposes a "gluten-free" menu, checks the inventory information of local stores, and generates a menu including teriyaki salmon, boiled spinach, and fruit yogurt. The Tanaka family orders ingredients based on this menu, and the order is forwarded to the local store. A new menu using tomatoes, which are in excess stock, is also proposed, and the Tanaka family confirms this menu and places an order.

[2294] Prompt Sentence Examples

[2295] "We have a family of four with wheat allergies. Can you suggest a menu?"

[2296] "Please tell me a recipe that uses tomatoes that are close to their expiration date."

[2297] "Please suggest the best menu for tonight's dinner."

[2298] In this way, the entire system aims to improve user convenience and reduce food waste.

[2299] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2300] Step 1:

[2301] Registering user information

[2302] Subject: User

[2303] Users launch the app and enter their family information, allergy information, and religious restrictions, which then collects information about the user's individual dietary restrictions.

[2304] Input: User's family structure, allergy information, religious restrictions, etc.

[2305] Output: User information formatted in JSON format

[2306] Specific operation: When the user enters information, the device formats it into JSON format, generates an HTTP request, and sends it to the server.

[2307] Step 2:

[2308] Saving user information

[2309] Subject: Server

[2310] The server saves the received user information in the database, and if the saving is successful, returns a registration completion message to the user.

[2311] Input: User information in JSON format

[2312] Output: Registration complete message

[2313] Specific operation: The server parses the received user information, generates an SQL query to store it in the database, and then returns a message to the user confirming registration.

[2314] Step 3:

[2315] Menu generation

[2316] Subject: Server

[2317] The server retrieves user information from the database and sends it to the AI ​​engine, which then generates the optimal menu based on the user information.

[2318] Input: User information retrieved from the database

[2319] Output: Generated menu information

[2320] Specific operation: The server inputs user information into the AI ​​engine to obtain predicted menu information, which is then sent to the device for display on the user interface.

[2321] Step 4:

[2322] Menu display

[2323] Subject: Terminal

[2324] The terminal displays the menu information received from the server on the user interface, and the user can check the proposed menu and make corrections or changes.

[2325] Input: Menu information sent from the server

[2326] Output: Menu information displayed in the user interface

[2327] Specific operation: The device parses the received menu information and displays it in a visually easy-to-understand format.

[2328] Step 5:

[2329] Updating retailer inventory

[2330] Subject: Dealer

[2331] The retailer periodically sends inventory information (type of ingredients, quantity, expiration date, etc.) to the server.

[2332] Input: Dealer inventory information

[2333] Output: Updated inventory information on the server

[2334] Specific operation: Inventory information is automatically collected from the retailer's system and sent to the server in JSON format.

[2335] Step 6:

[2336] Confirmation and notification of order details

[2337] Subject: User

[2338] The user checks the proposed menu and confirms the order. The device then formats the order information for the necessary ingredients in JSON format and sends it to the server.

[2339] Input: Order information based on suggested menu

[2340] Output: Order information in JSON format

[2341] Specific operation: When the user confirms the order, the terminal formats the information into JSON format and sends it to the server.

[2342] Step 7:

[2343] Transfer and confirmation of order information

[2344] Subject: Server

[2345] The server processes the received order information, sends the required ingredients list to the local store, and also sends the user an order confirmation email with an estimated delivery date and time.

[2346] Input: Order information in JSON format

[2347] Output: Ingredient list for the retailer and order confirmation email for the user

[2348] Specific operation: The server parses the order information and generates a list of ingredients required by the store's inventory management system. This list is sent to the store, and an order confirmation email is sent to the user.

[2349] Step 8:

[2350] Obtaining information on ingredients that are overstocked or nearing their expiration date

[2351] Subject: Dealer

[2352] The store transmits information about ingredients that are in excess stock or are close to their expiration date to the server.

[2353] Input: Information on ingredients that are overstocked or close to their expiration date

[2354] Output: New inventory information sent to the server

[2355] Specific operation: Information on ingredients that are overstocked or near their expiration date is automatically collected from the retailer's system and sent to the server.

[2356] Step 9:

[2357] New menu suggestions

[2358] Subject: Server

[2359] Based on the received inventory information, the server uses an AI engine to generate new menus and propose them to the user.

[2360] Input: Information on ingredients that are overstocked or close to their expiration date

[2361] Output: New menu information generated

[2362] Specific operation: The server inputs new inventory information into the AI ​​engine and generates new menus to minimize food waste. The generated menu information is sent to the user.

[2363] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2364] This invention provides a system that proposes menus tailored to the user's household and allows them to order the ingredients online in collaboration with local retailers. This system aims to reduce food waste and ease the burden of housework. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it becomes possible to propose menus that are more tailored to the user's needs.

[2365] Program processing

[2366] 1. User information registration

[2367] 1.1 Users

[2368] Launch the app and enter information such as family composition, allergy information, religious restrictions, emotional state, etc. Confirm the information you entered and press the "Register" button.

[2369] 1.2 Terminal

[2370] Convert the user input information into JSON format and generate an HTTP request to send to the server.

[2371] 1.3 Server

[2372] Parse the received user information and save it in the database. If the save is successful, return a registration completion message to the user.

[2373] 2. Menu suggestions

[2374] 2.1 Server

[2375] The database is queried (searched) for user information and sent to the AI ​​engine for processing. The AI ​​engine generates an appropriate menu based on the user information and emotional information from the emotion engine.

[2376] 2.2 Server

[2377] The generated menu information is sent to the user's terminal as a response.

[2378] 2.3 Terminal

[2379] The received menu information is displayed on the user interface.

[2380] 2.4 Users

[2381] Review the proposed menu, ...

Claims

1. a first means for registering user information; A second means for suggesting a menu based on user information; a third means for checking ingredients required for the proposed menu against inventory information of local retailers; The fourth method is to allow customers to order the ingredients they need online. A fifth means for acquiring information on ingredients that are overstocked or close to their expiration date in order to reduce food waste; A system including a sixth means for suggesting new menus based on the acquired food information.

2. The system according to claim 1, wherein the system suggests menus based on the user's allergy information and religious restrictions.

3. 10. The system of claim 1, wherein local retailer inventory information is updated periodically.

Images