system

Abstract

Provide a system. [Solution] means for receiving and storing health examination information; means for receiving and storing user food preference information; a means for generating a menu based on the health checkup information and the food preference information; means for generating a list of ingredients required based on the generated menu; means for transmitting the list of ingredients to a food delivery system; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's busy lifestyles, it is difficult to consistently prepare healthy meals. Furthermore, planning, shopping, and cooking meals that meet individual health conditions and food preferences is time-consuming and inefficient. Choosing the right menu can be particularly difficult and time-consuming when certain nutrients are lacking or dietary restrictions are in place. Furthermore, in today's society, where food waste is common, systematic food management is required. [Means for solving the problem]

[0005] This invention provides a system that includes a means for receiving and storing health checkup information, a means for receiving and storing a user's food preference information, a means for generating a menu based on the health checkup information and the food preference information, a means for generating a list of ingredients based on the generated menu, and a means for transmitting the list of ingredients to a food delivery system. The system also includes a means for presenting the menu generated based on the health checkup information and the food preference information to the user, a means for accepting user confirmation and changes to the menu, and a means for generating a menu based on the health checkup information, the food preference information, and the user's past food ingredient data. This system enables users to easily receive appropriate menus based on the health checkup information and the food preference information, and efficiently lead a healthy diet.

[0006] "Health checkup information" is data that indicates the user's health condition, and includes a series of medical information such as blood test results, blood pressure, and cholesterol levels.

[0007] "Food preference information" is data that indicates a user's personal food preferences, such as preferred ingredients and cooking methods, as well as disliked ingredients and cooking methods.

[0008] A "menu" is a meal suggestion generated based on the user's health checkup information and food preference information, and is a list including specific dish names and necessary ingredients.

[0009] The "list of ingredients" refers to a list of ingredients required for each dish based on the generated menu.

[0010] A "food delivery system" is a system that provides a series of services, such as online supermarkets and food delivery services, to prepare and deliver ingredients ordered by users.

[0011] "User" refers to an individual who uses this system, and is a consumer who provides health checkup information and food preference information and selects and changes menu items.

[0012] "Storage means" means the technical process of storing the data received from the user in a database or other storage device.

[0013] "Means for receiving" means the technical means for obtaining input data from a user and converting it into a format that can be used within the system.

[0014] "Means of generation" refers to the algorithms and processes used to create new menus and ingredient lists based on data in the system, such as health checkup information and food preference information.

[0015] "Presentation means" refers to the technology that provides a user interface for displaying the generated menu or list to the user. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9]1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] Overall system configuration

[0038] This system is composed of a series of processes that generate the optimal menu for the user based on the user's health check information, food preference information, and past food ingredient data, create a list of necessary ingredients, and link with the food delivery system.The system consists of three main parts: the server, the terminal, and the user.

[0039] Server Roles and Operations

[0040] The server provides the following main functions:

[0041] 1. Receiving and storing health examination information:

[0042] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure.

[0043] 2. Receiving and storing your food preferences:

[0044] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[0045] 3. Generate the menu:

[0046] The server runs a menu generation algorithm based on the stored health checkup information and food preference information to generate an appropriate meal menu, for example, "stir-fried spinach and beef" for a user who is iron deficient.

[0047] 4. Generate the ingredients list:

[0048] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[0049] 5. Sending the Ingredient List:

[0050] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[0051] Device role and operation

[0052] The terminal transmits information input by the user to the server and provides an interface that presents data transmitted from the server to the user.

[0053] 1. Enter and submit basic information:

[0054] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends that data to the server.

[0055] 2. Enter and submit your medical examination information:

[0056] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[0057] 3. Enter and submit your food preferences:

[0058] The user inputs food preference information into the terminal and sends it to the server.

[0059] 4. Check and change the menu:

[0060] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[0061] User Roles and Actions

[0062] Users can input their health checkup information and food preferences, check and change the suggested menu, and finally prepare a meal using the delivered ingredients.

[0063] 1. Basic information provided:

[0064] Users provide basic information when using the system.

[0065] 2. Providing health checkup information:

[0066] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[0067] 3. Providing Food Preference Information:

[0068] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[0069] 4. Check and change the menu:

[0070] Review the proposed menu, decide if it suits you, and make any necessary changes.

[0071] 5. Receiving and Preparing Ingredients:

[0072] Receive ingredients delivered from the food delivery system and prepare meals based on the suggested menu.

[0073] Specific examples

[0074] For example, suppose a user is a 40-year-old man who was recently diagnosed with low iron in his blood during a medical checkup, and who also inputs that he likes chicken and dislikes broccoli.

[0075] 1. The user enters basic information, health check information, and food preference information into the terminal and sends it to the server.

[0076] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Spinach and Chicken Stir-fry."

[0077] 3. The server sends the generated menu to the user's device, where the user confirms it.

[0078] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[0079] 5. The food delivery system will deliver the ingredients on the specified date.

[0080] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[0081] In this way, users can easily obtain menus that suit their health condition and maintain a balanced diet.

[0082] The processing flow will be explained below.

[0083] Step 1:

[0084] The user opens the smartphone app and accesses the basic information entry screen, where they enter basic information such as age, gender, weight, and height.

[0085] Step 2:

[0086] The terminal receives the input basic information and sends it to the server.

[0087] Step 3:

[0088] The server saves the received basic information in the database. It creates a new entry in the user database and registers the basic information along with the user ID.

[0089] Step 4:

[0090] The user enters the results of their health check into the app, or the information is automatically retrieved from the linked medical institution's system.

[0091] Step 5:

[0092] The terminal receives the user's health checkup information and transmits it to the server.

[0093] Step 6:

[0094] The server analyzes the health checkup information and stores it in the health ranking database, linking it to the user ID. For example, it determines that the user has an iron deficiency based on the blood test results.

[0095] Step 7:

[0096] Users select their favorite and least favorite ingredients and food preferences in the app. For example, they could enter "Favorite ingredient: chicken" and "Dislike ingredient: broccoli."

[0097] Step 8:

[0098] The terminal receives the food preference information and transmits it to the server.

[0099] Step 9:

[0100] The server stores the preference information in a preference database, along with the user ID.

[0101] Step 10:

[0102] The server runs a menu generation algorithm based on the stored health checkup information, food preference information, and past delivery data to generate an appropriate meal menu. For example, it might suggest a menu including "stir-fried spinach and beef" for a user with iron deficiency.

[0103] Step 11:

[0104] The server sends the generated menu to the terminal for presentation to the user.

[0105] Step 12:

[0106] Users can review the suggested menu items in the app and make changes if necessary, for example, changing a menu item that contains an ingredient they dislike to another menu item.

[0107] Step 13:

[0108] The terminal receives the changed menu information and transmits it to the server.

[0109] Step 14:

[0110] The server finalizes the menu and generates the necessary ingredient list, which is then stored in the ingredient list database.

[0111] Step 15:

[0112] The server sends the generated ingredient list to the online supermarket or food delivery system, specifically, by sending the order information via API or email.

[0113] Step 16:

[0114] The food delivery system prepares the ingredients and delivers them to the address specified by the user.

[0115] Step 17:

[0116] The user receives the delivered ingredients and cooks based on the suggested menu. Cooking instructions and recipes can be viewed within the app.

[0117] Example 1

[0118] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0119] In today's world, it is difficult to easily obtain meal menus that cater to individual health conditions and food preferences. Furthermore, selecting and procuring ingredients based on individual needs is time-consuming, making effective nutritional management difficult. Furthermore, generating menus using a user's past ingredient data requires advanced data analysis and AI technology. There is a need for a system that can solve these issues and help users maintain their health and improve their dietary habits.

[0120] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0121] In this invention, the server includes means for receiving and storing health condition information, means for receiving and storing user dietary preference information, means for generating a menu using a generative AI model based on the health condition information and the dietary preference information, means for generating a list of necessary ingredients based on the generated menu, and means for transmitting the list of ingredients to a food delivery system. This enables automatic generation of an appropriate menu according to individual health conditions and dietary preferences, and efficient procurement of necessary ingredients.

[0122] "Health status information" is information related to the user's health, and includes, for example, blood test results, blood pressure, weight, body fat percentage, and the like.

[0123] "Dietary preference information" is information about the user's food preferences and disliked ingredients, such as data about favorite foods and disliked foods.

[0124] A "generative AI model" refers to an algorithm that uses artificial intelligence algorithms to analyze data and perform specific tasks to generate the optimal menu for the user.

[0125] The "list of ingredients" is a list of ingredients required based on the menu, and is data that includes the type and amount of each ingredient.

[0126] A "food delivery system" is a system that provides a network and services for delivering food ingredients specified by a user.

[0127] A "menu" is a meal suggestion for a user, including specific dish names, cooking methods, and nutritional information.

[0128] A "server" is a computer system that receives and stores data sent by users and processes it.

[0129] The "database" is a management system for storing received health status information, food preference information, past food ingredient data, and the like.

[0130] A "prompt" is a specific instruction or question that is entered when creating a menu using a generative AI model.

[0131] MODE FOR CARRYING OUT THE INVENTION

[0132] This invention is a system that generates optimal menus for users based on their health status information, food preference information, and past ingredient data, creates a list of necessary ingredients, and provides a series of processes that link with a food delivery system. The system consists of three main parts: a server, a terminal, and a user.

[0133] Server Roles and Operations

[0134] The server provides the following main functions: First, it receives and stores health status information by storing the data sent by the user in a database such as MySQL (registered trademark) or PostgreSQL. Second, it receives and stores the user's dietary preference information and manages this information using DynamoDB or MongoDB.

[0135] The server runs a menu generation algorithm using a generative AI model (e.g., GPT-4 (registered trademark)) based on the stored health condition information and food preference information to generate an appropriate meal menu. An example of this prompt sentence is, "40-year-old male user. Health checkup results show low iron in the blood. Prefers chicken and dislikes broccoli. Please generate an appropriate menu."

[0136] Based on the generated menu, the server creates a list of necessary ingredients and stores this list in an in-memory data store such as Redis. Furthermore, to send this list of ingredients to the food delivery system, the server uses the API of the online supermarket or food delivery service, utilizing a RESTful API using the HTTP protocol.

[0137] Device role and operation

[0138] The terminal sends the information entered by the user to the server and provides an interface that displays the data sent from the server to the user. The terminal can be an iOS or ANDROID (registered trademark) based smartphone or PC.

[0139] Users input their health condition information, dietary preferences, and basic information (age, gender, weight, height, etc.) into the device. React or Flutter (registered trademark) is used as the input form, and this data is sent to the server using the HTTPS protocol. Furthermore, the device can also link with medical institutions' systems and automatically obtain health checkup information using the FHIR (Fast Healthcare Interoperability Resources) standard.

[0140] User Roles and Actions

[0141] Users input their health status and dietary preferences, confirm and modify the proposed menu, and finally prepare a meal using the delivered ingredients. The data entered by the user through the device is processed appropriately by the server, and the generated menu and list of ingredients are sent to the user's device. The user can review this and modify the menu as needed.

[0142] By receiving ingredients delivered by the food delivery system and cooking according to the recipes displayed on the device, customers can easily maintain a balanced diet.

[0143] This invention automatically generates a menu that matches the user's individual health condition and food preferences, enabling efficient food procurement.

[0144] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0145] Step 1:

[0146] The user enters basic information (age, gender, weight, height, etc.) into the device and sends that data to the server. The server creates an individual user profile based on this basic information and stores it in a database. The entered information is securely transmitted from the device via the HTTPS protocol, and the server stores the information in a database management system (DBMS).

[0147] Input: User's basic information (age, gender, weight, height, etc.)

[0148] Output: New user profile saved in database

[0149] Specific operation: The user enters basic information into the input form and presses the "Submit" button. The terminal sends the information to the server, which receives it and stores it in the database.

[0150] Step 2:

[0151] The user enters their health status information into the device and sends it to the server. The entered information can be uploaded as a PDF result from a medical institution or automatically obtained through the medical institution's API. The server receives this information and stores it in a database.

[0152] Input: User's health information (blood test results, blood pressure, etc.)

[0153] Output: Save health information to database

[0154] Specific operation: The user uploads the health checkup results to the terminal and sends them to the server, which then stores the received data in a database.

[0155] Step 3:

[0156] The user inputs food preference information (favorite ingredients, disliked ingredients, etc.) into the terminal and sends it to the server, which receives this information and stores it in a database.

[0157] Input: User's food preference information (favorite ingredients, disliked ingredients)

[0158] Output: Save preference information to database

[0159] Specific operation: The user answers questions in a questionnaire about their food preferences and sends the data from their device to the server, which then stores the received information in a database.

[0160] Step 4:

[0161] The server retrieves health status information and dietary preference information from the database and runs a menu generation algorithm using a generative AI model (e.g., GPT-4). This is the process of inputting specific prompts into the generative AI model to generate a menu.

[0162] Input: Health status information, dietary preference information

[0163] Output: The generated menu

[0164] Specific operation: The server retrieves the necessary information from the database, inputs the prompt statement "40-year-old male user. Health check results show low blood iron. Prefers chicken and dislikes broccoli. Please generate an appropriate menu" into the generative AI model, and retrieves the generated menu.

[0165] Step 5:

[0166] The server creates a list of ingredients needed based on the generated menu, identifies the ingredients and quantities needed for each dish on the generated menu, and stores this information in a database.

[0167] Input: Generated menu

[0168] Output: List of ingredients needed

[0169] Specific operation: The server analyzes the generated menu, lists the necessary ingredients and their quantities, and stores them in a database.

[0170] Step 6:

[0171] The server sends the generated list of ingredients to the food delivery system, and sends the order data using the API of the online supermarket or food delivery service.

[0172] Input: List of ingredients

[0173] Output: Order data sent to the food delivery system

[0174] Specific operation: The server sends the list of ingredients to the food delivery system's API and confirms the order of the necessary ingredients. The order status and delivery schedule can also be checked at the same time.

[0175] Step 7:

[0176] The user receives the delivered ingredients, cooks them based on the recipe displayed on the device, and finally, cooks based on the suggested menu and enjoys a balanced meal.

[0177] Input: Delivered ingredients

[0178] Output: Cooked food

[0179] Specific operation: The device checks the received ingredients and cooks them according to the recipe displayed on the device. The device delivers the finished dish, allowing the user to maintain a balanced diet.

[0180] (Application example 1)

[0181] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0182] Conventional meal menu suggestion systems can generate menus based on a user's health checkup information and food preferences, but they require users to manually order ingredients from the generated list, which is time-consuming. Furthermore, since the generated menus do not automatically order or arrange for delivery of ingredients, users have to go to the trouble of purchasing ingredients. There is a need to solve these problems and improve user convenience.

[0183] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0184] In this invention, the server includes means for receiving and saving health checkup information, means for receiving and saving user food preference information, means for generating a menu based on the health checkup information and the food preference information, means for generating a list of necessary ingredients based on the generated menu, means for transmitting the list of ingredients to the food delivery system, means for transmitting the health checkup information and food preference information input from the user's terminal to the server, means for displaying the data transmitted from the server to the user, and means for automatically ordering the list of ingredients corresponding to the proposed menu based on the application. This allows the user to easily receive a menu tailored to their health condition and food preferences, and enables the automatic ordering and delivery of necessary ingredients.

[0185] "Health checkup information" is data that indicates the user's health condition, and includes blood test results, blood pressure values, and the like.

[0186] "Food preference information" is personal information that indicates the user's favorite and least favorite ingredients, taste preferences, etc.

[0187] The "menu" refers to meal suggestions generated based on the health checkup information and the food preference information.

[0188] The "ingredients list" is a list of ingredients required based on the menu.

[0189] The "food delivery system" is a system for delivering ingredients to users based on the ingredient list.

[0190] A "server" is a computer system that stores information received from users and generates menus and ingredient lists.

[0191] A "terminal" is an electronic device that transmits information entered by a user to a server and displays data transmitted from the server to the user.

[0192] The "automatic ordering means" is a means for automatically ordering ingredients from an affiliated food delivery system based on the generated ingredient list.

[0193] "Delivery arrangement" refers to making arrangements for the delivery of ingredients at a date and time specified by the user based on the generated ingredient list.

[0194] The "menu generation means" refers to an algorithm or program for generating a meal menu suited to a user based on health checkup information and food preference information.

[0195] Overall system configuration

[0196] This system is composed of a series of processes that generate the optimal menu for the user based on the user's health check information, food preference information, and past food ingredient data, create a list of necessary ingredients, and link with the food delivery system.The system consists of three main parts: the server, the terminal, and the user.

[0197] Server Roles and Operations

[0198] The server provides the following main functions:

[0199] 1. Receiving and storing health examination information:

[0200] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure.

[0201] 2. Receiving and storing your food preferences:

[0202] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[0203] 3. Generate the menu:

[0204] The server runs a menu generation algorithm based on the stored health checkup information and food preference information to generate an appropriate meal menu, for example, "stir-fried spinach and beef" for a user who is iron deficient.

[0205] 4. Generate the ingredients list:

[0206] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[0207] 5. Sending the Ingredient List:

[0208] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[0209] 6. Automated ordering methods:

[0210] The server automatically places an order for the created ingredient list to an affiliated food delivery system.

[0211] Device role and operation

[0212] The terminal transmits the information entered by the user to the server and provides an interface that presents the data transmitted by the server to the user:

[0213] 1. Enter and submit basic information:

[0214] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends that data to the server.

[0215] 2. Enter and submit your medical examination information:

[0216] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[0217] 3. Enter and submit your food preferences:

[0218] The user inputs food preference information into the terminal and sends it to the server.

[0219] 4. Check and change the menu:

[0220] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[0221] User Roles and Actions

[0222] Users input their health and food preferences, review and modify the suggested menu, and finally prepare a meal using the delivered ingredients:

[0223] 1. Basic information provided:

[0224] Users provide basic information when using the system.

[0225] 2. Providing health checkup information:

[0226] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[0227] 3. Providing Food Preference Information:

[0228] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[0229] 4. Check and change the menu:

[0230] Review the proposed menu, decide if it suits you, and make any necessary changes.

[0231] 5. Receiving and Preparing Ingredients:

[0232] Receive ingredients delivered from the food delivery system and prepare meals based on the suggested menu.

[0233] Specific examples

[0234] For example, suppose a user is a 40-year-old man who was recently diagnosed with high blood pressure during a medical checkup, and also enters information that he likes chicken and dislikes salty foods.

[0235] 1. The user enters basic information, health check information, and food preference information into the terminal and sends it to the server.

[0236] 2. Based on the information received, the server runs a menu generation algorithm and generates a menu item called Low-salt Steamed Chicken.

[0237] 3. The server sends the generated menu to the user's device, where the user confirms it.

[0238] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the affiliated online supermarket.

[0239] 5. The food delivery system will deliver the ingredients on the specified date.

[0240] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[0241] This allows users to easily obtain menus suited to their health condition, smoothly receive the necessary ingredients, and maintain a balanced diet.

[0242] Example prompt sentence:

[0243] User's health check information: "High blood pressure"

[0244] Food preference information: "Favourite food: Chicken" "Disliked food: Salty food"

[0245] Generated menu: Low-sodium steamed chicken

[0246] Generated ingredients list: Chicken, carrots, spinach, low-sodium spices

[0247] Ordering process: Send ingredient list to online supermarket => Ingredients are delivered on the specified date and time

[0248] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0249] Step 1:

[0250] The user enters basic information (age, gender, weight, height) into the device and sends that data to the server. The entered basic information is format-checked on the device (checking required fields, format consistency, etc.) and then sent to the server in JSON format. The server stores the received information in a user information database.

[0251] Step 2:

[0252] The user enters health checkup information (blood test results, blood pressure, etc.) into the device and sends it to the server. The entered health checkup information is checked for format on the device and then sent to the server in the same JSON format. The server stores the received health checkup information in a health information database. In some cases, the server may also link with the medical institution's system to automatically obtain health checkup data.

[0253] Step 3:

[0254] The user inputs food preference information (favorite ingredients, disliked ingredients, etc.) into the device and sends it to the server. The input food preference information is checked for format and then sent to the server in JSON format. The server stores the received information in a preference database.

[0255] Step 4:

[0256] The server runs a menu generation algorithm based on the stored health checkup information and food preference information. Based on the algorithm, the server generates a menu that best suits the input information, associates it with the user information, and stores it in a menu list database. For example, a user who is iron deficient might be suggested a spinach and chicken stir-fry.

[0257] Step 5:

[0258] The server sends the generated menu to the terminal and displays it to the user. The menu sent from the server is received by the terminal and displayed in a format that is easy for the user to understand. The user can check the proposed menu and make changes as needed (for example, to reduce the salt content). The changed menu is then sent back to the server.

[0259] Step 6:

[0260] The server generates an ingredient list based on the finalized menu. The ingredient list includes the ingredients and quantities required for the dish obtained from the menu generation algorithm and is stored in the ingredient list database.

[0261] Step 7:

[0262] The server executes an automatic ordering process to send the generated ingredient list to the food delivery system. The automatic ordering process sends the ingredient list to affiliated online supermarkets and food delivery services, and the ordering process is carried out.

[0263] Step 8:

[0264] The food delivery system prepares ingredients based on the received ingredient list and delivers them to the user at the specified date and time. To ensure that the delivery system delivers the ingredients appropriately, delivery schedules and address information are sent in advance from the server.

[0265] Step 9:

[0266] Users receive ingredients at the specified date and time and prepare meals based on the suggested menu. They can use their smartphones, tablets, or other devices to check the recipes while cooking.

[0267] By following these steps, users can easily obtain menus tailored to their health condition and food preferences, and quickly receive the ingredients they need.

[0268] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0269] Overall system configuration

[0270] This system generates the optimal menu for the user based on the user's health checkup information, food preference information, and emotional information, creates a list of necessary ingredients, and connects with the food delivery system.The system consists of three main parts: a server, a terminal, and the user.

[0271] Server Roles and Operations

[0272] The server provides the following main functions:

[0273] 1. Receiving and storing health examination information:

[0274] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure information.

[0275] 2. Receiving and storing your food preferences:

[0276] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[0277] 3. Emotion engine recognizes and stores emotional information:

[0278] The server uses an emotion engine to acquire emotional information through user input, facial expression analysis, and voice recognition. The acquired emotional information is stored in an emotion database and managed by linking it to the user ID.

[0279] 4. Generate the menu:

[0280] The server runs a menu generation algorithm based on health checkup information, food preferences, and emotional information to generate an appropriate meal menu. For example, it might suggest "stir-fried beef and vegetables" to a user who is iron deficient and under high stress.

[0281] 5. Generate the ingredients list:

[0282] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[0283] 6. Sending the Ingredient List:

[0284] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[0285] 7. User response recording and menu improvements:

[0286] The server records the user's reaction to the suggested menu based on the user's emotions received from the emotion engine, and improves the menu suggestions for the next time and thereafter.

[0287] Device role and operation

[0288] The terminal transmits information input by the user to the server and provides an interface that presents data transmitted from the server to the user.

[0289] 1. Enter and submit basic information:

[0290] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends the data to the server.

[0291] 2. Enter and submit your medical examination information:

[0292] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[0293] 3. Enter and submit your food preferences:

[0294] The user inputs food preference information into the terminal and sends it to the server.

[0295] 4. Acquiring emotional information using the emotion engine:

[0296] The user can input their own emotions through the device, or emotions can be recognized from facial expressions and voice through the device's camera and microphone.

[0297] 5. Menu confirmation and changes:

[0298] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[0299] User Roles and Actions

[0300] Users input their health checkup information, food preferences, and emotional information, confirm and change the suggested menu, and finally prepare a meal using the delivered ingredients.

[0301] 1. Basic information provided:

[0302] Users provide basic information when using the system.

[0303] 2. Providing health checkup information:

[0304] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[0305] 3. Providing Food Preference Information:

[0306] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[0307] 4. Providing emotional information:

[0308] Emotions can be recognized using the device's camera or microphone, or the emotional state can be input directly.

[0309] 5. Menu confirmation and changes:

[0310] Review the proposed menu, decide if it suits you, and make any necessary changes.

[0311] 6. Receiving and Preparing Ingredients:

[0312] Receive ingredients delivered from the food delivery system and prepare dishes based on the suggested menu.

[0313] Specific examples

[0314] For example, suppose the user is a 30-year-old woman who was recently diagnosed with a vitamin D deficiency in a medical checkup. She also inputs information that she likes fish and dislikes beef, and the emotion engine recognizes that she is stressed.

[0315] 1. The user enters basic information, health check information, food preference information, and emotional information into the terminal and sends it to the server.

[0316] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Grilled Salmon and Spinach Salad."

[0317] 3. The server sends the generated menu to the user's device, where the user confirms it.

[0318] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[0319] 5. The food delivery system will deliver the ingredients on the specified date.

[0320] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[0321] In this way, users can easily obtain menus that suit their health and emotional state and maintain a balanced diet.

[0322] The processing flow will be explained below.

[0323] Step 1:

[0324] The user opens the smartphone app and accesses the basic information entry screen, where they enter basic information such as age, gender, weight, and height.

[0325] Step 2:

[0326] The terminal receives the input basic information and sends it to the server.

[0327] Step 3:

[0328] The server saves the received basic information in the database. It creates a new entry in the user database and registers the basic information along with the user ID.

[0329] Step 4:

[0330] The user enters the results of their health check into the app, or the information is automatically retrieved from the linked medical institution's system.

[0331] Step 5:

[0332] The terminal receives the user's health checkup information and transmits it to the server.

[0333] Step 6:

[0334] The server analyzes the health checkup information and stores it in the health ranking database, linking it to the user ID. For example, it determines that a person is deficient in vitamin D based on the blood test results.

[0335] Step 7:

[0336] The user selects their favorite and least favorite ingredients and food preferences in the app. For example, they can enter "Favorite ingredient: fish" and "Dislike ingredient: beef."

[0337] Step 8:

[0338] The terminal receives the food preference information and transmits it to the server.

[0339] Step 9:

[0340] The server stores the preference information in a preference database, along with the user ID.

[0341] Step 10:

[0342] The device activates a camera and microphone to recognize the user's emotions and capture facial expressions and voice characteristics.

[0343] Step 11:

[0344] The device uses an emotion engine to analyze the user's emotional state based on facial expressions and voice characteristics, for example, determining that the user is feeling stressed.

[0345] Step 12:

[0346] The device sends the analysis results to the server.

[0347] Step 13:

[0348] The server stores the received emotion information in an emotion database and associates it with the user ID.

[0349] Step 14:

[0350] The server runs a menu generation algorithm based on the stored health check information, food preference information, and emotional information to generate an appropriate meal menu. For example, for a user who is feeling stressed due to a vitamin D deficiency, it would generate "grilled salmon and spinach salad."

[0351] Step 15:

[0352] The server sends the generated menu to the terminal for presentation to the user.

[0353] Step 16:

[0354] Users can review the suggested menu items in the app and make changes if necessary. For example, if you like fish, you can accept the "grilled salmon" option, or if you don't like beef, you can change the menu item that includes it to another option.

[0355] Step 17:

[0356] The terminal receives the changed menu information and transmits it to the server.

[0357] Step 18:

[0358] The server finalizes the menu and generates the necessary ingredient list, which is then stored in the ingredient list database.

[0359] Step 19:

[0360] The server sends the generated ingredient list to an online supermarket or food delivery system, for example, by sending the order information via API or email.

[0361] Step 20:

[0362] The food delivery system prepares the ingredients and delivers them to the address specified by the user.

[0363] Step 21:

[0364] The user receives the delivered ingredients and cooks based on the suggested menu. Cooking instructions and recipes can be viewed within the app.

[0365] Step 22:

[0366] The server records the user's reaction using an emotion engine and reflects it in future menu suggestions.

[0367] Example 2

[0368] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0369] Conventional dietary management systems only consider the user's health status and food preferences when proposing menus, but do not provide personalized menu suggestions that reflect the user's emotional state. This often results in users being dissatisfied with the proposed menus, limiting the effectiveness of the system. Furthermore, the system lacks the functionality to continuously improve the menus based on user feedback, making it difficult to propose optimal menus for each user.

[0370] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving and saving health checkup information, means for receiving and saving user food preference information, means for acquiring and saving emotional information, means for generating a menu based on the health checkup information, the food preference information, and the emotional information, means for generating a list of ingredients based on the generated menu, and means for transmitting the list of ingredients to the food delivery system. This enables personalized menu suggestions that take into account not only the user's health status but also their food preferences and emotional state. Furthermore, by continuously improving the menu based on user feedback, it is possible to provide each user with a more appropriate and satisfying meal menu.

[0371] "Health checkup information" is data indicating the health condition of the user, and includes diagnostic results provided by medical institutions, such as blood test results, blood pressure, and cholesterol levels.

[0372] "Food preference information" is data that indicates the user's food preferences, such as the user's favorite and least favorite ingredients, and allergy information.

[0373] "Emotion information" is data that indicates the emotional state of the user, and includes the emotional state obtained by the emotion engine from facial expression and voice analysis, as well as the emotional state input by the user himself.

[0374] The "means for generating a menu" refers to a method including an algorithm and a generative AI model for generating an optimal meal menu for a user based on health checkup information, food preference information, and emotional information.

[0375] The "means for generating a list of ingredients" is a technique that includes algorithms and databases for creating a list of ingredients required based on the generated menu.

[0376] A "food delivery system" is an external system for delivering food ingredients to users, such as an online supermarket or food delivery service.

[0377] The "means for accepting user confirmation and changes" refers to a technique that includes an interface that allows the user to confirm the proposed menu and make changes as necessary, and an algorithm for reflecting those changes.

[0378] This system generates the optimal menu for a user based on their health checkup information, food preferences, and emotional information, creates a list of necessary ingredients, and connects with a food delivery system. The system consists of three main parts: a server, a terminal, and a user. The specific operation of each part is explained below.

[0379] Server Roles and Operations

[0380] Receiving and storing health examination information

[0381] The server receives the health checkup information sent by the user and stores it in a health database, including blood test results and blood pressure, allowing for continuous analysis of the user's health status.

[0382] Receiving and storing user food preference information

[0383] The server receives the food preference information sent by the user and stores it in a preference database. For example, it stores information such as "Favorite food: chicken" and "Disliked food: broccoli." This makes it possible to suggest menu items according to the user's preferences.

[0384] Emotion engine recognizes and stores emotional information

[0385] The server uses an emotion engine to acquire emotional information through user input, facial expression analysis, and voice recognition, and stores it in an emotion database, enabling it to propose menus according to the user's emotional state.

[0386] Generate Menu

[0387] The server uses a generative AI model to generate the optimal menu based on health checkup information, food preferences, and emotional information. For example, it would suggest "stir-fried beef and vegetables" to a user who is iron deficient and under high stress. This process is carried out by a menu generation algorithm.

[0388] Generate an ingredient list

[0389] Based on the generated menu, the server creates a list of ingredients needed and stores it in an ingredient list database, which indicates the specific ingredients that the user needs to purchase.

[0390] Sending an Ingredient List

[0391] The generated ingredient list is sent to the food delivery system, specifically, the order data is sent to the online supermarket or food delivery service.

[0392] User response recording and menu improvements

[0393] The server records the user's reaction to the proposed menu based on the user's emotions received from the emotion engine and reflects this in future menu suggestions, thereby providing a menu customized for each user.

[0394] Device role and operation

[0395] Enter and submit basic information

[0396] The user uses the device to input basic information (age, gender, weight, height, etc.) and sends that data to the server, which then obtains the user's basic health information.

[0397] Enter and submit health check information

[0398] Users enter their health checkup results into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically obtain information. This simplifies the input of diagnostic information and improves accuracy.

[0399] Enter and submit food preference information

[0400] The user inputs their food preferences into the terminal and sends them to the server, which then proposes a meal menu that reflects the user's preferences.

[0401] Acquiring emotional information using an emotion engine

[0402] The user can input their own emotions through the device, or emotions can be recognized from facial expressions and voice via the device's camera and microphone, making it possible to grasp the user's emotional state in real time.

[0403] Check and change the menu

[0404] The proposed menu sent from the server is displayed on the terminal, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[0405] User Roles and Actions

[0406] Provision of basic information

[0407] Users provide basic information when using the system, which lays the foundation for the system to suggest optimal menus based on the user's individual information.

[0408] Providing health checkup information

[0409] Enter your latest health checkup information into the system, or link it with your medical institution's system to automatically provide the information, so that the latest health data is reflected in the menu generation.

[0410] Providing information about food preferences

[0411] Users input information about their food preferences, disliked ingredients, and how to avoid nutritional imbalances, and the system will suggest menus that reflect their tastes.

[0412] Providing emotional information

[0413] Emotions can be recognized using the device's camera and microphone, or emotional state can be input directly, allowing for meal suggestions based on the emotional state.

[0414] Check and change the menu

[0415] Review the suggested menu, decide if it's right for you, and make changes if necessary, incorporating your feedback in real time.

[0416] Receiving and preparing ingredients

[0417] The system receives ingredients from a food delivery system and prepares meals based on suggested menus, allowing customers to maintain a healthy and personalized diet.

[0418] Specific examples

[0419] For example, suppose the user is a 30-year-old woman who was recently diagnosed with a vitamin D deficiency in her health checkup. She also inputs information that she likes fish and dislikes beef, and the emotion engine recognizes that she is stressed. In this case, the specific steps are as follows:

[0420] 1. The user enters basic information, health check information, food preference information, and emotional information into the terminal and sends it to the server.

[0421] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Grilled Salmon and Spinach Salad."

[0422] 3. The server sends the generated menu to the user's device, and the user confirms it.

[0423] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[0424] 5. The food delivery system will deliver the ingredients on the specified date.

[0425] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[0426] As described above, users can easily obtain menus that suit their own health and emotional state, and maintain a balanced diet.

[0427] Prompt Sentence Examples

[0428] An example of a prompt sentence is, "Please suggest the optimal meal menu for a user who is 30 years old, female, has a vitamin D deficiency, likes fresh fish, dislikes beef, and feels stressed." By inputting this prompt sentence into the generative AI model, personalized menu suggestions can be obtained.

[0429] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0430] Step 1:

[0431] Input: Basic information (age, gender, weight, height, etc.)

[0432] Processing: The user starts the device and enters basic information according to the on-screen instructions. The device then sends the entered data to the server in real time.

[0433] Output: Basic information stored in the server's database, so that the server knows the user's basic health information.

[0434] Specific operation: The user enters information such as "age 30, female, weight 60 kg, height 165 cm" into an input form, and the information is sent to the server.

[0435] Step 2:

[0436] Input: Health checkup results

[0437] Processing: The user enters the results of the health check into the terminal and sends the data to the server. It is also possible to automatically obtain information by linking with the medical institution's system.

[0438] Output: Health check information stored in the server's health database.

[0439] Specific operation: A user accesses the site and enters blood test results or blood pressure, or data provided by a medical institution is automatically sent to the server.

[0440] Step 3:

[0441] Input: Food preference information

[0442] Processing: The user inputs information about their food preferences, such as favorite ingredients, disliked ingredients, and allergy information, and sends the data to the server.

[0443] Output: Food preference information stored in the server's preference database.

[0444] Specific operation: The user enters information such as "Favorite food: fish, Disliked food: beef, Allergy: peanuts" and sends it to the server.

[0445] Step 4:

[0446] Input: Emotion information

[0447] Processing: The user inputs emotional information using the device's camera or microphone, or the emotion engine automatically analyzes emotional information from facial expressions and voice and sends the data to the server.

[0448] Output: Emotion information stored in the emotion database on the server.

[0449] Specific operation: The user types "I feel stressed," or the device's camera and microphone analyze the user's facial expressions and tone of voice and recognize that they are "highly stressed."

[0450] Step 5:

[0451] Input: Health checkup information, food preference information, emotional information

[0452] Processing: The server uses this information to generate an optimal meal menu using a generative AI model.

[0453] Output: The generated menu information.

[0454] Specific behavior: The server generates a menu such as "Grilled salmon and spinach salad for a user with a vitamin D deficiency and high stress level."

[0455] Step 6:

[0456] Input: Generated menu

[0457] Processing: The server sends the generated menu to the terminal, where the user confirms it. If necessary, the user can modify the menu and send it back to the server.

[0458] Output: The final menu that is confirmed after user confirmation.

[0459] Specific behavior: The device displays a menu suggestion of "Grilled salmon and spinach salad," which the user can review and accept or change.

[0460] Step 7:

[0461] Input: Final menu confirmed

[0462] Processing: The server creates a list of ingredients based on the confirmed menu and sends the list to the food delivery system.

[0463] Output: A list of ingredients sent to the food delivery system.

[0464] Specific operation: The server generates a list such as "salmon, spinach, lemon, olive oil" and sends it to the online supermarket as order data.

[0465] Step 8:

[0466] Input: Delivery data from food delivery system

[0467] Processing: The food delivery system delivers the ingredients to the user's address at the specified date and time.

[0468] Output: The ingredients delivered to the user.

[0469] Specific operation: The food delivery system delivers ingredients such as "salmon, spinach" to the user's address, and the user picks them up.

[0470] Step 9:

[0471] Input: Proposed menu and ingredients received

[0472] Process: The user cooks the food based on the suggested menu.

[0473] Output: A cooked meal.

[0474] Specific Action: The user follows instructions to cook a dish, such as "grill salmon and prepare a spinach salad."

[0475] In this way, the server processes and calculates the data based on the information entered at each step, generating the optimal menu and ingredient list, and realizing a diet that suits the user's health and emotional state.

[0476] (Application example 2)

[0477] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0478] Conventional meal recommendation systems generate menus and create ingredient lists based solely on the user's health checkup information and food preference information. However, no system was available that could provide individually optimized meal recommendations that took into account the user's emotional state and daily changes in mental state. This created a need for a system that could suggest meals that matched not only the user's health condition and food preferences, but also their emotions. Additionally, a system was needed that could provide feedback on the user's reactions to the suggested menus and further improve future meal recommendations.

[0479] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0480] In this invention, the server includes means for receiving and storing health checkup information, means for receiving and storing user food preference information, means for receiving and storing emotion information including facial expression analysis and voice recognition, means for generating a menu based on the health checkup information, the food preference information, and the emotion information, means for generating a list of ingredients based on the generated menu, means for transmitting the list of ingredients to a food delivery system, and means for improving future menu suggestions based on the user's responses. This enables personalized, optimized meal suggestions based on multifaceted information including the user's emotional state, thereby providing a healthy and stress-conscious dietary lifestyle.

[0481] "Health checkup information" refers to test results and diagnostic data regarding the user's health condition, including blood test results and blood pressure.

[0482] "Food preference information" refers to personal food preference data such as the user's favorite ingredients, disliked ingredients, allergies, etc.

[0483] "Emotional information" refers to data that indicates the user's emotional state obtained by analyzing their facial expressions and voice.

[0484] The "menu generation means" refers to a means for automatically creating an optimal meal menu based on health checkup information, food preference information, and emotional information.

[0485] The "ingredient list generating means" refers to a means for creating a list of necessary ingredients based on the generated menu.

[0486] "Food delivery system" refers to a system for delivering food to users based on a created ingredient list.

[0487] "Response history" refers to data regarding changes in the user's evaluation and emotions regarding proposed menu items.

[0488] Overall system configuration

[0489] The system of the present invention generates the optimal menu for the user based on the user's health checkup information, food preference information, and emotional information, creates a list of necessary ingredients, and links with the food delivery system. The system consists of three main parts: a server, a terminal, and the user.

[0490] Server Roles and Operations

[0491] The server provides the following main functions:

[0492] 1. Receiving and storing health examination information:

[0493] It receives health checkup information sent by users and stores it in a database. For example, it stores information such as blood test results and blood pressure. The hardware used includes a server computer, and the software is a database management system (DBMS).

[0494] 2. Receiving and storing your food preferences:

[0495] It also receives food preference information sent by users and stores it in a database. For example, it stores information such as "Favorite food: chicken" and "Disliked food: broccoli."

[0496] 3. Acquisition and storage of emotional information:

[0497] The emotion engine uses Google Cloud Vision API and AWS Rekognition to acquire emotional information from users through facial expression analysis and voice recognition, and stores it in an emotion database.

[0498] 4. Menu generation algorithm:

[0499] Based on health checkup information, food preference information, and emotional information, a menu generation algorithm is executed to generate the optimal meal menu. Specifically, a machine learning algorithm using Python (such as Scikit-learn or TENSORFLOW (registered trademark)) is used.

[0500] 5. Generate the ingredients list:

[0501] Create a list of ingredients needed based on the generated menu.

[0502] 6. Sending the Ingredient List:

[0503] The generated ingredient list is sent to the partner food delivery system via API communication.

[0504] 7. User response recording and menu improvements:

[0505] Record user responses to suggested menu items to improve future menu suggestions.

[0506] Device role and operation

[0507] The terminal sends the information entered by the user to the server and provides an interface that displays the data sent from the server to the user. Specifically, it has the following functions:

[0508] 1. Enter and submit basic information:

[0509] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends it to the server.

[0510] 2. Enter and submit your medical examination information:

[0511] The user enters the results of their health checkup into the terminal and sends them to the server. In some cases, it is possible to link with the medical institution's system and automatically obtain the information.

[0512] 3. Enter and submit your food preferences:

[0513] The user inputs food preference information into the terminal and sends it to the server.

[0514] 4. Acquiring emotional information:

[0515] Using the device's camera and microphone, emotional information is obtained from the user's facial expressions and voice and sent to the server.

[0516] 5. Menu confirmation and changes:

[0517] The proposed menu sent from the server is displayed on the terminal, and the user can check it and change it if necessary.

[0518] User Roles and Actions

[0519] Users can input their health checkup information, food preferences, and emotional information, confirm and change the suggested menu, and finally prepare a meal using the delivered ingredients. Specifically, the steps are as follows:

[0520] 1. Basic information provided:

[0521] Users provide basic information when using the system.

[0522] 2. Providing health checkup information:

[0523] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[0524] 3. Providing Food Preference Information:

[0525] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[0526] 4. Providing emotional information:

[0527] Emotions can be recognized using the device's camera or microphone, or the emotional state can be input directly.

[0528] 5. Menu confirmation and changes:

[0529] Review the proposed menu, decide if it suits you, and make any necessary changes.

[0530] 6. Receiving and Preparing Ingredients:

[0531] Receive ingredients delivered from the food delivery system and prepare dishes based on the suggested menu.

[0532] Specific examples

[0533] For example, a 30-year-old female user enters the following information:

[0534] Health checkup results: Vitamin D deficiency, mild high blood pressure

[0535] Food preferences: Likes fish, dislikes beef

[0536] Emotional state: Feeling stressed

[0537] 1. The user enters health check information, food preference information, and emotional information into the terminal and sends it to the server.

[0538] 2. The server processes the information and generates the menu item "Grilled Salmon with Spinach Salad."

[0539] 3. If the user reviews and agrees with the proposed menu, an ingredient list is generated and an order is automatically placed with the food delivery platform.

[0540] 4. The ingredients will be automatically delivered to the user on the specified date.

[0541] 5. The user uses the delivered ingredients to prepare a meal according to the suggested menu.

[0542] Prompt Sentence Examples

[0543] Sample prompt 1: "A 30-year-old woman with a vitamin D deficiency and mild high blood pressure. Her favorite food is fish, and her least favorite food is beef. She is currently feeling stressed. What is the best healthy menu for this user?"

[0544] Sample prompt 2: "50-year-old male, pre-diabetic, enjoys elegant meals, and is emotionally relaxed. Please suggest the best menu."

[0545] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0546] Step 1:

[0547] The device inputs the user's basic information (age, gender, weight, height, etc.) and sends this information to the server, where it is recorded in the user's basic database.

[0548] Step 2:

[0549] The terminal inputs the user's health checkup information (e.g., blood test results and blood pressure) and sends it to the server. The input health checkup data is stored in the health database (DBMS) on the server. Specifically, the user scans or manually inputs the health checkup results into the terminal and sends them to the server.

[0550] Step 3:

[0551] The device inputs the user's food preference information (likes and dislikes, allergies, etc.) and sends it to the server, where the input data is stored in the server's preference database.

[0552] Step 4:

[0553] The device uses the device's camera and microphone to analyze facial expressions and voice to obtain emotional information about the user. The obtained emotional information is sent to an emotion database on the server. Specifically, the device uses Google Cloud Vision API and AWS Rekognition to determine the emotion and sends the results to the server.

[0554] Step 5:

[0555] The device sends the collected user health check information, food preference information, and emotional information to a server, which stores this data and integrates it into a single profile.

[0556] Step 6:

[0557] The server runs a menu generation algorithm based on the received health checkup information, food preference information, and emotional information. The algorithm uses Python machine learning models (Scikit-learn and TensorFlow) to generate an optimal meal menu. Specific menu suggestions include "seafood dishes rich in vitamin D."

[0558] Step 7:

[0559] The server sends the generated menu to the terminal and presents it to the user. The user can check this menu and change it if necessary. The changed menu information is also sent back to the server.

[0560] Step 8:

[0561] The server generates a list of ingredients based on the finalized menu, and the generated list is stored in an ingredient list database.

[0562] Step 9:

[0563] The server sends the generated ingredient list to the partner food delivery system, which transfers the data via API communication and processes the specific order.

[0564] Step 10:

[0565] The user inputs their reaction to the proposed menu items on their device, and this reaction information is sent to the server, which uses it as data to improve future menu suggestions.

[0566] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0567] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0568] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0569] [Second embodiment]

[0570] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0571] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0572] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0573] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0574] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0575] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0576] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0577] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0578] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0579] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0580] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0581] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0582] Overall system configuration

[0583] This system is composed of a series of processes that generate the optimal menu for the user based on the user's health check information, food preference information, and past food ingredient data, create a list of necessary ingredients, and link with the food delivery system.The system consists of three main parts: the server, the terminal, and the user.

[0584] Server Roles and Operations

[0585] The server provides the following main functions:

[0586] 1. Receiving and storing health examination information:

[0587] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure.

[0588] 2. Receiving and storing your food preferences:

[0589] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[0590] 3. Generate the menu:

[0591] The server runs a menu generation algorithm based on the stored health checkup information and food preference information to generate an appropriate meal menu, for example, "stir-fried spinach and beef" for a user who is iron deficient.

[0592] 4. Generate the ingredients list:

[0593] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[0594] 5. Sending the Ingredient List:

[0595] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[0596] Device role and operation

[0597] The terminal transmits information input by the user to the server and provides an interface that presents data transmitted from the server to the user.

[0598] 1. Enter and submit basic information:

[0599] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends that data to the server.

[0600] 2. Enter and submit your medical examination information:

[0601] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[0602] 3. Enter and submit your food preferences:

[0603] The user inputs food preference information into the terminal and sends it to the server.

[0604] 4. Check and change the menu:

[0605] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[0606] User Roles and Actions

[0607] Users can input their health checkup information and food preferences, check and change the suggested menu, and finally prepare a meal using the delivered ingredients.

[0608] 1. Basic information provided:

[0609] Users provide basic information when using the system.

[0610] 2. Providing health checkup information:

[0611] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[0612] 3. Providing Food Preference Information:

[0613] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[0614] 4. Check and change the menu:

[0615] Review the proposed menu, decide if it suits you, and make any necessary changes.

[0616] 5. Receiving and Preparing Ingredients:

[0617] Receive ingredients delivered from the food delivery system and prepare meals based on the suggested menu.

[0618] Specific examples

[0619] For example, suppose a user is a 40-year-old man who was recently diagnosed with low iron in his blood during a medical checkup, and who also inputs that he likes chicken and dislikes broccoli.

[0620] 1. The user enters basic information, health check information, and food preference information into the terminal and sends it to the server.

[0621] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Spinach and Chicken Stir-fry."

[0622] 3. The server sends the generated menu to the user's device, where the user confirms it.

[0623] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[0624] 5. The food delivery system will deliver the ingredients on the specified date.

[0625] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[0626] In this way, users can easily obtain menus that suit their health condition and maintain a balanced diet.

[0627] The processing flow will be explained below.

[0628] Step 1:

[0629] The user opens the smartphone app and accesses the basic information entry screen, where they enter basic information such as age, gender, weight, and height.

[0630] Step 2:

[0631] The terminal receives the input basic information and sends it to the server.

[0632] Step 3:

[0633] The server saves the received basic information in the database. It creates a new entry in the user database and registers the basic information along with the user ID.

[0634] Step 4:

[0635] The user enters the results of their health check into the app, or the information is automatically retrieved from the linked medical institution's system.

[0636] Step 5:

[0637] The terminal receives the user's health checkup information and transmits it to the server.

[0638] Step 6:

[0639] The server analyzes the health checkup information and stores it in the health ranking database, linking it to the user ID. For example, it determines that the user has an iron deficiency based on the blood test results.

[0640] Step 7:

[0641] Users select their favorite and least favorite ingredients and food preferences in the app. For example, they could enter "Favorite ingredient: chicken" and "Dislike ingredient: broccoli."

[0642] Step 8:

[0643] The terminal receives the food preference information and transmits it to the server.

[0644] Step 9:

[0645] The server stores the preference information in a preference database, along with the user ID.

[0646] Step 10:

[0647] The server runs a menu generation algorithm based on the stored health checkup information, food preference information, and past delivery data to generate an appropriate meal menu. For example, it might suggest a menu including "stir-fried spinach and beef" for a user with iron deficiency.

[0648] Step 11:

[0649] The server sends the generated menu to the terminal for presentation to the user.

[0650] Step 12:

[0651] Users can review the suggested menu items in the app and make changes if necessary, for example, changing a menu item that contains an ingredient they dislike to another menu item.

[0652] Step 13:

[0653] The terminal receives the changed menu information and transmits it to the server.

[0654] Step 14:

[0655] The server finalizes the menu and generates the necessary ingredient list, which is then stored in the ingredient list database.

[0656] Step 15:

[0657] The server sends the generated ingredient list to the online supermarket or food delivery system, specifically, by sending the order information via API or email.

[0658] Step 16:

[0659] The food delivery system prepares the ingredients and delivers them to the address specified by the user.

[0660] Step 17:

[0661] The user receives the delivered ingredients and cooks based on the suggested menu. Cooking instructions and recipes can be viewed within the app.

[0662] Example 1

[0663] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0664] In today's world, it is difficult to easily obtain meal menus that cater to individual health conditions and food preferences. Furthermore, selecting and procuring ingredients based on individual needs is time-consuming, making effective nutritional management difficult. Furthermore, generating menus using a user's past ingredient data requires advanced data analysis and AI technology. There is a need for a system that can solve these issues and help users maintain their health and improve their dietary habits.

[0665] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0666] In this invention, the server includes means for receiving and storing health condition information, means for receiving and storing user dietary preference information, means for generating a menu using a generative AI model based on the health condition information and the dietary preference information, means for generating a list of necessary ingredients based on the generated menu, and means for transmitting the list of ingredients to a food delivery system. This enables automatic generation of an appropriate menu according to individual health conditions and dietary preferences, and efficient procurement of necessary ingredients.

[0667] "Health status information" is information related to the user's health, and includes, for example, blood test results, blood pressure, weight, body fat percentage, and the like.

[0668] "Dietary preference information" is information about the user's food preferences and disliked ingredients, such as data about favorite foods and disliked foods.

[0669] A "generative AI model" refers to an algorithm that uses artificial intelligence algorithms to analyze data and perform specific tasks to generate the optimal menu for the user.

[0670] The "list of ingredients" is a list of ingredients required based on the menu, and is data that includes the type and amount of each ingredient.

[0671] A "food delivery system" is a system that provides a network and services for delivering food ingredients specified by a user.

[0672] A "menu" is a meal suggestion for a user, including specific dish names, cooking methods, and nutritional information.

[0673] A "server" is a computer system that receives and stores data sent by users and processes it.

[0674] The "database" is a management system for storing received health status information, food preference information, past food ingredient data, and the like.

[0675] A "prompt" is a specific instruction or question that is entered when creating a menu using a generative AI model.

[0676] MODE FOR CARRYING OUT THE INVENTION

[0677] This invention is a system that generates optimal menus for users based on their health status information, food preference information, and past ingredient data, creates a list of necessary ingredients, and provides a series of processes that link with a food delivery system. The system consists of three main parts: a server, a terminal, and a user.

[0678] Server Roles and Operations

[0679] The server provides the following main functions: First, it receives and stores health status information by storing the data sent by the user in a database such as MySQL or PostgreSQL. Second, it receives and stores the user's dietary preference information and manages this information using DynamoDB or MongoDB.

[0680] The server runs a menu generation algorithm using a generative AI model (e.g., GPT-4) based on the stored health status information and food preference information to generate an appropriate meal menu. An example of this prompt sentence is, "40-year-old male user. Health checkup results show low iron in the blood. Prefers chicken and dislikes broccoli. Please generate an appropriate menu."

[0681] Based on the generated menu, the server creates a list of necessary ingredients and stores this list in an in-memory data store such as Redis. Furthermore, to send this list of ingredients to the food delivery system, the server uses the API of the online supermarket or food delivery service, utilizing a RESTful API using the HTTP protocol.

[0682] Device role and operation

[0683] The terminal sends the information entered by the user to the server and provides an interface that displays the data sent from the server to the user. The terminal can be an iOS or Android-based smartphone or PC.

[0684] Users input their health condition information, dietary preferences, and basic information (age, gender, weight, height, etc.) into the device. React or Flutter is used as the input form, and this data is sent to the server using the HTTPS protocol. Furthermore, the device can also connect to medical institutions' systems and automatically obtain health checkup information using the FHIR (Fast Healthcare Interoperability Resources) standard.

[0685] User Roles and Actions

[0686] Users input their health status and dietary preferences, confirm and modify the proposed menu, and finally prepare a meal using the delivered ingredients. The data entered by the user through the device is processed appropriately by the server, and the generated menu and list of ingredients are sent to the user's device. The user can review this and modify the menu as needed.

[0687] By receiving ingredients delivered by the food delivery system and cooking according to the recipes displayed on the device, customers can easily maintain a balanced diet.

[0688] This invention automatically generates a menu that matches the user's individual health condition and food preferences, enabling efficient food procurement.

[0689] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0690] Step 1:

[0691] The user enters basic information (age, gender, weight, height, etc.) into the device and sends that data to the server. The server creates an individual user profile based on this basic information and stores it in a database. The entered information is securely transmitted from the device via the HTTPS protocol, and the server stores the information in a database management system (DBMS).

[0692] Input: User's basic information (age, gender, weight, height, etc.)

[0693] Output: New user profile saved in database

[0694] Specific operation: The user enters basic information into the input form and presses the "Submit" button. The terminal sends the information to the server, which receives it and stores it in the database.

[0695] Step 2:

[0696] The user enters their health status information into the device and sends it to the server. The entered information can be uploaded as a PDF result from a medical institution or automatically obtained through the medical institution's API. The server receives this information and stores it in a database.

[0697] Input: User's health information (blood test results, blood pressure, etc.)

[0698] Output: Save health information to database

[0699] Specific operation: The user uploads the health checkup results to the terminal and sends them to the server, which then stores the received data in a database.

[0700] Step 3:

[0701] The user inputs food preference information (favorite ingredients, disliked ingredients, etc.) into the terminal and sends it to the server, which receives this information and stores it in a database.

[0702] Input: User's food preference information (favorite ingredients, disliked ingredients)

[0703] Output: Save preference information to database

[0704] Specific operation: The user answers questions in a questionnaire about their food preferences and sends the data from their device to the server, which then stores the received information in a database.

[0705] Step 4:

[0706] The server retrieves health status information and dietary preference information from the database and runs a menu generation algorithm using a generative AI model (e.g., GPT-4). This is the process of inputting specific prompts into the generative AI model to generate a menu.

[0707] Input: Health status information, dietary preference information

[0708] Output: The generated menu

[0709] Specific operation: The server retrieves the necessary information from the database, inputs the prompt statement "40-year-old male user. Health check results show low blood iron. Prefers chicken and dislikes broccoli. Please generate an appropriate menu" into the generative AI model, and retrieves the generated menu.

[0710] Step 5:

[0711] The server creates a list of ingredients needed based on the generated menu, identifies the ingredients and quantities needed for each dish on the generated menu, and stores this information in a database.

[0712] Input: Generated menu

[0713] Output: List of ingredients needed

[0714] Specific operation: The server analyzes the generated menu, lists the necessary ingredients and their quantities, and stores them in a database.

[0715] Step 6:

[0716] The server sends the generated list of ingredients to the food delivery system, and sends the order data using the API of the online supermarket or food delivery service.

[0717] Input: List of ingredients

[0718] Output: Order data sent to the food delivery system

[0719] Specific operation: The server sends the list of ingredients to the food delivery system's API and confirms the order of the necessary ingredients. The order status and delivery schedule can also be checked at the same time.

[0720] Step 7:

[0721] The user receives the delivered ingredients, cooks them based on the recipe displayed on the device, and finally, cooks based on the suggested menu and enjoys a balanced meal.

[0722] Input: Delivered ingredients

[0723] Output: Cooked food

[0724] Specific operation: The device checks the received ingredients and cooks them according to the recipe displayed on the device. The device delivers the finished dish, allowing the user to maintain a balanced diet.

[0725] (Application example 1)

[0726] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0727] Conventional meal menu suggestion systems can generate menus based on a user's health checkup information and food preferences, but they require users to manually order ingredients from the generated list, which is time-consuming. Furthermore, since the generated menus do not automatically order or arrange for delivery of ingredients, users have to go to the trouble of purchasing ingredients. There is a need to solve these problems and improve user convenience.

[0728] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0729] In this invention, the server includes means for receiving and saving health checkup information, means for receiving and saving user food preference information, means for generating a menu based on the health checkup information and the food preference information, means for generating a list of necessary ingredients based on the generated menu, means for transmitting the list of ingredients to the food delivery system, means for transmitting the health checkup information and food preference information input from the user's terminal to the server, means for displaying the data transmitted from the server to the user, and means for automatically ordering the list of ingredients corresponding to the proposed menu based on the application. This allows the user to easily receive a menu tailored to their health condition and food preferences, and enables the automatic ordering and delivery of necessary ingredients.

[0730] "Health checkup information" is data that indicates the user's health condition, and includes blood test results, blood pressure values, and the like.

[0731] "Food preference information" is personal information that indicates the user's favorite and least favorite ingredients, taste preferences, etc.

[0732] The "menu" refers to meal suggestions generated based on the health checkup information and the food preference information.

[0733] The "ingredients list" is a list of ingredients required based on the menu.

[0734] The "food delivery system" is a system for delivering ingredients to users based on the ingredient list.

[0735] A "server" is a computer system that stores information received from users and generates menus and ingredient lists.

[0736] A "terminal" is an electronic device that transmits information entered by a user to a server and displays data transmitted from the server to the user.

[0737] The "automatic ordering means" is a means for automatically ordering ingredients from an affiliated food delivery system based on the generated ingredient list.

[0738] "Delivery arrangement" refers to making arrangements for the delivery of ingredients at a date and time specified by the user based on the generated ingredient list.

[0739] The "menu generation means" refers to an algorithm or program for generating a meal menu suited to a user based on health checkup information and food preference information.

[0740] Overall system configuration

[0741] This system is composed of a series of processes that generate the optimal menu for the user based on the user's health check information, food preference information, and past food ingredient data, create a list of necessary ingredients, and link with the food delivery system.The system consists of three main parts: the server, the terminal, and the user.

[0742] Server Roles and Operations

[0743] The server provides the following main functions:

[0744] 1. Receiving and storing health examination information:

[0745] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure.

[0746] 2. Receiving and storing your food preferences:

[0747] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[0748] 3. Generate the menu:

[0749] The server runs a menu generation algorithm based on the stored health checkup information and food preference information to generate an appropriate meal menu, for example, "stir-fried spinach and beef" for a user who is iron deficient.

[0750] 4. Generate the ingredients list:

[0751] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[0752] 5. Sending the Ingredient List:

[0753] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[0754] 6. Automated ordering methods:

[0755] The server automatically places an order for the created ingredient list to an affiliated food delivery system.

[0756] Device role and operation

[0757] The terminal transmits the information entered by the user to the server and provides an interface that presents the data transmitted by the server to the user:

[0758] 1. Enter and submit basic information:

[0759] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends that data to the server.

[0760] 2. Enter and submit your medical examination information:

[0761] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[0762] 3. Enter and submit your food preferences:

[0763] The user inputs food preference information into the terminal and sends it to the server.

[0764] 4. Check and change the menu:

[0765] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[0766] User Roles and Actions

[0767] Users input their health and food preferences, review and modify the suggested menu, and finally prepare a meal using the delivered ingredients:

[0768] 1. Basic information provided:

[0769] Users provide basic information when using the system.

[0770] 2. Providing health checkup information:

[0771] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[0772] 3. Providing Food Preference Information:

[0773] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[0774] 4. Check and change the menu:

[0775] Review the proposed menu, decide if it suits you, and make any necessary changes.

[0776] 5. Receiving and Preparing Ingredients:

[0777] Receive ingredients delivered from the food delivery system and prepare meals based on the suggested menu.

[0778] Specific examples

[0779] For example, suppose a user is a 40-year-old man who was recently diagnosed with high blood pressure during a medical checkup, and also enters information that he likes chicken and dislikes salty foods.

[0780] 1. The user enters basic information, health check information, and food preference information into the terminal and sends it to the server.

[0781] 2. Based on the information received, the server runs a menu generation algorithm and generates a menu item called Low-salt Steamed Chicken.

[0782] 3. The server sends the generated menu to the user's device, where the user confirms it.

[0783] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the affiliated online supermarket.

[0784] 5. The food delivery system will deliver the ingredients on the specified date.

[0785] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[0786] This allows users to easily obtain menus suited to their health condition, smoothly receive the necessary ingredients, and maintain a balanced diet.

[0787] Example prompt sentence:

[0788] User's health check information: "High blood pressure"

[0789] Food preference information: "Favourite food: Chicken" "Disliked food: Salty food"

[0790] Generated menu: Low-sodium steamed chicken

[0791] Generated ingredients list: Chicken, carrots, spinach, low-sodium spices

[0792] Ordering process: Send ingredient list to online supermarket => Ingredients are delivered on the specified date and time

[0793] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0794] Step 1:

[0795] The user enters basic information (age, gender, weight, height) into the device and sends that data to the server. The entered basic information is format-checked on the device (checking required fields, format consistency, etc.) and then sent to the server in JSON format. The server stores the received information in a user information database.

[0796] Step 2:

[0797] The user enters health checkup information (blood test results, blood pressure, etc.) into the device and sends it to the server. The entered health checkup information is checked for format on the device and then sent to the server in the same JSON format. The server stores the received health checkup information in a health information database. In some cases, the server may also link with the medical institution's system to automatically obtain health checkup data.

[0798] Step 3:

[0799] The user inputs food preference information (favorite ingredients, disliked ingredients, etc.) into the device and sends it to the server. The input food preference information is checked for format and then sent to the server in JSON format. The server stores the received information in a preference database.

[0800] Step 4:

[0801] The server runs a menu generation algorithm based on the stored health checkup information and food preference information. Based on the algorithm, the server generates a menu that best suits the input information, associates it with the user information, and stores it in a menu list database. For example, a user who is iron deficient might be suggested a spinach and chicken stir-fry.

[0802] Step 5:

[0803] The server sends the generated menu to the terminal and displays it to the user. The menu sent from the server is received by the terminal and displayed in a format that is easy for the user to understand. The user can check the proposed menu and make changes as needed (for example, to reduce the salt content). The changed menu is then sent back to the server.

[0804] Step 6:

[0805] The server generates an ingredient list based on the finalized menu. The ingredient list includes the ingredients and quantities required for the dish obtained from the menu generation algorithm and is stored in the ingredient list database.

[0806] Step 7:

[0807] The server executes an automatic ordering process to send the generated ingredient list to the food delivery system. The automatic ordering process sends the ingredient list to affiliated online supermarkets and food delivery services, and the ordering process is carried out.

[0808] Step 8:

[0809] The food delivery system prepares ingredients based on the received ingredient list and delivers them to the user at the specified date and time. To ensure that the delivery system delivers the ingredients appropriately, delivery schedules and address information are sent in advance from the server.

[0810] Step 9:

[0811] Users receive ingredients at the specified date and time and prepare meals based on the suggested menu. They can use their smartphones, tablets, or other devices to check the recipes while cooking.

[0812] By following these steps, users can easily obtain menus tailored to their health condition and food preferences, and quickly receive the ingredients they need.

[0813] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0814] Overall system configuration

[0815] This system generates the optimal menu for the user based on the user's health checkup information, food preference information, and emotional information, creates a list of necessary ingredients, and connects with the food delivery system.The system consists of three main parts: a server, a terminal, and the user.

[0816] Server Roles and Operations

[0817] The server provides the following main functions:

[0818] 1. Receiving and storing health examination information:

[0819] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure information.

[0820] 2. Receiving and storing your food preferences:

[0821] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[0822] 3. Emotion engine recognizes and stores emotional information:

[0823] The server uses an emotion engine to acquire emotional information through user input, facial expression analysis, and voice recognition. The acquired emotional information is stored in an emotion database and managed by linking it to the user ID.

[0824] 4. Generate the menu:

[0825] The server runs a menu generation algorithm based on health checkup information, food preferences, and emotional information to generate an appropriate meal menu. For example, it might suggest "stir-fried beef and vegetables" to a user who is iron deficient and under high stress.

[0826] 5. Generate the ingredients list:

[0827] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[0828] 6. Sending the Ingredient List:

[0829] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[0830] 7. User response recording and menu improvements:

[0831] The server records the user's reaction to the suggested menu based on the user's emotions received from the emotion engine, and improves the menu suggestions for the next time and thereafter.

[0832] Device role and operation

[0833] The terminal transmits information input by the user to the server and provides an interface that presents data transmitted from the server to the user.

[0834] 1. Enter and submit basic information:

[0835] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends the data to the server.

[0836] 2. Enter and submit your medical examination information:

[0837] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[0838] 3. Enter and submit your food preferences:

[0839] The user inputs food preference information into the terminal and sends it to the server.

[0840] 4. Acquiring emotional information using the emotion engine:

[0841] The user can input their own emotions through the device, or emotions can be recognized from facial expressions and voice through the device's camera and microphone.

[0842] 5. Menu confirmation and changes:

[0843] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[0844] User Roles and Actions

[0845] Users input their health checkup information, food preferences, and emotional information, confirm and change the suggested menu, and finally prepare a meal using the delivered ingredients.

[0846] 1. Basic information provided:

[0847] Users provide basic information when using the system.

[0848] 2. Providing health checkup information:

[0849] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[0850] 3. Providing Food Preference Information:

[0851] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[0852] 4. Providing emotional information:

[0853] Emotions can be recognized using the device's camera or microphone, or the emotional state can be input directly.

[0854] 5. Menu confirmation and changes:

[0855] Review the proposed menu, decide if it suits you, and make any necessary changes.

[0856] 6. Receiving and Preparing Ingredients:

[0857] Receive ingredients delivered from the food delivery system and prepare dishes based on the suggested menu.

[0858] Specific examples

[0859] For example, suppose the user is a 30-year-old woman who was recently diagnosed with a vitamin D deficiency in a medical checkup. She also inputs information that she likes fish and dislikes beef, and the emotion engine recognizes that she is stressed.

[0860] 1. The user enters basic information, health check information, food preference information, and emotional information into the terminal and sends it to the server.

[0861] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Grilled Salmon and Spinach Salad."

[0862] 3. The server sends the generated menu to the user's device, where the user confirms it.

[0863] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[0864] 5. The food delivery system will deliver the ingredients on the specified date.

[0865] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[0866] In this way, users can easily obtain menus that suit their health and emotional state and maintain a balanced diet.

[0867] The processing flow will be explained below.

[0868] Step 1:

[0869] The user opens the smartphone app and accesses the basic information entry screen, where they enter basic information such as age, gender, weight, and height.

[0870] Step 2:

[0871] The terminal receives the input basic information and sends it to the server.

[0872] Step 3:

[0873] The server saves the received basic information in the database. It creates a new entry in the user database and registers the basic information along with the user ID.

[0874] Step 4:

[0875] The user enters the results of their health check into the app, or the information is automatically retrieved from the linked medical institution's system.

[0876] Step 5:

[0877] The terminal receives the user's health checkup information and transmits it to the server.

[0878] Step 6:

[0879] The server analyzes the health checkup information and stores it in the health ranking database, linking it to the user ID. For example, it determines that a person is deficient in vitamin D based on the blood test results.

[0880] Step 7:

[0881] The user selects their favorite and least favorite ingredients and food preferences in the app. For example, they can enter "Favorite ingredient: fish" and "Dislike ingredient: beef."

[0882] Step 8:

[0883] The terminal receives the food preference information and transmits it to the server.

[0884] Step 9:

[0885] The server stores the preference information in a preference database, along with the user ID.

[0886] Step 10:

[0887] The device activates a camera and microphone to recognize the user's emotions and capture facial expressions and voice characteristics.

[0888] Step 11:

[0889] The device uses an emotion engine to analyze the user's emotional state based on facial expressions and voice characteristics, for example, determining that the user is feeling stressed.

[0890] Step 12:

[0891] The device sends the analysis results to the server.

[0892] Step 13:

[0893] The server stores the received emotion information in an emotion database and associates it with the user ID.

[0894] Step 14:

[0895] The server runs a menu generation algorithm based on the stored health check information, food preference information, and emotional information to generate an appropriate meal menu. For example, for a user who is feeling stressed due to a vitamin D deficiency, it would generate "grilled salmon and spinach salad."

[0896] Step 15:

[0897] The server sends the generated menu to the terminal for presentation to the user.

[0898] Step 16:

[0899] Users can review the suggested menu items in the app and make changes if necessary. For example, if you like fish, you can accept the "grilled salmon" option, or if you don't like beef, you can change the menu item that includes it to another option.

[0900] Step 17:

[0901] The terminal receives the changed menu information and transmits it to the server.

[0902] Step 18:

[0903] The server finalizes the menu and generates the necessary ingredient list, which is then stored in the ingredient list database.

[0904] Step 19:

[0905] The server sends the generated ingredient list to an online supermarket or food delivery system, for example, by sending the order information via API or email.

[0906] Step 20:

[0907] The food delivery system prepares the ingredients and delivers them to the address specified by the user.

[0908] Step 21:

[0909] The user receives the delivered ingredients and cooks based on the suggested menu. Cooking instructions and recipes can be viewed within the app.

[0910] Step 22:

[0911] The server records the user's reaction using an emotion engine and reflects it in future menu suggestions.

[0912] Example 2

[0913] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0914] Conventional dietary management systems only consider the user's health status and food preferences when proposing menus, but do not provide personalized menu suggestions that reflect the user's emotional state. This often results in users being dissatisfied with the proposed menus, limiting the effectiveness of the system. Furthermore, the system lacks the functionality to continuously improve the menus based on user feedback, making it difficult to propose optimal menus for each user.

[0915] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving and saving health checkup information, means for receiving and saving user food preference information, means for acquiring and saving emotional information, means for generating a menu based on the health checkup information, the food preference information, and the emotional information, means for generating a list of ingredients based on the generated menu, and means for transmitting the list of ingredients to the food delivery system. This enables personalized menu suggestions that take into account not only the user's health status but also their food preferences and emotional state. Furthermore, by continuously improving the menu based on user feedback, it is possible to provide each user with a more appropriate and satisfying meal menu.

[0916] "Health checkup information" is data indicating the health condition of the user, and includes diagnostic results provided by medical institutions, such as blood test results, blood pressure, and cholesterol levels.

[0917] "Food preference information" is data that indicates the user's food preferences, such as the user's favorite and least favorite ingredients, and allergy information.

[0918] "Emotion information" is data that indicates the emotional state of the user, and includes the emotional state obtained by the emotion engine from facial expression and voice analysis, as well as the emotional state input by the user himself.

[0919] The "means for generating a menu" refers to a method including an algorithm and a generative AI model for generating an optimal meal menu for a user based on health checkup information, food preference information, and emotional information.

[0920] The "means for generating a list of ingredients" is a technique that includes algorithms and databases for creating a list of ingredients required based on the generated menu.

[0921] A "food delivery system" is an external system for delivering food ingredients to users, such as an online supermarket or food delivery service.

[0922] The "means for accepting user confirmation and changes" refers to a technique that includes an interface that allows the user to confirm the proposed menu and make changes as necessary, and an algorithm for reflecting those changes.

[0923] This system generates the optimal menu for a user based on their health checkup information, food preferences, and emotional information, creates a list of necessary ingredients, and connects with a food delivery system. The system consists of three main parts: a server, a terminal, and a user. The specific operation of each part is explained below.

[0924] Server Roles and Operations

[0925] Receiving and storing health examination information

[0926] The server receives the health checkup information sent by the user and stores it in a health database, including blood test results and blood pressure, allowing for continuous analysis of the user's health status.

[0927] Receiving and storing user food preference information

[0928] The server receives the food preference information sent by the user and stores it in a preference database. For example, it stores information such as "Favorite food: chicken" and "Disliked food: broccoli." This makes it possible to suggest menu items according to the user's preferences.

[0929] Emotion engine recognizes and stores emotional information

[0930] The server uses an emotion engine to acquire emotional information through user input, facial expression analysis, and voice recognition, and stores it in an emotion database, enabling it to propose menus according to the user's emotional state.

[0931] Generate Menu

[0932] The server uses a generative AI model to generate the optimal menu based on health checkup information, food preferences, and emotional information. For example, it would suggest "stir-fried beef and vegetables" to a user who is iron deficient and under high stress. This process is carried out by a menu generation algorithm.

[0933] Generate an ingredient list

[0934] Based on the generated menu, the server creates a list of ingredients needed and stores it in an ingredient list database, which indicates the specific ingredients that the user needs to purchase.

[0935] Sending an Ingredient List

[0936] The generated ingredient list is sent to the food delivery system, specifically, the order data is sent to the online supermarket or food delivery service.

[0937] User response recording and menu improvements

[0938] The server records the user's reaction to the proposed menu based on the user's emotions received from the emotion engine and reflects this in future menu suggestions, thereby providing a menu customized for each user.

[0939] Device role and operation

[0940] Enter and submit basic information

[0941] The user uses the device to input basic information (age, gender, weight, height, etc.) and sends that data to the server, which then obtains the user's basic health information.

[0942] Enter and submit health check information

[0943] Users enter their health checkup results into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically obtain information. This simplifies the input of diagnostic information and improves accuracy.

[0944] Enter and submit food preference information

[0945] The user inputs their food preferences into the terminal and sends them to the server, which then proposes a meal menu that reflects the user's preferences.

[0946] Acquiring emotional information using an emotion engine

[0947] The user can input their own emotions through the device, or emotions can be recognized from facial expressions and voice via the device's camera and microphone, making it possible to grasp the user's emotional state in real time.

[0948] Check and change the menu

[0949] The proposed menu sent from the server is displayed on the terminal, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[0950] User Roles and Actions

[0951] Provision of basic information

[0952] Users provide basic information when using the system, which lays the foundation for the system to suggest optimal menus based on the user's individual information.

[0953] Providing health checkup information

[0954] Enter your latest health checkup information into the system, or link it with your medical institution's system to automatically provide the information, so that the latest health data is reflected in the menu generation.

[0955] Providing information about food preferences

[0956] Users input information about their food preferences, disliked ingredients, and how to avoid nutritional imbalances, and the system will suggest menus that reflect their tastes.

[0957] Providing emotional information

[0958] Emotions can be recognized using the device's camera and microphone, or emotional state can be input directly, allowing for meal suggestions based on the emotional state.

[0959] Check and change the menu

[0960] Review the suggested menu, decide if it's right for you, and make changes if necessary, incorporating your feedback in real time.

[0961] Receiving and preparing ingredients

[0962] The system receives ingredients from a food delivery system and prepares meals based on suggested menus, allowing customers to maintain a healthy and personalized diet.

[0963] Specific examples

[0964] For example, suppose the user is a 30-year-old woman who was recently diagnosed with a vitamin D deficiency in her health checkup. She also inputs information that she likes fish and dislikes beef, and the emotion engine recognizes that she is stressed. In this case, the specific steps are as follows:

[0965] 1. The user enters basic information, health check information, food preference information, and emotional information into the terminal and sends it to the server.

[0966] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Grilled Salmon and Spinach Salad."

[0967] 3. The server sends the generated menu to the user's device, and the user confirms it.

[0968] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[0969] 5. The food delivery system will deliver the ingredients on the specified date.

[0970] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[0971] As described above, users can easily obtain menus that suit their own health and emotional state, and maintain a balanced diet.

[0972] Prompt Sentence Examples

[0973] An example of a prompt sentence is, "Please suggest the optimal meal menu for a user who is 30 years old, female, has a vitamin D deficiency, likes fresh fish, dislikes beef, and feels stressed." By inputting this prompt sentence into the generative AI model, personalized menu suggestions can be obtained.

[0974] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0975] Step 1:

[0976] Input: Basic information (age, gender, weight, height, etc.)

[0977] Processing: The user starts the device and enters basic information according to the on-screen instructions. The device then sends the entered data to the server in real time.

[0978] Output: Basic information stored in the server's database, so that the server knows the user's basic health information.

[0979] Specific operation: The user enters information such as "age 30, female, weight 60 kg, height 165 cm" into an input form, and the information is sent to the server.

[0980] Step 2:

[0981] Input: Health checkup results

[0982] Processing: The user enters the results of the health check into the terminal and sends the data to the server. It is also possible to automatically obtain information by linking with the medical institution's system.

[0983] Output: Health check information stored in the server's health database.

[0984] Specific operation: A user accesses the site and enters blood test results or blood pressure, or data provided by a medical institution is automatically sent to the server.

[0985] Step 3:

[0986] Input: Food preference information

[0987] Processing: The user inputs information about their food preferences, such as favorite ingredients, disliked ingredients, and allergy information, and sends the data to the server.

[0988] Output: Food preference information stored in the server's preference database.

[0989] Specific operation: The user enters information such as "Favorite food: fish, Disliked food: beef, Allergy: peanuts" and sends it to the server.

[0990] Step 4:

[0991] Input: Emotion information

[0992] Processing: The user inputs emotional information using the device's camera or microphone, or the emotion engine automatically analyzes emotional information from facial expressions and voice and sends the data to the server.

[0993] Output: Emotion information stored in the emotion database on the server.

[0994] Specific operation: The user types "I feel stressed," or the device's camera and microphone analyze the user's facial expressions and tone of voice and recognize that they are "highly stressed."

[0995] Step 5:

[0996] Input: Health checkup information, food preference information, emotional information

[0997] Processing: The server uses this information to generate an optimal meal menu using a generative AI model.

[0998] Output: The generated menu information.

[0999] Specific behavior: The server generates a menu such as "Grilled salmon and spinach salad for a user with a vitamin D deficiency and high stress level."

[1000] Step 6:

[1001] Input: Generated menu

[1002] Processing: The server sends the generated menu to the terminal, where the user confirms it. If necessary, the user can modify the menu and send it back to the server.

[1003] Output: The final menu that is confirmed after user confirmation.

[1004] Specific behavior: The device displays a menu suggestion of "Grilled salmon and spinach salad," which the user can review and accept or change.

[1005] Step 7:

[1006] Input: Final menu confirmed

[1007] Processing: The server creates a list of ingredients based on the confirmed menu and sends the list to the food delivery system.

[1008] Output: A list of ingredients sent to the food delivery system.

[1009] Specific operation: The server generates a list such as "salmon, spinach, lemon, olive oil" and sends it to the online supermarket as order data.

[1010] Step 8:

[1011] Input: Delivery data from food delivery system

[1012] Processing: The food delivery system delivers the ingredients to the user's address at the specified date and time.

[1013] Output: The ingredients delivered to the user.

[1014] Specific operation: The food delivery system delivers ingredients such as "salmon, spinach" to the user's address, and the user picks them up.

[1015] Step 9:

[1016] Input: Proposed menu and ingredients received

[1017] Process: The user cooks the food based on the suggested menu.

[1018] Output: A cooked meal.

[1019] Specific Action: The user follows instructions to cook a dish, such as "grill salmon and prepare a spinach salad."

[1020] In this way, the server processes and calculates the data based on the information entered at each step, generating the optimal menu and ingredient list, and realizing a diet that suits the user's health and emotional state.

[1021] (Application example 2)

[1022] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1023] Conventional meal recommendation systems generate menus and create ingredient lists based solely on the user's health checkup information and food preference information. However, no system was available that could provide individually optimized meal recommendations that took into account the user's emotional state and daily changes in mental state. This created a need for a system that could suggest meals that matched not only the user's health condition and food preferences, but also their emotions. Additionally, a system was needed that could provide feedback on the user's reactions to the suggested menus and further improve future meal recommendations.

[1024] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1025] In this invention, the server includes means for receiving and storing health checkup information, means for receiving and storing user food preference information, means for receiving and storing emotion information including facial expression analysis and voice recognition, means for generating a menu based on the health checkup information, the food preference information, and the emotion information, means for generating a list of ingredients based on the generated menu, means for transmitting the list of ingredients to a food delivery system, and means for improving future menu suggestions based on the user's responses. This enables personalized, optimized meal suggestions based on multifaceted information including the user's emotional state, thereby providing a healthy and stress-conscious dietary lifestyle.

[1026] "Health checkup information" refers to test results and diagnostic data regarding the user's health condition, including blood test results and blood pressure.

[1027] "Food preference information" refers to personal food preference data such as the user's favorite ingredients, disliked ingredients, allergies, etc.

[1028] "Emotional information" refers to data that indicates the user's emotional state obtained by analyzing their facial expressions and voice.

[1029] The "menu generation means" refers to a means for automatically creating an optimal meal menu based on health checkup information, food preference information, and emotional information.

[1030] The "ingredient list generating means" refers to a means for creating a list of necessary ingredients based on the generated menu.

[1031] "Food delivery system" refers to a system for delivering food to users based on a created ingredient list.

[1032] "Response history" refers to data regarding changes in the user's evaluation and emotions regarding proposed menu items.

[1033] Overall system configuration

[1034] The system of the present invention generates the optimal menu for the user based on the user's health checkup information, food preference information, and emotional information, creates a list of necessary ingredients, and links with the food delivery system. The system consists of three main parts: a server, a terminal, and the user.

[1035] Server Roles and Operations

[1036] The server provides the following main functions:

[1037] 1. Receiving and storing health examination information:

[1038] It receives health checkup information sent by users and stores it in a database. For example, it stores information such as blood test results and blood pressure. The hardware used includes a server computer, and the software is a database management system (DBMS).

[1039] 2. Receiving and storing your food preferences:

[1040] It also receives food preference information sent by users and stores it in a database. For example, it stores information such as "Favorite food: chicken" and "Disliked food: broccoli."

[1041] 3. Acquisition and storage of emotional information:

[1042] The emotion engine uses Google Cloud Vision API and AWS Rekognition to acquire emotional information through facial expression analysis and voice recognition, and stores it in an emotion database.

[1043] 4. Menu generation algorithm:

[1044] Based on health checkup information, food preference information, and emotional information, a menu generation algorithm is run to generate the optimal meal menu. Specifically, machine learning algorithms using Python (such as Scikit-learn and TensorFlow) are used.

[1045] 5. Generate the ingredients list:

[1046] Create a list of ingredients needed based on the generated menu.

[1047] 6. Sending the Ingredient List:

[1048] The generated ingredient list is sent to the partner food delivery system via API communication.

[1049] 7. User response recording and menu improvements:

[1050] Record user responses to suggested menu items to improve future menu suggestions.

[1051] Device role and operation

[1052] The terminal sends the information entered by the user to the server and provides an interface that displays the data sent from the server to the user. Specifically, it has the following functions:

[1053] 1. Enter and submit basic information:

[1054] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends it to the server.

[1055] 2. Enter and submit your medical examination information:

[1056] The user enters the results of their health checkup into the terminal and sends them to the server. In some cases, it is possible to link with the medical institution's system and automatically obtain the information.

[1057] 3. Enter and submit your food preferences:

[1058] The user inputs food preference information into the terminal and sends it to the server.

[1059] 4. Acquiring emotional information:

[1060] Using the device's camera and microphone, emotional information is obtained from the user's facial expressions and voice and sent to the server.

[1061] 5. Menu confirmation and changes:

[1062] The proposed menu sent from the server is displayed on the terminal, and the user can check it and change it if necessary.

[1063] User Roles and Actions

[1064] Users can input their health checkup information, food preferences, and emotional information, confirm and change the suggested menu, and finally prepare a meal using the delivered ingredients. Specifically, the steps are as follows:

[1065] 1. Basic information provided:

[1066] Users provide basic information when using the system.

[1067] 2. Providing health checkup information:

[1068] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[1069] 3. Providing Food Preference Information:

[1070] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[1071] 4. Providing emotional information:

[1072] Emotions can be recognized using the device's camera or microphone, or the emotional state can be input directly.

[1073] 5. Menu confirmation and changes:

[1074] Review the proposed menu, decide if it suits you, and make any necessary changes.

[1075] 6. Receiving and Preparing Ingredients:

[1076] Receive ingredients delivered from the food delivery system and prepare dishes based on the suggested menu.

[1077] Specific examples

[1078] For example, a 30-year-old female user enters the following information:

[1079] Health checkup results: Vitamin D deficiency, mild high blood pressure

[1080] Food preferences: Likes fish, dislikes beef

[1081] Emotional state: Feeling stressed

[1082] 1. The user enters health check information, food preference information, and emotional information into the terminal and sends it to the server.

[1083] 2. The server processes the information and generates the menu item "Grilled Salmon with Spinach Salad."

[1084] 3. If the user reviews and agrees with the proposed menu, an ingredient list is generated and an order is automatically placed with the food delivery platform.

[1085] 4. The ingredients will be automatically delivered to the user on the specified date.

[1086] 5. The user uses the delivered ingredients to prepare a meal according to the suggested menu.

[1087] Prompt Sentence Examples

[1088] Sample prompt 1: "A 30-year-old woman with a vitamin D deficiency and mild high blood pressure. Her favorite food is fish, and her least favorite food is beef. She is currently feeling stressed. What is the best healthy menu for this user?"

[1089] Sample prompt 2: "50-year-old male, pre-diabetic, enjoys elegant meals, and is emotionally relaxed. Please suggest the best menu."

[1090] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1091] Step 1:

[1092] The device inputs the user's basic information (age, gender, weight, height, etc.) and sends this information to the server, where it is recorded in the user's basic database.

[1093] Step 2:

[1094] The terminal inputs the user's health checkup information (e.g., blood test results and blood pressure) and sends it to the server. The input health checkup data is stored in the health database (DBMS) on the server. Specifically, the user scans or manually inputs the health checkup results into the terminal and sends them to the server.

[1095] Step 3:

[1096] The device inputs the user's food preference information (likes and dislikes, allergies, etc.) and sends it to the server, where the input data is stored in the server's preference database.

[1097] Step 4:

[1098] The device uses the device's camera and microphone to analyze facial expressions and voice to obtain emotional information about the user. The obtained emotional information is sent to an emotion database on the server. Specifically, the device uses Google Cloud Vision API and AWS Rekognition to determine the emotion and sends the results to the server.

[1099] Step 5:

[1100] The device sends the collected user health check information, food preference information, and emotional information to a server, which stores this data and integrates it into a single profile.

[1101] Step 6:

[1102] The server runs a menu generation algorithm based on the received health checkup information, food preference information, and emotional information. The algorithm uses Python machine learning models (Scikit-learn and TensorFlow) to generate an optimal meal menu. Specific menu suggestions include "seafood dishes rich in vitamin D."

[1103] Step 7:

[1104] The server sends the generated menu to the terminal and presents it to the user. The user can check this menu and change it if necessary. The changed menu information is also sent back to the server.

[1105] Step 8:

[1106] The server generates a list of ingredients based on the finalized menu, and the generated list is stored in an ingredient list database.

[1107] Step 9:

[1108] The server sends the generated ingredient list to the partner food delivery system, which transfers the data via API communication and processes the specific order.

[1109] Step 10:

[1110] The user inputs their reaction to the proposed menu items on their device, and this reaction information is sent to the server, which uses it as data to improve future menu suggestions.

[1111] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1112] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1113] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1114] [Third embodiment]

[1115] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1116] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1117] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1118] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1119] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1120] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1121] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1122] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1123] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1124] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1125] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1126] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1127] Overall system configuration

[1128] This system is composed of a series of processes that generate the optimal menu for the user based on the user's health check information, food preference information, and past food ingredient data, create a list of necessary ingredients, and link with the food delivery system.The system consists of three main parts: the server, the terminal, and the user.

[1129] Server Roles and Operations

[1130] The server provides the following main functions:

[1131] 1. Receiving and storing health examination information:

[1132] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure.

[1133] 2. Receiving and storing your food preferences:

[1134] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[1135] 3. Generate the menu:

[1136] The server runs a menu generation algorithm based on the stored health checkup information and food preference information to generate an appropriate meal menu, for example, "stir-fried spinach and beef" for a user who is iron deficient.

[1137] 4. Generate the ingredients list:

[1138] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[1139] 5. Sending the Ingredient List:

[1140] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[1141] Device role and operation

[1142] The terminal transmits information input by the user to the server and provides an interface that presents data transmitted from the server to the user.

[1143] 1. Enter and submit basic information:

[1144] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends that data to the server.

[1145] 2. Enter and submit your medical examination information:

[1146] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[1147] 3. Enter and submit your food preferences:

[1148] The user inputs food preference information into the terminal and sends it to the server.

[1149] 4. Check and change the menu:

[1150] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[1151] User Roles and Actions

[1152] Users can input their health checkup information and food preferences, check and change the suggested menu, and finally prepare a meal using the delivered ingredients.

[1153] 1. Basic information provided:

[1154] Users provide basic information when using the system.

[1155] 2. Providing health checkup information:

[1156] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[1157] 3. Providing Food Preference Information:

[1158] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[1159] 4. Check and change the menu:

[1160] Review the proposed menu, decide if it suits you, and make any necessary changes.

[1161] 5. Receiving and Preparing Ingredients:

[1162] Receive ingredients delivered from the food delivery system and prepare meals based on the suggested menu.

[1163] Specific examples

[1164] For example, suppose a user is a 40-year-old man who was recently diagnosed with low iron in his blood during a medical checkup, and who also inputs that he likes chicken and dislikes broccoli.

[1165] 1. The user enters basic information, health check information, and food preference information into the terminal and sends it to the server.

[1166] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Spinach and Chicken Stir-fry."

[1167] 3. The server sends the generated menu to the user's device, where the user confirms it.

[1168] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[1169] 5. The food delivery system will deliver the ingredients on the specified date.

[1170] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[1171] In this way, users can easily obtain menus that suit their health condition and maintain a balanced diet.

[1172] The processing flow will be explained below.

[1173] Step 1:

[1174] The user opens the smartphone app and accesses the basic information entry screen, where they enter basic information such as age, gender, weight, and height.

[1175] Step 2:

[1176] The terminal receives the input basic information and sends it to the server.

[1177] Step 3:

[1178] The server saves the received basic information in the database. It creates a new entry in the user database and registers the basic information along with the user ID.

[1179] Step 4:

[1180] The user enters the results of their health check into the app, or the information is automatically retrieved from the linked medical institution's system.

[1181] Step 5:

[1182] The terminal receives the user's health checkup information and transmits it to the server.

[1183] Step 6:

[1184] The server analyzes the health checkup information and stores it in the health ranking database, linking it to the user ID. For example, it determines that the user has an iron deficiency based on the blood test results.

[1185] Step 7:

[1186] Users select their favorite and least favorite ingredients and food preferences in the app. For example, they could enter "Favorite ingredient: chicken" and "Dislike ingredient: broccoli."

[1187] Step 8:

[1188] The terminal receives the food preference information and transmits it to the server.

[1189] Step 9:

[1190] The server stores the preference information in a preference database, along with the user ID.

[1191] Step 10:

[1192] The server runs a menu generation algorithm based on the stored health checkup information, food preference information, and past delivery data to generate an appropriate meal menu. For example, it might suggest a menu including "stir-fried spinach and beef" for a user with iron deficiency.

[1193] Step 11:

[1194] The server sends the generated menu to the terminal for presentation to the user.

[1195] Step 12:

[1196] Users can review the suggested menu items in the app and make changes if necessary, for example, changing a menu item that contains an ingredient they dislike to another menu item.

[1197] Step 13:

[1198] The terminal receives the changed menu information and transmits it to the server.

[1199] Step 14:

[1200] The server finalizes the menu and generates the necessary ingredient list, which is then stored in the ingredient list database.

[1201] Step 15:

[1202] The server sends the generated ingredient list to the online supermarket or food delivery system, specifically, by sending the order information via API or email.

[1203] Step 16:

[1204] The food delivery system prepares the ingredients and delivers them to the address specified by the user.

[1205] Step 17:

[1206] The user receives the delivered ingredients and cooks based on the suggested menu. Cooking instructions and recipes can be viewed within the app.

[1207] Example 1

[1208] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1209] In today's world, it is difficult to easily obtain meal menus that cater to individual health conditions and food preferences. Furthermore, selecting and procuring ingredients based on individual needs is time-consuming, making effective nutritional management difficult. Furthermore, generating menus using a user's past ingredient data requires advanced data analysis and AI technology. There is a need for a system that can solve these issues and help users maintain their health and improve their dietary habits.

[1210] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1211] In this invention, the server includes means for receiving and storing health condition information, means for receiving and storing user dietary preference information, means for generating a menu using a generative AI model based on the health condition information and the dietary preference information, means for generating a list of necessary ingredients based on the generated menu, and means for transmitting the list of ingredients to a food delivery system. This enables automatic generation of an appropriate menu according to individual health conditions and dietary preferences, and efficient procurement of necessary ingredients.

[1212] "Health status information" is information related to the user's health, and includes, for example, blood test results, blood pressure, weight, body fat percentage, and the like.

[1213] "Dietary preference information" is information about the user's food preferences and disliked ingredients, such as data about favorite foods and disliked foods.

[1214] A "generative AI model" refers to an algorithm that uses artificial intelligence algorithms to analyze data and perform specific tasks to generate the optimal menu for the user.

[1215] The "list of ingredients" is a list of ingredients required based on the menu, and is data that includes the type and amount of each ingredient.

[1216] A "food delivery system" is a system that provides a network and services for delivering food ingredients specified by a user.

[1217] A "menu" is a meal suggestion for a user, including specific dish names, cooking methods, and nutritional information.

[1218] A "server" is a computer system that receives and stores data sent by users and processes it.

[1219] The "database" is a management system for storing received health status information, food preference information, past food ingredient data, and the like.

[1220] A "prompt" is a specific instruction or question that is entered when creating a menu using a generative AI model.

[1221] MODE FOR CARRYING OUT THE INVENTION

[1222] This invention is a system that generates optimal menus for users based on their health status information, food preference information, and past ingredient data, creates a list of necessary ingredients, and provides a series of processes that link with a food delivery system. The system consists of three main parts: a server, a terminal, and a user.

[1223] Server Roles and Operations

[1224] The server provides the following main functions: First, it receives and stores health status information by storing the data sent by the user in a database such as MySQL or PostgreSQL. Second, it receives and stores the user's dietary preference information and manages this information using DynamoDB or MongoDB.

[1225] The server runs a menu generation algorithm using a generative AI model (e.g., GPT-4) based on the stored health status information and food preference information to generate an appropriate meal menu. An example of this prompt sentence is, "40-year-old male user. Health checkup results show low iron in the blood. Prefers chicken and dislikes broccoli. Please generate an appropriate menu."

[1226] Based on the generated menu, the server creates a list of necessary ingredients and stores this list in an in-memory data store such as Redis. Furthermore, to send this list of ingredients to the food delivery system, the server uses the API of the online supermarket or food delivery service, utilizing a RESTful API using the HTTP protocol.

[1227] Device role and operation

[1228] The terminal sends the information entered by the user to the server and provides an interface that displays the data sent from the server to the user. The terminal can be an iOS or Android-based smartphone or PC.

[1229] Users input their health condition information, dietary preferences, and basic information (age, gender, weight, height, etc.) into the device. React or Flutter is used as the input form, and this data is sent to the server using the HTTPS protocol. Furthermore, the device can also connect to medical institutions' systems and automatically obtain health checkup information using the FHIR (Fast Healthcare Interoperability Resources) standard.

[1230] User Roles and Actions

[1231] Users input their health status and dietary preferences, confirm and modify the proposed menu, and finally prepare a meal using the delivered ingredients. The data entered by the user through the device is processed appropriately by the server, and the generated menu and list of ingredients are sent to the user's device. The user can review this and modify the menu as needed.

[1232] By receiving ingredients delivered by the food delivery system and cooking according to the recipes displayed on the device, customers can easily maintain a balanced diet.

[1233] This invention automatically generates a menu that matches the user's individual health condition and food preferences, enabling efficient food procurement.

[1234] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1235] Step 1:

[1236] The user enters basic information (age, gender, weight, height, etc.) into the device and sends that data to the server. The server creates an individual user profile based on this basic information and stores it in a database. The entered information is securely transmitted from the device via the HTTPS protocol, and the server stores the information in a database management system (DBMS).

[1237] Input: User's basic information (age, gender, weight, height, etc.)

[1238] Output: New user profile saved in database

[1239] Specific operation: The user enters basic information into the input form and presses the "Submit" button. The terminal sends the information to the server, which receives it and stores it in the database.

[1240] Step 2:

[1241] The user enters their health status information into the device and sends it to the server. The entered information can be uploaded as a PDF result from a medical institution or automatically obtained through the medical institution's API. The server receives this information and stores it in a database.

[1242] Input: User's health information (blood test results, blood pressure, etc.)

[1243] Output: Save health information to database

[1244] Specific operation: The user uploads the health checkup results to the terminal and sends them to the server, which then stores the received data in a database.

[1245] Step 3:

[1246] The user inputs food preference information (favorite ingredients, disliked ingredients, etc.) into the terminal and sends it to the server, which receives this information and stores it in a database.

[1247] Input: User's food preference information (favorite ingredients, disliked ingredients)

[1248] Output: Save preference information to database

[1249] Specific operation: The user answers questions in a questionnaire about their food preferences and sends the data from their device to the server, which then stores the received information in a database.

[1250] Step 4:

[1251] The server retrieves health status information and dietary preference information from the database and runs a menu generation algorithm using a generative AI model (e.g., GPT-4). This is the process of inputting specific prompts into the generative AI model to generate a menu.

[1252] Input: Health status information, dietary preference information

[1253] Output: The generated menu

[1254] Specific operation: The server retrieves the necessary information from the database, inputs the prompt statement "40-year-old male user. Health check results show low blood iron. Prefers chicken and dislikes broccoli. Please generate an appropriate menu" into the generative AI model, and retrieves the generated menu.

[1255] Step 5:

[1256] The server creates a list of ingredients needed based on the generated menu, identifies the ingredients and quantities needed for each dish on the generated menu, and stores this information in a database.

[1257] Input: Generated menu

[1258] Output: List of ingredients needed

[1259] Specific operation: The server analyzes the generated menu, lists the necessary ingredients and their quantities, and stores them in a database.

[1260] Step 6:

[1261] The server sends the generated list of ingredients to the food delivery system, and sends the order data using the API of the online supermarket or food delivery service.

[1262] Input: List of ingredients

[1263] Output: Order data sent to the food delivery system

[1264] Specific operation: The server sends the list of ingredients to the food delivery system's API and confirms the order of the necessary ingredients. The order status and delivery schedule can also be checked at the same time.

[1265] Step 7:

[1266] The user receives the delivered ingredients, cooks them based on the recipe displayed on the device, and finally, cooks based on the suggested menu and enjoys a balanced meal.

[1267] Input: Delivered ingredients

[1268] Output: Cooked food

[1269] Specific operation: The device checks the received ingredients and cooks them according to the recipe displayed on the device. The device delivers the finished dish, allowing the user to maintain a balanced diet.

[1270] (Application example 1)

[1271] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1272] Conventional meal menu suggestion systems can generate menus based on a user's health checkup information and food preferences, but they require users to manually order ingredients from the generated list, which is time-consuming. Furthermore, since the generated menus do not automatically order or arrange for delivery of ingredients, users have to go to the trouble of purchasing ingredients. There is a need to solve these problems and improve user convenience.

[1273] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1274] In this invention, the server includes means for receiving and saving health checkup information, means for receiving and saving user food preference information, means for generating a menu based on the health checkup information and the food preference information, means for generating a list of necessary ingredients based on the generated menu, means for transmitting the list of ingredients to the food delivery system, means for transmitting the health checkup information and food preference information input from the user's terminal to the server, means for displaying the data transmitted from the server to the user, and means for automatically ordering the list of ingredients corresponding to the proposed menu based on the application. This allows the user to easily receive a menu tailored to their health condition and food preferences, and enables the automatic ordering and delivery of necessary ingredients.

[1275] "Health checkup information" is data that indicates the user's health condition, and includes blood test results, blood pressure values, and the like.

[1276] "Food preference information" is personal information that indicates the user's favorite and least favorite ingredients, taste preferences, etc.

[1277] The "menu" refers to meal suggestions generated based on the health checkup information and the food preference information.

[1278] The "ingredients list" is a list of ingredients required based on the menu.

[1279] The "food delivery system" is a system for delivering ingredients to users based on the ingredient list.

[1280] A "server" is a computer system that stores information received from users and generates menus and ingredient lists.

[1281] A "terminal" is an electronic device that transmits information entered by a user to a server and displays data transmitted from the server to the user.

[1282] The "automatic ordering means" is a means for automatically ordering ingredients from an affiliated food delivery system based on the generated ingredient list.

[1283] "Delivery arrangement" refers to making arrangements for the delivery of ingredients at a date and time specified by the user based on the generated ingredient list.

[1284] The "menu generation means" refers to an algorithm or program for generating a meal menu suited to a user based on health checkup information and food preference information.

[1285] Overall system configuration

[1286] This system is composed of a series of processes that generate the optimal menu for the user based on the user's health check information, food preference information, and past food ingredient data, create a list of necessary ingredients, and link with the food delivery system.The system consists of three main parts: the server, the terminal, and the user.

[1287] Server Roles and Operations

[1288] The server provides the following main functions:

[1289] 1. Receiving and storing health examination information:

[1290] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure.

[1291] 2. Receiving and storing your food preferences:

[1292] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[1293] 3. Generate the menu:

[1294] The server runs a menu generation algorithm based on the stored health checkup information and food preference information to generate an appropriate meal menu, for example, "stir-fried spinach and beef" for a user who is iron deficient.

[1295] 4. Generate the ingredients list:

[1296] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[1297] 5. Sending the Ingredient List:

[1298] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[1299] 6. Automated ordering methods:

[1300] The server automatically places an order for the created ingredient list to an affiliated food delivery system.

[1301] Device role and operation

[1302] The terminal transmits the information entered by the user to the server and provides an interface that presents the data transmitted by the server to the user:

[1303] 1. Enter and submit basic information:

[1304] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends that data to the server.

[1305] 2. Enter and submit your medical examination information:

[1306] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[1307] 3. Enter and submit your food preferences:

[1308] The user inputs food preference information into the terminal and sends it to the server.

[1309] 4. Check and change the menu:

[1310] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[1311] User Roles and Actions

[1312] Users input their health and food preferences, review and modify the suggested menu, and finally prepare a meal using the delivered ingredients:

[1313] 1. Basic information provided:

[1314] Users provide basic information when using the system.

[1315] 2. Providing health checkup information:

[1316] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[1317] 3. Providing Food Preference Information:

[1318] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[1319] 4. Check and change the menu:

[1320] Review the proposed menu, decide if it suits you, and make any necessary changes.

[1321] 5. Receiving and Preparing Ingredients:

[1322] Receive ingredients delivered from the food delivery system and prepare meals based on the suggested menu.

[1323] Specific examples

[1324] For example, suppose a user is a 40-year-old man who was recently diagnosed with high blood pressure during a medical checkup, and also enters information that he likes chicken and dislikes salty foods.

[1325] 1. The user enters basic information, health check information, and food preference information into the terminal and sends it to the server.

[1326] 2. Based on the information received, the server runs a menu generation algorithm and generates a menu item called Low-salt Steamed Chicken.

[1327] 3. The server sends the generated menu to the user's device, where the user confirms it.

[1328] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the affiliated online supermarket.

[1329] 5. The food delivery system will deliver the ingredients on the specified date.

[1330] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[1331] This allows users to easily obtain menus suited to their health condition, smoothly receive the necessary ingredients, and maintain a balanced diet.

[1332] Example prompt sentence:

[1333] User's health check information: "High blood pressure"

[1334] Food preference information: "Favourite food: Chicken" "Disliked food: Salty food"

[1335] Generated menu: Low-sodium steamed chicken

[1336] Generated ingredients list: Chicken, carrots, spinach, low-sodium spices

[1337] Ordering process: Send ingredient list to online supermarket => Ingredients are delivered on the specified date and time

[1338] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1339] Step 1:

[1340] The user enters basic information (age, gender, weight, height) into the device and sends that data to the server. The entered basic information is format-checked on the device (checking required fields, format consistency, etc.) and then sent to the server in JSON format. The server stores the received information in a user information database.

[1341] Step 2:

[1342] The user enters health checkup information (blood test results, blood pressure, etc.) into the device and sends it to the server. The entered health checkup information is checked for format on the device and then sent to the server in the same JSON format. The server stores the received health checkup information in a health information database. In some cases, the server may also link with the medical institution's system to automatically obtain health checkup data.

[1343] Step 3:

[1344] The user inputs food preference information (favorite ingredients, disliked ingredients, etc.) into the device and sends it to the server. The input food preference information is checked for format and then sent to the server in JSON format. The server stores the received information in a preference database.

[1345] Step 4:

[1346] The server runs a menu generation algorithm based on the stored health checkup information and food preference information. Based on the algorithm, the server generates a menu that best suits the input information, associates it with the user information, and stores it in a menu list database. For example, a user who is iron deficient might be suggested a spinach and chicken stir-fry.

[1347] Step 5:

[1348] The server sends the generated menu to the terminal and displays it to the user. The menu sent from the server is received by the terminal and displayed in a format that is easy for the user to understand. The user can check the proposed menu and make changes as needed (for example, to reduce the salt content). The changed menu is then sent back to the server.

[1349] Step 6:

[1350] The server generates an ingredient list based on the finalized menu. The ingredient list includes the ingredients and quantities required for the dish obtained from the menu generation algorithm and is stored in the ingredient list database.

[1351] Step 7:

[1352] The server executes an automatic ordering process to send the generated ingredient list to the food delivery system. The automatic ordering process sends the ingredient list to affiliated online supermarkets and food delivery services, and the ordering process is carried out.

[1353] Step 8:

[1354] The food delivery system prepares ingredients based on the received ingredient list and delivers them to the user at the specified date and time. To ensure that the delivery system delivers the ingredients appropriately, delivery schedules and address information are sent in advance from the server.

[1355] Step 9:

[1356] Users receive ingredients at the specified date and time and prepare meals based on the suggested menu. They can use their smartphones, tablets, or other devices to check the recipes while cooking.

[1357] By following these steps, users can easily obtain menus tailored to their health condition and food preferences, and quickly receive the ingredients they need.

[1358] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1359] Overall system configuration

[1360] This system generates the optimal menu for the user based on the user's health checkup information, food preference information, and emotional information, creates a list of necessary ingredients, and connects with the food delivery system.The system consists of three main parts: a server, a terminal, and the user.

[1361] Server Roles and Operations

[1362] The server provides the following main functions:

[1363] 1. Receiving and storing health examination information:

[1364] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure information.

[1365] 2. Receiving and storing your food preferences:

[1366] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[1367] 3. Emotion engine recognizes and stores emotional information:

[1368] The server uses an emotion engine to acquire emotional information through user input, facial expression analysis, and voice recognition. The acquired emotional information is stored in an emotion database and managed by linking it to the user ID.

[1369] 4. Generate the menu:

[1370] The server runs a menu generation algorithm based on health checkup information, food preferences, and emotional information to generate an appropriate meal menu. For example, it might suggest "stir-fried beef and vegetables" to a user who is iron deficient and under high stress.

[1371] 5. Generate the ingredients list:

[1372] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[1373] 6. Sending the Ingredient List:

[1374] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[1375] 7. User response recording and menu improvements:

[1376] The server records the user's reaction to the suggested menu based on the user's emotions received from the emotion engine, and improves the menu suggestions for the next time and thereafter.

[1377] Device role and operation

[1378] The terminal transmits information input by the user to the server and provides an interface that presents data transmitted from the server to the user.

[1379] 1. Enter and submit basic information:

[1380] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends the data to the server.

[1381] 2. Enter and submit your medical examination information:

[1382] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[1383] 3. Enter and submit your food preferences:

[1384] The user inputs food preference information into the terminal and sends it to the server.

[1385] 4. Acquiring emotional information using the emotion engine:

[1386] The user can input their own emotions through the device, or emotions can be recognized from facial expressions and voice through the device's camera and microphone.

[1387] 5. Menu confirmation and changes:

[1388] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[1389] User Roles and Actions

[1390] Users input their health checkup information, food preferences, and emotional information, confirm and change the suggested menu, and finally prepare a meal using the delivered ingredients.

[1391] 1. Basic information provided:

[1392] Users provide basic information when using the system.

[1393] 2. Providing health checkup information:

[1394] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[1395] 3. Providing Food Preference Information:

[1396] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[1397] 4. Providing emotional information:

[1398] Emotions can be recognized using the device's camera or microphone, or the emotional state can be input directly.

[1399] 5. Menu confirmation and changes:

[1400] Review the proposed menu, decide if it suits you, and make any necessary changes.

[1401] 6. Receiving and Preparing Ingredients:

[1402] Receive ingredients delivered from the food delivery system and prepare dishes based on the suggested menu.

[1403] Specific examples

[1404] For example, suppose the user is a 30-year-old woman who was recently diagnosed with a vitamin D deficiency in a medical checkup. She also inputs information that she likes fish and dislikes beef, and the emotion engine recognizes that she is stressed.

[1405] 1. The user enters basic information, health check information, food preference information, and emotional information into the terminal and sends it to the server.

[1406] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Grilled Salmon and Spinach Salad."

[1407] 3. The server sends the generated menu to the user's device, where the user confirms it.

[1408] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[1409] 5. The food delivery system will deliver the ingredients on the specified date.

[1410] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[1411] In this way, users can easily obtain menus that suit their health and emotional state and maintain a balanced diet.

[1412] The processing flow will be explained below.

[1413] Step 1:

[1414] The user opens the smartphone app and accesses the basic information entry screen, where they enter basic information such as age, gender, weight, and height.

[1415] Step 2:

[1416] The terminal receives the input basic information and sends it to the server.

[1417] Step 3:

[1418] The server saves the received basic information in the database. It creates a new entry in the user database and registers the basic information along with the user ID.

[1419] Step 4:

[1420] The user enters the results of their health check into the app, or the information is automatically retrieved from the linked medical institution's system.

[1421] Step 5:

[1422] The terminal receives the user's health checkup information and transmits it to the server.

[1423] Step 6:

[1424] The server analyzes the health checkup information and stores it in the health ranking database, linking it to the user ID. For example, it determines that a person is deficient in vitamin D based on the blood test results.

[1425] Step 7:

[1426] The user selects their favorite and least favorite ingredients and food preferences in the app. For example, they can enter "Favorite ingredient: fish" and "Dislike ingredient: beef."

[1427] Step 8:

[1428] The terminal receives the food preference information and transmits it to the server.

[1429] Step 9:

[1430] The server stores the preference information in a preference database, along with the user ID.

[1431] Step 10:

[1432] The device activates a camera and microphone to recognize the user's emotions and capture facial expressions and voice characteristics.

[1433] Step 11:

[1434] The device uses an emotion engine to analyze the user's emotional state based on facial expressions and voice characteristics, for example, determining that the user is feeling stressed.

[1435] Step 12:

[1436] The device sends the analysis results to the server.

[1437] Step 13:

[1438] The server stores the received emotion information in an emotion database and associates it with the user ID.

[1439] Step 14:

[1440] The server runs a menu generation algorithm based on the stored health check information, food preference information, and emotional information to generate an appropriate meal menu. For example, for a user who is feeling stressed due to a vitamin D deficiency, it would generate "grilled salmon and spinach salad."

[1441] Step 15:

[1442] The server sends the generated menu to the terminal for presentation to the user.

[1443] Step 16:

[1444] Users can review the suggested menu items in the app and make changes if necessary. For example, if you like fish, you can accept the "grilled salmon" option, or if you don't like beef, you can change the menu item that includes it to another option.

[1445] Step 17:

[1446] The terminal receives the changed menu information and transmits it to the server.

[1447] Step 18:

[1448] The server finalizes the menu and generates the necessary ingredient list, which is then stored in the ingredient list database.

[1449] Step 19:

[1450] The server sends the generated ingredient list to an online supermarket or food delivery system, for example, by sending the order information via API or email.

[1451] Step 20:

[1452] The food delivery system prepares the ingredients and delivers them to the address specified by the user.

[1453] Step 21:

[1454] The user receives the delivered ingredients and cooks based on the suggested menu. Cooking instructions and recipes can be viewed within the app.

[1455] Step 22:

[1456] The server records the user's reaction using an emotion engine and reflects it in future menu suggestions.

[1457] Example 2

[1458] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1459] Conventional dietary management systems only consider the user's health status and food preferences when proposing menus, but do not provide personalized menu suggestions that reflect the user's emotional state. This often results in users being dissatisfied with the proposed menus, limiting the effectiveness of the system. Furthermore, the system lacks the functionality to continuously improve the menus based on user feedback, making it difficult to propose optimal menus for each user.

[1460] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving and saving health checkup information, means for receiving and saving user food preference information, means for acquiring and saving emotional information, means for generating a menu based on the health checkup information, the food preference information, and the emotional information, means for generating a list of ingredients based on the generated menu, and means for transmitting the list of ingredients to the food delivery system. This enables personalized menu suggestions that take into account not only the user's health status but also their food preferences and emotional state. Furthermore, by continuously improving the menu based on user feedback, it is possible to provide each user with a more appropriate and satisfying meal menu.

[1461] "Health checkup information" is data indicating the health condition of the user, and includes diagnostic results provided by medical institutions, such as blood test results, blood pressure, and cholesterol levels.

[1462] "Food preference information" is data that indicates the user's food preferences, such as the user's favorite and least favorite ingredients, and allergy information.

[1463] "Emotion information" is data that indicates the emotional state of the user, and includes the emotional state obtained by the emotion engine from facial expression and voice analysis, as well as the emotional state input by the user himself.

[1464] The "means for generating a menu" refers to a method including an algorithm and a generative AI model for generating an optimal meal menu for a user based on health checkup information, food preference information, and emotional information.

[1465] The "means for generating a list of ingredients" is a technique that includes algorithms and databases for creating a list of ingredients required based on the generated menu.

[1466] A "food delivery system" is an external system for delivering food ingredients to users, such as an online supermarket or food delivery service.

[1467] The "means for accepting user confirmation and changes" refers to a technique that includes an interface that allows the user to confirm the proposed menu and make changes as necessary, and an algorithm for reflecting those changes.

[1468] This system generates the optimal menu for a user based on their health checkup information, food preferences, and emotional information, creates a list of necessary ingredients, and connects with a food delivery system. The system consists of three main parts: a server, a terminal, and a user. The specific operation of each part is explained below.

[1469] Server Roles and Operations

[1470] Receiving and storing health examination information

[1471] The server receives the health checkup information sent by the user and stores it in a health database, including blood test results and blood pressure, allowing for continuous analysis of the user's health status.

[1472] Receiving and storing user food preference information

[1473] The server receives the food preference information sent by the user and stores it in a preference database. For example, it stores information such as "Favorite food: chicken" and "Disliked food: broccoli." This makes it possible to suggest menu items according to the user's preferences.

[1474] Emotion engine recognizes and stores emotional information

[1475] The server uses an emotion engine to acquire emotional information through user input, facial expression analysis, and voice recognition, and stores it in an emotion database, enabling it to propose menus according to the user's emotional state.

[1476] Generate Menu

[1477] The server uses a generative AI model to generate the optimal menu based on health checkup information, food preferences, and emotional information. For example, it would suggest "stir-fried beef and vegetables" to a user who is iron deficient and under high stress. This process is carried out by a menu generation algorithm.

[1478] Generate an ingredient list

[1479] Based on the generated menu, the server creates a list of ingredients needed and stores it in an ingredient list database, which indicates the specific ingredients that the user needs to purchase.

[1480] Sending an Ingredient List

[1481] The generated ingredient list is sent to the food delivery system, specifically, the order data is sent to the online supermarket or food delivery service.

[1482] User response recording and menu improvements

[1483] The server records the user's reaction to the proposed menu based on the user's emotions received from the emotion engine and reflects this in future menu suggestions, thereby providing a menu customized for each user.

[1484] Device role and operation

[1485] Enter and submit basic information

[1486] The user uses the device to input basic information (age, gender, weight, height, etc.) and sends that data to the server, which then obtains the user's basic health information.

[1487] Enter and submit health check information

[1488] Users enter their health checkup results into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically obtain information. This simplifies the input of diagnostic information and improves accuracy.

[1489] Enter and submit food preference information

[1490] The user inputs their food preferences into the terminal and sends them to the server, which then proposes a meal menu that reflects the user's preferences.

[1491] Acquiring emotional information using an emotion engine

[1492] The user can input their own emotions through the device, or emotions can be recognized from facial expressions and voice via the device's camera and microphone, making it possible to grasp the user's emotional state in real time.

[1493] Check and change the menu

[1494] The proposed menu sent from the server is displayed on the terminal, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[1495] User Roles and Actions

[1496] Provision of basic information

[1497] Users provide basic information when using the system, which lays the foundation for the system to suggest optimal menus based on the user's individual information.

[1498] Providing health checkup information

[1499] Enter your latest health checkup information into the system, or link it with your medical institution's system to automatically provide the information, so that the latest health data is reflected in the menu generation.

[1500] Providing information about food preferences

[1501] Users input information about their food preferences, disliked ingredients, and how to avoid nutritional imbalances, and the system will suggest menus that reflect their tastes.

[1502] Providing emotional information

[1503] Emotions can be recognized using the device's camera and microphone, or emotional state can be input directly, allowing for meal suggestions based on the emotional state.

[1504] Check and change the menu

[1505] Review the suggested menu, decide if it's right for you, and make changes if necessary, incorporating your feedback in real time.

[1506] Receiving and preparing ingredients

[1507] The system receives ingredients from a food delivery system and prepares meals based on suggested menus, allowing customers to maintain a healthy and personalized diet.

[1508] Specific examples

[1509] For example, suppose the user is a 30-year-old woman who was recently diagnosed with a vitamin D deficiency in her health checkup. She also inputs information that she likes fish and dislikes beef, and the emotion engine recognizes that she is stressed. In this case, the specific steps are as follows:

[1510] 1. The user enters basic information, health check information, food preference information, and emotional information into the terminal and sends it to the server.

[1511] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Grilled Salmon and Spinach Salad."

[1512] 3. The server sends the generated menu to the user's device, and the user confirms it.

[1513] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[1514] 5. The food delivery system will deliver the ingredients on the specified date.

[1515] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[1516] As described above, users can easily obtain menus that suit their own health and emotional state, and maintain a balanced diet.

[1517] Prompt Sentence Examples

[1518] An example of a prompt sentence is, "Please suggest the optimal meal menu for a user who is 30 years old, female, has a vitamin D deficiency, likes fresh fish, dislikes beef, and feels stressed." By inputting this prompt sentence into the generative AI model, personalized menu suggestions can be obtained.

[1519] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1520] Step 1:

[1521] Input: Basic information (age, gender, weight, height, etc.)

[1522] Processing: The user starts the device and enters basic information according to the on-screen instructions. The device then sends the entered data to the server in real time.

[1523] Output: Basic information stored in the server's database, so that the server knows the user's basic health information.

[1524] Specific operation: The user enters information such as "age 30, female, weight 60 kg, height 165 cm" into an input form, and the information is sent to the server.

[1525] Step 2:

[1526] Input: Health checkup results

[1527] Processing: The user enters the results of the health check into the terminal and sends the data to the server. It is also possible to automatically obtain information by linking with the medical institution's system.

[1528] Output: Health check information stored in the server's health database.

[1529] Specific operation: A user accesses the site and enters blood test results or blood pressure, or data provided by a medical institution is automatically sent to the server.

[1530] Step 3:

[1531] Input: Food preference information

[1532] Processing: The user inputs information about their food preferences, such as favorite ingredients, disliked ingredients, and allergy information, and sends the data to the server.

[1533] Output: Food preference information stored in the server's preference database.

[1534] Specific operation: The user enters information such as "Favorite food: fish, Disliked food: beef, Allergy: peanuts" and sends it to the server.

[1535] Step 4:

[1536] Input: Emotion information

[1537] Processing: The user inputs emotional information using the device's camera or microphone, or the emotion engine automatically analyzes emotional information from facial expressions and voice and sends the data to the server.

[1538] Output: Emotion information stored in the emotion database on the server.

[1539] Specific operation: The user types "I feel stressed," or the device's camera and microphone analyze the user's facial expressions and tone of voice and recognize that they are "highly stressed."

[1540] Step 5:

[1541] Input: Health checkup information, food preference information, emotional information

[1542] Processing: The server uses this information to generate an optimal meal menu using a generative AI model.

[1543] Output: The generated menu information.

[1544] Specific behavior: The server generates a menu such as "Grilled salmon and spinach salad for a user with a vitamin D deficiency and high stress level."

[1545] Step 6:

[1546] Input: Generated menu

[1547] Processing: The server sends the generated menu to the terminal, where the user confirms it. If necessary, the user can modify the menu and send it back to the server.

[1548] Output: The final menu that is confirmed after user confirmation.

[1549] Specific behavior: The device displays a menu suggestion of "Grilled salmon and spinach salad," which the user can review and accept or change.

[1550] Step 7:

[1551] Input: Final menu confirmed

[1552] Processing: The server creates a list of ingredients based on the confirmed menu and sends the list to the food delivery system.

[1553] Output: A list of ingredients sent to the food delivery system.

[1554] Specific operation: The server generates a list such as "salmon, spinach, lemon, olive oil" and sends it to the online supermarket as order data.

[1555] Step 8:

[1556] Input: Delivery data from food delivery system

[1557] Processing: The food delivery system delivers the ingredients to the user's address at the specified date and time.

[1558] Output: The ingredients delivered to the user.

[1559] Specific operation: The food delivery system delivers ingredients such as "salmon, spinach" to the user's address, and the user picks them up.

[1560] Step 9:

[1561] Input: Proposed menu and ingredients received

[1562] Process: The user cooks the food based on the suggested menu.

[1563] Output: A cooked meal.

[1564] Specific Action: The user follows instructions to cook a dish, such as "grill salmon and prepare a spinach salad."

[1565] In this way, the server processes and calculates the data based on the information entered at each step, generating the optimal menu and ingredient list, and realizing a diet that suits the user's health and emotional state.

[1566] (Application example 2)

[1567] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1568] Conventional meal recommendation systems generate menus and create ingredient lists based solely on the user's health checkup information and food preference information. However, no system was available that could provide individually optimized meal recommendations that took into account the user's emotional state and daily changes in mental state. This created a need for a system that could suggest meals that matched not only the user's health condition and food preferences, but also their emotions. Additionally, a system was needed that could provide feedback on the user's reactions to the suggested menus and further improve future meal recommendations.

[1569] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1570] In this invention, the server includes means for receiving and storing health checkup information, means for receiving and storing user food preference information, means for receiving and storing emotion information including facial expression analysis and voice recognition, means for generating a menu based on the health checkup information, the food preference information, and the emotion information, means for generating a list of ingredients based on the generated menu, means for transmitting the list of ingredients to a food delivery system, and means for improving future menu suggestions based on the user's responses. This enables personalized, optimized meal suggestions based on multifaceted information including the user's emotional state, thereby providing a healthy and stress-conscious dietary lifestyle.

[1571] "Health checkup information" refers to test results and diagnostic data regarding the user's health condition, including blood test results and blood pressure.

[1572] "Food preference information" refers to personal food preference data such as the user's favorite ingredients, disliked ingredients, allergies, etc.

[1573] "Emotional information" refers to data that indicates the user's emotional state obtained by analyzing their facial expressions and voice.

[1574] The "menu generation means" refers to a means for automatically creating an optimal meal menu based on health checkup information, food preference information, and emotional information.

[1575] The "ingredient list generating means" refers to a means for creating a list of necessary ingredients based on the generated menu.

[1576] "Food delivery system" refers to a system for delivering food to users based on a created ingredient list.

[1577] "Response history" refers to data regarding changes in the user's evaluation and emotions regarding proposed menu items.

[1578] Overall system configuration

[1579] The system of the present invention generates the optimal menu for the user based on the user's health checkup information, food preference information, and emotional information, creates a list of necessary ingredients, and links with the food delivery system. The system consists of three main parts: a server, a terminal, and the user.

[1580] Server Roles and Operations

[1581] The server provides the following main functions:

[1582] 1. Receiving and storing health examination information:

[1583] It receives health checkup information sent by users and stores it in a database. For example, it stores information such as blood test results and blood pressure. The hardware used includes a server computer, and the software is a database management system (DBMS).

[1584] 2. Receiving and storing your food preferences:

[1585] It also receives food preference information sent by users and stores it in a database. For example, it stores information such as "Favorite food: chicken" and "Disliked food: broccoli."

[1586] 3. Acquisition and storage of emotional information:

[1587] The emotion engine uses Google Cloud Vision API and AWS Rekognition to acquire emotional information through facial expression analysis and voice recognition, and stores it in an emotion database.

[1588] 4. Menu generation algorithm:

[1589] Based on health checkup information, food preference information, and emotional information, a menu generation algorithm is run to generate the optimal meal menu. Specifically, machine learning algorithms using Python (such as Scikit-learn and TensorFlow) are used.

[1590] 5. Generate the ingredients list:

[1591] Create a list of ingredients needed based on the generated menu.

[1592] 6. Sending the Ingredient List:

[1593] The generated ingredient list is sent to the partner food delivery system via API communication.

[1594] 7. User response recording and menu improvements:

[1595] Record user responses to suggested menu items to improve future menu suggestions.

[1596] Device role and operation

[1597] The terminal sends the information entered by the user to the server and provides an interface that displays the data sent from the server to the user. Specifically, it has the following functions:

[1598] 1. Enter and submit basic information:

[1599] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends it to the server.

[1600] 2. Enter and submit your medical examination information:

[1601] The user enters the results of their health checkup into the terminal and sends them to the server. In some cases, it is possible to link with the medical institution's system and automatically obtain the information.

[1602] 3. Enter and submit your food preferences:

[1603] The user inputs food preference information into the terminal and sends it to the server.

[1604] 4. Acquiring emotional information:

[1605] Using the device's camera and microphone, emotional information is obtained from the user's facial expressions and voice and sent to the server.

[1606] 5. Menu confirmation and changes:

[1607] The proposed menu sent from the server is displayed on the terminal, and the user can check it and change it if necessary.

[1608] User Roles and Actions

[1609] Users can input their health checkup information, food preferences, and emotional information, confirm and change the suggested menu, and finally prepare a meal using the delivered ingredients. Specifically, the steps are as follows:

[1610] 1. Basic information provided:

[1611] Users provide basic information when using the system.

[1612] 2. Providing health checkup information:

[1613] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[1614] 3. Providing Food Preference Information:

[1615] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[1616] 4. Providing emotional information:

[1617] Emotions can be recognized using the device's camera or microphone, or the emotional state can be input directly.

[1618] 5. Menu confirmation and changes:

[1619] Review the proposed menu, decide if it suits you, and make any necessary changes.

[1620] 6. Receiving and Preparing Ingredients:

[1621] Receive ingredients delivered from the food delivery system and prepare dishes based on the suggested menu.

[1622] Specific examples

[1623] For example, a 30-year-old female user enters the following information:

[1624] Health checkup results: Vitamin D deficiency, mild high blood pressure

[1625] Food preferences: Likes fish, dislikes beef

[1626] Emotional state: Feeling stressed

[1627] 1. The user enters health check information, food preference information, and emotional information into the terminal and sends it to the server.

[1628] 2. The server processes the information and generates the menu item "Grilled Salmon with Spinach Salad."

[1629] 3. If the user reviews and agrees with the proposed menu, an ingredient list is generated and an order is automatically placed with the food delivery platform.

[1630] 4. The ingredients will be automatically delivered to the user on the specified date.

[1631] 5. The user uses the delivered ingredients to prepare a meal according to the suggested menu.

[1632] Prompt Sentence Examples

[1633] Sample prompt 1: "A 30-year-old woman with a vitamin D deficiency and mild high blood pressure. Her favorite food is fish, and her least favorite food is beef. She is currently feeling stressed. What is the best healthy menu for this user?"

[1634] Sample prompt 2: "50-year-old male, pre-diabetic, enjoys elegant meals, and is emotionally relaxed. Please suggest the best menu."

[1635] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1636] Step 1:

[1637] The device inputs the user's basic information (age, gender, weight, height, etc.) and sends this information to the server, where it is recorded in the user's basic database.

[1638] Step 2:

[1639] The terminal inputs the user's health checkup information (e.g., blood test results and blood pressure) and sends it to the server. The input health checkup data is stored in the health database (DBMS) on the server. Specifically, the user scans or manually inputs the health checkup results into the terminal and sends them to the server.

[1640] Step 3:

[1641] The device inputs the user's food preference information (likes and dislikes, allergies, etc.) and sends it to the server, where the input data is stored in the server's preference database.

[1642] Step 4:

[1643] The device uses the device's camera and microphone to analyze facial expressions and voice to obtain emotional information about the user. The obtained emotional information is sent to an emotion database on the server. Specifically, the device uses Google Cloud Vision API and AWS Rekognition to determine the emotion and sends the results to the server.

[1644] Step 5:

[1645] The device sends the collected user health check information, food preference information, and emotional information to a server, which stores this data and integrates it into a single profile.

[1646] Step 6:

[1647] The server runs a menu generation algorithm based on the received health checkup information, food preference information, and emotional information. The algorithm uses Python machine learning models (Scikit-learn and TensorFlow) to generate an optimal meal menu. Specific menu suggestions include "seafood dishes rich in vitamin D."

[1648] Step 7:

[1649] The server sends the generated menu to the terminal and presents it to the user. The user can check this menu and change it if necessary. The changed menu information is also sent back to the server.

[1650] Step 8:

[1651] The server generates a list of ingredients based on the finalized menu, and the generated list is stored in an ingredient list database.

[1652] Step 9:

[1653] The server sends the generated ingredient list to the partner food delivery system, which transfers the data via API communication and processes the specific order.

[1654] Step 10:

[1655] The user inputs their reaction to the proposed menu items on their device, and this reaction information is sent to the server, which uses it as data to improve future menu suggestions.

[1656] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1657] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1658] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1659] [Fourth embodiment]

[1660] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1661] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1662] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1663] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1664] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1665] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1666] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1667] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1668] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1669] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1670] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1671] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1672] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1673] Overall system configuration

[1674] This system is composed of a series of processes that generate the optimal menu for the user based on the user's health check information, food preference information, and past food ingredient data, create a list of necessary ingredients, and link with the food delivery system.The system consists of three main parts: the server, the terminal, and the user.

[1675] Server Roles and Operations

[1676] The server provides the following main functions:

[1677] 1. Receiving and storing health examination information:

[1678] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure.

[1679] 2. Receiving and storing your food preferences:

[1680] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[1681] 3. Generate the menu:

[1682] The server runs a menu generation algorithm based on the stored health checkup information and food preference information to generate an appropriate meal menu, for example, "stir-fried spinach and beef" for a user who is iron deficient.

[1683] 4. Generate the ingredients list:

[1684] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[1685] 5. Sending the Ingredient List:

[1686] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[1687] Device role and operation

[1688] The terminal transmits information input by the user to the server and provides an interface that presents data transmitted from the server to the user.

[1689] 1. Enter and submit basic information:

[1690] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends that data to the server.

[1691] 2. Enter and submit your medical examination information:

[1692] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[1693] 3. Enter and submit your food preferences:

[1694] The user inputs food preference information into the terminal and sends it to the server.

[1695] 4. Check and change the menu:

[1696] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[1697] User Roles and Actions

[1698] Users can input their health checkup information and food preferences, check and change the suggested menu, and finally prepare a meal using the delivered ingredients.

[1699] 1. Basic information provided:

[1700] Users provide basic information when using the system.

[1701] 2. Providing health checkup information:

[1702] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[1703] 3. Providing Food Preference Information:

[1704] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[1705] 4. Check and change the menu:

[1706] Review the proposed menu, decide if it suits you, and make any necessary changes.

[1707] 5. Receiving and Preparing Ingredients:

[1708] Receive ingredients delivered from the food delivery system and prepare meals based on the suggested menu.

[1709] Specific examples

[1710] For example, suppose a user is a 40-year-old man who was recently diagnosed with low iron in his blood during a medical checkup, and who also inputs that he likes chicken and dislikes broccoli.

[1711] 1. The user enters basic information, health check information, and food preference information into the terminal and sends it to the server.

[1712] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Spinach and Chicken Stir-fry."

[1713] 3. The server sends the generated menu to the user's device, where the user confirms it.

[1714] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[1715] 5. The food delivery system will deliver the ingredients on the specified date.

[1716] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[1717] In this way, users can easily obtain menus that suit their health condition and maintain a balanced diet.

[1718] The processing flow will be explained below.

[1719] Step 1:

[1720] The user opens the smartphone app and accesses the basic information entry screen, where they enter basic information such as age, gender, weight, and height.

[1721] Step 2:

[1722] The terminal receives the input basic information and sends it to the server.

[1723] Step 3:

[1724] The server saves the received basic information in the database. It creates a new entry in the user database and registers the basic information along with the user ID.

[1725] Step 4:

[1726] The user enters the results of their health check into the app, or the information is automatically retrieved from the linked medical institution's system.

[1727] Step 5:

[1728] The terminal receives the user's health checkup information and transmits it to the server.

[1729] Step 6:

[1730] The server analyzes the health checkup information and stores it in the health ranking database, linking it to the user ID. For example, it determines that the user has an iron deficiency based on the blood test results.

[1731] Step 7:

[1732] Users select their favorite and least favorite ingredients and food preferences in the app. For example, they could enter "Favorite ingredient: chicken" and "Dislike ingredient: broccoli."

[1733] Step 8:

[1734] The terminal receives the food preference information and transmits it to the server.

[1735] Step 9:

[1736] The server stores the preference information in a preference database, along with the user ID.

[1737] Step 10:

[1738] The server runs a menu generation algorithm based on the stored health checkup information, food preference information, and past delivery data to generate an appropriate meal menu. For example, it might suggest a menu including "stir-fried spinach and beef" for a user with iron deficiency.

[1739] Step 11:

[1740] The server sends the generated menu to the terminal for presentation to the user.

[1741] Step 12:

[1742] Users can review the suggested menu items in the app and make changes if necessary, for example, changing a menu item that contains an ingredient they dislike to another menu item.

[1743] Step 13:

[1744] The terminal receives the changed menu information and transmits it to the server.

[1745] Step 14:

[1746] The server finalizes the menu and generates the necessary ingredient list, which is then stored in the ingredient list database.

[1747] Step 15:

[1748] The server sends the generated ingredient list to the online supermarket or food delivery system, specifically, by sending the order information via API or email.

[1749] Step 16:

[1750] The food delivery system prepares the ingredients and delivers them to the address specified by the user.

[1751] Step 17:

[1752] The user receives the delivered ingredients and cooks based on the suggested menu. Cooking instructions and recipes can be viewed within the app.

[1753] Example 1

[1754] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1755] In today's world, it is difficult to easily obtain meal menus that cater to individual health conditions and food preferences. Furthermore, selecting and procuring ingredients based on individual needs is time-consuming, making effective nutritional management difficult. Furthermore, generating menus using a user's past ingredient data requires advanced data analysis and AI technology. There is a need for a system that can solve these issues and help users maintain their health and improve their dietary habits.

[1756] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1757] In this invention, the server includes means for receiving and storing health condition information, means for receiving and storing user dietary preference information, means for generating a menu using a generative AI model based on the health condition information and the dietary preference information, means for generating a list of necessary ingredients based on the generated menu, and means for transmitting the list of ingredients to a food delivery system. This enables automatic generation of an appropriate menu according to individual health conditions and dietary preferences, and efficient procurement of necessary ingredients.

[1758] "Health status information" is information related to the user's health, and includes, for example, blood test results, blood pressure, weight, body fat percentage, and the like.

[1759] "Dietary preference information" is information about the user's food preferences and disliked ingredients, such as data about favorite foods and disliked foods.

[1760] A "generative AI model" refers to an algorithm that uses artificial intelligence algorithms to analyze data and perform specific tasks to generate the optimal menu for the user.

[1761] The "list of ingredients" is a list of ingredients required based on the menu, and is data that includes the type and amount of each ingredient.

[1762] A "food delivery system" is a system that provides a network and services for delivering food ingredients specified by a user.

[1763] A "menu" is a meal suggestion for a user, including specific dish names, cooking methods, and nutritional information.

[1764] A "server" is a computer system that receives and stores data sent by users and processes it.

[1765] The "database" is a management system for storing received health status information, food preference information, past food ingredient data, and the like.

[1766] A "prompt" is a specific instruction or question that is entered when creating a menu using a generative AI model.

[1767] MODE FOR CARRYING OUT THE INVENTION

[1768] This invention is a system that generates optimal menus for users based on their health status information, food preference information, and past ingredient data, creates a list of necessary ingredients, and provides a series of processes that link with a food delivery system. The system consists of three main parts: a server, a terminal, and a user.

[1769] Server Roles and Operations

[1770] The server provides the following main functions: First, it receives and stores health status information by storing the data sent by the user in a database such as MySQL or PostgreSQL. Second, it receives and stores the user's dietary preference information and manages this information using DynamoDB or MongoDB.

[1771] The server runs a menu generation algorithm using a generative AI model (e.g., GPT-4) based on the stored health status information and food preference information to generate an appropriate meal menu. An example of this prompt sentence is, "40-year-old male user. Health checkup results show low iron in the blood. Prefers chicken and dislikes broccoli. Please generate an appropriate menu."

[1772] Based on the generated menu, the server creates a list of necessary ingredients and stores this list in an in-memory data store such as Redis. Furthermore, to send this list of ingredients to the food delivery system, the server uses the API of the online supermarket or food delivery service, utilizing a RESTful API using the HTTP protocol.

[1773] Device role and operation

[1774] The terminal sends the information entered by the user to the server and provides an interface that displays the data sent from the server to the user. The terminal can be an iOS or Android-based smartphone or PC.

[1775] Users input their health condition information, dietary preferences, and basic information (age, gender, weight, height, etc.) into the device. React or Flutter is used as the input form, and this data is sent to the server using the HTTPS protocol. Furthermore, the device can also connect to medical institutions' systems and automatically obtain health checkup information using the FHIR (Fast Healthcare Interoperability Resources) standard.

[1776] User Roles and Actions

[1777] Users input their health status and dietary preferences, confirm and modify the proposed menu, and finally prepare a meal using the delivered ingredients. The data entered by the user through the device is processed appropriately by the server, and the generated menu and list of ingredients are sent to the user's device. The user can review this and modify the menu as needed.

[1778] By receiving ingredients delivered by the food delivery system and cooking according to the recipes displayed on the device, customers can easily maintain a balanced diet.

[1779] This invention automatically generates a menu that matches the user's individual health condition and food preferences, enabling efficient food procurement.

[1780] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1781] Step 1:

[1782] The user enters basic information (age, gender, weight, height, etc.) into the device and sends that data to the server. The server creates an individual user profile based on this basic information and stores it in a database. The entered information is securely transmitted from the device via the HTTPS protocol, and the server stores the information in a database management system (DBMS).

[1783] Input: User's basic information (age, gender, weight, height, etc.)

[1784] Output: New user profile saved in database

[1785] Specific operation: The user enters basic information into the input form and presses the "Submit" button. The terminal sends the information to the server, which receives it and stores it in the database.

[1786] Step 2:

[1787] The user enters their health status information into the device and sends it to the server. The entered information can be uploaded as a PDF result from a medical institution or automatically obtained through the medical institution's API. The server receives this information and stores it in a database.

[1788] Input: User's health information (blood test results, blood pressure, etc.)

[1789] Output: Save health information to database

[1790] Specific operation: The user uploads the health checkup results to the terminal and sends them to the server, which then stores the received data in a database.

[1791] Step 3:

[1792] The user inputs food preference information (favorite ingredients, disliked ingredients, etc.) into the terminal and sends it to the server, which receives this information and stores it in a database.

[1793] Input: User's food preference information (favorite ingredients, disliked ingredients)

[1794] Output: Save preference information to database

[1795] Specific operation: The user answers questions in a questionnaire about their food preferences and sends the data from their device to the server, which then stores the received information in a database.

[1796] Step 4:

[1797] The server retrieves health status information and dietary preference information from the database and runs a menu generation algorithm using a generative AI model (e.g., GPT-4). This is the process of inputting specific prompts into the generative AI model to generate a menu.

[1798] Input: Health status information, dietary preference information

[1799] Output: The generated menu

[1800] Specific operation: The server retrieves the necessary information from the database, inputs the prompt statement "40-year-old male user. Health check results show low blood iron. Prefers chicken and dislikes broccoli. Please generate an appropriate menu" into the generative AI model, and retrieves the generated menu.

[1801] Step 5:

[1802] The server creates a list of ingredients needed based on the generated menu, identifies the ingredients and quantities needed for each dish on the generated menu, and stores this information in a database.

[1803] Input: Generated menu

[1804] Output: List of ingredients needed

[1805] Specific operation: The server analyzes the generated menu, lists the necessary ingredients and their quantities, and stores them in a database.

[1806] Step 6:

[1807] The server sends the generated list of ingredients to the food delivery system, and sends the order data using the API of the online supermarket or food delivery service.

[1808] Input: List of ingredients

[1809] Output: Order data sent to the food delivery system

[1810] Specific operation: The server sends the list of ingredients to the food delivery system's API and confirms the order of the necessary ingredients. The order status and delivery schedule can also be checked at the same time.

[1811] Step 7:

[1812] The user receives the delivered ingredients, cooks them based on the recipe displayed on the device, and finally, cooks based on the suggested menu and enjoys a balanced meal.

[1813] Input: Delivered ingredients

[1814] Output: Cooked food

[1815] Specific operation: The device checks the received ingredients and cooks them according to the recipe displayed on the device. The device delivers the finished dish, allowing the user to maintain a balanced diet.

[1816] (Application example 1)

[1817] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1818] Conventional meal menu suggestion systems can generate menus based on a user's health checkup information and food preferences, but they require users to manually order ingredients from the generated list, which is time-consuming. Furthermore, since the generated menus do not automatically order or arrange for delivery of ingredients, users have to go to the trouble of purchasing ingredients. There is a need to solve these problems and improve user convenience.

[1819] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1820] In this invention, the server includes means for receiving and saving health checkup information, means for receiving and saving user food preference information, means for generating a menu based on the health checkup information and the food preference information, means for generating a list of necessary ingredients based on the generated menu, means for transmitting the list of ingredients to the food delivery system, means for transmitting the health checkup information and food preference information input from the user's terminal to the server, means for displaying the data transmitted from the server to the user, and means for automatically ordering the list of ingredients corresponding to the proposed menu based on the application. This allows the user to easily receive a menu tailored to their health condition and food preferences, and enables the automatic ordering and delivery of necessary ingredients.

[1821] "Health checkup information" is data that indicates the user's health condition, and includes blood test results, blood pressure values, and the like.

[1822] "Food preference information" is personal information that indicates the user's favorite and least favorite ingredients, taste preferences, etc.

[1823] The "menu" refers to meal suggestions generated based on the health checkup information and the food preference information.

[1824] The "ingredients list" is a list of ingredients required based on the menu.

[1825] The "food delivery system" is a system for delivering ingredients to users based on the ingredient list.

[1826] A "server" is a computer system that stores information received from users and generates menus and ingredient lists.

[1827] A "terminal" is an electronic device that transmits information entered by a user to a server and displays data transmitted from the server to the user.

[1828] The "automatic ordering means" is a means for automatically ordering ingredients from an affiliated food delivery system based on the generated ingredient list.

[1829] "Delivery arrangement" refers to making arrangements for the delivery of ingredients at a date and time specified by the user based on the generated ingredient list.

[1830] The "menu generation means" refers to an algorithm or program for generating a meal menu suited to a user based on health checkup information and food preference information.

[1831] Overall system configuration

[1832] This system is composed of a series of processes that generate the optimal menu for the user based on the user's health check information, food preference information, and past food ingredient data, create a list of necessary ingredients, and link with the food delivery system.The system consists of three main parts: the server, the terminal, and the user.

[1833] Server Roles and Operations

[1834] The server provides the following main functions:

[1835] 1. Receiving and storing health examination information:

[1836] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure.

[1837] 2. Receiving and storing your food preferences:

[1838] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[1839] 3. Generate the menu:

[1840] The server runs a menu generation algorithm based on the stored health checkup information and food preference information to generate an appropriate meal menu, for example, "stir-fried spinach and beef" for a user who is iron deficient.

[1841] 4. Generate the ingredients list:

[1842] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[1843] 5. Sending the Ingredient List:

[1844] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[1845] 6. Automated ordering methods:

[1846] The server automatically places an order for the created ingredient list to an affiliated food delivery system.

[1847] Device role and operation

[1848] The terminal transmits the information entered by the user to the server and provides an interface that presents the data transmitted by the server to the user:

[1849] 1. Enter and submit basic information:

[1850] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends that data to the server.

[1851] 2. Enter and submit your medical examination information:

[1852] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[1853] 3. Enter and submit your food preferences:

[1854] The user inputs food preference information into the terminal and sends it to the server.

[1855] 4. Check and change the menu:

[1856] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[1857] User Roles and Actions

[1858] Users input their health and food preferences, review and modify the suggested menu, and finally prepare a meal using the delivered ingredients:

[1859] 1. Basic information provided:

[1860] Users provide basic information when using the system.

[1861] 2. Providing health checkup information:

[1862] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[1863] 3. Providing Food Preference Information:

[1864] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[1865] 4. Check and change the menu:

[1866] Review the proposed menu, decide if it suits you, and make any necessary changes.

[1867] 5. Receiving and Preparing Ingredients:

[1868] Receive ingredients delivered from the food delivery system and prepare meals based on the suggested menu.

[1869] Specific examples

[1870] For example, suppose a user is a 40-year-old man who was recently diagnosed with high blood pressure during a medical checkup, and also enters information that he likes chicken and dislikes salty foods.

[1871] 1. The user enters basic information, health check information, and food preference information into the terminal and sends it to the server.

[1872] 2. Based on the information received, the server runs a menu generation algorithm and generates a menu item called Low-salt Steamed Chicken.

[1873] 3. The server sends the generated menu to the user's device, where the user confirms it.

[1874] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the affiliated online supermarket.

[1875] 5. The food delivery system will deliver the ingredients on the specified date.

[1876] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[1877] This allows users to easily obtain menus suited to their health condition, smoothly receive the necessary ingredients, and maintain a balanced diet.

[1878] Example prompt sentence:

[1879] User's health check information: "High blood pressure"

[1880] Food preference information: "Favourite food: Chicken" "Disliked food: Salty food"

[1881] Generated menu: Low-sodium steamed chicken

[1882] Generated ingredients list: Chicken, carrots, spinach, low-sodium spices

[1883] Ordering process: Send ingredient list to online supermarket => Ingredients are delivered on the specified date and time

[1884] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1885] Step 1:

[1886] The user enters basic information (age, gender, weight, height) into the device and sends that data to the server. The entered basic information is format-checked on the device (checking required fields, format consistency, etc.) and then sent to the server in JSON format. The server stores the received information in a user information database.

[1887] Step 2:

[1888] The user enters health checkup information (blood test results, blood pressure, etc.) into the device and sends it to the server. The entered health checkup information is checked for format on the device and then sent to the server in the same JSON format. The server stores the received health checkup information in a health information database. In some cases, the server may also link with the medical institution's system to automatically obtain health checkup data.

[1889] Step 3:

[1890] The user inputs food preference information (favorite ingredients, disliked ingredients, etc.) into the device and sends it to the server. The input food preference information is checked for format and then sent to the server in JSON format. The server stores the received information in a preference database.

[1891] Step 4:

[1892] The server runs a menu generation algorithm based on the stored health checkup information and food preference information. Based on the algorithm, the server generates a menu that best suits the input information, associates it with the user information, and stores it in a menu list database. For example, a user who is iron deficient might be suggested a spinach and chicken stir-fry.

[1893] Step 5:

[1894] The server sends the generated menu to the terminal and displays it to the user. The menu sent from the server is received by the terminal and displayed in a format that is easy for the user to understand. The user can check the proposed menu and make changes as needed (for example, to reduce the salt content). The changed menu is then sent back to the server.

[1895] Step 6:

[1896] The server generates an ingredient list based on the finalized menu. The ingredient list includes the ingredients and quantities required for the dish obtained from the menu generation algorithm and is stored in the ingredient list database.

[1897] Step 7:

[1898] The server executes an automatic ordering process to send the generated ingredient list to the food delivery system. The automatic ordering process sends the ingredient list to affiliated online supermarkets and food delivery services, and the ordering process is carried out.

[1899] Step 8:

[1900] The food delivery system prepares ingredients based on the received ingredient list and delivers them to the user at the specified date and time. To ensure that the delivery system delivers the ingredients appropriately, delivery schedules and address information are sent in advance from the server.

[1901] Step 9:

[1902] Users receive ingredients at the specified date and time and prepare meals based on the suggested menu. They can use their smartphones, tablets, or other devices to check the recipes while cooking.

[1903] By following these steps, users can easily obtain menus tailored to their health condition and food preferences, and quickly receive the ingredients they need.

[1904] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1905] Overall system configuration

[1906] This system generates the optimal menu for the user based on the user's health checkup information, food preference information, and emotional information, creates a list of necessary ingredients, and connects with the food delivery system.The system consists of three main parts: a server, a terminal, and the user.

[1907] Server Roles and Operations

[1908] The server provides the following main functions:

[1909] 1. Receiving and storing health examination information:

[1910] The server receives the health checkup information sent by the user and stores it in a health ranking database, such as blood test results and blood pressure information.

[1911] 2. Receiving and storing your food preferences:

[1912] The server receives the food preference information sent by the user and stores it in a preference database, such as "Favorite food: chicken" and "Disliked food: broccoli."

[1913] 3. Emotion engine recognizes and stores emotional information:

[1914] The server uses an emotion engine to acquire emotional information through user input, facial expression analysis, and voice recognition. The acquired emotional information is stored in an emotion database and managed by linking it to the user ID.

[1915] 4. Generate the menu:

[1916] The server runs a menu generation algorithm based on health checkup information, food preferences, and emotional information to generate an appropriate meal menu. For example, it might suggest "stir-fried beef and vegetables" to a user who is iron deficient and under high stress.

[1917] 5. Generate the ingredients list:

[1918] Once the menu is generated, the server generates a list of ingredients required based on the menu, which is stored in an ingredient list database.

[1919] 6. Sending the Ingredient List:

[1920] The generated ingredient list is sent to a food delivery system, for example, sending order data to an online supermarket or food delivery service.

[1921] 7. User response recording and menu improvements:

[1922] The server records the user's reaction to the suggested menu based on the user's emotions received from the emotion engine, and improves the menu suggestions for the next time and thereafter.

[1923] Device role and operation

[1924] The terminal transmits information input by the user to the server and provides an interface that presents data transmitted from the server to the user.

[1925] 1. Enter and submit basic information:

[1926] The user uses the device to enter basic information (age, gender, weight, height, etc.) and sends the data to the server.

[1927] 2. Enter and submit your medical examination information:

[1928] Users enter the results of their health checkups into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically retrieve the information.

[1929] 3. Enter and submit your food preferences:

[1930] The user inputs food preference information into the terminal and sends it to the server.

[1931] 4. Acquiring emotional information using the emotion engine:

[1932] The user can input their own emotions through the device, or emotions can be recognized from facial expressions and voice through the device's camera and microphone.

[1933] 5. Menu confirmation and changes:

[1934] The proposed menu sent from the server is displayed on the device, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[1935] User Roles and Actions

[1936] Users input their health checkup information, food preferences, and emotional information, confirm and change the suggested menu, and finally prepare a meal using the delivered ingredients.

[1937] 1. Basic information provided:

[1938] Users provide basic information when using the system.

[1939] 2. Providing health checkup information:

[1940] The latest health check information is entered into the system, or the information is automatically provided in conjunction with the medical institution's system.

[1941] 3. Providing Food Preference Information:

[1942] Enter information about your food preferences, disliked ingredients, and how to avoid nutritional imbalances.

[1943] 4. Providing emotional information:

[1944] Emotions can be recognized using the device's camera or microphone, or the emotional state can be input directly.

[1945] 5. Menu confirmation and changes:

[1946] Review the proposed menu, decide if it suits you, and make any necessary changes.

[1947] 6. Receiving and Preparing Ingredients:

[1948] Receive ingredients delivered from the food delivery system and prepare dishes based on the suggested menu.

[1949] Specific examples

[1950] For example, suppose the user is a 30-year-old woman who was recently diagnosed with a vitamin D deficiency in a medical checkup. She also inputs information that she likes fish and dislikes beef, and the emotion engine recognizes that she is stressed.

[1951] 1. The user enters basic information, health check information, food preference information, and emotional information into the terminal and sends it to the server.

[1952] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Grilled Salmon and Spinach Salad."

[1953] 3. The server sends the generated menu to the user's device, where the user confirms it.

[1954] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[1955] 5. The food delivery system will deliver the ingredients on the specified date.

[1956] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[1957] In this way, users can easily obtain menus that suit their health and emotional state and maintain a balanced diet.

[1958] The processing flow will be explained below.

[1959] Step 1:

[1960] The user opens the smartphone app and accesses the basic information entry screen, where they enter basic information such as age, gender, weight, and height.

[1961] Step 2:

[1962] The terminal receives the input basic information and sends it to the server.

[1963] Step 3:

[1964] The server saves the received basic information in the database. It creates a new entry in the user database and registers the basic information along with the user ID.

[1965] Step 4:

[1966] The user enters the results of their health check into the app, or the information is automatically retrieved from the linked medical institution's system.

[1967] Step 5:

[1968] The terminal receives the user's health checkup information and transmits it to the server.

[1969] Step 6:

[1970] The server analyzes the health checkup information and stores it in the health ranking database, linking it to the user ID. For example, it determines that a person is deficient in vitamin D based on the blood test results.

[1971] Step 7:

[1972] The user selects their favorite and least favorite ingredients and food preferences in the app. For example, they can enter "Favorite ingredient: fish" and "Dislike ingredient: beef."

[1973] Step 8:

[1974] The terminal receives the food preference information and transmits it to the server.

[1975] Step 9:

[1976] The server stores the preference information in a preference database, along with the user ID.

[1977] Step 10:

[1978] The device activates a camera and microphone to recognize the user's emotions and capture facial expressions and voice characteristics.

[1979] Step 11:

[1980] The device uses an emotion engine to analyze the user's emotional state based on facial expressions and voice characteristics, for example, determining that the user is feeling stressed.

[1981] Step 12:

[1982] The device sends the analysis results to the server.

[1983] Step 13:

[1984] The server stores the received emotion information in an emotion database and associates it with the user ID.

[1985] Step 14:

[1986] The server runs a menu generation algorithm based on the stored health check information, food preference information, and emotional information to generate an appropriate meal menu. For example, for a user who is feeling stressed due to a vitamin D deficiency, it would generate "grilled salmon and spinach salad."

[1987] Step 15:

[1988] The server sends the generated menu to the terminal for presentation to the user.

[1989] Step 16:

[1990] Users can review the suggested menu items in the app and make changes if necessary. For example, if you like fish, you can accept the "grilled salmon" option, or if you don't like beef, you can change the menu item that includes it to another option.

[1991] Step 17:

[1992] The terminal receives the changed menu information and transmits it to the server.

[1993] Step 18:

[1994] The server finalizes the menu and generates the necessary ingredient list, which is then stored in the ingredient list database.

[1995] Step 19:

[1996] The server sends the generated ingredient list to an online supermarket or food delivery system, for example, by sending the order information via API or email.

[1997] Step 20:

[1998] The food delivery system prepares the ingredients and delivers them to the address specified by the user.

[1999] Step 21:

[2000] The user receives the delivered ingredients and cooks based on the suggested menu. Cooking instructions and recipes can be viewed within the app.

[2001] Step 22:

[2002] The server records the user's reaction using an emotion engine and reflects it in future menu suggestions.

[2003] Example 2

[2004] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2005] Conventional dietary management systems only consider the user's health status and food preferences when proposing menus, but do not provide personalized menu suggestions that reflect the user's emotional state. This often results in users being dissatisfied with the proposed menus, limiting the effectiveness of the system. Furthermore, the system lacks the functionality to continuously improve the menus based on user feedback, making it difficult to propose optimal menus for each user.

[2006] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving and saving health checkup information, means for receiving and saving user food preference information, means for acquiring and saving emotional information, means for generating a menu based on the health checkup information, the food preference information, and the emotional information, means for generating a list of ingredients based on the generated menu, and means for transmitting the list of ingredients to the food delivery system. This enables personalized menu suggestions that take into account not only the user's health status but also their food preferences and emotional state. Furthermore, by continuously improving the menu based on user feedback, it is possible to provide each user with a more appropriate and satisfying meal menu.

[2007] "Health checkup information" is data indicating the health condition of the user, and includes diagnostic results provided by medical institutions, such as blood test results, blood pressure, and cholesterol levels.

[2008] "Food preference information" is data that indicates the user's food preferences, such as the user's favorite and least favorite ingredients, and allergy information.

[2009] "Emotion information" is data that indicates the emotional state of the user, and includes the emotional state obtained by the emotion engine from facial expression and voice analysis, as well as the emotional state input by the user himself.

[2010] The "means for generating a menu" refers to a method including an algorithm and a generative AI model for generating an optimal meal menu for a user based on health checkup information, food preference information, and emotional information.

[2011] The "means for generating a list of ingredients" is a technique that includes algorithms and databases for creating a list of ingredients required based on the generated menu.

[2012] A "food delivery system" is an external system for delivering food ingredients to users, such as an online supermarket or food delivery service.

[2013] The "means for accepting user confirmation and changes" refers to a technique that includes an interface that allows the user to confirm the proposed menu and make changes as necessary, and an algorithm for reflecting those changes.

[2014] This system generates the optimal menu for a user based on their health checkup information, food preferences, and emotional information, creates a list of necessary ingredients, and connects with a food delivery system. The system consists of three main parts: a server, a terminal, and a user. The specific operation of each part is explained below.

[2015] Server Roles and Operations

[2016] Receiving and storing health examination information

[2017] The server receives the health checkup information sent by the user and stores it in a health database, including blood test results and blood pressure, allowing for continuous analysis of the user's health status.

[2018] Receiving and storing user food preference information

[2019] The server receives the food preference information sent by the user and stores it in a preference database. For example, it stores information such as "Favorite food: chicken" and "Disliked food: broccoli." This makes it possible to suggest menu items according to the user's preferences.

[2020] Emotion engine recognizes and stores emotional information

[2021] The server uses an emotion engine to acquire emotional information through user input, facial expression analysis, and voice recognition, and stores it in an emotion database, enabling it to propose menus according to the user's emotional state.

[2022] Generate Menu

[2023] The server uses a generative AI model to generate the optimal menu based on health checkup information, food preferences, and emotional information. For example, it would suggest "stir-fried beef and vegetables" to a user who is iron deficient and under high stress. This process is carried out by a menu generation algorithm.

[2024] Generate an ingredient list

[2025] Based on the generated menu, the server creates a list of ingredients needed and stores it in an ingredient list database, which indicates the specific ingredients that the user needs to purchase.

[2026] Sending an Ingredient List

[2027] The generated ingredient list is sent to the food delivery system, specifically, the order data is sent to the online supermarket or food delivery service.

[2028] User response recording and menu improvements

[2029] The server records the user's reaction to the proposed menu based on the user's emotions received from the emotion engine and reflects this in future menu suggestions, thereby providing a menu customized for each user.

[2030] Device role and operation

[2031] Enter and submit basic information

[2032] The user uses the device to input basic information (age, gender, weight, height, etc.) and sends that data to the server, which then obtains the user's basic health information.

[2033] Enter and submit health check information

[2034] Users enter their health checkup results into the terminal and send them to the server. It is also possible to link with medical institutions' systems to automatically obtain information. This simplifies the input of diagnostic information and improves accuracy.

[2035] Enter and submit food preference information

[2036] The user inputs their food preferences into the terminal and sends them to the server, which then proposes a meal menu that reflects the user's preferences.

[2037] Acquiring emotional information using an emotion engine

[2038] The user can input their own emotions through the device, or emotions can be recognized from facial expressions and voice via the device's camera and microphone, making it possible to grasp the user's emotional state in real time.

[2039] Check and change the menu

[2040] The proposed menu sent from the server is displayed on the terminal, and the user can check it and change it if necessary. The changed menu information is also sent to the server.

[2041] User Roles and Actions

[2042] Provision of basic information

[2043] Users provide basic information when using the system, which lays the foundation for the system to suggest optimal menus based on the user's individual information.

[2044] Providing health checkup information

[2045] Enter your latest health checkup information into the system, or link it with your medical institution's system to automatically provide the information, so that the latest health data is reflected in the menu generation.

[2046] Providing information about food preferences

[2047] Users input information about their food preferences, disliked ingredients, and how to avoid nutritional imbalances, and the system will suggest menus that reflect their tastes.

[2048] Providing emotional information

[2049] Emotions can be recognized using the device's camera and microphone, or emotional state can be input directly, allowing for meal suggestions based on the emotional state.

[2050] Check and change the menu

[2051] Review the suggested menu, decide if it's right for you, and make changes if necessary, incorporating your feedback in real time.

[2052] Receiving and preparing ingredients

[2053] The system receives ingredients from a food delivery system and prepares meals based on suggested menus, allowing customers to maintain a healthy and personalized diet.

[2054] Specific examples

[2055] For example, suppose the user is a 30-year-old woman who was recently diagnosed with a vitamin D deficiency in her health checkup. She also inputs information that she likes fish and dislikes beef, and the emotion engine recognizes that she is stressed. In this case, the specific steps are as follows:

[2056] 1. The user enters basic information, health check information, food preference information, and emotional information into the terminal and sends it to the server.

[2057] 2. Based on the information received by the server, it runs a menu generation algorithm and generates a menu item called "Grilled Salmon and Spinach Salad."

[2058] 3. The server sends the generated menu to the user's device, and the user confirms it.

[2059] 4. The user accepts the menu, a list of ingredients is generated, and an order is automatically placed with the online supermarket.

[2060] 5. The food delivery system will deliver the ingredients on the specified date.

[2061] 6. The user receives the ingredients and cooks the dish based on the suggested recipe.

[2062] As described above, users can easily obtain menus that suit their own health and emotional state, and maintain a balanced diet.

[2063] Prompt Sentence Examples

[2064] An example of a prompt sentence is, "Please suggest the optimal meal menu for a user who is 30 years old, female, has a vitamin D deficiency, likes fresh fish, dislikes beef, and feels stressed." By inputting this prompt sentence into the generative AI model, personalized menu suggestions can be obtained.

[2065] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2066] Step 1:

[2067] Input: Basic information (age, gender, weight, height, etc.)

[2068] Processing: The user starts the device and enters basic information according to the on-screen instructions. The device then sends the entered data to the server in real time.

[2069] Output: Basic information stored in the server's database, so that the server knows the user's basic health information.

[2070] Specific operation: The user enters information such as "age 30, female, weight 60 kg, height 165 cm" into an input form, and the information is sent to the server.

[2071] Step 2:

[2072] Input: Health checkup results

[2073] Processing: The user enters the results of the health check into the terminal and sends the data to the server. It is also possible to automatically obtain information by linking with the medical institution's system.

[2074] Output: Health check information stored in the server's health database.

[2075] Specific operation: A user accesses the site and enters blood test results or blood pressure, or data provided by a medical institution is automatically sent to the server.

[2076] Step 3:

[2077] Input: Food preference information

[2078] Processing: The user inputs information about their food preferences, such as favorite ingredients, disliked ingredients, and allergy information, and sends the data to the server.

[2079] Output: Food preference information stored in the server's preference database.

[2080] Specific operation: The user enters information such as "Favorite food: fish, Disliked food: beef, Allergy: peanuts" and sends it to the server.

[2081] Step 4:

[2082] Input: Emotion information

[2083] Processing: The user inputs emotional information using the device's camera or microphone, or the emotion engine automatically analyzes emotional information from facial expressions and voice and sends the data to the server.

[2084] Output: Emotion information stored in the emotion database on the server.

[2085] Specific operation: The user types "I feel stressed," or the device's camera and microphone analyze the user's facial expressions and tone of voice and recognize that they are "highly stressed."

[2086] Step 5:

[2087] Input: Health checkup information, food preference information, emotional information

[2088] Processing: The server uses this information to generate an optimal meal menu using a generative AI model.

[2089] Output: The generated menu information.

[2090] Specific behavior: The server generates a menu such as "Grilled salmon and spinach salad for a user with a vitamin D deficiency and high stress level."

[2091] Step 6:

[2092] Input: Generated menu

[2093] Processing: The server sends the generated menu to the terminal, where the user confirms it. If necessary, the user can modify the menu and send it back to the server.

[2094] Output: The final menu that is confirmed after user confirmation.

[2095] Specific behavior: The device displays a menu suggestion of "Grilled salmon and spinach salad," which the user can review and accept or change.

[2096] Step 7:

[2097] Input: Final menu confirmed

[2098] Processing: The server creates a list of ingredients based on the confirmed menu and sends the list to the food delivery system.

[2099] Output: A list of ingredients sent to the food delivery system.

[2100] Specific operation: The server generates a list such as "salmon, spinach, lemon, olive oil" and sends it to the online supermarket as order data.

[2101] Step 8:

[2102] Input: Delivery data from food delivery system

[2103] Processing: The food delivery system delivers the ingredients to the user's address at the specified date and time.

[2104] Output: The ingredients delivered to the user.

[2105] Specific operation: The food delivery system delivers ingredients such as "salmon, spinach" to the user's address, and the user picks them up.

[2106] Step 9:

[2107] Input: Proposed menu and ingredients received

[2108] Process: The user cooks the food based on the suggested menu.

[2109] Output: A cooked meal.

[2110] Specific Action: The user follows instructions to cook a dish, such as "grill salmon and prepare a spinach salad."

[2111] In this way, the server processes and calculates the data based on the information entered at each step, generating the optimal menu and ingredient list, and realizing a diet that suits the user's health and emotional state.

[2112] (Application example 2)

[2113] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2114] Conventional meal recommendation systems generate menus and create ingredient lists based solely on the user's health checkup information and food preference information. However, no system was available that could provide individually optimized meal recommendations that took into account the user's emotional state and daily changes in mental state. This created a need for a system that could suggest meals that matched not only the user's health condition and food preferences, but also their emotions. Additionally, a system was needed that could provide feedback on the user's reactions to the suggested menus and further improve future meal recommendations.

[2115] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2116] In this invention, the server includes means for receiving and storing health checkup information, means for receiving and storing user food preference information, means for receiving and storing emotion information including facial expression analysis and voice recognition, means for generating a menu based on the health checkup information, the food preference information, and the emotion information, means for generating a list of ingredients based on the generated menu, means for transmitting the list of ingredients to a food delivery system, and means for improving future menu suggestions based on the user's responses. This enables personalized, optimized meal suggestions based on multifaceted information including the user's emotional state, thereby providing a healthy and stress-conscious dietary lifestyle.

[2117] "Health checkup information" refers to test results and diagnostic data regarding the user's health condition, including blood test results and blood pressure.

[2118] "Food preference information" refers to personal food preference data such as the user's favorite ingredients, disliked ingredients, allergies, etc.

[2119] "Emotional information" refers to data that indicates the user's emotional state obtained by analyzing their facial expressions and voice.

[2120] The "menu generation means" refers to a means for automatically creating an optimal meal menu based on health checkup information, food preference information, and emotional information.

[2121] The "ingredient list generating means" refers to a means for creating a list of necessary ingredients based on the generated menu.

[2122] "Food delivery system" refers to a system for delivering food to users based on a created ingredient list.

[2123] "Response history" refers to data regarding changes in the user's evaluation and emotions regarding proposed menu items.

[2124] Overall system configuration

[2125] The system of the present invention generates the optimal menu for the user based on the user's health checkup information, food preference information, and emotional information, creates a list of necessary ingredients, and links with the food delivery system. The system consists of three main parts: a server, a terminal, and the user.

[2126] Server Roles and Operations

[2127] The server provides the following main functions:

[2128] 1. Receiving and storing health examination information:

[2129] It receives health checkup information sent by users and stores it in a database. For example, it stores information such as blood test results and blood pressure. The hardware used includes a server computer, and the software is a database management system (DBMS).

[2130] 2. Receiving and storing your food preferences:

[2131] It also receives food preference information sent by users and stores it in a database. For example, it stores information such as "Favorite food: chicken" and "Disliked food: broccoli."

[2132] 3. Acquisition and storage of emotional information:

[2133] The emotion engine uses Google Cloud Vision API and AWS Rekognition to acquire emotional information through facial expression analysis and voice recognition, and stores it in an emotion database.

[2134] 4. Menu generation algorithm:

[2135] Based on health checkup information, food preference information, and emotional information, a menu generation algorithm is run to generate the optimal meal menu. Specifically, machine learning algorithms using Python (such as Scikit-learn and TensorFlow) are used.

[2136] 5. Generate the ingredients list:

[2137] Create a list of ingredients needed based on the generated menu.

[2138] 6. Sending the Ingredient List:

[2139] The generated ingredient list is sent to the partner food delivery system via API communication.

[2140] 7. User ...

Claims

1. means for receiving and storing health examination information; means for receiving and storing user food preference information; a means for generating a menu based on the health checkup information and the food preference information; means for generating a list of ingredients required based on the generated menu; means for transmitting the list of ingredients to a food delivery system; A system including:

2. a means for presenting a menu to a user that is generated based on the health checkup information and the food preference information; a means for accepting user confirmation and changes to the menu; The system of claim 1 further comprising:

3. a means for generating a menu based on the health checkup information, the food preference information, and the user's past food ingredient data; The system of claim 1 further comprising:

Images