System

Abstract

A system is provided.SOLUTION: A system, comprising: a server connected to a computer and a database for receiving and storing meal setting information and medical examination results input by users; means connected to the server for generating a recipe based on the input information using a generative AI model; and means for transmitting and displaying the generated recipe to the users and providing interactive cooking procedures.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The recent rise in prices has led to an increase in home cooking, but beginners and those who want to improve their cooking skills face many challenges. For example, recipe books and online information may not provide specific instructions tailored to individual needs. Furthermore, cooking can often leave users with their hands full or feeling lonely. Furthermore, improving dietary habits requires extensive information gathering and planning. This invention aims to provide a means to solve these challenges. [Means for solving the problem]

[0005] The present invention provides a system that allows users to input dietary preferences and health checkup results, and provides a means connected to a server and database for receiving and storing the input information. The server also provides a system that uses a generative AI model to generate appropriate recipes based on the input information, transmits and displays the generated recipes to the user, and provides interactive cooking instructions. This allows users to receive professional cooking techniques and advice via the generative AI model, and even when their hands are full while cooking, they can receive guidance and instructions on the cooking process in real time via voice input. This system allows even beginners to easily create delicious dishes and supports improved dietary habits and health management.

[0006] "User" refers to an individual who receives cooking support using this system.

[0007] "Setting information" refers to user-specific information such as allergen information, food preferences, and cooking skill level.

[0008] "Health checkup results" refers to information based on the results of a health checkup that a user has undergone, including, for example, data regarding nutrient deficiencies and health status.

[0009] "Computer" refers to an electronic device for processing information, and includes devices that primarily function as servers.

[0010] "Database" refers to a system for organizing and storing various information, and includes storage devices managed by a server.

[0011] "Server" refers to a computer system that provides services over a network, and in this case refers to a device that stores and processes configuration information and health checkup results.

[0012] "Generative AI model" refers to an algorithm or system that uses artificial intelligence technology to generate optimal recipes or guides based on input information.

[0013] A "recipe" is a list of steps and ingredients for making a particular dish.

[0014] "Interactive" refers to a format in which the computer and the user communicate with each other to carry out an action.

[0015] "Cooking instructions" refers to step-by-step instructions for making a particular dish.

[0016] "Professional culinary skills" refers to the culinary techniques and knowledge practiced by experts and professional chefs.

[0017] "Advice" refers to information that provides appropriate guidance or advice for a particular situation or task.

[0018] "Voice input" refers to the act of a user giving instructions or asking questions to a system using voice.

[0019] "Real-time" refers to a state in which data processing and communication is immediate and with little to no delay.

[0020] "Guide" refers to instructions or directions that lead users to a specific action or procedure.

[0021] A "cooking process" refers to the series of steps or procedures for preparing a dish. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] This invention relates to an application that provides interactive support for users when cooking. This system provides a means for beginners and health-conscious people to cook more effectively. It also allows users to enjoy cooking while learning professional cooking techniques.

[0044] Registering users and getting their personal settings

[0045] When a user launches the application for the first time, a screen appears prompting them to enter basic information such as their name, email address, and password. Once the basic information is entered, the device sends the information to the server, which then stores it in a database.

[0046] Next, the user enters personal information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[0047] Recipe suggestions and interactive guides

[0048] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device.

[0049] As the user cooks, the device will guide them through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[0050] Professional technology provided

[0051] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[0052] Collaboration with nutritionists

[0053] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[0054] Specific examples

[0055] Example 1: A user wants to make a quick dinner

[0056] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[0057] 2. The device displays the recipe and the user begins cooking.

[0058] 3. The device will then say, "Fry the bacon until crispy."

[0059] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[0060] Example 2: Recipe suggestions to make up for nutritional deficiencies

[0061] 1. The user enters the results of a health check and submits iron deficiency data.

[0062] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[0063] 3. The device displays the recipe and provides it to the user.

[0064] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[0065] This system provides an environment in which even beginners can easily create delicious and healthy meals.

[0066] The processing flow will be explained below.

[0067] Step 1:

[0068] A user launches an application and enters basic information such as name, email address, and password.

[0069] Step 2:

[0070] The terminal transmits the entered registration information to the server.

[0071] Step 3:

[0072] The server stores the received registration information in a database.

[0073] Step 4:

[0074] The user enters personal preference information such as allergen information, food preferences, and cooking skill level.

[0075] Step 5:

[0076] The device sends the personal setting information to the server.

[0077] Step 6:

[0078] The server stores the received personal setting information in a database.

[0079] Step 7:

[0080] A user uses the in-app search feature to request "easy dinner recipes."

[0081] Step 8:

[0082] Based on the request received by the server, a generative AI model is used to generate an appropriate recipe.

[0083] Step 9:

[0084] The server sends the generated recipe to the terminal.

[0085] Step 10:

[0086] The terminal displays the received recipe on the user interface.

[0087] Step 11:

[0088] The user presses a button to notify the user that cooking with the selected recipe is about to begin.

[0089] Step 12:

[0090] The device requests cooking instructions from the server.

[0091] Step 13:

[0092] The server generates the appropriate cooking instructions and sends them to the device.

[0093] Step 14:

[0094] The device will then guide the user through cooking steps via voice or text, for example, "Chop the onion and fry it in a frying pan."

[0095] Step 15:

[0096] The user speaks, "What should I do next?"

[0097] Step 16:

[0098] The server analyzes the question, generates the next steps, and sends them to the device, such as "Add tomatoes and continue to stir-fry."

[0099] Step 17:

[0100] The device will guide the user through the next steps via voice or text.

[0101] Step 18:

[0102] The user speaks, "How can I cook it better?"

[0103] Step 19:

[0104] The server searches for advice based on professional cooking techniques and sends it to the device, such as "Vegetables will taste better if you season them with a little salt and stir-fry them for a short time over high heat."

[0105] Step 20:

[0106] The terminal provides advice to the user by voice or text.

[0107] Step 21:

[0108] The user inputs the results of the health check.

[0109] Step 22:

[0110] The terminal transmits the health check results to the server.

[0111] Step 23:

[0112] The server stores the received health checkup results in a database and generates suitable recipes based on advice from a nutritionist.

[0113] Step 24:

[0114] The server sends the generated recipe to the device, suggesting, for example, "Stir-fried spinach and ground beef."

[0115] Step 25:

[0116] The terminal displays the received recipe on the user interface.

[0117] Step 26:

[0118] A user asks, "What else goes in this recipe?"

[0119] Step 27:

[0120] The server analyzes the question and generates additional ingredients and instructions to send to the device, such as "Please also add potatoes and onions."

[0121] Step 28:

[0122] The device will provide the user with additional instructions via voice or text.

[0123] In this way, the present invention provides an interactive cooking support system that can be easily used even by beginners, enabling users to prepare delicious dishes and improve the quality of their dietary life.

[0124] Example 1

[0125] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0126] In today's society, many users find it difficult to eat healthy meals due to their busy lifestyles. Cooking effectively and efficiently can also be challenging for beginners and those with limited cooking skills. Furthermore, finding recipes that take into account specific health conditions and nutritional balance can be challenging, and there is a lack of access to the necessary cooking techniques and advice in real time. Therefore, there is a need for a system that allows users to easily obtain and execute recipes tailored to their individual conditions and needs.

[0127] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0128] In this invention, the server includes an information providing device connected to an information processing device that receives and stores the input information by the user's setting information and diagnostic results, a means for generating recipes based on the input information using a generative AI model, and a means for transmitting and displaying the generated recipes to the user and providing interactive cooking instructions, allowing users to easily obtain and execute recipes tailored to their individual conditions and needs.

[0129] An "information processing device" is a device that receives input information and performs the necessary calculations and data processing.

[0130] An "information storage device" is a device for storing received information and retrieving it as needed.

[0131] An "information providing device" is a device that includes an information processing device and an information storage device and provides necessary information to a user.

[0132] A "generative AI model" is an artificial intelligence model that generates a specific output based on given data.

[0133] "Cooking content" refers to the recipe and cooking steps required for the user to cook.

[0134] "User" refers to an individual who receives cooking assistance using this system.

[0135] "Interactive" refers to a method in which the system and the user interact with each other and provide appropriate responses in response to the user's questions and requests.

[0136] "Diagnosis results" refers to information and data regarding the user's health condition.

[0137] "Guide" refers to showing users the steps and providing instruction and guidance to help them achieve their goals.

[0138] This invention provides a cooking assistance system. The system allows users to input setting information and diagnostic results, and provides appropriate recipes and cooking procedures based on the input information. The system uses an information processing device, an information storage device, an information providing device, and a generative AI model.

[0139] Specifically, the user first launches the application and enters basic information such as name, email address, password, etc., as well as personal setting information such as allergen information, food preferences, cooking skill level, etc. The device sends this information to the server, and the server stores the received information in an information storage device, which is a database.

[0140] Next, when the user inputs a prompt such as "easy dinner recipe," the device sends this prompt to the server. The server uses the generative AI model to generate the optimal recipe and sends the result to the device. The device then displays the recipe information sent from the server and provides it to the user.

[0141] When a user selects a recipe and starts cooking, the device sends a cooking instructions request to the server. The server uses a generative AI model to generate appropriate cooking instructions and sends them to the device. The device then displays the received instructions in text or audio format, interactively guiding the user through the next cooking step. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time.

[0142] If a user asks, "How can I cook vegetables more deliciously?" while cooking, the device will send the question to the server. The server will generate advice based on professional cooking techniques and send it to the device. The device will then display the advice as voice or text, providing instructions to the user.

[0143] Furthermore, if a user wants to find dietary recipes to improve their health, they can input their health checkup results. For example, if they input information about iron deficiency, the device will send it to the server. The server will generate an appropriate recipe based on the advice of a nutritionist and send it to the device. The device will then display the generated recipe to the user and provide cooking support.

[0144] Prompt Sentence Examples

[0145] "Tell me some easy dinner recipes"

[0146] How can I cook vegetables more deliciously?

[0147] "What else goes into this recipe?"

[0148] This system allows users to easily obtain recipes tailored to their individual conditions and needs and then execute them step by step.

[0149] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0150] Step 1:

[0151] When a user launches the application for the first time, they enter basic information (such as name, email address, and password) and personal settings information (such as allergen information, food preferences, and cooking skill level). The entered information is sent by the device.

[0152] Step 2:

[0153] The device sends basic information and personal setting information to the server, which stores the received information in a database. This process records each user's individual information in the database.

[0154] Step 3:

[0155] The user inputs a prompt such as "easy dinner recipes." The terminal sends the input prompt to the server.

[0156] Step 4:

[0157] The server generates an appropriate recipe using a generative AI model based on the received prompt, taking into account the user's personal settings. The generated recipe is then sent from the server to the device.

[0158] Step 5:

[0159] The terminal displays the recipe information sent from the server and provides it to the user, who can then select a recipe from the displayed list.

[0160] Step 6:

[0161] The user selects a recipe and starts cooking. The device sends a request for the corresponding cooking instructions to the server.

[0162] Step 7:

[0163] The server uses the generative AI model to generate appropriate cooking instructions and sends them to the device, where they are displayed and provided to the user.

[0164] Step 8:

[0165] As the user cooks, they can ask questions such as "What's next?" and the device will send the question to the server.

[0166] Step 9:

[0167] The server generates the next cooking procedure or advice based on the question, and sends the generated procedure or advice to the terminal.

[0168] Step 10:

[0169] The device displays instructions and advice sent from the server in text or audio format and guides the user, providing specific instructions such as "Chop the onion and fry it in a frying pan."

[0170] Step 11:

[0171] When a user asks, "How can I cook vegetables more deliciously?" the device sends the question to the server.

[0172] Step 12:

[0173] The server generates advice based on professional cooking techniques and sends it to the device. The advice is displayed on the device and provided to the user. For example, specific advice such as "season vegetables with a little salt and stir-fry them for a short time over high heat will make them delicious" is provided.

[0174] Step 13:

[0175] When a user requests dietary recipes to improve their health, they input their health checkup results, and the terminal sends the input health information to the server.

[0176] Step 14:

[0177] The server uses a generative AI model based on the nutritionist's advice to generate an appropriate recipe, which is then sent to the device.

[0178] Step 15:

[0179] The device displays the generated recipe to the user and provides cooking support, and the user proceeds with cooking according to the displayed recipe.

[0180] (Application example 1)

[0181] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0182] In today's busy lifestyles, it is difficult for beginners and health-conscious people to cook easily and effectively at home. In particular, specific instructions on recipe selection, ingredient procurement, and cooking procedures are necessary, and a system that can consistently support these steps is needed.

[0183] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0184] In this invention, the server includes: means for a user to input dietary preference information and health checkup results, and means connected to a computer that receives the input information and a database that stores the input information; means for generating recipes based on the input information using a generative AI model; means for analyzing ingredients for the generated recipes and ordering delivery in bulk; means for sending and displaying the generated recipes to the user and providing interactive cooking instructions; and means for providing cooking instructions in text or voice in real time. This allows users to receive consistent support from recipe selection to ingredient procurement and cooking instructions, enabling them to cook easily and effectively at home.

[0185] "User" refers to an individual who uses the System to cook.

[0186] "Dietary settings information" refers to data about a user's individual diet, such as allergen information, food preferences, and cooking skill level.

[0187] "Health checkup results" refers to diagnostic results and medical data that indicate the user's health condition.

[0188] "Computer" means an electronic computing device for receiving and processing user information and requests.

[0189] "Database" refers to a data storage device used by a computer to store user information received or system-generated data.

[0190] "Server" refers to a central device connected to a computer and database that manages the processing of the entire system.

[0191] "Generative AI model" refers to an artificial intelligence model that generates recipes based on input information.

[0192] A "recipe" refers to cooking instructions that include cooking steps, ingredients, etc.

[0193] "Ingredients" refers to the ingredients listed in the recipe and items needed for cooking.

[0194] "Delivery" refers to the service of delivering materials ordered on the system to the user.

[0195] "Interactive means" refers to the functionality that allows users and systems to communicate in real time.

[0196] "Cooking instructions" refers to the specific cooking steps and advice provided by the system as the user cooks.

[0197] The present invention relates to a system that provides interactive support for users when cooking. This system provides a means for more effective cooking, especially for beginners and health-conscious people. It also allows users to enjoy cooking while learning professional cooking techniques.

[0198] Registering users and getting their personal settings

[0199] When a user launches the application for the first time, a screen appears where they can enter basic information such as their name, email address, and password. Once the basic information has been entered, the device sends the information to the server, which stores the received information in a database. Next, the user enters personal setting information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[0200] Recipe suggestions and ingredient delivery orders

[0201] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. The server then analyzes the ingredients of the generated recipe and automatically initiates a bulk delivery order. The ingredients are then quickly delivered to the user via a delivery service.

[0202] Interactive Cooking Support

[0203] When a user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device. As the user continues cooking, the device guides the user through the next steps via text or voice. For example, specific instructions such as "fry the bacon until crispy" are provided in real time. This allows even beginners to cook step by step. When the user asks "What's next?", the server provides further cooking instructions.

[0204] Professional technical support and nutritional management

[0205] If a user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and stir-fry them briefly over high heat to make them more delicious." The device then displays this information as voice or text, providing instructions to the user.

[0206] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[0207] Computer System Configuration

[0208] The server is connected to a computer and a database that stores the information. The computer is a device that receives and processes user information and requests, and the database is a data storage device that stores that information. The server uses a generative AI model to generate recipes, order ingredients for delivery, and provide interactive cooking instructions. The hardware and software used include Python, Django, or Flask (server-side), requests (API communication), and OpenAI GPT-3 (generative AI model).

[0209] Examples and prompts

[0210] 1. The user launches the application and requests "easy dinner recipes."

[0211] 2. The server uses GPT-3 to suggest a recipe for "Easy Tomato and Bacon Pasta" and display a list of ingredients.

[0212] 3. When the user presses the "Order" button, the necessary ingredients are ordered via a delivery service.

[0213] 4. After the delivery is complete, the device provides specific cooking instructions in real time, such as "Please fry the bacon until crispy."

[0214] Example prompt sentence:

[0215] "Suggest easy dinner recipes based on your user information: {preferences: 'healthy, easy'}. For example, easy pasta with tomatoes and bacon."

[0216] Thus, the present invention is a system that helps users cook at home simply and effectively. بهره‌برداری از این ‌اختراع، کاربر را قادر می‌سازد که با بهره‌گیری از فناوری هوش مصنوعی ایجاد شده و خدمات تحویل مواد بسته‌بندی شده، آشپزی در منزل را به یک تجربه ساده و کارآمد تبدیل کند.

[0217] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0218] Step 1:

[0219] Enter user registration information

[0220] When a user starts an application for the first time, a screen appears on the device where the user can enter basic information such as name, email address, and password. When the user enters this information (input), the device sends the information to the server (data transmission). The server then stores the received information in a database (data storage).

[0221] Step 2:

[0222] Obtaining personal setting information

[0223] The user then enters personal information such as allergen information, food preferences, and cooking skill level (input). The device sends this information to the server (data transmission), which then stores it in a database (data storage). This allows for the accumulation of personalized information that can be used for future recipe suggestions and interactive support (data storage).

[0224] Step 3:

[0225] Requesting and generating recipe suggestions

[0226] When a user makes a search request for "easy dinner recipes" (input), the device sends the request to the server (data transmission). Based on the received information, the server uses a generative AI model (GPT-3) to generate a prompt and create an "easy dinner recipe" (data generation). The generated recipe is sent to the device and displayed (data display).

[0227] Step 4:

[0228] Material delivery order

[0229] After the generated recipe is displayed, the user presses the "Order" button (input), and the device sends the ingredients list to the server (data transmission). The server analyzes the received ingredients list and places a bulk delivery order (data processing). The order data is then sent to the delivery service (data transmission).

[0230] Step 5:

[0231] Interactive cooking support launched

[0232] After the recipe ingredients arrive at the user's home (ingredient receipt), when the user begins cooking, the device sends a cooking procedure request to the server (data transmission). The server generates appropriate cooking procedures and sends them to the device (data generation, data transmission). The device then displays or audibly guides the user through the procedures (data display, audio output).

[0233] Step 6:

[0234] Providing cooking instructions in real time

[0235] As the user continues cooking, for example by asking "What's next?" (input), the device sends the voice data or text to the server (data transmission). The server analyzes the request, generates the next cooking instruction, and sends it to the device (data analysis, data generation, data transmission). The device then displays or plays back this in real time as voice or text (data display, voice output).

[0236] Step 7:

[0237] Professional technical support and advice

[0238] If the user needs additional advice while cooking (input), for example, by asking, "How can I cook vegetables more deliciously?", the device will send the question to the server (data transmission). The server will use a generative AI model to generate advice based on professional cooking techniques (data generation) and immediately send it to the device (data transmission). The device will then display or provide audio guidance in real time (data display, audio output).

[0239] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0240] This invention relates to a system that provides interactive support for users when cooking and, by combining it with an emotion engine, provides support according to the user's emotions. This system provides a means for beginners and health-conscious people to cook more effectively. It also allows users to enjoy cooking while learning professional cooking techniques, and provides appropriate responses according to the user's emotions.

[0241] Registering users and getting their personal settings

[0242] When a user launches the application for the first time, a screen appears prompting them to enter basic information such as their name, email address, and password. Once the basic information is entered, the device sends the information to the server, which then stores it in a database.

[0243] Next, the user enters personal information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[0244] Recipe suggestions and interactive guides

[0245] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device.

[0246] As the user cooks, the device will guide them through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[0247] Professional technology provided

[0248] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[0249] Collaboration with nutritionists

[0250] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[0251] Emotion Engine

[0252] The present invention also incorporates an emotion engine, which analyzes the user's voice input and facial expression data, allowing the server to use the emotion engine to generate responses based on the user's emotional state. If the user is feeling stressed, the system can provide recipes and advice that promote relaxation, making cooking more comfortable.

[0253] For example, if a user inputs "I'm tired today," the server will respond by suggesting a simple and relaxing dish, such as "cream-braised chicken." If the emotion engine detects sadness or fatigue from the user's voice or facial expression, it can also provide a warm message such as "Take a short break and then resume cooking."

[0254] Specific examples

[0255] Example 1: A user wants to make a quick dinner

[0256] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[0257] 2. The device displays the recipe and the user begins cooking.

[0258] 3. The device will then say, "Fry the bacon until crispy."

[0259] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[0260] Example 2: Recipe suggestions to make up for nutritional deficiencies

[0261] 1. The user enters the results of a health check and submits iron deficiency data.

[0262] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[0263] 3. The device displays the recipe and provides it to the user.

[0264] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[0265] Example 3: Using the Emotion Engine

[0266] 1. The user types, "I'm tired today."

[0267] 2. The server uses its emotion engine to respond, "We'll suggest some relaxing dishes."

[0268] 3. The server suggests "creamed chicken" and the device displays the recipe.

[0269] 4. When the user asks, "What's an easier dish to make?" the server offers the advice, "Maybe make a salad."

[0270] This system allows even beginners to easily create delicious and healthy meals, and also provides appropriate support based on the user's emotions.

[0271] The processing flow will be explained below.

[0272] Step 1:

[0273] A user launches an application and enters basic information such as name, email address, and password.

[0274] Step 2:

[0275] The terminal transmits the entered registration information to the server.

[0276] Step 3:

[0277] The server stores the received registration information in a database.

[0278] Step 4:

[0279] The user enters personal preference information such as allergen information, food preferences, and cooking skill level.

[0280] Step 5:

[0281] The device sends the personal setting information to the server.

[0282] Step 6:

[0283] The server stores the received personal setting information in a database.

[0284] Step 7:

[0285] A user uses the in-app search feature to request "easy dinner recipes."

[0286] Step 8:

[0287] Based on the request received by the server, a generative AI model is used to generate an appropriate recipe.

[0288] Step 9:

[0289] The server sends the generated recipe to the terminal.

[0290] Step 10:

[0291] The terminal displays the received recipe on the user interface.

[0292] Step 11:

[0293] The user presses a button to notify the user that cooking with the selected recipe is about to begin.

[0294] Step 12:

[0295] The device requests cooking instructions from the server.

[0296] Step 13:

[0297] The server generates the appropriate cooking instructions and sends them to the device.

[0298] Step 14:

[0299] The device will then guide the user through cooking steps via voice or text, for example, "Chop the onion and fry it in a frying pan."

[0300] Step 15:

[0301] The user speaks, "What should I do next?"

[0302] Step 16:

[0303] The server analyzes the question, generates the next steps, and sends them to the device, such as "Add tomatoes and continue to stir-fry."

[0304] Step 17:

[0305] The device will guide the user through the next steps via voice or text.

[0306] Step 18:

[0307] The user speaks, "How can I cook it better?"

[0308] Step 19:

[0309] The server searches for advice based on professional cooking techniques and sends it to the device, such as "Vegetables will taste better if you season them with a little salt and stir-fry them for a short time over high heat."

[0310] Step 20:

[0311] The terminal provides advice to the user by voice or text.

[0312] Step 21:

[0313] The user inputs the results of the health check.

[0314] Step 22:

[0315] The terminal transmits the health check results to the server.

[0316] Step 23:

[0317] The server stores the received health checkup results in a database and generates suitable recipes based on advice from a nutritionist.

[0318] Step 24:

[0319] The server sends the generated recipe to the device, suggesting, for example, "Stir-fried spinach and ground beef."

[0320] Step 25:

[0321] The terminal displays the received recipe on the user interface.

[0322] Step 26:

[0323] A user asks, "What else goes in this recipe?"

[0324] Step 27:

[0325] The server analyzes the question and generates additional ingredients and instructions to send to the device, such as "Please also add potatoes and onions."

[0326] Step 28:

[0327] The device will provide the user with additional instructions via voice or text.

[0328] Additional processing for the emotion engine

[0329] Step 29:

[0330] The user types, "I'm tired today."

[0331] Step 30:

[0332] The server uses an emotion engine to analyze the user's emotional state and responds by saying, "We'll suggest some dishes that will help you relax."

[0333] Step 31:

[0334] The server generates a recipe for a relaxing dish, such as "creamed chicken," and sends it to the device.

[0335] Step 32:

[0336] The terminal displays the received recipe on the user interface.

[0337] Step 33:

[0338] A user asks, "What's an easier recipe?"

[0339] Step 34:

[0340] The server uses an emotion engine to analyze easy-to-make dishes and suggest, for example, "It would be good to make a salad."

[0341] Step 35:

[0342] The device provides the user with simple cooking instructions via voice or text.

[0343] In this way, the present invention provides an interactive cooking support system that can be easily used even by beginners, and by combining it with an emotion engine, it can provide support that responds to the user's emotions, allowing users to cook delicious meals and improve the quality of their diet.

[0344] Example 2

[0345] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0346] Conventional cooking support systems have had difficulty providing appropriate support based on a user's individual settings, health condition, and emotional state. Furthermore, they lacked a means to provide users with professional cooking techniques or advice from nutritionists in real time, making it difficult to quickly and effectively resolve users' problems. Furthermore, they were unable to provide recipe suggestions or advice based on the user's emotional state, making it difficult to increase user satisfaction.

[0347] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0348] In this invention, the server includes: a means for a user to input dietary setting information and health checkup results; a means for connecting to a database that receives and stores the input information; a means for generating a recipe based on the input information using a generative AI model; a means for sending the generated recipe to the user, displaying it, and providing interactive cooking instructions; a means for analyzing the user's emotional data and generating a response based on the user's emotional state using an emotion engine; a means for generating a recipe based on the user's health state and providing advice from a nutritionist; and a means for providing advice based on professional cooking techniques. This makes it possible to quickly and effectively provide appropriate cooking support based on the user's individual information, health state, and emotional state.

[0349] "User" refers to the entity that uses the system to receive cooking support.

[0350] "Meal-related setting information" refers to information that users individually set when eating meals, such as allergen information, food preferences, and cooking skill level.

[0351] "Health checkup results" refers to data based on health checkups conducted at medical institutions, etc., and indicates information that indicates the user's health condition in numerical and written form.

[0352] "Input means" refers to the method a user uses to provide information to a system, including touch screens, keyboard input, etc.

[0353] "Server connected to a database that receives and stores" refers to a server connected to a network that receives input information and stores it in a database.

[0354] A "generative AI model" refers to an artificial intelligence model that automatically generates appropriate recipes and advice based on input data.

[0355] "Means for generating recipes" refers to a method for using a generative AI model to create a recipe based on user input.

[0356] "Means for providing interactive cooking instructions" refers to a system that provides step-by-step guidance on cooking steps while interacting with the user.

[0357] "Emotional data" refers to information that indicates the user's emotional state, such as voice input or facial expression data.

[0358] "Emotion engine" refers to an algorithm for analyzing emotional data and generating a response based on the user's emotional state.

[0359] "Dietitian advice" refers to advice based on the expertise and guidance on healthy eating provided by a dietitian.

[0360] "Professional culinary advice" refers to advice on cooking methods and techniques recommended by experienced chefs or culinary experts.

[0361] This invention is an interactive cooking support system that allows users to input dietary preferences and health checkup results and provides appropriate recipes based on those preferences. It uses an emotion engine to provide support that responds to the user's emotions. This system provides a means for beginners and health-conscious people to cook effectively. It also allows users to enjoy cooking while learning professional cooking techniques, and provides appropriate responses that respond to the user's emotions.

[0362] Registering users and getting their personal settings

[0363] When a user launches the application for the first time, a screen appears where they can enter basic information such as their name, email address, and password. Once this basic information has been entered, the device sends the information to the server, which stores the received information in a database. Next, the user enters personal setting information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[0364] Recipe suggestions and interactive guides

[0365] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses a generative AI model (e.g., GPT-4) to generate an appropriate recipe. The generative AI model uses "Generate an easy dinner recipe" as the prompt. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking steps from the server. The server generates appropriate cooking steps and sends them to the device. As the user continues cooking, the device guides the user through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[0366] Professional technology provided

[0367] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[0368] Collaboration with nutritionists

[0369] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[0370] Emotion Engine

[0371] The present invention also incorporates an emotion engine. This allows the server to analyze the user's voice input and facial expression data and use the emotion engine to generate a response based on the user's emotional state. If the user is feeling stressed, the server can provide recipes and advice that promote relaxation, making cooking more comfortable. For example, if the user inputs "I'm tired today," the server can respond by saying, "I'll suggest some easy and relaxing dishes," such as "chicken in cream sauce." Furthermore, if the emotion engine detects sadness or fatigue from the user's voice or facial expression, it can provide a warm message such as, "Take a short break and resume cooking."

[0372] Specific examples

[0373] Example 1: A user wants to make a quick dinner

[0374] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[0375] 2. The device displays the recipe and the user begins cooking.

[0376] 3. The device will then say, "Fry the bacon until crispy."

[0377] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[0378] Example 2: Recipe suggestions to make up for nutritional deficiencies

[0379] 1. The user enters the results of a health check and submits iron deficiency data.

[0380] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[0381] 3. The device displays the recipe and provides it to the user.

[0382] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[0383] Example 3: Using the Emotion Engine

[0384] 1. The user types, "I'm tired today."

[0385] 2. The server uses its emotion engine to respond, "We'll suggest some relaxing dishes."

[0386] 3. The server suggests "creamed chicken" and the device displays the recipe.

[0387] 4. When the user asks, "What's an easier dish to make?" the server offers the advice, "Maybe make a salad."

[0388] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0389] Program processing flow

[0390] Step 1: Register and retrieve user preferences

[0391] 1. User launches application for the first time:

[0392] Input: Basic information: Name, Email address, Password

[0393] Process: The user enters basic information into the input form.

[0394] Output: Basic information is entered into the terminal.

[0395] 2. The device sends basic information to the server:

[0396] Input: Basic information entered by the user

[0397] Processing: The terminal sends the entered basic information to the server.

[0398] Output: The server receives the basic information.

[0399] 3. The server saves the basic information to a database:

[0400] Input: Received basic information

[0401] Processing: The server stores the received basic information in a database.

[0402] Output: Basic information stored in a database.

[0403] 4. User enters personal configuration information:

[0404] Input: Personal settings such as allergen information, food preferences, and cooking skill level

[0405] Action: The user enters personal preference information into an input form.

[0406] Output: The personalization information is entered into the device.

[0407] 5. The device sends personal configuration information to the server:

[0408] Input: Personal setting information entered by the user

[0409] Processing: The device sends the entered personal setting information to the server.

[0410] Output: The server receives the personalization information.

[0411] 6. The server stores your personal settings in a database:

[0412] Input: Received personal setting information

[0413] Processing: The server stores the received personal setting information in a database.

[0414] Output: Personalization information stored in a database.

[0415] Step 2: Recipe suggestions

[0416] 1. User searches for a recipe:

[0417] Input: Search keyword (e.g. "easy dinner recipes")

[0418] What happens: A user enters keywords into the search bar and performs a search.

[0419] Output: A search request is generated on the device.

[0420] 2. The server generates a recipe using the generative AI model:

[0421] Input: Search keywords, personal settings information

[0422] Processing: The server uses a generative AI model (e.g., GPT-4) with the prompt "Generate a simple dinner recipe" to generate a recipe.

[0423] Output: Recipe data generated by the generative AI model is sent back to the server.

[0424] 3. The server sends the generated recipe to the device:

[0425] Input: Generated recipe data

[0426] Processing: The server sends the generated recipe to the device.

[0427] Output: Recipe data is received on the device.

[0428] 4. The device will display the recipe:

[0429] Input: Received recipe data

[0430] Processing: The terminal displays the recipe data on the user interface.

[0431] Output: The user can view the recipe.

[0432] Step 3: Interactive Guide

[0433] 1. User starts cooking and requests cooking instructions:

[0434] Input: Recipe selection, start instruction

[0435] Action: The device starts cooking based on the recipe selected by the user and requests the next cooking step.

[0436] Output: A cooking instructions request is generated on the device.

[0437] 2. The server generates the appropriate cooking instructions and sends them to the device:

[0438] Input: Selected recipe data, cooking procedure request

[0439] Processing: The server generates cooking instructions and sends them to the terminal.

[0440] Output: Cooking instructions data is received on the device.

[0441] 3. Your device will display or speak cooking instructions:

[0442] Input: Received cooking instructions data

[0443] Processing: The device provides the user with cooking instructions in text or audio format.

[0444] Output: The user is guided through the cooking steps (e.g., "Chop the onion and fry it in a frying pan").

[0445] Step 4: Professional technical support

[0446] 1. User requests additional advice:

[0447] Input: Question (e.g., "How can I cook vegetables more deliciously?")

[0448] Process: The user types or speaks a question into the terminal.

[0449] Output: A question request is generated on the terminal.

[0450] 2. The server provides professional advice:

[0451] Input: Question

[0452] Processing: The server generates advice based on professional cooking techniques and sends it to the device.

[0453] Output: Advice received by device (e.g. "Vegetables taste better if seasoned with a little salt and fried briefly over high heat").

[0454] 3. Your device will display or speak advice:

[0455] Input: Advice received

[0456] Processing: The terminal provides advice to the user by displaying text or by voice guidance.

[0457] Output: The user receives the advice.

[0458] Step 5: Work with a dietitian

[0459] 1. User enters health check results:

[0460] Input: Health checkup result data (e.g., iron deficiency information)

[0461] Process: The user enters the results of a health check into the application.

[0462] Output: The health check results are entered into the terminal.

[0463] 2. The device sends the health check result to the server:

[0464] Input: Health check result data

[0465] Processing: The terminal sends the health check result data to the server.

[0466] Output: Health check result data is received by the server.

[0467] 3. The server generates a recipe based on the nutritionist's advice:

[0468] Input: Health check result data

[0469] Processing: The server generates an appropriate recipe based on the nutritionist's advice (e.g., "Spinach and ground beef stir-fry").

[0470] Output: The generated recipe data is generated on the server.

[0471] 4. The server sends the generated recipe to the device:

[0472] Input: Generated recipe data

[0473] Processing: The server sends the generated recipe to the device.

[0474] Output: Recipe data is received on the device.

[0475] 5. The device will display the recipe:

[0476] Input: Received recipe data

[0477] Processing: The device displays the recipe in the user interface.

[0478] Output: The user can view the recipe.

[0479] Step 6: Leverage the Emotion Engine

[0480] 1. User inputs their emotion:

[0481] Input: Emotional state text data (e.g., "I'm tired today")

[0482] Processing: The user inputs their emotional state into the application.

[0483] Output: The emotional state is input to the terminal.

[0484] 2. The server uses the emotion engine to generate a response:

[0485] Input: Emotional state data

[0486] Processing: The server uses an emotion engine to generate a response based on the user's emotional state.

[0487] Output: Response data is generated on the server (e.g., "Suggested relaxing dishes").

[0488] 3. The server generates a recipe based on the emotion and sends it to the device:

[0489] Input: Emotional state data, generative AI model

[0490] Processing: The server uses the generative AI model to generate a recipe based on the emotion and sends it to the device (e.g., "cream-braised chicken").

[0491] Output: Recipe data is received on the device.

[0492] 4. The device will display the recipe:

[0493] Input: Received recipe data

[0494] Processing: The device displays the recipe in the user interface.

[0495] Output: The user can view the recipe.

[0496] 5. The emotion engine analyzes user reactions and responds further:

[0497] Input: User voice and facial expression data

[0498] Processing: The emotion engine analyzes the user's emotional state from their voice and facial expressions and generates an appropriate response.

[0499] Output: Response data is generated on the server and sent to the device (e.g., "Let's take a short break and then resume cooking").

[0500] (Application example 2)

[0501] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0502] In modern society, finding the right recipe and cooking effectively is a major challenge for beginners and busy people. They also lack the tools to reduce the emotions and stress they experience while cooking. Furthermore, it is difficult to incorporate healthy eating habits into their daily lives. Conventional systems struggle to address these needs, and new approaches are needed to improve user satisfaction.

[0503] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an information processing device connected to an electronic device that receives and stores the input information by a user's dietary setting information and health checkup results, means connected to the information processing device and that generates cooking instructions based on the input information using a generative AI model, means for sending and displaying the generated cooking instructions to the user and providing interactive cooking procedures, and means for analyzing the user's voice and facial expression data using an emotion engine and generating a response based on the user's emotions. This enables beginners and busy people to easily find appropriate and healthy recipes, cook effectively, and receive support tailored to their emotions.

[0504] A "user" is someone who uses the system to input dietary preferences and health check results and receive suggested recipes and cooking instructions.

[0505] "Dietary setting information" refers to personal setting information that affects meal selection and cooking, such as the user's allergen information, food preferences, and cooking skill level.

[0506] "Health checkup results" are medical data that indicate the user's health status and are information used to make dietary suggestions based on nutritional deficiencies or specific health risks.

[0507] "Input information" refers to the dietary settings and health check results entered by the user into the system.

[0508] "Electronic Device" means a device used by a User to input information and receive information from the System, including a smartphone, tablet, smart glasses, or head-mounted display.

[0509] An "information storage device" is hardware or software that stores data such as input information and generated cooking instructions.

[0510] An "information processing device" is a server or computer connected to an electronic device and information storage device for receiving and processing input information.

[0511] A "generative AI model" is an artificial intelligence model that generates appropriate cooking instructions and recipes based on information entered by the user.

[0512] "Cooking instructions" are specific cooking steps and advice generated by a generative AI model and provided to users.

[0513] "Means for providing interactive cooking instructions" refers to a function that provides users with real-time audio or text guidance on specific steps as they cook.

[0514] An "emotion engine" is a device or software that analyzes a user's voice and facial expression data to determine the user's emotional state.

[0515] The "means for generating a response based on emotions" is a function for generating appropriate responses or advice based on the user's emotional state analyzed by the emotion engine.

[0516] The present invention is a system that provides interactive support to users when cooking, and combines an emotion engine to provide support according to the user's emotions. This system is particularly suitable for beginners and people who are health conscious. To implement the invention, the following configuration and operating procedures are followed.

[0517] System configuration

[0518] Hardware

[0519] Electronic devices: Includes devices such as smartphones, tablets, smart glasses, and head-mounted displays.

[0520] Information storage: Includes MySQL and other database systems.

[0521] Information processing device: A server or cloud computing resource is used.

[0522] software

[0523] Generative AI models: Use Python and generative AI models (e.g., ChatGPT) to generate recipes and cooking instructions.

[0524] Sentiment engine: Uses machine learning libraries such as TensorFlow for sentiment analysis.

[0525] Front-end: Uses HTML, CSS, JavaScript, or a mobile application framework (e.g., React Native) to provide the user interface.

[0526] Program processing overview

[0527] 1. User registration and personal settings acquisition

[0528] When a user launches the application for the first time, they enter basic information (name, email address, password) into the electronic device. The entered information is sent to the information processing device and stored in the information storage device. Next, personal setting information such as allergen information and cooking skill level is also obtained.

[0529] 2. Recipe suggestions and interactive guides

[0530] When a user searches for a specific recipe, the information processing device uses a generative AI model to generate an appropriate recipe, which is then sent to the electronic device and displayed to the user, providing interactive support by providing real-time cooking instructions via voice and text.

[0531] 3. Professional technology provided

[0532] If the user needs additional advice while cooking, advice based on professional cooking techniques is provided via a generative AI model.

[0533] 4. Collaboration with nutritionists

[0534] If a user wants to improve their diet based on their health status, they can input their health check results and appropriate recipes will be generated based on them.

[0535] 5. Supported by Emotion Engine

[0536] The emotion engine analyzes the user's voice and facial expression data and generates responses based on their emotions. For example, if the user is tired, it will suggest relaxing dishes, providing support that matches the user's mood.

[0537] Specific examples

[0538] 1. Example 1: Simple dinner recipe suggestions

[0539] A user speaks, "Tell me an easy dinner recipe." The information processing device uses a generative AI model to suggest "Easy pasta with tomatoes and bacon." The device then displays the recipe and instructs the user to fry the bacon in a frying pan until crispy.

[0540] Prompt Sentence Examples

[0541] Can you recommend some easy dinner recipes?

[0542] 2. Example 2: Relaxation recipe suggestions using an emotion engine

[0543] The user inputs "I'm tired today" by voice. The information processing device analyzes the user's emotions using its emotion engine and responds by saying, "I'll suggest a dish that will help you relax." The next suggestion is "chicken stewed in cream sauce."

[0544] Prompt Sentence Examples

[0545] What are some relaxing cooking recipes you recommend for users when they're feeling tired?

[0546] In this way, beginners and busy people can cook properly and healthily without stress, and can also receive support according to their emotions.

[0547] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0548] Step 1: Enter and submit basic user information

[0549] A user starts up an electronic device and enters basic information such as name, email address, and password. The entered basic information is sent from the device to a server, which receives the information and stores it in an information storage device.

[0550] Step 2: Enter and submit your personal settings information

[0551] The user inputs personal setting information such as allergen information, food preferences, cooking skill level, etc. The input information is sent from the terminal to the server, which receives this information and stores it in an information storage device.

[0552] Step 3: Find and generate recipes

[0553] The user voice-inputs a request for a specific dish (e.g., "easy dinner recipes"), which is then sent from the device to the server. The server uses a generative AI model to generate a recipe based on the request, taking into account the user's personal settings. The server then sends the generated recipe back to the device.

[0554] Step 4: Display the recipe and provide cooking instructions

[0555] The device displays the received recipe to the user. When the user starts cooking, the device requests the next step from the server. The server uses a generative AI model to generate the next cooking steps and sends them to the device. The device then guides the user through these steps via voice or text, providing specific instructions such as "fry the bacon until crispy."

[0556] Step 5: Professional technical support

[0557] If a user needs additional advice while cooking, for example, by asking, "How can I cook vegetables more deliciously?", the device sends this question to the server. The server uses a generative AI model to generate advice based on professional cooking techniques and sends it to the device. The device then provides this advice to the user via voice or text.

[0558] Step 6: Health-based recipe suggestions

[0559] The user inputs the results of a health check (e.g., iron deficiency). These results are sent from the device to the server. The server combines the generative AI model with advice from a nutritionist to generate an appropriate recipe. The generated recipe is sent from the server to the device and displayed. The user then proceeds with cooking according to this recipe.

[0560] Step 7: Support from the Emotion Engine

[0561] The user provides voice input (for example, "I feel tired today"). This voice data is sent from the device to the server. The server uses an emotion engine to analyze the user's emotional state and generates appropriate recipes and advice based on the results. For example, the server responds with "I'll suggest some dishes that will help you relax" and suggests "cream-braised chicken." This information is sent from the server to the device and displayed.

[0562] At each step, the system processes data, with a generative AI model generating recipes based on the input information and an emotion engine analyzing the user's emotions. The output is cooking instructions, professional advice, and emotion-based suggestions provided to the device.

[0563] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0564] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0565] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0566] [Second embodiment]

[0567] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0568] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0569] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0570] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0571] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0572] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0573] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0574] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0575] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0576] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0577] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0578] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0579] This invention relates to an application that provides interactive support for users when cooking. This system provides a means for beginners and health-conscious people to cook more effectively. It also allows users to enjoy cooking while learning professional cooking techniques.

[0580] Registering users and getting their personal settings

[0581] When a user launches the application for the first time, a screen appears prompting them to enter basic information such as their name, email address, and password. Once the basic information is entered, the device sends the information to the server, which then stores it in a database.

[0582] Next, the user enters personal information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[0583] Recipe suggestions and interactive guides

[0584] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device.

[0585] As the user cooks, the device will guide them through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[0586] Professional technology provided

[0587] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[0588] Collaboration with nutritionists

[0589] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[0590] Specific examples

[0591] Example 1: A user wants to make a quick dinner

[0592] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[0593] 2. The device displays the recipe and the user begins cooking.

[0594] 3. The device will then say, "Fry the bacon until crispy."

[0595] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[0596] Example 2: Recipe suggestions to make up for nutritional deficiencies

[0597] 1. The user enters the results of a health check and submits iron deficiency data.

[0598] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[0599] 3. The device displays the recipe and provides it to the user.

[0600] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[0601] This system provides an environment in which even beginners can easily create delicious and healthy meals.

[0602] The processing flow will be explained below.

[0603] Step 1:

[0604] A user launches an application and enters basic information such as name, email address, and password.

[0605] Step 2:

[0606] The terminal transmits the entered registration information to the server.

[0607] Step 3:

[0608] The server stores the received registration information in a database.

[0609] Step 4:

[0610] The user enters personal preference information such as allergen information, food preferences, and cooking skill level.

[0611] Step 5:

[0612] The device sends the personal setting information to the server.

[0613] Step 6:

[0614] The server stores the received personal setting information in a database.

[0615] Step 7:

[0616] A user uses the in-app search feature to request "easy dinner recipes."

[0617] Step 8:

[0618] Based on the request received by the server, a generative AI model is used to generate an appropriate recipe.

[0619] Step 9:

[0620] The server sends the generated recipe to the terminal.

[0621] Step 10:

[0622] The terminal displays the received recipe on the user interface.

[0623] Step 11:

[0624] The user presses a button to notify the user that cooking with the selected recipe is about to begin.

[0625] Step 12:

[0626] The device requests cooking instructions from the server.

[0627] Step 13:

[0628] The server generates the appropriate cooking instructions and sends them to the device.

[0629] Step 14:

[0630] The device will then guide the user through cooking steps via voice or text, for example, "Chop the onion and fry it in a frying pan."

[0631] Step 15:

[0632] The user speaks, "What should I do next?"

[0633] Step 16:

[0634] The server analyzes the question, generates the next steps, and sends them to the device, such as "Add tomatoes and continue to stir-fry."

[0635] Step 17:

[0636] The device will guide the user through the next steps via voice or text.

[0637] Step 18:

[0638] The user speaks, "How can I cook it better?"

[0639] Step 19:

[0640] The server searches for advice based on professional cooking techniques and sends it to the device, such as "Vegetables will taste better if you season them with a little salt and stir-fry them for a short time over high heat."

[0641] Step 20:

[0642] The terminal provides advice to the user by voice or text.

[0643] Step 21:

[0644] The user inputs the results of the health check.

[0645] Step 22:

[0646] The terminal transmits the health check results to the server.

[0647] Step 23:

[0648] The server stores the received health checkup results in a database and generates suitable recipes based on advice from a nutritionist.

[0649] Step 24:

[0650] The server sends the generated recipe to the device, suggesting, for example, "Stir-fried spinach and ground beef."

[0651] Step 25:

[0652] The terminal displays the received recipe on the user interface.

[0653] Step 26:

[0654] A user asks, "What else goes in this recipe?"

[0655] Step 27:

[0656] The server analyzes the question and generates additional ingredients and instructions to send to the device, such as "Please also add potatoes and onions."

[0657] Step 28:

[0658] The device will provide the user with additional instructions via voice or text.

[0659] In this way, the present invention provides an interactive cooking support system that can be easily used even by beginners, enabling users to prepare delicious dishes and improve the quality of their dietary life.

[0660] Example 1

[0661] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0662] In today's society, many users find it difficult to eat healthy meals due to their busy lifestyles. Cooking effectively and efficiently can also be challenging for beginners and those with limited cooking skills. Furthermore, finding recipes that take into account specific health conditions and nutritional balance can be challenging, and there is a lack of access to the necessary cooking techniques and advice in real time. Therefore, there is a need for a system that allows users to easily obtain and execute recipes tailored to their individual conditions and needs.

[0663] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0664] In this invention, the server includes an information providing device connected to an information processing device that receives and stores the input information by the user's setting information and diagnostic results, a means for generating recipes based on the input information using a generative AI model, and a means for transmitting and displaying the generated recipes to the user and providing interactive cooking instructions, allowing users to easily obtain and execute recipes tailored to their individual conditions and needs.

[0665] An "information processing device" is a device that receives input information and performs the necessary calculations and data processing.

[0666] An "information storage device" is a device for storing received information and retrieving it as needed.

[0667] An "information providing device" is a device that includes an information processing device and an information storage device and provides necessary information to a user.

[0668] A "generative AI model" is an artificial intelligence model that generates a specific output based on given data.

[0669] "Cooking content" refers to the recipe and cooking steps required for the user to cook.

[0670] "User" refers to an individual who receives cooking assistance using this system.

[0671] "Interactive" refers to a method in which the system and the user interact with each other and provide appropriate responses in response to the user's questions and requests.

[0672] "Diagnosis results" refers to information and data regarding the user's health condition.

[0673] "Guide" refers to showing users the steps and providing instruction and guidance to help them achieve their goals.

[0674] This invention provides a cooking assistance system. The system allows users to input setting information and diagnostic results, and provides appropriate recipes and cooking procedures based on the input information. The system uses an information processing device, an information storage device, an information providing device, and a generative AI model.

[0675] Specifically, the user first launches the application and enters basic information such as name, email address, password, etc., as well as personal setting information such as allergen information, food preferences, cooking skill level, etc. The device sends this information to the server, and the server stores the received information in an information storage device, which is a database.

[0676] Next, when the user inputs a prompt such as "easy dinner recipe," the device sends this prompt to the server. The server uses the generative AI model to generate the optimal recipe and sends the result to the device. The device then displays the recipe information sent from the server and provides it to the user.

[0677] When a user selects a recipe and starts cooking, the device sends a cooking instructions request to the server. The server uses a generative AI model to generate appropriate cooking instructions and sends them to the device. The device then displays the received instructions in text or audio format, interactively guiding the user through the next cooking step. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time.

[0678] If a user asks, "How can I cook vegetables more deliciously?" while cooking, the device will send the question to the server. The server will generate advice based on professional cooking techniques and send it to the device. The device will then display the advice as voice or text, providing instructions to the user.

[0679] Furthermore, if a user wants to find dietary recipes to improve their health, they can input their health checkup results. For example, if they input information about iron deficiency, the device will send it to the server. The server will generate an appropriate recipe based on the advice of a nutritionist and send it to the device. The device will then display the generated recipe to the user and provide cooking support.

[0680] Prompt Sentence Examples

[0681] "Tell me some easy dinner recipes"

[0682] How can I cook vegetables more deliciously?

[0683] "What else goes into this recipe?"

[0684] This system allows users to easily obtain recipes tailored to their individual conditions and needs and then execute them step by step.

[0685] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0686] Step 1:

[0687] When a user launches the application for the first time, they enter basic information (such as name, email address, and password) and personal settings information (such as allergen information, food preferences, and cooking skill level). The entered information is sent by the device.

[0688] Step 2:

[0689] The device sends basic information and personal setting information to the server, which stores the received information in a database. This process records each user's individual information in the database.

[0690] Step 3:

[0691] The user inputs a prompt such as "easy dinner recipes." The terminal sends the input prompt to the server.

[0692] Step 4:

[0693] The server generates an appropriate recipe using a generative AI model based on the received prompt, taking into account the user's personal settings. The generated recipe is then sent from the server to the device.

[0694] Step 5:

[0695] The terminal displays the recipe information sent from the server and provides it to the user, who can then select a recipe from the displayed list.

[0696] Step 6:

[0697] The user selects a recipe and starts cooking. The device sends a request for the corresponding cooking instructions to the server.

[0698] Step 7:

[0699] The server uses the generative AI model to generate appropriate cooking instructions and sends them to the device, where they are displayed and provided to the user.

[0700] Step 8:

[0701] As the user cooks, they can ask questions such as "What's next?" and the device will send the question to the server.

[0702] Step 9:

[0703] The server generates the next cooking procedure or advice based on the question, and sends the generated procedure or advice to the terminal.

[0704] Step 10:

[0705] The device displays instructions and advice sent from the server in text or audio format and guides the user, providing specific instructions such as "Chop the onion and fry it in a frying pan."

[0706] Step 11:

[0707] When a user asks, "How can I cook vegetables more deliciously?" the device sends the question to the server.

[0708] Step 12:

[0709] The server generates advice based on professional cooking techniques and sends it to the device. The advice is displayed on the device and provided to the user. For example, specific advice such as "season vegetables with a little salt and stir-fry them for a short time over high heat will make them delicious" is provided.

[0710] Step 13:

[0711] When a user requests dietary recipes to improve their health, they input their health checkup results, and the terminal sends the input health information to the server.

[0712] Step 14:

[0713] The server uses a generative AI model based on the nutritionist's advice to generate an appropriate recipe, which is then sent to the device.

[0714] Step 15:

[0715] The device displays the generated recipe to the user and provides cooking support, and the user proceeds with cooking according to the displayed recipe.

[0716] (Application example 1)

[0717] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0718] In today's busy lifestyles, it is difficult for beginners and health-conscious people to cook easily and effectively at home. In particular, specific instructions on recipe selection, ingredient procurement, and cooking procedures are necessary, and a system that can consistently support these steps is needed.

[0719] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0720] In this invention, the server includes: means for a user to input dietary preference information and health checkup results, and means connected to a computer that receives the input information and a database that stores the input information; means for generating recipes based on the input information using a generative AI model; means for analyzing ingredients for the generated recipes and ordering delivery in bulk; means for sending and displaying the generated recipes to the user and providing interactive cooking instructions; and means for providing cooking instructions in text or voice in real time. This allows users to receive consistent support from recipe selection to ingredient procurement and cooking instructions, enabling them to cook easily and effectively at home.

[0721] "User" refers to an individual who uses the System to cook.

[0722] "Dietary settings information" refers to data about a user's individual diet, such as allergen information, food preferences, and cooking skill level.

[0723] "Health checkup results" refers to diagnostic results and medical data that indicate the user's health condition.

[0724] "Computer" means an electronic computing device for receiving and processing user information and requests.

[0725] "Database" refers to a data storage device used by a computer to store user information received or system-generated data.

[0726] "Server" refers to a central device connected to a computer and database that manages the processing of the entire system.

[0727] "Generative AI model" refers to an artificial intelligence model that generates recipes based on input information.

[0728] A "recipe" refers to cooking instructions that include cooking steps, ingredients, etc.

[0729] "Ingredients" refers to the ingredients listed in the recipe and items needed for cooking.

[0730] "Delivery" refers to the service of delivering materials ordered on the system to the user.

[0731] "Interactive means" refers to the functionality that allows users and systems to communicate in real time.

[0732] "Cooking instructions" refers to the specific cooking steps and advice provided by the system as the user cooks.

[0733] The present invention relates to a system that provides interactive support for users when cooking. This system provides a means for more effective cooking, especially for beginners and health-conscious people. It also allows users to enjoy cooking while learning professional cooking techniques.

[0734] Registering users and getting their personal settings

[0735] When a user launches the application for the first time, a screen appears where they can enter basic information such as their name, email address, and password. Once the basic information has been entered, the device sends the information to the server, which stores the received information in a database. Next, the user enters personal setting information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[0736] Recipe suggestions and ingredient delivery orders

[0737] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. The server then analyzes the ingredients of the generated recipe and automatically initiates a bulk delivery order. The ingredients are then quickly delivered to the user via a delivery service.

[0738] Interactive Cooking Support

[0739] When a user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device. As the user continues cooking, the device guides the user through the next steps via text or voice. For example, specific instructions such as "fry the bacon until crispy" are provided in real time. This allows even beginners to cook step by step. When the user asks "What's next?", the server provides further cooking instructions.

[0740] Professional technical support and nutritional management

[0741] If a user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and stir-fry them briefly over high heat to make them more delicious." The device then displays this information as voice or text, providing instructions to the user.

[0742] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[0743] Computer System Configuration

[0744] The server is connected to a computer and a database that stores the information. The computer is a device that receives and processes user information and requests, and the database is a data storage device that stores that information. The server uses a generative AI model to generate recipes, order ingredients for delivery, and provide interactive cooking instructions. The hardware and software used include Python, Django, or Flask (server-side), requests (API communication), and OpenAI GPT-3 (generative AI model).

[0745] Examples and prompts

[0746] 1. The user launches the application and requests "easy dinner recipes."

[0747] 2. The server uses GPT-3 to suggest a recipe for "Easy Tomato and Bacon Pasta" and display a list of ingredients.

[0748] 3. When the user presses the "Order" button, the necessary ingredients are ordered via a delivery service.

[0749] 4. After the delivery is complete, the device provides specific cooking instructions in real time, such as "Please fry the bacon until crispy."

[0750] Example prompt sentence:

[0751] "Suggest easy dinner recipes based on your user information: {preferences: 'healthy, easy'}. For example, easy pasta with tomatoes and bacon."

[0752] Thus, the present invention is a system that helps users cook at home simply and effectively. بهره‌برداری از این ‌اختراع، کاربر را قادر می‌سازد که با بهره‌گیری از فناوری هوش مصنوعی ایجاد شده و خدمات تحویل مواد بسته‌بندی شده، آشپزی در منزل را به یک تجربه ساده و کارآمد تبدیل کند.

[0753] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0754] Step 1:

[0755] Enter user registration information

[0756] When a user starts an application for the first time, a screen appears on the device where the user can enter basic information such as name, email address, and password. When the user enters this information (input), the device sends the information to the server (data transmission). The server then stores the received information in a database (data storage).

[0757] Step 2:

[0758] Obtaining personal setting information

[0759] The user then enters personal information such as allergen information, food preferences, and cooking skill level (input). The device sends this information to the server (data transmission), which then stores it in a database (data storage). This allows for the accumulation of personalized information that can be used for future recipe suggestions and interactive support (data storage).

[0760] Step 3:

[0761] Requesting and generating recipe suggestions

[0762] When a user makes a search request for "easy dinner recipes" (input), the device sends the request to the server (data transmission). Based on the received information, the server uses a generative AI model (GPT-3) to generate a prompt and create an "easy dinner recipe" (data generation). The generated recipe is sent to the device and displayed (data display).

[0763] Step 4:

[0764] Material delivery order

[0765] After the generated recipe is displayed, the user presses the "Order" button (input), and the device sends the ingredients list to the server (data transmission). The server analyzes the received ingredients list and places a bulk delivery order (data processing). The order data is then sent to the delivery service (data transmission).

[0766] Step 5:

[0767] Interactive cooking support launched

[0768] After the recipe ingredients arrive at the user's home (ingredient receipt), when the user begins cooking, the device sends a cooking procedure request to the server (data transmission). The server generates appropriate cooking procedures and sends them to the device (data generation, data transmission). The device then displays or audibly guides the user through the procedures (data display, audio output).

[0769] Step 6:

[0770] Providing cooking instructions in real time

[0771] As the user continues cooking, for example by asking "What's next?" (input), the device sends the voice data or text to the server (data transmission). The server analyzes the request, generates the next cooking instruction, and sends it to the device (data analysis, data generation, data transmission). The device then displays or plays back this in real time as voice or text (data display, voice output).

[0772] Step 7:

[0773] Professional technical support and advice

[0774] If the user needs additional advice while cooking (input), for example, by asking, "How can I cook vegetables more deliciously?", the device will send the question to the server (data transmission). The server will use a generative AI model to generate advice based on professional cooking techniques (data generation) and immediately send it to the device (data transmission). The device will then display or provide audio guidance in real time (data display, audio output).

[0775] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0776] This invention relates to a system that provides interactive support for users when cooking and, by combining it with an emotion engine, provides support according to the user's emotions. This system provides a means for beginners and health-conscious people to cook more effectively. It also allows users to enjoy cooking while learning professional cooking techniques, and provides appropriate responses according to the user's emotions.

[0777] Registering users and getting their personal settings

[0778] When a user launches the application for the first time, a screen appears prompting them to enter basic information such as their name, email address, and password. Once the basic information is entered, the device sends the information to the server, which then stores it in a database.

[0779] Next, the user enters personal information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[0780] Recipe suggestions and interactive guides

[0781] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device.

[0782] As the user cooks, the device will guide them through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[0783] Professional technology provided

[0784] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[0785] Collaboration with nutritionists

[0786] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[0787] Emotion Engine

[0788] The present invention also incorporates an emotion engine, which analyzes the user's voice input and facial expression data, allowing the server to use the emotion engine to generate responses based on the user's emotional state. If the user is feeling stressed, the system can provide recipes and advice that promote relaxation, making cooking more comfortable.

[0789] For example, if a user inputs "I'm tired today," the server will respond by suggesting a simple and relaxing dish, such as "cream-braised chicken." If the emotion engine detects sadness or fatigue from the user's voice or facial expression, it can also provide a warm message such as "Take a short break and then resume cooking."

[0790] Specific examples

[0791] Example 1: A user wants to make a quick dinner

[0792] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[0793] 2. The device displays the recipe and the user begins cooking.

[0794] 3. The device will then say, "Fry the bacon until crispy."

[0795] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[0796] Example 2: Recipe suggestions to make up for nutritional deficiencies

[0797] 1. The user enters the results of a health check and submits iron deficiency data.

[0798] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[0799] 3. The device displays the recipe and provides it to the user.

[0800] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[0801] Example 3: Using the Emotion Engine

[0802] 1. The user types, "I'm tired today."

[0803] 2. The server uses its emotion engine to respond, "We'll suggest some relaxing dishes."

[0804] 3. The server suggests "creamed chicken" and the device displays the recipe.

[0805] 4. When the user asks, "What's an easier dish to make?" the server offers the advice, "Maybe make a salad."

[0806] This system allows even beginners to easily create delicious and healthy meals, and also provides appropriate support based on the user's emotions.

[0807] The processing flow will be explained below.

[0808] Step 1:

[0809] A user launches an application and enters basic information such as name, email address, and password.

[0810] Step 2:

[0811] The terminal transmits the entered registration information to the server.

[0812] Step 3:

[0813] The server stores the received registration information in a database.

[0814] Step 4:

[0815] The user enters personal preference information such as allergen information, food preferences, and cooking skill level.

[0816] Step 5:

[0817] The device sends the personal setting information to the server.

[0818] Step 6:

[0819] The server stores the received personal setting information in a database.

[0820] Step 7:

[0821] A user uses the in-app search feature to request "easy dinner recipes."

[0822] Step 8:

[0823] Based on the request received by the server, a generative AI model is used to generate an appropriate recipe.

[0824] Step 9:

[0825] The server sends the generated recipe to the terminal.

[0826] Step 10:

[0827] The terminal displays the received recipe on the user interface.

[0828] Step 11:

[0829] The user presses a button to notify the user that cooking with the selected recipe is about to begin.

[0830] Step 12:

[0831] The device requests cooking instructions from the server.

[0832] Step 13:

[0833] The server generates the appropriate cooking instructions and sends them to the device.

[0834] Step 14:

[0835] The device will then guide the user through cooking steps via voice or text, for example, "Chop the onion and fry it in a frying pan."

[0836] Step 15:

[0837] The user speaks, "What should I do next?"

[0838] Step 16:

[0839] The server analyzes the question, generates the next steps, and sends them to the device, such as "Add tomatoes and continue to stir-fry."

[0840] Step 17:

[0841] The device will guide the user through the next steps via voice or text.

[0842] Step 18:

[0843] The user speaks, "How can I cook it better?"

[0844] Step 19:

[0845] The server searches for advice based on professional cooking techniques and sends it to the device, such as "Vegetables will taste better if you season them with a little salt and stir-fry them for a short time over high heat."

[0846] Step 20:

[0847] The terminal provides advice to the user by voice or text.

[0848] Step 21:

[0849] The user inputs the results of the health check.

[0850] Step 22:

[0851] The terminal transmits the health check results to the server.

[0852] Step 23:

[0853] The server stores the received health checkup results in a database and generates suitable recipes based on advice from a nutritionist.

[0854] Step 24:

[0855] The server sends the generated recipe to the device, suggesting, for example, "Stir-fried spinach and ground beef."

[0856] Step 25:

[0857] The terminal displays the received recipe on the user interface.

[0858] Step 26:

[0859] A user asks, "What else goes in this recipe?"

[0860] Step 27:

[0861] The server analyzes the question and generates additional ingredients and instructions to send to the device, such as "Please also add potatoes and onions."

[0862] Step 28:

[0863] The device will provide the user with additional instructions via voice or text.

[0864] Additional processing for the emotion engine

[0865] Step 29:

[0866] The user types, "I'm tired today."

[0867] Step 30:

[0868] The server uses an emotion engine to analyze the user's emotional state and responds by saying, "We'll suggest some dishes that will help you relax."

[0869] Step 31:

[0870] The server generates a recipe for a relaxing dish, such as "creamed chicken," and sends it to the device.

[0871] Step 32:

[0872] The terminal displays the received recipe on the user interface.

[0873] Step 33:

[0874] A user asks, "What's an easier recipe?"

[0875] Step 34:

[0876] The server uses an emotion engine to analyze easy-to-make dishes and suggest, for example, "It would be good to make a salad."

[0877] Step 35:

[0878] The device provides the user with simple cooking instructions via voice or text.

[0879] In this way, the present invention provides an interactive cooking support system that can be easily used even by beginners, and by combining it with an emotion engine, it can provide support that responds to the user's emotions, allowing users to cook delicious meals and improve the quality of their diet.

[0880] Example 2

[0881] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0882] Conventional cooking support systems have had difficulty providing appropriate support based on a user's individual settings, health condition, and emotional state. Furthermore, they lacked a means to provide users with professional cooking techniques or advice from nutritionists in real time, making it difficult to quickly and effectively resolve users' problems. Furthermore, they were unable to provide recipe suggestions or advice based on the user's emotional state, making it difficult to increase user satisfaction.

[0883] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0884] In this invention, the server includes: a means for a user to input dietary setting information and health checkup results; a means for connecting to a database that receives and stores the input information; a means for generating a recipe based on the input information using a generative AI model; a means for sending the generated recipe to the user, displaying it, and providing interactive cooking instructions; a means for analyzing the user's emotional data and generating a response based on the user's emotional state using an emotion engine; a means for generating a recipe based on the user's health state and providing advice from a nutritionist; and a means for providing advice based on professional cooking techniques. This makes it possible to quickly and effectively provide appropriate cooking support based on the user's individual information, health state, and emotional state.

[0885] "User" refers to the entity that uses the system to receive cooking support.

[0886] "Meal-related setting information" refers to information that users individually set when eating meals, such as allergen information, food preferences, and cooking skill level.

[0887] "Health checkup results" refers to data based on health checkups conducted at medical institutions, etc., and indicates information that indicates the user's health condition in numerical and written form.

[0888] "Input means" refers to the method a user uses to provide information to a system, including touch screens, keyboard input, etc.

[0889] "Server connected to a database that receives and stores" refers to a server connected to a network that receives input information and stores it in a database.

[0890] A "generative AI model" refers to an artificial intelligence model that automatically generates appropriate recipes and advice based on input data.

[0891] "Means for generating recipes" refers to a method for using a generative AI model to create a recipe based on user input.

[0892] "Means for providing interactive cooking instructions" refers to a system that provides step-by-step guidance on cooking steps while interacting with the user.

[0893] "Emotional data" refers to information that indicates the user's emotional state, such as voice input or facial expression data.

[0894] "Emotion engine" refers to an algorithm for analyzing emotional data and generating a response based on the user's emotional state.

[0895] "Dietitian advice" refers to advice based on the expertise and guidance on healthy eating provided by a dietitian.

[0896] "Professional culinary advice" refers to advice on cooking methods and techniques recommended by experienced chefs or culinary experts.

[0897] This invention is an interactive cooking support system that allows users to input dietary preferences and health checkup results and provides appropriate recipes based on those preferences. It uses an emotion engine to provide support that responds to the user's emotions. This system provides a means for beginners and health-conscious people to cook effectively. It also allows users to enjoy cooking while learning professional cooking techniques, and provides appropriate responses that respond to the user's emotions.

[0898] Registering users and getting their personal settings

[0899] When a user launches the application for the first time, a screen appears where they can enter basic information such as their name, email address, and password. Once this basic information has been entered, the device sends the information to the server, which stores the received information in a database. Next, the user enters personal setting information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[0900] Recipe suggestions and interactive guides

[0901] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses a generative AI model (e.g., GPT-4) to generate an appropriate recipe. The generative AI model uses "Generate an easy dinner recipe" as the prompt. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking steps from the server. The server generates appropriate cooking steps and sends them to the device. As the user continues cooking, the device guides the user through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[0902] Professional technology provided

[0903] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[0904] Collaboration with nutritionists

[0905] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[0906] Emotion Engine

[0907] The present invention also incorporates an emotion engine. This allows the server to analyze the user's voice input and facial expression data and use the emotion engine to generate a response based on the user's emotional state. If the user is feeling stressed, the server can provide recipes and advice that promote relaxation, making cooking more comfortable. For example, if the user inputs "I'm tired today," the server can respond by saying, "I'll suggest some easy and relaxing dishes," such as "chicken in cream sauce." Furthermore, if the emotion engine detects sadness or fatigue from the user's voice or facial expression, it can provide a warm message such as, "Take a short break and resume cooking."

[0908] Specific examples

[0909] Example 1: A user wants to make a quick dinner

[0910] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[0911] 2. The device displays the recipe and the user begins cooking.

[0912] 3. The device will then say, "Fry the bacon until crispy."

[0913] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[0914] Example 2: Recipe suggestions to make up for nutritional deficiencies

[0915] 1. The user enters the results of a health check and submits iron deficiency data.

[0916] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[0917] 3. The device displays the recipe and provides it to the user.

[0918] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[0919] Example 3: Using the Emotion Engine

[0920] 1. The user types, "I'm tired today."

[0921] 2. The server uses its emotion engine to respond, "We'll suggest some relaxing dishes."

[0922] 3. The server suggests "creamed chicken" and the device displays the recipe.

[0923] 4. When the user asks, "What's an easier dish to make?" the server offers the advice, "Maybe make a salad."

[0924] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0925] Program processing flow

[0926] Step 1: Register and retrieve user preferences

[0927] 1. User launches application for the first time:

[0928] Input: Basic information: Name, Email address, Password

[0929] Process: The user enters basic information into the input form.

[0930] Output: Basic information is entered into the terminal.

[0931] 2. The device sends basic information to the server:

[0932] Input: Basic information entered by the user

[0933] Processing: The terminal sends the entered basic information to the server.

[0934] Output: The server receives the basic information.

[0935] 3. The server saves the basic information to a database:

[0936] Input: Received basic information

[0937] Processing: The server stores the received basic information in a database.

[0938] Output: Basic information stored in a database.

[0939] 4. User enters personal configuration information:

[0940] Input: Personal settings such as allergen information, food preferences, and cooking skill level

[0941] Action: The user enters personal preference information into an input form.

[0942] Output: The personalization information is entered into the device.

[0943] 5. The device sends personal configuration information to the server:

[0944] Input: Personal setting information entered by the user

[0945] Processing: The device sends the entered personal setting information to the server.

[0946] Output: The server receives the personalization information.

[0947] 6. The server stores your personal settings in a database:

[0948] Input: Received personal setting information

[0949] Processing: The server stores the received personal setting information in a database.

[0950] Output: Personalization information stored in a database.

[0951] Step 2: Recipe suggestions

[0952] 1. User searches for a recipe:

[0953] Input: Search keyword (e.g. "easy dinner recipes")

[0954] What happens: A user enters keywords into the search bar and performs a search.

[0955] Output: A search request is generated on the device.

[0956] 2. The server generates a recipe using the generative AI model:

[0957] Input: Search keywords, personal settings information

[0958] Processing: The server uses a generative AI model (e.g., GPT-4) with the prompt "Generate a simple dinner recipe" to generate a recipe.

[0959] Output: Recipe data generated by the generative AI model is sent back to the server.

[0960] 3. The server sends the generated recipe to the device:

[0961] Input: Generated recipe data

[0962] Processing: The server sends the generated recipe to the device.

[0963] Output: Recipe data is received on the device.

[0964] 4. The device will display the recipe:

[0965] Input: Received recipe data

[0966] Processing: The terminal displays the recipe data on the user interface.

[0967] Output: The user can view the recipe.

[0968] Step 3: Interactive Guide

[0969] 1. User starts cooking and requests cooking instructions:

[0970] Input: Recipe selection, start instruction

[0971] Action: The device starts cooking based on the recipe selected by the user and requests the next cooking step.

[0972] Output: A cooking instructions request is generated on the device.

[0973] 2. The server generates the appropriate cooking instructions and sends them to the device:

[0974] Input: Selected recipe data, cooking procedure request

[0975] Processing: The server generates cooking instructions and sends them to the terminal.

[0976] Output: Cooking instructions data is received on the device.

[0977] 3. Your device will display or speak cooking instructions:

[0978] Input: Received cooking instructions data

[0979] Processing: The device provides the user with cooking instructions in text or audio format.

[0980] Output: The user is guided through the cooking steps (e.g., "Chop the onion and fry it in a frying pan").

[0981] Step 4: Professional technical support

[0982] 1. User requests additional advice:

[0983] Input: Question (e.g., "How can I cook vegetables more deliciously?")

[0984] Process: The user types or speaks a question into the terminal.

[0985] Output: A question request is generated on the terminal.

[0986] 2. The server provides professional advice:

[0987] Input: Question

[0988] Processing: The server generates advice based on professional cooking techniques and sends it to the device.

[0989] Output: Advice received by device (e.g. "Vegetables taste better if seasoned with a little salt and fried briefly over high heat").

[0990] 3. Your device will display or speak advice:

[0991] Input: Advice received

[0992] Processing: The terminal provides advice to the user by displaying text or by voice guidance.

[0993] Output: The user receives the advice.

[0994] Step 5: Work with a dietitian

[0995] 1. User enters health check results:

[0996] Input: Health checkup result data (e.g., iron deficiency information)

[0997] Process: The user enters the results of a health check into the application.

[0998] Output: The health check results are entered into the terminal.

[0999] 2. The device sends the health check result to the server:

[1000] Input: Health check result data

[1001] Processing: The terminal sends the health check result data to the server.

[1002] Output: Health check result data is received by the server.

[1003] 3. The server generates a recipe based on the nutritionist's advice:

[1004] Input: Health check result data

[1005] Processing: The server generates an appropriate recipe based on the nutritionist's advice (e.g., "Spinach and ground beef stir-fry").

[1006] Output: The generated recipe data is generated on the server.

[1007] 4. The server sends the generated recipe to the device:

[1008] Input: Generated recipe data

[1009] Processing: The server sends the generated recipe to the device.

[1010] Output: Recipe data is received on the device.

[1011] 5. The device will display the recipe:

[1012] Input: Received recipe data

[1013] Processing: The device displays the recipe in the user interface.

[1014] Output: The user can view the recipe.

[1015] Step 6: Leverage the Emotion Engine

[1016] 1. User inputs their emotion:

[1017] Input: Emotional state text data (e.g., "I'm tired today")

[1018] Processing: The user inputs their emotional state into the application.

[1019] Output: The emotional state is input to the terminal.

[1020] 2. The server uses the emotion engine to generate a response:

[1021] Input: Emotional state data

[1022] Processing: The server uses an emotion engine to generate a response based on the user's emotional state.

[1023] Output: Response data is generated on the server (e.g., "Suggested relaxing dishes").

[1024] 3. The server generates a recipe based on the emotion and sends it to the device:

[1025] Input: Emotional state data, generative AI model

[1026] Processing: The server uses the generative AI model to generate a recipe based on the emotion and sends it to the device (e.g., "cream-braised chicken").

[1027] Output: Recipe data is received on the device.

[1028] 4. The device will display the recipe:

[1029] Input: Received recipe data

[1030] Processing: The device displays the recipe in the user interface.

[1031] Output: The user can view the recipe.

[1032] 5. The emotion engine analyzes user reactions and responds further:

[1033] Input: User voice and facial expression data

[1034] Processing: The emotion engine analyzes the user's emotional state from their voice and facial expressions and generates an appropriate response.

[1035] Output: Response data is generated on the server and sent to the device (e.g., "Let's take a short break and then resume cooking").

[1036] (Application example 2)

[1037] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1038] In modern society, finding the right recipe and cooking effectively is a major challenge for beginners and busy people. They also lack the tools to reduce the emotions and stress they experience while cooking. Furthermore, it is difficult to incorporate healthy eating habits into their daily lives. Conventional systems struggle to address these needs, and new approaches are needed to improve user satisfaction.

[1039] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an information processing device connected to an electronic device that receives and stores the input information by a user's dietary setting information and health checkup results, means connected to the information processing device and that generates cooking instructions based on the input information using a generative AI model, means for sending and displaying the generated cooking instructions to the user and providing interactive cooking procedures, and means for analyzing the user's voice and facial expression data using an emotion engine and generating a response based on the user's emotions. This enables beginners and busy people to easily find appropriate and healthy recipes, cook effectively, and receive support tailored to their emotions.

[1040] A "user" is someone who uses the system to input dietary preferences and health check results and receive suggested recipes and cooking instructions.

[1041] "Dietary setting information" refers to personal setting information that affects meal selection and cooking, such as the user's allergen information, food preferences, and cooking skill level.

[1042] "Health checkup results" are medical data that indicate the user's health status and are information used to make dietary suggestions based on nutritional deficiencies or specific health risks.

[1043] "Input information" refers to the dietary settings and health check results entered by the user into the system.

[1044] "Electronic Device" means a device used by a User to input information and receive information from the System, including a smartphone, tablet, smart glasses, or head-mounted display.

[1045] An "information storage device" is hardware or software that stores data such as input information and generated cooking instructions.

[1046] An "information processing device" is a server or computer connected to an electronic device and information storage device for receiving and processing input information.

[1047] A "generative AI model" is an artificial intelligence model that generates appropriate cooking instructions and recipes based on information entered by the user.

[1048] "Cooking instructions" are specific cooking steps and advice generated by a generative AI model and provided to users.

[1049] "Means for providing interactive cooking instructions" refers to a function that provides users with real-time audio or text guidance on specific steps as they cook.

[1050] An "emotion engine" is a device or software that analyzes a user's voice and facial expression data to determine the user's emotional state.

[1051] The "means for generating a response based on emotions" is a function for generating appropriate responses or advice based on the user's emotional state analyzed by the emotion engine.

[1052] The present invention is a system that provides interactive support to users when cooking, and combines an emotion engine to provide support according to the user's emotions. This system is particularly suitable for beginners and people who are health conscious. To implement the invention, the following configuration and operating procedures are followed.

[1053] System configuration

[1054] Hardware

[1055] Electronic devices: Includes devices such as smartphones, tablets, smart glasses, and head-mounted displays.

[1056] Information storage: Includes MySQL and other database systems.

[1057] Information processing device: A server or cloud computing resource is used.

[1058] software

[1059] Generative AI models: Use Python and generative AI models (e.g., ChatGPT) to generate recipes and cooking instructions.

[1060] Sentiment engine: Uses machine learning libraries such as TensorFlow for sentiment analysis.

[1061] Front-end: Uses HTML, CSS, JavaScript, or a mobile application framework (e.g., React Native) to provide the user interface.

[1062] Program processing overview

[1063] 1. User registration and personal settings acquisition

[1064] When a user launches the application for the first time, they enter basic information (name, email address, password) into the electronic device. The entered information is sent to the information processing device and stored in the information storage device. Next, personal setting information such as allergen information and cooking skill level is also obtained.

[1065] 2. Recipe suggestions and interactive guides

[1066] When a user searches for a specific recipe, the information processing device uses a generative AI model to generate an appropriate recipe, which is then sent to the electronic device and displayed to the user, providing interactive support by providing real-time cooking instructions via voice and text.

[1067] 3. Professional technology provided

[1068] If the user needs additional advice while cooking, advice based on professional cooking techniques is provided via a generative AI model.

[1069] 4. Collaboration with nutritionists

[1070] If a user wants to improve their diet based on their health status, they can input their health check results and appropriate recipes will be generated based on them.

[1071] 5. Supported by Emotion Engine

[1072] The emotion engine analyzes the user's voice and facial expression data and generates responses based on their emotions. For example, if the user is tired, it will suggest relaxing dishes, providing support that matches the user's mood.

[1073] Specific examples

[1074] 1. Example 1: Simple dinner recipe suggestions

[1075] A user speaks, "Tell me an easy dinner recipe." The information processing device uses a generative AI model to suggest "Easy pasta with tomatoes and bacon." The device then displays the recipe and instructs the user to fry the bacon in a frying pan until crispy.

[1076] Prompt Sentence Examples

[1077] Can you recommend some easy dinner recipes?

[1078] 2. Example 2: Relaxation recipe suggestions using an emotion engine

[1079] The user inputs "I'm tired today" by voice. The information processing device analyzes the user's emotions using its emotion engine and responds by saying, "I'll suggest a dish that will help you relax." The next suggestion is "chicken stewed in cream sauce."

[1080] Prompt Sentence Examples

[1081] What are some relaxing cooking recipes you recommend for users when they're feeling tired?

[1082] In this way, beginners and busy people can cook properly and healthily without stress, and can also receive support according to their emotions.

[1083] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1084] Step 1: Enter and submit basic user information

[1085] A user starts up an electronic device and enters basic information such as name, email address, and password. The entered basic information is sent from the device to a server, which receives the information and stores it in an information storage device.

[1086] Step 2: Enter and submit your personal settings information

[1087] The user inputs personal setting information such as allergen information, food preferences, cooking skill level, etc. The input information is sent from the terminal to the server, which receives this information and stores it in an information storage device.

[1088] Step 3: Find and generate recipes

[1089] The user voice-inputs a request for a specific dish (e.g., "easy dinner recipes"), which is then sent from the device to the server. The server uses a generative AI model to generate a recipe based on the request, taking into account the user's personal settings. The server then sends the generated recipe back to the device.

[1090] Step 4: Display the recipe and provide cooking instructions

[1091] The device displays the received recipe to the user. When the user starts cooking, the device requests the next step from the server. The server uses a generative AI model to generate the next cooking steps and sends them to the device. The device then guides the user through these steps via voice or text, providing specific instructions such as "fry the bacon until crispy."

[1092] Step 5: Professional technical support

[1093] If a user needs additional advice while cooking, for example, by asking, "How can I cook vegetables more deliciously?", the device sends this question to the server. The server uses a generative AI model to generate advice based on professional cooking techniques and sends it to the device. The device then provides this advice to the user via voice or text.

[1094] Step 6: Health-based recipe suggestions

[1095] The user inputs the results of a health check (e.g., iron deficiency). These results are sent from the device to the server. The server combines the generative AI model with advice from a nutritionist to generate an appropriate recipe. The generated recipe is sent from the server to the device and displayed. The user then proceeds with cooking according to this recipe.

[1096] Step 7: Support from the Emotion Engine

[1097] The user provides voice input (for example, "I feel tired today"). This voice data is sent from the device to the server. The server uses an emotion engine to analyze the user's emotional state and generates appropriate recipes and advice based on the results. For example, the server responds with "I'll suggest some dishes that will help you relax" and suggests "cream-braised chicken." This information is sent from the server to the device and displayed.

[1098] At each step, the system processes data, with a generative AI model generating recipes based on the input information and an emotion engine analyzing the user's emotions. The output is cooking instructions, professional advice, and emotion-based suggestions provided to the device.

[1099] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1100] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1101] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1102] [Third embodiment]

[1103] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1104] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1105] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1106] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1107] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1108] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1109] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1110] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1111] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1112] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1113] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1114] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1115] This invention relates to an application that provides interactive support for users when cooking. This system provides a means for beginners and health-conscious people to cook more effectively. It also allows users to enjoy cooking while learning professional cooking techniques.

[1116] Registering users and getting their personal settings

[1117] When a user launches the application for the first time, a screen appears prompting them to enter basic information such as their name, email address, and password. Once the basic information is entered, the device sends the information to the server, which then stores it in a database.

[1118] Next, the user enters personal information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[1119] Recipe suggestions and interactive guides

[1120] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device.

[1121] As the user cooks, the device will guide them through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[1122] Professional technology provided

[1123] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[1124] Collaboration with nutritionists

[1125] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[1126] Specific examples

[1127] Example 1: A user wants to make a quick dinner

[1128] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[1129] 2. The device displays the recipe and the user begins cooking.

[1130] 3. The device will then say, "Fry the bacon until crispy."

[1131] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[1132] Example 2: Recipe suggestions to make up for nutritional deficiencies

[1133] 1. The user enters the results of a health check and submits iron deficiency data.

[1134] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[1135] 3. The device displays the recipe and provides it to the user.

[1136] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[1137] This system provides an environment in which even beginners can easily create delicious and healthy meals.

[1138] The processing flow will be explained below.

[1139] Step 1:

[1140] A user launches an application and enters basic information such as name, email address, and password.

[1141] Step 2:

[1142] The terminal transmits the entered registration information to the server.

[1143] Step 3:

[1144] The server stores the received registration information in a database.

[1145] Step 4:

[1146] The user enters personal preference information such as allergen information, food preferences, and cooking skill level.

[1147] Step 5:

[1148] The device sends the personal setting information to the server.

[1149] Step 6:

[1150] The server stores the received personal setting information in a database.

[1151] Step 7:

[1152] A user uses the in-app search feature to request "easy dinner recipes."

[1153] Step 8:

[1154] Based on the request received by the server, a generative AI model is used to generate an appropriate recipe.

[1155] Step 9:

[1156] The server sends the generated recipe to the terminal.

[1157] Step 10:

[1158] The terminal displays the received recipe on the user interface.

[1159] Step 11:

[1160] The user presses a button to notify the user that cooking with the selected recipe is about to begin.

[1161] Step 12:

[1162] The device requests cooking instructions from the server.

[1163] Step 13:

[1164] The server generates the appropriate cooking instructions and sends them to the device.

[1165] Step 14:

[1166] The device will then guide the user through cooking steps via voice or text, for example, "Chop the onion and fry it in a frying pan."

[1167] Step 15:

[1168] The user speaks, "What should I do next?"

[1169] Step 16:

[1170] The server analyzes the question, generates the next steps, and sends them to the device, such as "Add tomatoes and continue to stir-fry."

[1171] Step 17:

[1172] The device will guide the user through the next steps via voice or text.

[1173] Step 18:

[1174] The user speaks, "How can I cook it better?"

[1175] Step 19:

[1176] The server searches for advice based on professional cooking techniques and sends it to the device, such as "Vegetables will taste better if you season them with a little salt and stir-fry them for a short time over high heat."

[1177] Step 20:

[1178] The terminal provides advice to the user by voice or text.

[1179] Step 21:

[1180] The user inputs the results of the health check.

[1181] Step 22:

[1182] The terminal transmits the health check results to the server.

[1183] Step 23:

[1184] The server stores the received health checkup results in a database and generates suitable recipes based on advice from a nutritionist.

[1185] Step 24:

[1186] The server sends the generated recipe to the device, suggesting, for example, "Stir-fried spinach and ground beef."

[1187] Step 25:

[1188] The terminal displays the received recipe on the user interface.

[1189] Step 26:

[1190] A user asks, "What else goes in this recipe?"

[1191] Step 27:

[1192] The server analyzes the question and generates additional ingredients and instructions to send to the device, such as "Please also add potatoes and onions."

[1193] Step 28:

[1194] The device will provide the user with additional instructions via voice or text.

[1195] In this way, the present invention provides an interactive cooking support system that can be easily used even by beginners, enabling users to prepare delicious dishes and improve the quality of their dietary life.

[1196] Example 1

[1197] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1198] In today's society, many users find it difficult to eat healthy meals due to their busy lifestyles. Cooking effectively and efficiently can also be challenging for beginners and those with limited cooking skills. Furthermore, finding recipes that take into account specific health conditions and nutritional balance can be challenging, and there is a lack of access to the necessary cooking techniques and advice in real time. Therefore, there is a need for a system that allows users to easily obtain and execute recipes tailored to their individual conditions and needs.

[1199] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1200] In this invention, the server includes an information providing device connected to an information processing device that receives and stores the input information by the user's setting information and diagnostic results, a means for generating recipes based on the input information using a generative AI model, and a means for transmitting and displaying the generated recipes to the user and providing interactive cooking instructions, allowing users to easily obtain and execute recipes tailored to their individual conditions and needs.

[1201] An "information processing device" is a device that receives input information and performs the necessary calculations and data processing.

[1202] An "information storage device" is a device for storing received information and retrieving it as needed.

[1203] An "information providing device" is a device that includes an information processing device and an information storage device and provides necessary information to a user.

[1204] A "generative AI model" is an artificial intelligence model that generates a specific output based on given data.

[1205] "Cooking content" refers to the recipe and cooking steps required for the user to cook.

[1206] "User" refers to an individual who receives cooking assistance using this system.

[1207] "Interactive" refers to a method in which the system and the user interact with each other and provide appropriate responses in response to the user's questions and requests.

[1208] "Diagnosis results" refers to information and data regarding the user's health condition.

[1209] "Guide" refers to showing users the steps and providing instruction and guidance to help them achieve their goals.

[1210] This invention provides a cooking assistance system. The system allows users to input setting information and diagnostic results, and provides appropriate recipes and cooking procedures based on the input information. The system uses an information processing device, an information storage device, an information providing device, and a generative AI model.

[1211] Specifically, the user first launches the application and enters basic information such as name, email address, password, etc., as well as personal setting information such as allergen information, food preferences, cooking skill level, etc. The device sends this information to the server, and the server stores the received information in an information storage device, which is a database.

[1212] Next, when the user inputs a prompt such as "easy dinner recipe," the device sends this prompt to the server. The server uses the generative AI model to generate the optimal recipe and sends the result to the device. The device then displays the recipe information sent from the server and provides it to the user.

[1213] When a user selects a recipe and starts cooking, the device sends a cooking instructions request to the server. The server uses a generative AI model to generate appropriate cooking instructions and sends them to the device. The device then displays the received instructions in text or audio format, interactively guiding the user through the next cooking step. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time.

[1214] If a user asks, "How can I cook vegetables more deliciously?" while cooking, the device will send the question to the server. The server will generate advice based on professional cooking techniques and send it to the device. The device will then display the advice as voice or text, providing instructions to the user.

[1215] Furthermore, if a user wants to find dietary recipes to improve their health, they can input their health checkup results. For example, if they input information about iron deficiency, the device will send it to the server. The server will generate an appropriate recipe based on the advice of a nutritionist and send it to the device. The device will then display the generated recipe to the user and provide cooking support.

[1216] Prompt Sentence Examples

[1217] "Tell me some easy dinner recipes"

[1218] How can I cook vegetables more deliciously?

[1219] "What else goes into this recipe?"

[1220] This system allows users to easily obtain recipes tailored to their individual conditions and needs and then execute them step by step.

[1221] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1222] Step 1:

[1223] When a user launches the application for the first time, they enter basic information (such as name, email address, and password) and personal settings information (such as allergen information, food preferences, and cooking skill level). The entered information is sent by the device.

[1224] Step 2:

[1225] The device sends basic information and personal setting information to the server, which stores the received information in a database. This process records each user's individual information in the database.

[1226] Step 3:

[1227] The user inputs a prompt such as "easy dinner recipes." The terminal sends the input prompt to the server.

[1228] Step 4:

[1229] The server generates an appropriate recipe using a generative AI model based on the received prompt, taking into account the user's personal settings. The generated recipe is then sent from the server to the device.

[1230] Step 5:

[1231] The terminal displays the recipe information sent from the server and provides it to the user, who can then select a recipe from the displayed list.

[1232] Step 6:

[1233] The user selects a recipe and starts cooking. The device sends a request for the corresponding cooking instructions to the server.

[1234] Step 7:

[1235] The server uses the generative AI model to generate appropriate cooking instructions and sends them to the device, where they are displayed and provided to the user.

[1236] Step 8:

[1237] As the user cooks, they can ask questions such as "What's next?" and the device will send the question to the server.

[1238] Step 9:

[1239] The server generates the next cooking procedure or advice based on the question, and sends the generated procedure or advice to the terminal.

[1240] Step 10:

[1241] The device displays instructions and advice sent from the server in text or audio format and guides the user, providing specific instructions such as "Chop the onion and fry it in a frying pan."

[1242] Step 11:

[1243] When a user asks, "How can I cook vegetables more deliciously?" the device sends the question to the server.

[1244] Step 12:

[1245] The server generates advice based on professional cooking techniques and sends it to the device. The advice is displayed on the device and provided to the user. For example, specific advice such as "season vegetables with a little salt and stir-fry them for a short time over high heat will make them delicious" is provided.

[1246] Step 13:

[1247] When a user requests dietary recipes to improve their health, they input their health checkup results, and the terminal sends the input health information to the server.

[1248] Step 14:

[1249] The server uses a generative AI model based on the nutritionist's advice to generate an appropriate recipe, which is then sent to the device.

[1250] Step 15:

[1251] The device displays the generated recipe to the user and provides cooking support, and the user proceeds with cooking according to the displayed recipe.

[1252] (Application example 1)

[1253] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1254] In today's busy lifestyles, it is difficult for beginners and health-conscious people to cook easily and effectively at home. In particular, specific instructions on recipe selection, ingredient procurement, and cooking procedures are necessary, and a system that can consistently support these steps is needed.

[1255] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1256] In this invention, the server includes: means for a user to input dietary preference information and health checkup results, and means connected to a computer that receives the input information and a database that stores the input information; means for generating recipes based on the input information using a generative AI model; means for analyzing ingredients for the generated recipes and ordering delivery in bulk; means for sending and displaying the generated recipes to the user and providing interactive cooking instructions; and means for providing cooking instructions in text or voice in real time. This allows users to receive consistent support from recipe selection to ingredient procurement and cooking instructions, enabling them to cook easily and effectively at home.

[1257] "User" refers to an individual who uses the System to cook.

[1258] "Dietary settings information" refers to data about a user's individual diet, such as allergen information, food preferences, and cooking skill level.

[1259] "Health checkup results" refers to diagnostic results and medical data that indicate the user's health condition.

[1260] "Computer" means an electronic computing device for receiving and processing user information and requests.

[1261] "Database" refers to a data storage device used by a computer to store user information received or system-generated data.

[1262] "Server" refers to a central device connected to a computer and database that manages the processing of the entire system.

[1263] "Generative AI model" refers to an artificial intelligence model that generates recipes based on input information.

[1264] A "recipe" refers to cooking instructions that include cooking steps, ingredients, etc.

[1265] "Ingredients" refers to the ingredients listed in the recipe and items needed for cooking.

[1266] "Delivery" refers to the service of delivering materials ordered on the system to the user.

[1267] "Interactive means" refers to the functionality that allows users and systems to communicate in real time.

[1268] "Cooking instructions" refers to the specific cooking steps and advice provided by the system as the user cooks.

[1269] The present invention relates to a system that provides interactive support for users when cooking. This system provides a means for more effective cooking, especially for beginners and health-conscious people. It also allows users to enjoy cooking while learning professional cooking techniques.

[1270] Registering users and getting their personal settings

[1271] When a user launches the application for the first time, a screen appears where they can enter basic information such as their name, email address, and password. Once the basic information has been entered, the device sends the information to the server, which stores the received information in a database. Next, the user enters personal setting information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[1272] Recipe suggestions and ingredient delivery orders

[1273] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. The server then analyzes the ingredients of the generated recipe and automatically initiates a bulk delivery order. The ingredients are then quickly delivered to the user via a delivery service.

[1274] Interactive Cooking Support

[1275] When a user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device. As the user continues cooking, the device guides the user through the next steps via text or voice. For example, specific instructions such as "fry the bacon until crispy" are provided in real time. This allows even beginners to cook step by step. When the user asks "What's next?", the server provides further cooking instructions.

[1276] Professional technical support and nutritional management

[1277] If a user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and stir-fry them briefly over high heat to make them more delicious." The device then displays this information as voice or text, providing instructions to the user.

[1278] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[1279] Computer System Configuration

[1280] The server is connected to a computer and a database that stores the information. The computer is a device that receives and processes user information and requests, and the database is a data storage device that stores that information. The server uses a generative AI model to generate recipes, order ingredients for delivery, and provide interactive cooking instructions. The hardware and software used include Python, Django, or Flask (server-side), requests (API communication), and OpenAI GPT-3 (generative AI model).

[1281] Examples and prompts

[1282] 1. The user launches the application and requests "easy dinner recipes."

[1283] 2. The server uses GPT-3 to suggest a recipe for "Easy Tomato and Bacon Pasta" and display a list of ingredients.

[1284] 3. When the user presses the "Order" button, the necessary ingredients are ordered via a delivery service.

[1285] 4. After the delivery is complete, the device provides specific cooking instructions in real time, such as "Please fry the bacon until crispy."

[1286] Example prompt sentence:

[1287] "Suggest easy dinner recipes based on your user information: {preferences: 'healthy, easy'}. For example, easy pasta with tomatoes and bacon."

[1288] Thus, the present invention is a system that helps users cook at home simply and effectively. بهره‌برداری از این ‌اختراع، کاربر را قادر می‌سازد که با بهره‌گیری از فناوری هوش مصنوعی ایجاد شده و خدمات تحویل مواد بسته‌بندی شده، آشپزی در منزل را به یک تجربه ساده و کارآمد تبدیل کند.

[1289] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1290] Step 1:

[1291] Enter user registration information

[1292] When a user starts an application for the first time, a screen appears on the device where the user can enter basic information such as name, email address, and password. When the user enters this information (input), the device sends the information to the server (data transmission). The server then stores the received information in a database (data storage).

[1293] Step 2:

[1294] Obtaining personal setting information

[1295] The user then enters personal information such as allergen information, food preferences, and cooking skill level (input). The device sends this information to the server (data transmission), which then stores it in a database (data storage). This allows for the accumulation of personalized information that can be used for future recipe suggestions and interactive support (data storage).

[1296] Step 3:

[1297] Requesting and generating recipe suggestions

[1298] When a user makes a search request for "easy dinner recipes" (input), the device sends the request to the server (data transmission). Based on the received information, the server uses a generative AI model (GPT-3) to generate a prompt and create an "easy dinner recipe" (data generation). The generated recipe is sent to the device and displayed (data display).

[1299] Step 4:

[1300] Material delivery order

[1301] After the generated recipe is displayed, the user presses the "Order" button (input), and the device sends the ingredients list to the server (data transmission). The server analyzes the received ingredients list and places a bulk delivery order (data processing). The order data is then sent to the delivery service (data transmission).

[1302] Step 5:

[1303] Interactive cooking support launched

[1304] After the recipe ingredients arrive at the user's home (ingredient receipt), when the user begins cooking, the device sends a cooking procedure request to the server (data transmission). The server generates appropriate cooking procedures and sends them to the device (data generation, data transmission). The device then displays or audibly guides the user through the procedures (data display, audio output).

[1305] Step 6:

[1306] Providing cooking instructions in real time

[1307] As the user continues cooking, for example by asking "What's next?" (input), the device sends the voice data or text to the server (data transmission). The server analyzes the request, generates the next cooking instruction, and sends it to the device (data analysis, data generation, data transmission). The device then displays or plays back this in real time as voice or text (data display, voice output).

[1308] Step 7:

[1309] Professional technical support and advice

[1310] If the user needs additional advice while cooking (input), for example, by asking, "How can I cook vegetables more deliciously?", the device will send the question to the server (data transmission). The server will use a generative AI model to generate advice based on professional cooking techniques (data generation) and immediately send it to the device (data transmission). The device will then display or provide audio guidance in real time (data display, audio output).

[1311] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1312] This invention relates to a system that provides interactive support for users when cooking and, by combining it with an emotion engine, provides support according to the user's emotions. This system provides a means for beginners and health-conscious people to cook more effectively. It also allows users to enjoy cooking while learning professional cooking techniques, and provides appropriate responses according to the user's emotions.

[1313] Registering users and getting their personal settings

[1314] When a user launches the application for the first time, a screen appears prompting them to enter basic information such as their name, email address, and password. Once the basic information is entered, the device sends the information to the server, which then stores it in a database.

[1315] Next, the user enters personal information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[1316] Recipe suggestions and interactive guides

[1317] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device.

[1318] As the user cooks, the device will guide them through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[1319] Professional technology provided

[1320] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[1321] Collaboration with nutritionists

[1322] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[1323] Emotion Engine

[1324] The present invention also incorporates an emotion engine, which analyzes the user's voice input and facial expression data, allowing the server to use the emotion engine to generate responses based on the user's emotional state. If the user is feeling stressed, the system can provide recipes and advice that promote relaxation, making cooking more comfortable.

[1325] For example, if a user inputs "I'm tired today," the server will respond by suggesting a simple and relaxing dish, such as "cream-braised chicken." If the emotion engine detects sadness or fatigue from the user's voice or facial expression, it can also provide a warm message such as "Take a short break and then resume cooking."

[1326] Specific examples

[1327] Example 1: A user wants to make a quick dinner

[1328] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[1329] 2. The device displays the recipe and the user begins cooking.

[1330] 3. The device will then say, "Fry the bacon until crispy."

[1331] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[1332] Example 2: Recipe suggestions to make up for nutritional deficiencies

[1333] 1. The user enters the results of a health check and submits iron deficiency data.

[1334] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[1335] 3. The device displays the recipe and provides it to the user.

[1336] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[1337] Example 3: Using the Emotion Engine

[1338] 1. The user types, "I'm tired today."

[1339] 2. The server uses its emotion engine to respond, "We'll suggest some relaxing dishes."

[1340] 3. The server suggests "creamed chicken" and the device displays the recipe.

[1341] 4. When the user asks, "What's an easier dish to make?" the server offers the advice, "Maybe make a salad."

[1342] This system allows even beginners to easily create delicious and healthy meals, and also provides appropriate support based on the user's emotions.

[1343] The processing flow will be explained below.

[1344] Step 1:

[1345] A user launches an application and enters basic information such as name, email address, and password.

[1346] Step 2:

[1347] The terminal transmits the entered registration information to the server.

[1348] Step 3:

[1349] The server stores the received registration information in a database.

[1350] Step 4:

[1351] The user enters personal preference information such as allergen information, food preferences, and cooking skill level.

[1352] Step 5:

[1353] The device sends the personal setting information to the server.

[1354] Step 6:

[1355] The server stores the received personal setting information in a database.

[1356] Step 7:

[1357] A user uses the in-app search feature to request "easy dinner recipes."

[1358] Step 8:

[1359] Based on the request received by the server, a generative AI model is used to generate an appropriate recipe.

[1360] Step 9:

[1361] The server sends the generated recipe to the terminal.

[1362] Step 10:

[1363] The terminal displays the received recipe on the user interface.

[1364] Step 11:

[1365] The user presses a button to notify the user that cooking with the selected recipe is about to begin.

[1366] Step 12:

[1367] The device requests cooking instructions from the server.

[1368] Step 13:

[1369] The server generates the appropriate cooking instructions and sends them to the device.

[1370] Step 14:

[1371] The device will then guide the user through cooking steps via voice or text, for example, "Chop the onion and fry it in a frying pan."

[1372] Step 15:

[1373] The user speaks, "What should I do next?"

[1374] Step 16:

[1375] The server analyzes the question, generates the next steps, and sends them to the device, such as "Add tomatoes and continue to stir-fry."

[1376] Step 17:

[1377] The device will guide the user through the next steps via voice or text.

[1378] Step 18:

[1379] The user speaks, "How can I cook it better?"

[1380] Step 19:

[1381] The server searches for advice based on professional cooking techniques and sends it to the device, such as "Vegetables will taste better if you season them with a little salt and stir-fry them for a short time over high heat."

[1382] Step 20:

[1383] The terminal provides advice to the user by voice or text.

[1384] Step 21:

[1385] The user inputs the results of the health check.

[1386] Step 22:

[1387] The terminal transmits the health check results to the server.

[1388] Step 23:

[1389] The server stores the received health checkup results in a database and generates suitable recipes based on advice from a nutritionist.

[1390] Step 24:

[1391] The server sends the generated recipe to the device, suggesting, for example, "Stir-fried spinach and ground beef."

[1392] Step 25:

[1393] The terminal displays the received recipe on the user interface.

[1394] Step 26:

[1395] A user asks, "What else goes in this recipe?"

[1396] Step 27:

[1397] The server analyzes the question and generates additional ingredients and instructions to send to the device, such as "Please also add potatoes and onions."

[1398] Step 28:

[1399] The device will provide the user with additional instructions via voice or text.

[1400] Additional processing for the emotion engine

[1401] Step 29:

[1402] The user types, "I'm tired today."

[1403] Step 30:

[1404] The server uses an emotion engine to analyze the user's emotional state and responds by saying, "We'll suggest some dishes that will help you relax."

[1405] Step 31:

[1406] The server generates a recipe for a relaxing dish, such as "creamed chicken," and sends it to the device.

[1407] Step 32:

[1408] The terminal displays the received recipe on the user interface.

[1409] Step 33:

[1410] A user asks, "What's an easier recipe?"

[1411] Step 34:

[1412] The server uses an emotion engine to analyze easy-to-make dishes and suggest, for example, "It would be good to make a salad."

[1413] Step 35:

[1414] The device provides the user with simple cooking instructions via voice or text.

[1415] In this way, the present invention provides an interactive cooking support system that can be easily used even by beginners, and by combining it with an emotion engine, it can provide support that responds to the user's emotions, allowing users to cook delicious meals and improve the quality of their diet.

[1416] Example 2

[1417] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1418] Conventional cooking support systems have had difficulty providing appropriate support based on a user's individual settings, health condition, and emotional state. Furthermore, they lacked a means to provide users with professional cooking techniques or advice from nutritionists in real time, making it difficult to quickly and effectively resolve users' problems. Furthermore, they were unable to provide recipe suggestions or advice based on the user's emotional state, making it difficult to increase user satisfaction.

[1419] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1420] In this invention, the server includes: a means for a user to input dietary setting information and health checkup results; a means for connecting to a database that receives and stores the input information; a means for generating a recipe based on the input information using a generative AI model; a means for sending the generated recipe to the user, displaying it, and providing interactive cooking instructions; a means for analyzing the user's emotional data and generating a response based on the user's emotional state using an emotion engine; a means for generating a recipe based on the user's health state and providing advice from a nutritionist; and a means for providing advice based on professional cooking techniques. This makes it possible to quickly and effectively provide appropriate cooking support based on the user's individual information, health state, and emotional state.

[1421] "User" refers to the entity that uses the system to receive cooking support.

[1422] "Meal-related setting information" refers to information that users individually set when eating meals, such as allergen information, food preferences, and cooking skill level.

[1423] "Health checkup results" refers to data based on health checkups conducted at medical institutions, etc., and indicates information that indicates the user's health condition in numerical and written form.

[1424] "Input means" refers to the method a user uses to provide information to a system, including touch screens, keyboard input, etc.

[1425] "Server connected to a database that receives and stores" refers to a server connected to a network that receives input information and stores it in a database.

[1426] A "generative AI model" refers to an artificial intelligence model that automatically generates appropriate recipes and advice based on input data.

[1427] "Means for generating recipes" refers to a method for using a generative AI model to create a recipe based on user input.

[1428] "Means for providing interactive cooking instructions" refers to a system that provides step-by-step guidance on cooking steps while interacting with the user.

[1429] "Emotional data" refers to information that indicates the user's emotional state, such as voice input or facial expression data.

[1430] "Emotion engine" refers to an algorithm for analyzing emotional data and generating a response based on the user's emotional state.

[1431] "Dietitian advice" refers to advice based on the expertise and guidance on healthy eating provided by a dietitian.

[1432] "Professional culinary advice" refers to advice on cooking methods and techniques recommended by experienced chefs or culinary experts.

[1433] This invention is an interactive cooking support system that allows users to input dietary preferences and health checkup results and provides appropriate recipes based on those preferences. It uses an emotion engine to provide support that responds to the user's emotions. This system provides a means for beginners and health-conscious people to cook effectively. It also allows users to enjoy cooking while learning professional cooking techniques, and provides appropriate responses that respond to the user's emotions.

[1434] Registering users and getting their personal settings

[1435] When a user launches the application for the first time, a screen appears where they can enter basic information such as their name, email address, and password. Once this basic information has been entered, the device sends the information to the server, which stores the received information in a database. Next, the user enters personal setting information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[1436] Recipe suggestions and interactive guides

[1437] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses a generative AI model (e.g., GPT-4) to generate an appropriate recipe. The generative AI model uses "Generate an easy dinner recipe" as the prompt. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking steps from the server. The server generates appropriate cooking steps and sends them to the device. As the user continues cooking, the device guides the user through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[1438] Professional technology provided

[1439] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[1440] Collaboration with nutritionists

[1441] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[1442] Emotion Engine

[1443] The present invention also incorporates an emotion engine. This allows the server to analyze the user's voice input and facial expression data and use the emotion engine to generate a response based on the user's emotional state. If the user is feeling stressed, the server can provide recipes and advice that promote relaxation, making cooking more comfortable. For example, if the user inputs "I'm tired today," the server can respond by saying, "I'll suggest some easy and relaxing dishes," such as "chicken in cream sauce." Furthermore, if the emotion engine detects sadness or fatigue from the user's voice or facial expression, it can provide a warm message such as, "Take a short break and resume cooking."

[1444] Specific examples

[1445] Example 1: A user wants to make a quick dinner

[1446] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[1447] 2. The device displays the recipe and the user begins cooking.

[1448] 3. The device will then say, "Fry the bacon until crispy."

[1449] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[1450] Example 2: Recipe suggestions to make up for nutritional deficiencies

[1451] 1. The user enters the results of a health check and submits iron deficiency data.

[1452] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[1453] 3. The device displays the recipe and provides it to the user.

[1454] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[1455] Example 3: Using the Emotion Engine

[1456] 1. The user types, "I'm tired today."

[1457] 2. The server uses its emotion engine to respond, "We'll suggest some relaxing dishes."

[1458] 3. The server suggests "creamed chicken" and the device displays the recipe.

[1459] 4. When the user asks, "What's an easier dish to make?" the server offers the advice, "Maybe make a salad."

[1460] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1461] Program processing flow

[1462] Step 1: Register and retrieve user preferences

[1463] 1. User launches application for the first time:

[1464] Input: Basic information: Name, Email address, Password

[1465] Process: The user enters basic information into the input form.

[1466] Output: Basic information is entered into the terminal.

[1467] 2. The device sends basic information to the server:

[1468] Input: Basic information entered by the user

[1469] Processing: The terminal sends the entered basic information to the server.

[1470] Output: The server receives the basic information.

[1471] 3. The server saves the basic information to a database:

[1472] Input: Received basic information

[1473] Processing: The server stores the received basic information in a database.

[1474] Output: Basic information stored in a database.

[1475] 4. User enters personal configuration information:

[1476] Input: Personal settings such as allergen information, food preferences, and cooking skill level

[1477] Action: The user enters personal preference information into an input form.

[1478] Output: The personalization information is entered into the device.

[1479] 5. The device sends personal configuration information to the server:

[1480] Input: Personal setting information entered by the user

[1481] Processing: The device sends the entered personal setting information to the server.

[1482] Output: The server receives the personalization information.

[1483] 6. The server stores your personal settings in a database:

[1484] Input: Received personal setting information

[1485] Processing: The server stores the received personal setting information in a database.

[1486] Output: Personalization information stored in a database.

[1487] Step 2: Recipe suggestions

[1488] 1. User searches for a recipe:

[1489] Input: Search keyword (e.g. "easy dinner recipes")

[1490] What happens: A user enters keywords into the search bar and performs a search.

[1491] Output: A search request is generated on the device.

[1492] 2. The server generates a recipe using the generative AI model:

[1493] Input: Search keywords, personal settings information

[1494] Processing: The server uses a generative AI model (e.g., GPT-4) with the prompt "Generate a simple dinner recipe" to generate a recipe.

[1495] Output: Recipe data generated by the generative AI model is sent back to the server.

[1496] 3. The server sends the generated recipe to the device:

[1497] Input: Generated recipe data

[1498] Processing: The server sends the generated recipe to the device.

[1499] Output: Recipe data is received on the device.

[1500] 4. The device will display the recipe:

[1501] Input: Received recipe data

[1502] Processing: The terminal displays the recipe data on the user interface.

[1503] Output: The user can view the recipe.

[1504] Step 3: Interactive Guide

[1505] 1. User starts cooking and requests cooking instructions:

[1506] Input: Recipe selection, start instruction

[1507] Action: The device starts cooking based on the recipe selected by the user and requests the next cooking step.

[1508] Output: A cooking instructions request is generated on the device.

[1509] 2. The server generates the appropriate cooking instructions and sends them to the device:

[1510] Input: Selected recipe data, cooking procedure request

[1511] Processing: The server generates cooking instructions and sends them to the terminal.

[1512] Output: Cooking instructions data is received on the device.

[1513] 3. Your device will display or speak cooking instructions:

[1514] Input: Received cooking instructions data

[1515] Processing: The device provides the user with cooking instructions in text or audio format.

[1516] Output: The user is guided through the cooking steps (e.g., "Chop the onion and fry it in a frying pan").

[1517] Step 4: Professional technical support

[1518] 1. User requests additional advice:

[1519] Input: Question (e.g., "How can I cook vegetables more deliciously?")

[1520] Process: The user types or speaks a question into the terminal.

[1521] Output: A question request is generated on the terminal.

[1522] 2. The server provides professional advice:

[1523] Input: Question

[1524] Processing: The server generates advice based on professional cooking techniques and sends it to the device.

[1525] Output: Advice received by device (e.g. "Vegetables taste better if seasoned with a little salt and fried briefly over high heat").

[1526] 3. Your device will display or speak advice:

[1527] Input: Advice received

[1528] Processing: The terminal provides advice to the user by displaying text or by voice guidance.

[1529] Output: The user receives the advice.

[1530] Step 5: Work with a dietitian

[1531] 1. User enters health check results:

[1532] Input: Health checkup result data (e.g., iron deficiency information)

[1533] Process: The user enters the results of a health check into the application.

[1534] Output: The health check results are entered into the terminal.

[1535] 2. The device sends the health check result to the server:

[1536] Input: Health check result data

[1537] Processing: The terminal sends the health check result data to the server.

[1538] Output: Health check result data is received by the server.

[1539] 3. The server generates a recipe based on the nutritionist's advice:

[1540] Input: Health check result data

[1541] Processing: The server generates an appropriate recipe based on the nutritionist's advice (e.g., "Spinach and ground beef stir-fry").

[1542] Output: The generated recipe data is generated on the server.

[1543] 4. The server sends the generated recipe to the device:

[1544] Input: Generated recipe data

[1545] Processing: The server sends the generated recipe to the device.

[1546] Output: Recipe data is received on the device.

[1547] 5. The device will display the recipe:

[1548] Input: Received recipe data

[1549] Processing: The device displays the recipe in the user interface.

[1550] Output: The user can view the recipe.

[1551] Step 6: Leverage the Emotion Engine

[1552] 1. User inputs their emotion:

[1553] Input: Emotional state text data (e.g., "I'm tired today")

[1554] Processing: The user inputs their emotional state into the application.

[1555] Output: The emotional state is input to the terminal.

[1556] 2. The server uses the emotion engine to generate a response:

[1557] Input: Emotional state data

[1558] Processing: The server uses an emotion engine to generate a response based on the user's emotional state.

[1559] Output: Response data is generated on the server (e.g., "Suggested relaxing dishes").

[1560] 3. The server generates a recipe based on the emotion and sends it to the device:

[1561] Input: Emotional state data, generative AI model

[1562] Processing: The server uses the generative AI model to generate a recipe based on the emotion and sends it to the device (e.g., "cream-braised chicken").

[1563] Output: Recipe data is received on the device.

[1564] 4. The device will display the recipe:

[1565] Input: Received recipe data

[1566] Processing: The device displays the recipe in the user interface.

[1567] Output: The user can view the recipe.

[1568] 5. The emotion engine analyzes user reactions and responds further:

[1569] Input: User voice and facial expression data

[1570] Processing: The emotion engine analyzes the user's emotional state from their voice and facial expressions and generates an appropriate response.

[1571] Output: Response data is generated on the server and sent to the device (e.g., "Let's take a short break and then resume cooking").

[1572] (Application example 2)

[1573] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1574] In modern society, finding the right recipe and cooking effectively is a major challenge for beginners and busy people. They also lack the tools to reduce the emotions and stress they experience while cooking. Furthermore, it is difficult to incorporate healthy eating habits into their daily lives. Conventional systems struggle to address these needs, and new approaches are needed to improve user satisfaction.

[1575] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an information processing device connected to an electronic device that receives and stores the input information by a user's dietary setting information and health checkup results, means connected to the information processing device and that generates cooking instructions based on the input information using a generative AI model, means for sending and displaying the generated cooking instructions to the user and providing interactive cooking procedures, and means for analyzing the user's voice and facial expression data using an emotion engine and generating a response based on the user's emotions. This enables beginners and busy people to easily find appropriate and healthy recipes, cook effectively, and receive support tailored to their emotions.

[1576] A "user" is someone who uses the system to input dietary preferences and health check results and receive suggested recipes and cooking instructions.

[1577] "Dietary setting information" refers to personal setting information that affects meal selection and cooking, such as the user's allergen information, food preferences, and cooking skill level.

[1578] "Health checkup results" are medical data that indicate the user's health status and are information used to make dietary suggestions based on nutritional deficiencies or specific health risks.

[1579] "Input information" refers to the dietary settings and health check results entered by the user into the system.

[1580] "Electronic Device" means a device used by a User to input information and receive information from the System, including a smartphone, tablet, smart glasses, or head-mounted display.

[1581] An "information storage device" is hardware or software that stores data such as input information and generated cooking instructions.

[1582] An "information processing device" is a server or computer connected to an electronic device and information storage device for receiving and processing input information.

[1583] A "generative AI model" is an artificial intelligence model that generates appropriate cooking instructions and recipes based on information entered by the user.

[1584] "Cooking instructions" are specific cooking steps and advice generated by a generative AI model and provided to users.

[1585] "Means for providing interactive cooking instructions" refers to a function that provides users with real-time audio or text guidance on specific steps as they cook.

[1586] An "emotion engine" is a device or software that analyzes a user's voice and facial expression data to determine the user's emotional state.

[1587] The "means for generating a response based on emotions" is a function for generating appropriate responses or advice based on the user's emotional state analyzed by the emotion engine.

[1588] The present invention is a system that provides interactive support to users when cooking, and combines an emotion engine to provide support according to the user's emotions. This system is particularly suitable for beginners and people who are health conscious. To implement the invention, the following configuration and operating procedures are followed.

[1589] System configuration

[1590] Hardware

[1591] Electronic devices: Includes devices such as smartphones, tablets, smart glasses, and head-mounted displays.

[1592] Information storage: Includes MySQL and other database systems.

[1593] Information processing device: A server or cloud computing resource is used.

[1594] software

[1595] Generative AI models: Use Python and generative AI models (e.g., ChatGPT) to generate recipes and cooking instructions.

[1596] Sentiment engine: Uses machine learning libraries such as TensorFlow for sentiment analysis.

[1597] Front-end: Uses HTML, CSS, JavaScript, or a mobile application framework (e.g., React Native) to provide the user interface.

[1598] Program processing overview

[1599] 1. User registration and personal settings acquisition

[1600] When a user launches the application for the first time, they enter basic information (name, email address, password) into the electronic device. The entered information is sent to the information processing device and stored in the information storage device. Next, personal setting information such as allergen information and cooking skill level is also obtained.

[1601] 2. Recipe suggestions and interactive guides

[1602] When a user searches for a specific recipe, the information processing device uses a generative AI model to generate an appropriate recipe, which is then sent to the electronic device and displayed to the user, providing interactive support by providing real-time cooking instructions via voice and text.

[1603] 3. Professional technology provided

[1604] If the user needs additional advice while cooking, advice based on professional cooking techniques is provided via a generative AI model.

[1605] 4. Collaboration with nutritionists

[1606] If a user wants to improve their diet based on their health status, they can input their health check results and appropriate recipes will be generated based on them.

[1607] 5. Supported by Emotion Engine

[1608] The emotion engine analyzes the user's voice and facial expression data and generates responses based on their emotions. For example, if the user is tired, it will suggest relaxing dishes, providing support that matches the user's mood.

[1609] Specific examples

[1610] 1. Example 1: Simple dinner recipe suggestions

[1611] A user speaks, "Tell me an easy dinner recipe." The information processing device uses a generative AI model to suggest "Easy pasta with tomatoes and bacon." The device then displays the recipe and instructs the user to fry the bacon in a frying pan until crispy.

[1612] Prompt Sentence Examples

[1613] Can you recommend some easy dinner recipes?

[1614] 2. Example 2: Relaxation recipe suggestions using an emotion engine

[1615] The user inputs "I'm tired today" by voice. The information processing device analyzes the user's emotions using its emotion engine and responds by saying, "I'll suggest a dish that will help you relax." The next suggestion is "chicken stewed in cream sauce."

[1616] Prompt Sentence Examples

[1617] What are some relaxing cooking recipes you recommend for users when they're feeling tired?

[1618] In this way, beginners and busy people can cook properly and healthily without stress, and can also receive support according to their emotions.

[1619] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1620] Step 1: Enter and submit basic user information

[1621] A user starts up an electronic device and enters basic information such as name, email address, and password. The entered basic information is sent from the device to a server, which receives the information and stores it in an information storage device.

[1622] Step 2: Enter and submit your personal settings information

[1623] The user inputs personal setting information such as allergen information, food preferences, cooking skill level, etc. The input information is sent from the terminal to the server, which receives this information and stores it in an information storage device.

[1624] Step 3: Find and generate recipes

[1625] The user voice-inputs a request for a specific dish (e.g., "easy dinner recipes"), which is then sent from the device to the server. The server uses a generative AI model to generate a recipe based on the request, taking into account the user's personal settings. The server then sends the generated recipe back to the device.

[1626] Step 4: Display the recipe and provide cooking instructions

[1627] The device displays the received recipe to the user. When the user starts cooking, the device requests the next step from the server. The server uses a generative AI model to generate the next cooking steps and sends them to the device. The device then guides the user through these steps via voice or text, providing specific instructions such as "fry the bacon until crispy."

[1628] Step 5: Professional technical support

[1629] If a user needs additional advice while cooking, for example, by asking, "How can I cook vegetables more deliciously?", the device sends this question to the server. The server uses a generative AI model to generate advice based on professional cooking techniques and sends it to the device. The device then provides this advice to the user via voice or text.

[1630] Step 6: Health-based recipe suggestions

[1631] The user inputs the results of a health check (e.g., iron deficiency). These results are sent from the device to the server. The server combines the generative AI model with advice from a nutritionist to generate an appropriate recipe. The generated recipe is sent from the server to the device and displayed. The user then proceeds with cooking according to this recipe.

[1632] Step 7: Support from the Emotion Engine

[1633] The user provides voice input (for example, "I feel tired today"). This voice data is sent from the device to the server. The server uses an emotion engine to analyze the user's emotional state and generates appropriate recipes and advice based on the results. For example, the server responds with "I'll suggest some dishes that will help you relax" and suggests "cream-braised chicken." This information is sent from the server to the device and displayed.

[1634] At each step, the system processes data, with a generative AI model generating recipes based on the input information and an emotion engine analyzing the user's emotions. The output is cooking instructions, professional advice, and emotion-based suggestions provided to the device.

[1635] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1636] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1637] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1638] [Fourth embodiment]

[1639] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1640] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1641] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1642] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1643] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1644] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1645] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1646] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1647] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1648] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1649] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1650] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1651] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1652] This invention relates to an application that provides interactive support for users when cooking. This system provides a means for beginners and health-conscious people to cook more effectively. It also allows users to enjoy cooking while learning professional cooking techniques.

[1653] Registering users and getting their personal settings

[1654] When a user launches the application for the first time, a screen appears prompting them to enter basic information such as their name, email address, and password. Once the basic information is entered, the device sends the information to the server, which then stores it in a database.

[1655] Next, the user enters personal information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[1656] Recipe suggestions and interactive guides

[1657] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device.

[1658] As the user cooks, the device will guide them through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[1659] Professional technology provided

[1660] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[1661] Collaboration with nutritionists

[1662] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[1663] Specific examples

[1664] Example 1: A user wants to make a quick dinner

[1665] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[1666] 2. The device displays the recipe and the user begins cooking.

[1667] 3. The device will then say, "Fry the bacon until crispy."

[1668] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[1669] Example 2: Recipe suggestions to make up for nutritional deficiencies

[1670] 1. The user enters the results of a health check and submits iron deficiency data.

[1671] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[1672] 3. The device displays the recipe and provides it to the user.

[1673] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[1674] This system provides an environment in which even beginners can easily create delicious and healthy meals.

[1675] The processing flow will be explained below.

[1676] Step 1:

[1677] A user launches an application and enters basic information such as name, email address, and password.

[1678] Step 2:

[1679] The terminal transmits the entered registration information to the server.

[1680] Step 3:

[1681] The server stores the received registration information in a database.

[1682] Step 4:

[1683] The user enters personal preference information such as allergen information, food preferences, and cooking skill level.

[1684] Step 5:

[1685] The device sends the personal setting information to the server.

[1686] Step 6:

[1687] The server stores the received personal setting information in a database.

[1688] Step 7:

[1689] A user uses the in-app search feature to request "easy dinner recipes."

[1690] Step 8:

[1691] Based on the request received by the server, a generative AI model is used to generate an appropriate recipe.

[1692] Step 9:

[1693] The server sends the generated recipe to the terminal.

[1694] Step 10:

[1695] The terminal displays the received recipe on the user interface.

[1696] Step 11:

[1697] The user presses a button to notify the user that cooking with the selected recipe is about to begin.

[1698] Step 12:

[1699] The device requests cooking instructions from the server.

[1700] Step 13:

[1701] The server generates the appropriate cooking instructions and sends them to the device.

[1702] Step 14:

[1703] The device will then guide the user through cooking steps via voice or text, for example, "Chop the onion and fry it in a frying pan."

[1704] Step 15:

[1705] The user speaks, "What should I do next?"

[1706] Step 16:

[1707] The server analyzes the question, generates the next steps, and sends them to the device, such as "Add tomatoes and continue to stir-fry."

[1708] Step 17:

[1709] The device will guide the user through the next steps via voice or text.

[1710] Step 18:

[1711] The user speaks, "How can I cook it better?"

[1712] Step 19:

[1713] The server searches for advice based on professional cooking techniques and sends it to the device, such as "Vegetables will taste better if you season them with a little salt and stir-fry them for a short time over high heat."

[1714] Step 20:

[1715] The terminal provides advice to the user by voice or text.

[1716] Step 21:

[1717] The user inputs the results of the health check.

[1718] Step 22:

[1719] The terminal transmits the health check results to the server.

[1720] Step 23:

[1721] The server stores the received health checkup results in a database and generates suitable recipes based on advice from a nutritionist.

[1722] Step 24:

[1723] The server sends the generated recipe to the device, suggesting, for example, "Stir-fried spinach and ground beef."

[1724] Step 25:

[1725] The terminal displays the received recipe on the user interface.

[1726] Step 26:

[1727] A user asks, "What else goes in this recipe?"

[1728] Step 27:

[1729] The server analyzes the question and generates additional ingredients and instructions to send to the device, such as "Please also add potatoes and onions."

[1730] Step 28:

[1731] The device will provide the user with additional instructions via voice or text.

[1732] In this way, the present invention provides an interactive cooking support system that can be easily used even by beginners, enabling users to prepare delicious dishes and improve the quality of their dietary life.

[1733] Example 1

[1734] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1735] In today's society, many users find it difficult to eat healthy meals due to their busy lifestyles. Cooking effectively and efficiently can also be challenging for beginners and those with limited cooking skills. Furthermore, finding recipes that take into account specific health conditions and nutritional balance can be challenging, and there is a lack of access to the necessary cooking techniques and advice in real time. Therefore, there is a need for a system that allows users to easily obtain and execute recipes tailored to their individual conditions and needs.

[1736] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1737] In this invention, the server includes an information providing device connected to an information processing device that receives and stores the input information by the user's setting information and diagnostic results, a means for generating recipes based on the input information using a generative AI model, and a means for transmitting and displaying the generated recipes to the user and providing interactive cooking instructions, allowing users to easily obtain and execute recipes tailored to their individual conditions and needs.

[1738] An "information processing device" is a device that receives input information and performs the necessary calculations and data processing.

[1739] An "information storage device" is a device for storing received information and retrieving it as needed.

[1740] An "information providing device" is a device that includes an information processing device and an information storage device and provides necessary information to a user.

[1741] A "generative AI model" is an artificial intelligence model that generates a specific output based on given data.

[1742] "Cooking content" refers to the recipe and cooking steps required for the user to cook.

[1743] "User" refers to an individual who receives cooking assistance using this system.

[1744] "Interactive" refers to a method in which the system and the user interact with each other and provide appropriate responses in response to the user's questions and requests.

[1745] "Diagnosis results" refers to information and data regarding the user's health condition.

[1746] "Guide" refers to showing users the steps and providing instruction and guidance to help them achieve their goals.

[1747] This invention provides a cooking assistance system. The system allows users to input setting information and diagnostic results, and provides appropriate recipes and cooking procedures based on the input information. The system uses an information processing device, an information storage device, an information providing device, and a generative AI model.

[1748] Specifically, the user first launches the application and enters basic information such as name, email address, password, etc., as well as personal setting information such as allergen information, food preferences, cooking skill level, etc. The device sends this information to the server, and the server stores the received information in an information storage device, which is a database.

[1749] Next, when the user inputs a prompt such as "easy dinner recipe," the device sends this prompt to the server. The server uses the generative AI model to generate the optimal recipe and sends the result to the device. The device then displays the recipe information sent from the server and provides it to the user.

[1750] When a user selects a recipe and starts cooking, the device sends a cooking instructions request to the server. The server uses a generative AI model to generate appropriate cooking instructions and sends them to the device. The device then displays the received instructions in text or audio format, interactively guiding the user through the next cooking step. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time.

[1751] If a user asks, "How can I cook vegetables more deliciously?" while cooking, the device will send the question to the server. The server will generate advice based on professional cooking techniques and send it to the device. The device will then display the advice as voice or text, providing instructions to the user.

[1752] Furthermore, if a user wants to find dietary recipes to improve their health, they can input their health checkup results. For example, if they input information about iron deficiency, the device will send it to the server. The server will generate an appropriate recipe based on the advice of a nutritionist and send it to the device. The device will then display the generated recipe to the user and provide cooking support.

[1753] Prompt Sentence Examples

[1754] "Tell me some easy dinner recipes"

[1755] How can I cook vegetables more deliciously?

[1756] "What else goes into this recipe?"

[1757] This system allows users to easily obtain recipes tailored to their individual conditions and needs and then execute them step by step.

[1758] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1759] Step 1:

[1760] When a user launches the application for the first time, they enter basic information (such as name, email address, and password) and personal settings information (such as allergen information, food preferences, and cooking skill level). The entered information is sent by the device.

[1761] Step 2:

[1762] The device sends basic information and personal setting information to the server, which stores the received information in a database. This process records each user's individual information in the database.

[1763] Step 3:

[1764] The user inputs a prompt such as "easy dinner recipes." The terminal sends the input prompt to the server.

[1765] Step 4:

[1766] The server generates an appropriate recipe using a generative AI model based on the received prompt, taking into account the user's personal settings. The generated recipe is then sent from the server to the device.

[1767] Step 5:

[1768] The terminal displays the recipe information sent from the server and provides it to the user, who can then select a recipe from the displayed list.

[1769] Step 6:

[1770] The user selects a recipe and starts cooking. The device sends a request for the corresponding cooking instructions to the server.

[1771] Step 7:

[1772] The server uses the generative AI model to generate appropriate cooking instructions and sends them to the device, where they are displayed and provided to the user.

[1773] Step 8:

[1774] As the user cooks, they can ask questions such as "What's next?" and the device will send the question to the server.

[1775] Step 9:

[1776] The server generates the next cooking procedure or advice based on the question, and sends the generated procedure or advice to the terminal.

[1777] Step 10:

[1778] The device displays instructions and advice sent from the server in text or audio format and guides the user, providing specific instructions such as "Chop the onion and fry it in a frying pan."

[1779] Step 11:

[1780] When a user asks, "How can I cook vegetables more deliciously?" the device sends the question to the server.

[1781] Step 12:

[1782] The server generates advice based on professional cooking techniques and sends it to the device. The advice is displayed on the device and provided to the user. For example, specific advice such as "season vegetables with a little salt and stir-fry them for a short time over high heat will make them delicious" is provided.

[1783] Step 13:

[1784] When a user requests dietary recipes to improve their health, they input their health checkup results, and the terminal sends the input health information to the server.

[1785] Step 14:

[1786] The server uses a generative AI model based on the nutritionist's advice to generate an appropriate recipe, which is then sent to the device.

[1787] Step 15:

[1788] The device displays the generated recipe to the user and provides cooking support, and the user proceeds with cooking according to the displayed recipe.

[1789] (Application example 1)

[1790] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1791] In today's busy lifestyles, it is difficult for beginners and health-conscious people to cook easily and effectively at home. In particular, specific instructions on recipe selection, ingredient procurement, and cooking procedures are necessary, and a system that can consistently support these steps is needed.

[1792] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1793] In this invention, the server includes: means for a user to input dietary preference information and health checkup results, and means connected to a computer that receives the input information and a database that stores the input information; means for generating recipes based on the input information using a generative AI model; means for analyzing ingredients for the generated recipes and ordering delivery in bulk; means for sending and displaying the generated recipes to the user and providing interactive cooking instructions; and means for providing cooking instructions in text or voice in real time. This allows users to receive consistent support from recipe selection to ingredient procurement and cooking instructions, enabling them to cook easily and effectively at home.

[1794] "User" refers to an individual who uses the System to cook.

[1795] "Dietary settings information" refers to data about a user's individual diet, such as allergen information, food preferences, and cooking skill level.

[1796] "Health checkup results" refers to diagnostic results and medical data that indicate the user's health condition.

[1797] "Computer" means an electronic computing device for receiving and processing user information and requests.

[1798] "Database" refers to a data storage device used by a computer to store user information received or system-generated data.

[1799] "Server" refers to a central device connected to a computer and database that manages the processing of the entire system.

[1800] "Generative AI model" refers to an artificial intelligence model that generates recipes based on input information.

[1801] A "recipe" refers to cooking instructions that include cooking steps, ingredients, etc.

[1802] "Ingredients" refers to the ingredients listed in the recipe and items needed for cooking.

[1803] "Delivery" refers to the service of delivering materials ordered on the system to the user.

[1804] "Interactive means" refers to the functionality that allows users and systems to communicate in real time.

[1805] "Cooking instructions" refers to the specific cooking steps and advice provided by the system as the user cooks.

[1806] The present invention relates to a system that provides interactive support for users when cooking. This system provides a means for more effective cooking, especially for beginners and health-conscious people. It also allows users to enjoy cooking while learning professional cooking techniques.

[1807] Registering users and getting their personal settings

[1808] When a user launches the application for the first time, a screen appears where they can enter basic information such as their name, email address, and password. Once the basic information has been entered, the device sends the information to the server, which stores the received information in a database. Next, the user enters personal setting information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[1809] Recipe suggestions and ingredient delivery orders

[1810] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. The server then analyzes the ingredients of the generated recipe and automatically initiates a bulk delivery order. The ingredients are then quickly delivered to the user via a delivery service.

[1811] Interactive Cooking Support

[1812] When a user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device. As the user continues cooking, the device guides the user through the next steps via text or voice. For example, specific instructions such as "fry the bacon until crispy" are provided in real time. This allows even beginners to cook step by step. When the user asks "What's next?", the server provides further cooking instructions.

[1813] Professional technical support and nutritional management

[1814] If a user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and stir-fry them briefly over high heat to make them more delicious." The device then displays this information as voice or text, providing instructions to the user.

[1815] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[1816] Computer System Configuration

[1817] The server is connected to a computer and a database that stores the information. The computer is a device that receives and processes user information and requests, and the database is a data storage device that stores that information. The server uses a generative AI model to generate recipes, order ingredients for delivery, and provide interactive cooking instructions. The hardware and software used include Python, Django, or Flask (server-side), requests (API communication), and OpenAI GPT-3 (generative AI model).

[1818] Examples and prompts

[1819] 1. The user launches the application and requests "easy dinner recipes."

[1820] 2. The server uses GPT-3 to suggest a recipe for "Easy Tomato and Bacon Pasta" and display a list of ingredients.

[1821] 3. When the user presses the "Order" button, the necessary ingredients are ordered via a delivery service.

[1822] 4. After the delivery is complete, the device provides specific cooking instructions in real time, such as "Please fry the bacon until crispy."

[1823] Example prompt sentence:

[1824] "Suggest easy dinner recipes based on your user information: {preferences: 'healthy, easy'}. For example, easy pasta with tomatoes and bacon."

[1825] Thus, the present invention is a system that helps users cook at home simply and effectively. بهره‌برداری از این ‌اختراع، کاربر را قادر می‌سازد که با بهره‌گیری از فناوری هوش مصنوعی ایجاد شده و خدمات تحویل مواد بسته‌بندی شده، آشپزی در منزل را به یک تجربه ساده و کارآمد تبدیل کند.

[1826] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1827] Step 1:

[1828] Enter user registration information

[1829] When a user starts an application for the first time, a screen appears on the device where the user can enter basic information such as name, email address, and password. When the user enters this information (input), the device sends the information to the server (data transmission). The server then stores the received information in a database (data storage).

[1830] Step 2:

[1831] Obtaining personal setting information

[1832] The user then enters personal information such as allergen information, food preferences, and cooking skill level (input). The device sends this information to the server (data transmission), which then stores it in a database (data storage). This allows for the accumulation of personalized information that can be used for future recipe suggestions and interactive support (data storage).

[1833] Step 3:

[1834] Requesting and generating recipe suggestions

[1835] When a user makes a search request for "easy dinner recipes" (input), the device sends the request to the server (data transmission). Based on the received information, the server uses a generative AI model (GPT-3) to generate a prompt and create an "easy dinner recipe" (data generation). The generated recipe is sent to the device and displayed (data display).

[1836] Step 4:

[1837] Material delivery order

[1838] After the generated recipe is displayed, the user presses the "Order" button (input), and the device sends the ingredients list to the server (data transmission). The server analyzes the received ingredients list and places a bulk delivery order (data processing). The order data is then sent to the delivery service (data transmission).

[1839] Step 5:

[1840] Interactive cooking support launched

[1841] After the recipe ingredients arrive at the user's home (ingredient receipt), when the user begins cooking, the device sends a cooking procedure request to the server (data transmission). The server generates appropriate cooking procedures and sends them to the device (data generation, data transmission). The device then displays or audibly guides the user through the procedures (data display, audio output).

[1842] Step 6:

[1843] Providing cooking instructions in real time

[1844] As the user continues cooking, for example by asking "What's next?" (input), the device sends the voice data or text to the server (data transmission). The server analyzes the request, generates the next cooking instruction, and sends it to the device (data analysis, data generation, data transmission). The device then displays or plays back this in real time as voice or text (data display, voice output).

[1845] Step 7:

[1846] Professional technical support and advice

[1847] If the user needs additional advice while cooking (input), for example, by asking, "How can I cook vegetables more deliciously?", the device will send the question to the server (data transmission). The server will use a generative AI model to generate advice based on professional cooking techniques (data generation) and immediately send it to the device (data transmission). The device will then display or provide audio guidance in real time (data display, audio output).

[1848] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1849] This invention relates to a system that provides interactive support for users when cooking and, by combining it with an emotion engine, provides support according to the user's emotions. This system provides a means for beginners and health-conscious people to cook more effectively. It also allows users to enjoy cooking while learning professional cooking techniques, and provides appropriate responses according to the user's emotions.

[1850] Registering users and getting their personal settings

[1851] When a user launches the application for the first time, a screen appears prompting them to enter basic information such as their name, email address, and password. Once the basic information is entered, the device sends the information to the server, which then stores it in a database.

[1852] Next, the user enters personal information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[1853] Recipe suggestions and interactive guides

[1854] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses the generative AI model to generate an appropriate recipe. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking instructions from the server. The server generates the appropriate cooking instructions and sends them to the device.

[1855] As the user cooks, the device will guide them through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[1856] Professional technology provided

[1857] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[1858] Collaboration with nutritionists

[1859] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[1860] Emotion Engine

[1861] The present invention also incorporates an emotion engine, which analyzes the user's voice input and facial expression data, allowing the server to use the emotion engine to generate responses based on the user's emotional state. If the user is feeling stressed, the system can provide recipes and advice that promote relaxation, making cooking more comfortable.

[1862] For example, if a user inputs "I'm tired today," the server will respond by suggesting a simple and relaxing dish, such as "cream-braised chicken." If the emotion engine detects sadness or fatigue from the user's voice or facial expression, it can also provide a warm message such as "Take a short break and then resume cooking."

[1863] Specific examples

[1864] Example 1: A user wants to make a quick dinner

[1865] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[1866] 2. The device displays the recipe and the user begins cooking.

[1867] 3. The device will then say, "Fry the bacon until crispy."

[1868] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[1869] Example 2: Recipe suggestions to make up for nutritional deficiencies

[1870] 1. The user enters the results of a health check and submits iron deficiency data.

[1871] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[1872] 3. The device displays the recipe and provides it to the user.

[1873] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[1874] Example 3: Using the Emotion Engine

[1875] 1. The user types, "I'm tired today."

[1876] 2. The server uses its emotion engine to respond, "We'll suggest some relaxing dishes."

[1877] 3. The server suggests "creamed chicken" and the device displays the recipe.

[1878] 4. When the user asks, "What's an easier dish to make?" the server offers the advice, "Maybe make a salad."

[1879] This system allows even beginners to easily create delicious and healthy meals, and also provides appropriate support based on the user's emotions.

[1880] The processing flow will be explained below.

[1881] Step 1:

[1882] A user launches an application and enters basic information such as name, email address, and password.

[1883] Step 2:

[1884] The terminal transmits the entered registration information to the server.

[1885] Step 3:

[1886] The server stores the received registration information in a database.

[1887] Step 4:

[1888] The user enters personal preference information such as allergen information, food preferences, and cooking skill level.

[1889] Step 5:

[1890] The device sends the personal setting information to the server.

[1891] Step 6:

[1892] The server stores the received personal setting information in a database.

[1893] Step 7:

[1894] A user uses the in-app search feature to request "easy dinner recipes."

[1895] Step 8:

[1896] Based on the request received by the server, a generative AI model is used to generate an appropriate recipe.

[1897] Step 9:

[1898] The server sends the generated recipe to the terminal.

[1899] Step 10:

[1900] The terminal displays the received recipe on the user interface.

[1901] Step 11:

[1902] The user presses a button to notify the user that cooking with the selected recipe is about to begin.

[1903] Step 12:

[1904] The device requests cooking instructions from the server.

[1905] Step 13:

[1906] The server generates the appropriate cooking instructions and sends them to the device.

[1907] Step 14:

[1908] The device will then guide the user through cooking steps via voice or text, for example, "Chop the onion and fry it in a frying pan."

[1909] Step 15:

[1910] The user speaks, "What should I do next?"

[1911] Step 16:

[1912] The server analyzes the question, generates the next steps, and sends them to the device, such as "Add tomatoes and continue to stir-fry."

[1913] Step 17:

[1914] The device will guide the user through the next steps via voice or text.

[1915] Step 18:

[1916] The user speaks, "How can I cook it better?"

[1917] Step 19:

[1918] The server searches for advice based on professional cooking techniques and sends it to the device, such as "Vegetables will taste better if you season them with a little salt and stir-fry them for a short time over high heat."

[1919] Step 20:

[1920] The terminal provides advice to the user by voice or text.

[1921] Step 21:

[1922] The user inputs the results of the health check.

[1923] Step 22:

[1924] The terminal transmits the health check results to the server.

[1925] Step 23:

[1926] The server stores the received health checkup results in a database and generates suitable recipes based on advice from a nutritionist.

[1927] Step 24:

[1928] The server sends the generated recipe to the device, suggesting, for example, "Stir-fried spinach and ground beef."

[1929] Step 25:

[1930] The terminal displays the received recipe on the user interface.

[1931] Step 26:

[1932] A user asks, "What else goes in this recipe?"

[1933] Step 27:

[1934] The server analyzes the question and generates additional ingredients and instructions to send to the device, such as "Please also add potatoes and onions."

[1935] Step 28:

[1936] The device will provide the user with additional instructions via voice or text.

[1937] Additional processing for the emotion engine

[1938] Step 29:

[1939] The user types, "I'm tired today."

[1940] Step 30:

[1941] The server uses an emotion engine to analyze the user's emotional state and responds by saying, "We'll suggest some dishes that will help you relax."

[1942] Step 31:

[1943] The server generates a recipe for a relaxing dish, such as "creamed chicken," and sends it to the device.

[1944] Step 32:

[1945] The terminal displays the received recipe on the user interface.

[1946] Step 33:

[1947] A user asks, "What's an easier recipe?"

[1948] Step 34:

[1949] The server uses an emotion engine to analyze easy-to-make dishes and suggest, for example, "It would be good to make a salad."

[1950] Step 35:

[1951] The device provides the user with simple cooking instructions via voice or text.

[1952] In this way, the present invention provides an interactive cooking support system that can be easily used even by beginners, and by combining it with an emotion engine, it can provide support that responds to the user's emotions, allowing users to cook delicious meals and improve the quality of their diet.

[1953] Example 2

[1954] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1955] Conventional cooking support systems have had difficulty providing appropriate support based on a user's individual settings, health condition, and emotional state. Furthermore, they lacked a means to provide users with professional cooking techniques or advice from nutritionists in real time, making it difficult to quickly and effectively resolve users' problems. Furthermore, they were unable to provide recipe suggestions or advice based on the user's emotional state, making it difficult to increase user satisfaction.

[1956] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1957] In this invention, the server includes: a means for a user to input dietary setting information and health checkup results; a means for connecting to a database that receives and stores the input information; a means for generating a recipe based on the input information using a generative AI model; a means for sending the generated recipe to the user, displaying it, and providing interactive cooking instructions; a means for analyzing the user's emotional data and generating a response based on the user's emotional state using an emotion engine; a means for generating a recipe based on the user's health state and providing advice from a nutritionist; and a means for providing advice based on professional cooking techniques. This makes it possible to quickly and effectively provide appropriate cooking support based on the user's individual information, health state, and emotional state.

[1958] "User" refers to the entity that uses the system to receive cooking support.

[1959] "Meal-related setting information" refers to information that users individually set when eating meals, such as allergen information, food preferences, and cooking skill level.

[1960] "Health checkup results" refers to data based on health checkups conducted at medical institutions, etc., and indicates information that indicates the user's health condition in numerical and written form.

[1961] "Input means" refers to the method a user uses to provide information to a system, including touch screens, keyboard input, etc.

[1962] "Server connected to a database that receives and stores" refers to a server connected to a network that receives input information and stores it in a database.

[1963] A "generative AI model" refers to an artificial intelligence model that automatically generates appropriate recipes and advice based on input data.

[1964] "Means for generating recipes" refers to a method for using a generative AI model to create a recipe based on user input.

[1965] "Means for providing interactive cooking instructions" refers to a system that provides step-by-step guidance on cooking steps while interacting with the user.

[1966] "Emotional data" refers to information that indicates the user's emotional state, such as voice input or facial expression data.

[1967] "Emotion engine" refers to an algorithm for analyzing emotional data and generating a response based on the user's emotional state.

[1968] "Dietitian advice" refers to advice based on the expertise and guidance on healthy eating provided by a dietitian.

[1969] "Professional culinary advice" refers to advice on cooking methods and techniques recommended by experienced chefs or culinary experts.

[1970] This invention is an interactive cooking support system that allows users to input dietary preferences and health checkup results and provides appropriate recipes based on those preferences. It uses an emotion engine to provide support that responds to the user's emotions. This system provides a means for beginners and health-conscious people to cook effectively. It also allows users to enjoy cooking while learning professional cooking techniques, and provides appropriate responses that respond to the user's emotions.

[1971] Registering users and getting their personal settings

[1972] When a user launches the application for the first time, a screen appears where they can enter basic information such as their name, email address, and password. Once this basic information has been entered, the device sends the information to the server, which stores the received information in a database. Next, the user enters personal setting information such as allergen information, food preferences, and cooking skill level. The device sends this information to the server, which stores it in a database. This records the user's individual information and makes it available for future recipe suggestions and interactive support.

[1973] Recipe suggestions and interactive guides

[1974] When a user tries to cook, for example by searching for "easy dinner recipes," the server uses a generative AI model (e.g., GPT-4) to generate an appropriate recipe. The generative AI model uses "Generate an easy dinner recipe" as the prompt. The generated recipe is sent to the device and displayed. When the user selects a recipe and starts cooking, the device requests the corresponding cooking steps from the server. The server generates appropriate cooking steps and sends them to the device. As the user continues cooking, the device guides the user through the next steps via text or voice. For example, specific instructions such as "Chop the onion and fry it in a frying pan" are provided in real time. This allows even beginners to cook step by step.

[1975] Professional technology provided

[1976] If the user needs additional advice while cooking, for example by asking, "How can I cook vegetables more deliciously?", the server will provide advice based on professional cooking techniques. The server processes this in real time and sends advice such as, "Season the vegetables with a little salt and fry them briefly over high heat to make them more delicious." The device then displays this advice as voice or text, providing instructions to the user.

[1977] Collaboration with nutritionists

[1978] Furthermore, if a user wants to improve their diet based on their health condition, they can input the results of their health check. For example, if they input information about iron deficiency, the device will send it to the server. The server will use this information to generate an appropriate recipe based on the advice of a nutritionist. For example, it will suggest "stir-fried spinach and ground beef" and send it to the device. The device will then provide the displayed recipe to the user, who can then proceed with cooking.

[1979] Emotion Engine

[1980] The present invention also incorporates an emotion engine. This allows the server to analyze the user's voice input and facial expression data and use the emotion engine to generate a response based on the user's emotional state. If the user is feeling stressed, the server can provide recipes and advice that promote relaxation, making cooking more comfortable. For example, if the user inputs "I'm tired today," the server can respond by saying, "I'll suggest some easy and relaxing dishes," such as "chicken in cream sauce." Furthermore, if the emotion engine detects sadness or fatigue from the user's voice or facial expression, it can provide a warm message such as, "Take a short break and resume cooking."

[1981] Specific examples

[1982] Example 1: A user wants to make a quick dinner

[1983] 1. A user searches for "easy dinner recipes" and the server suggests "easy pasta with tomatoes and bacon."

[1984] 2. The device displays the recipe and the user begins cooking.

[1985] 3. The device will then say, "Fry the bacon until crispy."

[1986] 4. The user asks, "What next?" and the server responds with instructions such as, "Add the tomatoes and sauté for another 3 minutes."

[1987] Example 2: Recipe suggestions to make up for nutritional deficiencies

[1988] 1. The user enters the results of a health check and submits iron deficiency data.

[1989] 2. The server generates a recipe for "Spinach and Ground Beef Stir-fry" based on advice from a nutritionist.

[1990] 3. The device displays the recipe and provides it to the user.

[1991] 4. When the user asks, "What else goes in this recipe?" the server offers the advice, "Add potatoes and onions too."

[1992] Example 3: Using the Emotion Engine

[1993] 1. The user types, "I'm tired today."

[1994] 2. The server uses its emotion engine to respond, "We'll suggest some relaxing dishes."

[1995] 3. The server suggests "creamed chicken" and the device displays the recipe.

[1996] 4. When the user asks, "What's an easier dish to make?" the server offers the advice, "Maybe make a salad."

[1997] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1998] Program processing flow

[1999] Step 1: Register and retrieve user preferences

[2000] 1. User launches application for the first time:

[2001] Input: Basic information: Name, Email address, Password

[2002] Process: The user enters basic information into the input form.

[2003] Output: Basic information is entered into the terminal.

[2004] 2. The device sends basic information to the server:

[2005] Input: Basic information entered by the user

[2006] Processing: The terminal sends the entered basic information to the server.

[2007] Output: The server receives the basic information.

[2008] 3. The server saves the basic information to a database:

[2009] Input: Received basic information

[2010] Processing: The server stores the received basic information in a database.

[2011] Output: Basic information stored in a database.

[2012] 4. User enters personal configuration information:

[2013] Input: Personal settings such as allergen information, food preferences, and cooking skill level

[2014] Action: The user enters personal preference information into an input form.

[2015] Output: The personalization information is entered into the device.

[2016] 5. The device sends personal configuration information to the server:

[2017] Input: Personal setting information entered by the user

[2018] Processing: The device sends the entered personal setting information to the server.

[2019] Output: The server receives the personalization information.

[2020] 6. The server stores your personal settings in a database:

[2021] Input: Received personal setting information

[2022] Processing: The server stores the received personal setting information in a database.

[2023] Output: Personalization information stored in a database.

[2024] Step 2: Recipe suggestions

[2025] 1. User searches for a recipe:

[2026] Input: Search keyword (e.g. "easy dinner recipes")

[2027] What happens: A user enters keywords into the search bar and performs a search.

[2028] Output: A search request is generated on the device.

[2029] 2. The server generates a recipe using the generative AI model:

[2030] Input: Search keywords, personal settings information

[2031] Processing: The server uses a generative AI model (e.g., GPT-4) with the prompt "Generate a simple dinner recipe" to generate a recipe.

[2032] Output: Recipe data generated by the generative AI model is sent back to the server.

[2033] 3. The server sends the generated recipe to the device:

[2034] Input: Generated recipe data

[2035] Processing: The server sends the generated recipe to the device.

[2036] Output: Recipe data is received on the device.

[2037] 4. The device will display the recipe:

[2038] Input: Received recipe data

[2039] Processing: The terminal displays the recipe data on the user interface.

[2040] Output: The user can view the recipe.

[2041] Step 3: Interactive Guide

[2042] 1. User starts cooking and requests cooking instructions:

[2043] Input: Recipe selection, start instruction

[2044] Action: The device starts cooking based on the recipe selected by the user and requests the next cooking step.

[2045] Output: A cooking instructions request is generated on the device.

[2046] 2. The server generates the appropriate cooking instructions and sends them to the device:

[2047] Input: Selected recipe data, cooking procedure request

[2048] Processing: The server generates cooking instructions and sends them to the terminal.

[2049] Output: Cooking instructions data is received on the device.

[2050] 3. Your device will display or speak cooking instructions:

[2051] Input: Received cooking instructions data

[2052] Processing: The device provides the user with cooking instructions in text or audio format.

[2053] Output: The user is guided through the cooking steps (e.g., "Chop the onion and fry it in a frying pan").

[2054] Step 4: Professional technical support

[2055] 1. User requests additional advice:

[2056] Input: Question (e.g., "How can I cook vegetables more deliciously?")

[2057] Process: The user types or speaks a question into the terminal.

[2058] Output: A question request is generated on the terminal.

[2059] 2. The server provides professional advice:

[2060] Input: Question

[2061] Processing: The server generates advice based on professional cooking techniques and sends it to the device.

[2062] Output: Advice received by device (e.g. "Vegetables taste better if seasoned with a little salt and fried briefly over high heat").

[2063] 3. Your device will display or speak advice:

[2064] Input: Advice received

[2065] Processing: The terminal provides advice to the user by displaying text or by voice guidance.

[2066] Output: The user receives the advice.

[2067] Step 5: Work with a dietitian

[2068] 1. User enters health check results:

[2069] Input: Health checkup result data (e.g., iron deficiency information)

[2070] Process: The user enters the results of a health check into the application.

[2071] Output: The health check results are entered into the terminal.

[2072] 2. The device sends the health check result to the server:

[2073] Input: Health check result data

[2074] Processing: The terminal sends the health check result data to the server.

[2075] Output: Health check result data is received by the server.

[2076] 3. The server generates a recipe based on the nutritionist's advice:

[2077] Input: Health check result data

[2078] Processing: The server generates an appropriate recipe based on the nutritionist's advice (e.g., "Spinach and ground beef stir-fry").

[2079] Output: The generated recipe data is generated on the server.

[2080] 4. The server sends the generated recipe to the device:

[2081] Input: Generated recipe data

[2082] Processing: The server sends the generated recipe to the device.

[2083] Output: Recipe data is received on the device.

[2084] 5. The device will display the recipe:

[2085] Input: Received recipe data

[2086] Processing: The device displays the recipe in the user interface.

[2087] Output: The user can view the recipe.

[2088] Step 6: Leverage the Emotion Engine

[2089] 1. User inputs their emotion:

[2090] Input: Emotional state text data (e.g., "I'm tired today")

[2091] Processing: The user inputs their emotional state into the application.

[2092] Output: The emotional state is input to the terminal.

[2093] 2. The server uses the emotion engine to generate a response:

[2094] Input: Emotional state data

[2095] Processing: The server uses an emotion engine to generate a response based on the user's emotional state.

[2096] Output: Response data is generated on the server (e.g., "Suggested relaxing dishes").

[2097] 3. The server generates a recipe based on the emotion and sends it to the device:

[2098] Input: Emotional state data, generative AI model

[2099] Processing: The server uses the generative AI model to generate a recipe based on the emotion and sends it to the device (e.g., "cream-braised chicken").

[2100] Output: Recipe data is received on the device.

[2101] 4. The device will display the recipe:

[2102] Input: Received recipe data

[2103] Processing: The device displays the recipe in the user interface.

[2104] Output: The user can view the recipe.

[2105] 5. The emotion engine analyzes user reactions and responds further:

[2106] Input: User voice and facial expression data

[2107] Processing: The emotion engine analyzes the user's emotional state from their voice and facial expressions and generates an appropriate response.

[2108] Output: Response data is generated on the server and sent to the device (e.g., "Let's take a short break and then resume cooking").

[2109] (Application example 2)

[2110] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2111] In modern society, finding the right recipe and cooking effectively is a major challenge for beginners and busy people. They also lack the tools to reduce the emotions and stress they experience while cooking. Furthermore, it is difficult to incorporate healthy eating habits into their daily lives. Conventional systems struggle to address these needs, and new approaches are needed to improve user satisfaction.

[2112] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an information processing device connected to an electronic device that receives and stores the input information by a user's dietary setting information and health checkup results, means connected to the information processing device and that generates cooking instructions based on the input information using a generative AI model, means for sending and displaying the generated cooking instructions to the user and providing interactive cooking procedures, and means for analyzing the user's voice and facial expression data using an emotion engine and generating a response based on the user's emotions. This enables beginners and busy people to easily find appropriate and healthy recipes, cook effectively, and receive support tailored to their emotions.

[2113] A "user" is someone who uses the system to input dietary preferences and health check results and receive suggested recipes and cooking instructions.

[2114] "Dietary setting information" refers to personal setting information that affects meal selection and cooking, such as the user's allergen information, food preferences, and cooking skill level.

[2115] "Health checkup results" are medical data that indicate the user's health status and are information used to make dietary suggestions based on nutritional deficiencies or specific health risks.

[2116] "Input information" refers to the dietary settings and health check results entered by the user into the system.

[2117] "Electronic Device" means a device used by a User to input information and receive information from the System, including a smartphone, tablet, smart glasses, or head-mounted display.

[2118] An "information storage device" is hardware or software that stores data such as input information and generated cooking instructions.

[2119] An "information processing device" is a server or computer connected to an electronic device and information storage device for receiving and processing input information.

[2120] A "generative AI model" is an artificial intelligence model that generates appropriate cooking instructions and recipes based on information entered by the user.

[2121] "Cooking instructions" are specific cooking steps and advice generated by a generative AI model and provided to users.

[2122] "Means for providing interactive cooking instructions" refers to a function that provides users with real-time audio or text guidance on specific steps as they cook.

[2123] An "emotion engine" is a device or software that analyzes a user's voice and facial expression data to determine the user's emotional state.

[2124] The "means for generating a response based on emotions" is a function for generating appropriate responses or advice based on the user's emotional state analyzed by the emotion engine.

[2125] The present invention is a system that provides interactive support to users when cooking, and combines an emotion engine to provide support according to the user's emotions. This system is particularly suitable for beginners and people who are health conscious. To implement the invention, the following configuration and operating procedures are followed.

[2126] System configuration

[2127] Hardware

[2128] Electronic devices: Includes devices such as smartphones, tablets, smart glasses, and head-mounted displays.

[2129] Information storage: Includes MySQL and other database systems.

[2130] Information processing device: A server or cloud computing resource is used.

[2131] software

[2132] Generative AI models: Use Python and generative AI models (e.g., ChatGPT) to generate recipes and cooking instructions.

[2133] Sentiment engine: Uses machine learning libraries such as TensorFlow for sentiment analysis.

[2134] Front-end: Uses HTML, CSS, JavaScript, or a mobile application framework (e.g., React Native) to provide the user interface.

[2135] Program processing overview

[2136] 1. User registration and personal settings acquisition

[2137] When a user launches the application for the first time, they enter basic information (name, email address, password) into the electronic device. The entered information is sent to the information processing device and stored in the information storage device. Next, personal setting information such as allergen information and cooking skill level is also obtained.

[2138] 2. Recipe suggestions and interactive guides

[2139] When a user searches for a specific recipe, the information processing device uses a generative AI model to generate an appropriate recipe, which is then sent to the electronic device and displayed to the user, providing interactive support by providing real-time cooking instructions via voice and text.

[2140] 3. Professional technology provided

[2141] If the user needs additional advice while cooking, advice based on professional cooking techniques is provided via a generative AI model.

[2142] 4. Collaboration with nutritionists

[2143] If a user wants to improve their diet based on their health status, they can input their health check results and appropriate recipes will be generated based on them.

[2144] 5. Supported by Emotion Engine

[2145] The emotion engine analyzes the user's voice and facial expression data and generates responses based on their emotions. For example, if the user is tired, it will suggest relaxing dishes, providing support that matches the user's mood.

[2146] Specific examples

[2147] 1. Example 1: Simple dinner recipe suggestions

[2148] A user speaks, "Tell me an easy dinner recipe." The information processing device uses a generative AI model to suggest "Easy pasta with tomatoes and bacon." The device then displays the recipe and instructs the user to fry the bacon in a frying pan until crispy.

[2149] Prompt Sentence Examples

[2150] Can you recommend some easy dinner recipes?

[2151] 2. Example 2: Relaxation recipe suggestions using an emotion engine

[2152] The user inputs "I'm tired today" by voice. The information processing device analyzes the user's emotions using its emotion engine and responds by saying, "I'll suggest a dish that will help you relax." The next suggestion is "chicken stewed in cream sauce."

[2153] Prompt Sentence Examples

[2154] What are some relaxing cooking recipes you recommend for users when they're feeling tired?

[2155] In this way, beginners and busy people can cook properly and healthily without stress, and can also receive support according to their emotions.

[2156] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2157] Step 1: Enter and submit basic user information

[2158] A user starts up an electronic device and enters basic information such as name, email address, and password. The entered basic information is sent from the device to a server, which receives the information and stores it in an information storage device.

[2159] Step 2: Enter and submit your personal settings information

[2160] The user inputs personal setting information such as allergen information, food preferences, cooking skill level, etc. The input information is sent from the terminal to the server, which receives this information and stores it in an information storage device.

[2161] Step 3: Find and generate recipes

[2162] The user voice-inputs a request for a specific dish (e.g., "easy dinner recipes"), which is then sent from the device to the server. The server uses a generative AI model to generate a recipe based on the request, taking into account the user's personal settings. The server then sends the generated recipe back to the device.

[2163] Step 4: Display the recipe and provide cooking instructions

[2164] The device displays the received recipe to the user. When the user starts cooking, the device requests the next step from the server. The server uses a generative AI model to generate the next cooking steps and sends them to the device. The device then guides the user through these steps via voice or text, providing specific instructions such as "fry the bacon until crispy."

[2165] Step 5: Professional technical support

[2166] If a user needs additional advice while cooking, for example, by asking, "How can I cook vegetables more deliciously?", the device sends this question to the server. The server uses a generative AI model to generate advice based on professional cooking techniques and sends it to the device. The device then provides this advice to the user via voice or text.

[2167] Step 6: Health-based recipe suggestions

[2168] The user inputs the results of a health check (e.g., iron deficiency). These results are sent from the device to the server. The server combines the generative AI model with advice from a nutritionist to generate an appropriate recipe. The generated recipe is sent from the server to the device and displayed. The user then proceeds with cooking according to this recipe.

[2169] Step 7: Support from the Emotion Engine

[2170] The user provides voice input (for example, "I feel tired today"). This voice data is sent from the device to the server. The server uses an emotion engine to analyze the user's emotional state and generates appropriate recipes and advice based on the results. For example, the server responds with "I'll suggest some dishes that will help you relax" and suggests "cream-braised chicken." This information is sent from the server to the device and displayed.

[2171] At each step, the system processes data, with a generative AI model generating recipes based on the input information and an emotion engine analyzing the user's emotions. The output is cooking instructions, professional advice, and emotion-based suggestions provided to the device.

[2172] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 ...

Claims

1. The user inputs dietary settings and health check results, a server connected to a computer that receives input information and a database that stores the information; a means, connected to the server, for generating a recipe based on the input information using a generative AI model; The system includes a means for transmitting the generated recipe to the user, displaying it, and providing interactive cooking instructions.

2. The system of claim 1, capable of providing professional cooking techniques and advice to users via a generative AI model.

3. 10. The system of claim 1, wherein the user provides voice input and the server provides real-time interactive guidance and instructions on the progress of the cooking process.

Images