System

Abstract

A system is provided.SOLUTION: A system, comprising: means for receiving home configuration information and generating a menu based on nutritional balance; means for generating a list of ingredients required for the menu; means for delivering ingredients based on the list of ingredients; and means for animating and providing a cooking procedure for the menu to a user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, many families are busy with work and housework, and spend a lot of time and effort preparing dinner every day. With more women entering the workforce, preparing dinner can be a burden, contributing to a decline in the quality of family life. Furthermore, planning a nutritionally balanced menu, shopping for the necessary ingredients, and learning effective cooking methods can be difficult, leaving many people in need of support for maintaining a healthy diet. The objective of this invention is to address these issues by streamlining dinner preparation, providing a healthy diet, and freeing up time. [Means for solving the problem]

[0005] The present invention solves the above problem by providing a system that includes: a means for receiving household composition information and generating a menu based on nutritional balance; a means for generating a list of ingredients required for the menu; a means for delivering ingredients based on the ingredient list; and a means for creating a video of the cooking steps for the menu and providing it to the user. Specifically, when a user inputs household information, AI automatically creates a week's worth of menus that take nutritional balance into consideration, delivers the necessary ingredients to the home via a delivery service, and provides cooking instructions via video, allowing the user to easily prepare healthy meals.

[0006] "Family composition information" refers to basic information about the user's household, such as the ages and number of family members, food preferences, and allergy information.

[0007] "Nutritional balance" refers to a state in which a particular diet is composed so that it contains various nutrients (carbohydrates, proteins, fats, vitamins, minerals, etc.) in appropriate proportions.

[0008] A "menu" refers to a combination of meals served over a specific period (e.g., one week).

[0009] "Ingredient list" refers to a list of all ingredients needed to achieve a particular meal plan.

[0010] "Delivery" refers to the process of delivering ingredients to a location specified by the user.

[0011] "Cooking instructions" refers to the cooking steps required to complete a particular meal.

[0012] "Animation" refers to the presentation of specific information or procedures in video format.

[0013] A "system" refers to a framework that includes multiple means and is integrated to achieve a certain purpose. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] This invention is a system that streamlines dinner preparation at home. The system includes an AI module that receives household composition information and generates a menu based on nutritional balance. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also creates videos of cooking procedures according to the menu, supporting users in cooking easily and efficiently.

[0036] Overall system overview

[0037] 1. Entering household information and generating menus

[0038] User: Enter household information (e.g., age, number of people, food preferences, allergy information) into the terminal.

[0039] Terminal: Sends the entered home information to the server.

[0040] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[0041] AI module: Creates a week's worth of nutritionally balanced meals tailored to the household's composition and sends them back to the server.

[0042] Server: Sends the generated menu to the terminal.

[0043] Terminal: Displays the menu so that the user can check it.

[0044] 2. Generating a list of ingredients and delivering

[0045] Server: Creates a list of ingredients based on the menu generated by the AI ​​module.

[0046] Delivery service: Prepares ingredients based on the ingredient list received from the server and delivers them to the user's address.

[0047] User: Receive the necessary ingredients.

[0048] 3. Videos and support for cooking procedures

[0049] Server: Receives cooking instructions from the AI ​​module and animates them.

[0050] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[0051] Server: Sends the generated cooking video to the device.

[0052] Device: Displays the video so that the user can proceed with cooking while watching the video.

[0053] User: Follow the video and perform the cooking.

[0054] Specific examples

[0055] For example, if a user inputs household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module. The AI ​​module takes nutritional balance into consideration and generates a weekly menu (e.g., "Monday: teriyaki chicken breast, rice, salad," "Tuesday: fish meunière, bread, soup," etc.). This menu information is sent via the server to the device, where the user can check it.

[0056] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service uses this list to collect the ingredients and delivers them to the user's address. By receiving the ingredients, the user can save time by not having to go shopping.

[0057] When cooking, the server sends the menu and cooking instructions to the AI ​​module, which then animates them. For example, it could show specific steps such as "preparing the chicken breast, how to cook it, and the order in which to season it," and the server sends this video to the device. Users can efficiently cook by playing the video on their device.

[0058] As described above, the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[0059] The processing flow will be explained below.

[0060] Menu planning process

[0061] Step 1:

[0062] The user accesses the terminal and inputs household information (age, number of people, food preferences, and allergy information).

[0063] Step 2:

[0064] The terminal formats the entered home information and sends it to the server.

[0065] Step 3:

[0066] The server receives the input information and transmits it to the AI ​​module.

[0067] Step 4:

[0068] The AI ​​module generates a weekly menu that takes nutritional balance into consideration based on household information.

[0069] Step 5:

[0070] The menu information generated by the AI ​​module is returned to the server.

[0071] Step 6:

[0072] The server receives the menu information and sends it to the terminal.

[0073] Step 7:

[0074] The device displays the menu information for the user to review.

[0075] Ingredient list generation and delivery

[0076] Step 1:

[0077] The server generates a list of necessary ingredients based on the menu received from the AI ​​module.

[0078] Step 2:

[0079] The server converts the ingredient list into a format suitable for the delivery service.

[0080] Step 3:

[0081] The server sends the converted ingredient list to the delivery service.

[0082] Step 4:

[0083] The delivery service prepares ingredients based on the ingredient list received from the server.

[0084] Step 5:

[0085] The delivery service delivers the ingredients to the user's address.

[0086] Step 6:

[0087] The user receives the ingredients at the specified address.

[0088] Cooking procedure animation and support

[0089] Step 1:

[0090] The server collects the menu and cooking instructions received from the AI ​​module.

[0091] Step 2:

[0092] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[0093] Step 3:

[0094] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[0095] Step 4:

[0096] The server sends the generated cooking video to the terminal.

[0097] Step 5:

[0098] The device displays the cooking video for the user to review.

[0099] Step 6:

[0100] The user plays a video on the device and follows along as they cook.

[0101] Through these steps, the present invention is a system that enables users to efficiently prepare dinner every day, providing healthy eating habits and freeing up time.

[0102] Example 1

[0103] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0104] In today's world, preparing dinner at home is a time-consuming and labor-intensive task for many families, and there is a need for efficient methods of preparation. However, planning a menu, purchasing the necessary ingredients, and then cooking with those ingredients requires a considerable amount of effort to manage and execute a large amount of information. For this reason, a system is needed to make meal preparation at home easier and healthier.

[0105] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0106] In this invention, the server includes a means for validating household composition information in real time and eliminating invalid data, a means for generating and sending prompts to the AI ​​module, and a calendar-format display means for integrating and displaying the generated menu information. This makes it possible to provide a system that efficiently generates nutritionally balanced menus based on household composition information, builds a list of necessary ingredients, and integrates ingredient delivery with video provision of cooking instructions.

[0107] "Family composition information" refers to detailed information about the household, including age, number of people, food preferences, and allergy information.

[0108] "Nutritional balance" refers to a state in which the necessary nutrients are contained in the right amounts.

[0109] A "menu" refers to a meal menu for a specific period (usually a week), and is a plan that includes the dishes to be served at each meal.

[0110] An "ingredient list" is a list of ingredients needed to prepare a specific menu.

[0111] "Delivery" refers to a service that delivers goods (in this case, food) to a specific location.

[0112] "Cooking procedure animation" refers to the process of recording cooking procedures and methods in video format and providing the video to users.

[0113] "Validation check" is the process of checking whether the entered data meets the specified standards and detecting and excluding invalid data.

[0114] A "prompt" is an instruction given to an AI to encourage it to perform a specific action.

[0115] "Calendar format display" is a method of visually displaying the generated menu information in the form of a calendar.

[0116] An "AI module" is a program that uses artificial intelligence technology to perform a specific task (in this case, generating a menu or animating cooking instructions).

[0117] This invention is a system for improving the efficiency of dinner preparation at home, and includes functions for receiving household configuration information, generating a menu based on nutritional balance, creating a list of ingredients based on the menu, and delivering the ingredients to the user via a delivery service.The system also creates a video of the cooking procedure according to the menu, supporting the user in cooking easily and efficiently.

[0118] System configuration

[0119] Hardware:

[0120] Server: This is the central processing device of the system, and is responsible for managing household composition information, generating menus, creating ingredient lists, linking with delivery services, and creating videos of cooking procedures.

[0121] Terminal: A device on which users can input household information and view menu information and cooking procedure videos. This includes smartphones, tablets, and PCs.

[0122] Delivery service: A service provider that delivers food ingredients to the user's address.

[0123] software:

[0124] AI module: An artificial intelligence program used to generate nutritionally balanced menus.

[0125] Prompt generator: A program that generates prompt sentences to send appropriate instructions to the AI ​​module.

[0126] Video generation program: A program for generating cooking instructions in video format.

[0127] Validation program: A program that validates the household configuration information entered by the user.

[0128] System Operation

[0129] The user uses a terminal to input household composition information (e.g., age, number of people, food preferences, allergy information). This input information is sent to the server via the terminal. The server receives this information, performs validation checks in real time, and eliminates invalid data. The prompt generation program then generates and sends a prompt to the AI ​​module: "Based on this household information, please generate a nutritionally balanced menu for one week."

[0130] The AI ​​module receives and analyzes the prompt text and generates a weekly menu that suits the household's configuration. The generated menu information is sent back to the server, which then sends it to the device to display in calendar format so that the user can check it. Examples include "Monday: Teriyaki chicken breast, rice, salad" and "Tuesday: Fish meunière, bread, soup."

[0131] Next, the server creates a list of ingredients based on the generated menu information and sends it to the delivery service. The delivery service prepares the ingredients based on the received ingredient list and delivers them to the user's address. By receiving these ingredients, the user can save time and effort in shopping.

[0132] Furthermore, the server generates and sends a prompt message to the AI ​​module requesting that it create a video of the cooking steps: "Please explain the cooking steps for teriyaki chicken breast in a video." The AI ​​module generates specific cooking steps in the form of a video and returns it to the server. The server then sends this video to the device and provides it to the user. The user can efficiently proceed with cooking while playing the video on the device.

[0133] As described above, the system of the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[0134] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0135] Step 1:

[0136] The user uses the terminal to input household configuration information.

[0137] Specifically, the user enters household information such as age, number of people, food preferences, and allergy information into an input form on the device. Once the input is complete, the device sends it to the server. The input data is sent to the server as JSON format data containing individual information for each household member.

[0138] Step 2:

[0139] The server performs a validation check on the received home configuration information.

[0140] Specifically, the server parses the JSON data it receives and checks whether each item has been entered in the correct format. For example, it verifies that age is a positive integer and that ingredient preferences have been entered in the correct list format. If invalid data is found, it generates an error message and returns it to the terminal. If validation is successful, it moves on to the next step.

[0141] Step 3:

[0142] The server generates and sends a prompt to the AI ​​module.

[0143] Specifically, a prompt is generated based on the household composition information, saying, "Based on this household information, please generate a nutritionally balanced menu for one week." The generated prompt is sent to the AI ​​module using a REST API or similar. The input is the validated household composition information, and the output is the prompt sent to the AI ​​module.

[0144] Step 4:

[0145] The AI ​​module generates a menu based on the prompt.

[0146] Specifically, the AI ​​module analyzes household configuration information and prompt text, and generates a weekly menu that takes nutritional balance into consideration. The generated menu is returned to the server as JSON data in a format such as "Monday: teriyaki chicken breast, rice, salad." The input is the prompt text, and the output is the generated weekly menu.

[0147] Step 5:

[0148] The server receives the generated menu data and transmits it to the terminal.

[0149] Specifically, the generated menu data is returned to the device and formatted in a format that can be viewed by the user. HTML and CSS are generated to display the menu in calendar or list format, and this is sent to the device. The input is the generated menu data, and the output is calendar-format HTML data that is sent to the device.

[0150] Step 6:

[0151] The terminal displays menu information to the user.

[0152] Specifically, the device displays the received HTML data in a browser, allowing the user to easily check a week's worth of menus. The input is the received HTML data, and the output is the displayed menu information.

[0153] Step 7:

[0154] The server creates an ingredient list based on the generated menu.

[0155] Specifically, the server analyzes the menu data and creates a list of ingredients needed for each dish. For example, it creates a list in the format "Monday: chicken breast, soy sauce, mirin, sesame oil, rice, lettuce, tomato." The input is the menu data, and the output is a list of ingredients.

[0156] Step 8:

[0157] The server sends the ingredient list to the delivery service.

[0158] Specifically, the created ingredient list is sent to the API endpoint of the delivery service using an HTTP POST request, etc. The input is the ingredient list, and the output is a request to the delivery service.

[0159] Step 9:

[0160] The delivery service prepares the ingredients and delivers them to the user.

[0161] Specifically, the delivery service collects the necessary ingredients based on the received ingredient list and delivers them to the user's address. The delivery status can be tracked in real time and checked from the terminal. The input is the ingredient list, and the output is the delivered ingredients.

[0162] Step 10:

[0163] The user receives the delivered ingredients.

[0164] Specifically, the user receives ingredients at a specified address and checks their quality. The received ingredients are then used for cooking. The input is the ingredients delivered by the delivery service, and the output is the received ingredients.

[0165] Step 11:

[0166] The server generates and sends a prompt to the AI ​​module requesting it to animate the cooking steps.

[0167] Specifically, a prompt message is generated that reads, "Please explain the cooking steps for teriyaki chicken breast in a video," and sent to the AI ​​module. The input is the menu data, and the output is a prompt message requesting the creation of a video of the cooking steps.

[0168] Step 12:

[0169] The AI ​​module animates the cooking process.

[0170] Specifically, based on the prompt sentence, the system efficiently generates specific cooking steps in the form of a video. For example, it generates a video showing steps such as "preparing chicken breast, cooking it, and the order in which to season it." The input is the prompt sentence, and the output is a video of the generated cooking steps.

[0171] Step 13:

[0172] The server receives the generated cooking video and sends it to the terminal.

[0173] Specifically, the generated video of the cooking instructions is sent to the device using an HTTP request, etc. The input is the video of the cooking instructions, and the output is a request to send the video to the device.

[0174] Step 14:

[0175] The device displays the cooking video to the user.

[0176] Specifically, a player is provided so that the device can play the received video data, allowing the user to check the cooking instructions while cooking. The video is played using a player that includes functions such as play, pause, rewind, and fast forward. The input is the received video data, and the output is a video of the cooking instructions displayed.

[0177] Step 15:

[0178] The user follows the video to perform cooking.

[0179] Specifically, the user watches a video played on the device and follows the cooking instructions. For example, when cooking chicken breast teriyaki, the user follows the steps shown in the video. The input is the video that is displayed, and the output is the cooked dish.

[0180] (Application example 1)

[0181] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0182] In today's busy households, preparing dinner every day takes a lot of time and effort. Planning a menu that takes into account the nutritional balance, preferences, and allergy information required for each household is extremely time-consuming. Purchasing each ingredient one by one is also a hassle, and guidance on how to efficiently execute cooking procedures is essential. However, conventional systems have faced challenges in consistently automating these processes and making them more efficient. In particular, they lacked the means to link with delivery services or display cooking procedures on a smartphone.

[0183] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0184] In this invention, the server includes a means for generating a nutritionally balanced menu based on household composition information, a means for creating an ingredient list for the generated menu, a means for sending the ingredient list to an affiliated delivery service, and a means for displaying cooking instructions in video form on a smartphone. This allows users to receive suggestions for efficient and balanced menus tailored to their household composition, automatically obtain the necessary ingredients through the delivery service, and further enable them to cook while checking the cooking instructions on their smartphone.

[0185] "Family composition information" refers to basic information about family members, including age, number of people, food preferences, and allergy information.

[0186] "Nutritional balance" means consuming an equal amount of nutrients necessary to maintain physical health.

[0187] A "menu" is a list of planned meals for a particular period of time (e.g., a week).

[0188] An "ingredient list" is a list of ingredients required based on a menu.

[0189] "Delivery" refers to the act of sending goods or ingredients to a specific location.

[0190] "Cooking instructions" are specific methods that show the procedures and steps for making a dish.

[0191] "Animation" refers to the presentation of specific information or procedures in the form of a video.

[0192] A "smartphone" is a type of mobile phone and a communications device with advanced computer functions and internet connectivity.

[0193] A "delivery service" is a service that delivers ingredients or products to a specific location.

[0194] An "AI module" refers to a program or algorithm that uses artificial intelligence and has functions such as data analysis and automation.

[0195] A "server" is a computer system that provides various services over a network.

[0196] This invention is a system that streamlines dinner preparation at home. The system includes an AI module that receives household composition information and generates a menu based on nutritional balance. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also creates videos of cooking procedures according to the menu, supporting users in cooking easily and efficiently.

[0197] Overall system overview

[0198] 1. Entering household information and generating menus

[0199] User: Enters household information (e.g., age, number of people, food preferences, allergy information) into a smartphone device.

[0200] Terminal: Sends the entered home information to the server.

[0201] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[0202] AI module: Using a generative AI model, it creates a nutritionally balanced menu that suits the household composition and returns it to the server.

[0203] Server: Sends the generated menu to the terminal.

[0204] Terminal: Displays the menu so that the user can check it.

[0205] 2. Generating a list of ingredients and delivering

[0206] Server: Creates a list of ingredients based on the menu generated by the AI ​​module.

[0207] Delivery service: Prepares ingredients based on the ingredient list received from the server and delivers them to the user's address.

[0208] User: Receive the necessary ingredients.

[0209] 3. Videos and support for cooking procedures

[0210] Server: Receives cooking instructions from the AI ​​module and animates them.

[0211] AI module: Using a generative AI model, the specific cooking steps are efficiently animated and sent back to the server.

[0212] Server: Sends the generated cooking video to the device.

[0213] Device: Displays the video so that the user can proceed with cooking while watching the video.

[0214] User: Follow the video and perform the cooking.

[0215] Hardware and Software Use

[0216] Hardware: Smartphone (device), delivery service server

[0217] Software: AI module using Python, database (e.g., SQLite), delivery service API (general delivery service)

[0218] Generative AI model: An AI model for generating menus that take nutritional balance into consideration

[0219] Specific examples

[0220] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a smartphone device, the device sends this information to a server. The server receives the information and passes it on to an AI module. The AI ​​module takes nutritional balance into consideration and generates a weekly menu (e.g., "Monday: teriyaki chicken breast, rice, salad," "Tuesday: fish meunière, bread, soup," etc.). This menu information is sent via the server to the device, where it can be viewed by the user.

[0221] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. By receiving the necessary ingredients, the user can save time and effort in shopping.

[0222] When cooking, the server sends the menu and cooking instructions to the AI ​​module, which then animates them. For example, the AI ​​module can show specific steps such as "preparing chicken breast, how to cook it, and the order in which to season it," and the server sends this video to the device. Users can efficiently cook by playing the video on their smartphone.

[0223] Prompt Sentence Examples

[0224] Examples of specific prompts include:

[0225] Generate a nutritionally balanced menu for one week based on your household composition information.

[0226] Age: 30

[0227] Number of people: 3

[0228] Allergies: None

[0229] As described above, the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[0230] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0231] Step 1:

[0232] Entering household information

[0233] Input: The user enters household composition information (age, number of people, food preferences, allergy information, etc.) into the smartphone device.

[0234] Operation: The terminal receives the entered home information.

[0235] Output: Send the received household information to the server.

[0236] Step 2:

[0237] Receiving household information and generating menus

[0238] Input: Family information (age, number of people, food preferences, allergy information).

[0239] Operation: The server passes the received household information to the AI ​​module and creates a prompt for menu generation. The prompt format might be something like, "Based on the household composition information, please generate a nutritionally balanced menu for one week. - Age: 30 - Number of people: 3 - Allergies: None."

[0240] Data processing and calculation: The AI ​​module generates a nutritionally balanced menu for one week based on household information. The generative AI model calculates ingredient combinations and nutritional values ​​to design the optimal menu.

[0241] Output: The generated menu is returned to the server.

[0242] Step 3:

[0243] Sending and displaying menus

[0244] Input: Menu returned from AI module.

[0245] Operation: The server receives the generated menu and sends it to the terminal, which displays the received menu information to the user.

[0246] Output: Display of menu information in a format that can be viewed by the user.

[0247] Step 4:

[0248] Generate an ingredient list

[0249] Input: Generated menu information.

[0250] Operation: The server creates a list of ingredients based on the menu information. The AI ​​module automatically generates the list of ingredients, so the server references a database of ingredients and lists the necessary ingredients.

[0251] Output: The created ingredient list.

[0252] Step 5:

[0253] Delivery service requests

[0254] Input: The created ingredient list.

[0255] Operation: The server sends the list of ingredients to the partner delivery service. Using the delivery service API, the order is sent based on the specified ingredient list.

[0256] Output: A food request to a delivery service.

[0257] Step 6:

[0258] Food delivery

[0259] Input: Incoming request from delivery service.

[0260] How it works: The delivery service prepares the food based on the received request and delivers it to the address specified by the user.

[0261] Output: Delivery of ingredients to the user.

[0262] Step 7:

[0263] Cooking procedure video

[0264] Input: Generated menu information.

[0265] How it works: The server sends menu information to the AI ​​module and instructs it to create a video of the specific cooking steps. The generative AI model analyzes the cooking steps and generates the video data.

[0266] Data processing and calculation: The AI ​​module creates video data based on specific cooking instructions and sends it back to the server.

[0267] Output: Video data of cooking instructions.

[0268] Step 8:

[0269] Send and display cooking videos

[0270] Input: Generated cooking videos.

[0271] Operation: The server sends the cooking video to the user's smartphone, where it displays the video for the user to review.

[0272] Output: Playback of cooking procedure video on smartphone.

[0273] The above is a specific description of the processing steps in the present invention.

[0274] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0275] This invention relates to a system that streamlines dinner preparation at home and takes user emotions into consideration. This system incorporates an AI module that receives household composition information and generates a menu based on nutritional balance, as well as an emotion engine, and includes a function that suggests optimal menus and cooking procedures based on the user's emotions. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. Furthermore, it supports users by creating videos of cooking procedures according to the menu, allowing them to cook easily and efficiently.

[0276] Overall system overview

[0277] 1. Entering household information and generating menus

[0278] User: Enter household information (e.g., age, number of people, food preferences, allergy information) into the terminal.

[0279] Terminal: Formats the entered home information and sends it to the server.

[0280] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[0281] AI module: Creates a nutritionally balanced menu for one week based on household composition and user emotional information, and returns it to the server.

[0282] Emotional engine: Analyzes the user's emotional state and takes this information into account when generating menus.

[0283] Server: Sends the generated menu information to the terminal.

[0284] Terminal: Displays the menu so that the user can check it.

[0285] 2. Generating a list of ingredients and delivering

[0286] Server: Generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[0287] Server: Converts the ingredient list into a format suitable for the delivery service.

[0288] Server: Sends the converted ingredient list to the delivery service.

[0289] Delivery service: Prepare ingredients based on the ingredient list received from the server.

[0290] Delivery service: delivers groceries to the user's address.

[0291] User: Pick up ingredients at the specified address.

[0292] 3. Videos and support for cooking procedures

[0293] Server: Collects menus and cooking instructions received from the AI ​​module.

[0294] Server: Sends the cooking instructions to the AI ​​module and asks it to animate them.

[0295] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[0296] Emotion Engine: Adjusts the tone and speed of cooking instruction videos based on the user's emotional state.

[0297] Server: Sends the generated cooking video to the device.

[0298] Device: Displays the cooking video so that the user can proceed with the cooking process while watching the video.

[0299] User: Play the video on the device and follow along as you cook.

[0300] Specific examples

[0301] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module and emotion engine. The emotion engine analyzes the user's emotional data, and if it determines that the user is under high stress, it generates a menu that will help the user relax (e.g., "Tuesday: grilled fish, rice, miso soup"). The generated menu information is sent to the device via the server, where the user can check it.

[0302] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. The user receives the ingredients they need, eliminating the need to go shopping.

[0303] When cooking, the server sends the menu and cooking steps to the AI ​​module, which then animates them. For example, specific steps such as "preparing grilled fish and adjusting the doneness" and "mixing seasonings" are shown in the video, and the emotion engine adjusts the tone and speed of the video according to the user's stress level. The server then sends this cooking video to the device, allowing the user to play the video on their device and cook efficiently.

[0304] In this way, the present invention is a system that streamlines dinner preparation at home and provides support according to the user's emotional state.

[0305] The processing flow will be explained below.

[0306] Menu planning and emotion engine processing

[0307] Step 1:

[0308] The user accesses the terminal and inputs household information (age, number of people, food preferences, and allergy information).

[0309] Step 2:

[0310] The terminal formats the home information and sends it to the server.

[0311] Step 3:

[0312] The user inputs emotional data (for example, heart rate data or facial expression data obtained by a smartwatch or smartphone) into the device.

[0313] Step 4:

[0314] The device transmits the emotion data to the server.

[0315] Step 5:

[0316] The server receives household information and emotion data and passes it to the AI ​​module and emotion engine.

[0317] Step 6:

[0318] The emotion engine analyzes the emotion data to identify the user's current emotional state (e.g., stress level, fatigue level, etc.).

[0319] Step 7:

[0320] Based on the information obtained from the emotion engine, the server sends instructions to the AI ​​module to generate a menu that takes into account the customer's emotional state.

[0321] Step 8:

[0322] The AI ​​module takes into account household information and emotional state to generate a nutritionally balanced menu for the week.

[0323] Step 9:

[0324] The menu information generated by the AI ​​module is returned to the server.

[0325] Step 10:

[0326] The server receives the menu information and sends it to the terminal.

[0327] Step 11:

[0328] The device displays the menu information for the user to review.

[0329] Ingredient list generation and delivery

[0330] Step 12:

[0331] The server generates a list of necessary ingredients based on the menu received from the AI ​​module.

[0332] Step 13:

[0333] The server converts the ingredient list into a format suitable for the delivery service.

[0334] Step 14:

[0335] The server sends the converted ingredient list to the delivery service.

[0336] Step 15:

[0337] The delivery service prepares ingredients based on the ingredient list received from the server.

[0338] Step 16:

[0339] The delivery service delivers the ingredients to the user's address.

[0340] Step 17:

[0341] The user receives the ingredients at the specified address.

[0342] Cooking procedure animation and support

[0343] Step 18:

[0344] The server collects the menu and cooking instructions received from the AI ​​module.

[0345] Step 19:

[0346] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[0347] Step 20:

[0348] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[0349] Step 21:

[0350] The emotional engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state.

[0351] Step 22:

[0352] The server sends the generated cooking video to the terminal.

[0353] Step 23:

[0354] The device displays the cooking video for the user to review.

[0355] Step 24:

[0356] The user plays a video on the device and follows along as they cook.

[0357] In this way, the present invention is a system that streamlines dinner preparation at home and provides support according to the user's emotional state.

[0358] Example 2

[0359] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0360] Modern households face the problem of inefficient dinner preparation. Planning a nutritionally balanced menu while taking into account various preferences and allergies within the household is burdensome, and providing meals that respond to the user's emotional state is also difficult. Conventional systems only provide simple menus without considering the user's emotions, and are unable to suggest menus aimed at stress relief or relaxation. Furthermore, purchasing the necessary ingredients and understanding cooking procedures are time-consuming, significantly reducing the efficiency of meal preparation at home.

[0361] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving household configuration information and generating a menu based on nutritional balance, a means for generating a list of ingredients required for the generated menu and transmitting it to a delivery service, a means for analyzing the user's emotional state and generating an optimal menu and cooking instructions based on the user's emotions, and a means for animating the cooking instructions for the menu, adjusting the tone and progression speed of the animation based on the user's emotional state, and providing the animation to the user. This enables efficient dinner preparation that takes the user's emotional state into consideration.

[0362] "Family composition information" refers to information about meals at home, such as the ages, number of people, food preferences, and allergy information of household members.

[0363] "Nutritional balance" refers to a balanced diet that maintains health by consuming appropriate amounts of each nutrient.

[0364] A "menu" is a set of meal menus served over a specific period of time (e.g., a week).

[0365] "Ingredient list" refers to a list of ingredients needed to create a specific menu.

[0366] "Delivery service" means a service that delivers food ingredients or goods to a designated location.

[0367] "User's emotional state" refers to the psychological or emotional state the user is feeling (e.g., stressed, relaxed, happy, sad).

[0368] An "emotion engine" refers to technology that analyzes a user's emotions and provides appropriate responses and suggestions based on that information.

[0369] "Animation" refers to the process of converting static or textual information into a dynamic, animated format.

[0370] "Tone" refers to the overall atmosphere or influential characteristics of a video or audio (e.g., calm, excited, relaxed).

[0371] "Progression speed" refers to the playback speed of video and audio, in other words, the speed at which information is presented.

[0372] This invention relates to a system that streamlines dinner preparation at home and takes the user's emotions into consideration. This system incorporates an AI module that inputs household composition information and generates a nutritionally balanced menu based on that information, and an emotion engine. It also includes a function that suggests optimal menus and cooking procedures based on the user's emotional state. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also supports the user by creating videos of cooking procedures according to the menu, allowing them to cook easily and efficiently.

[0373] The overall outline of the system is as follows:

[0374] 1. Entering household information and generating menus

[0375] The user enters household information (e.g., age, number of people, food preferences, allergy information) into the device. The device formats the entered household information and sends it to the server. The server passes the received household information to the AI ​​module, which generates an appropriate menu. The AI ​​module creates a nutritionally balanced menu for one week based on the household composition information and the user's emotional information, and returns it to the server. The emotion engine analyzes the user's emotional state and takes that information into consideration when generating the menu. The server sends the generated menu information to the device and displays it so that the user can check the menu.

[0376] 2. Generating a list of ingredients and delivering

[0377] The server generates a list of ingredients based on the menu generated by the AI ​​module, converts the list into a format suitable for the delivery service, and sends it. The delivery service prepares the ingredients based on the ingredient list received from the server and delivers them to the user's address. The user picks up the ingredients at the specified address.

[0378] 3. Videos and support for cooking procedures

[0379] The server collects the menu and cooking instructions received from the AI ​​module, sends the cooking instructions to the AI ​​module, and requests it to animate them. The AI ​​module efficiently animates the specific cooking instructions and returns them to the server. The emotion engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state. The server sends the generated cooking video to the device and displays it so that the user can watch the cooking video while cooking. The user plays the video on their device and cooks accordingly.

[0380] Specific examples

[0381] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module and emotion engine. The emotion engine analyzes the user's emotional data, and if it determines that the user is under high stress, it generates a menu that will help the user relax (e.g., "Tuesday: grilled fish, rice, miso soup"). The generated menu information is sent to the device via the server, where the user can check it.

[0382] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. The user receives the ingredients they need, eliminating the need to go shopping.

[0383] When cooking, the server sends the menu and cooking steps to the AI ​​module, which then animates them. For example, specific steps such as "preparing grilled fish and adjusting the doneness" and "mixing seasonings" are shown in the video, and the emotion engine adjusts the tone and speed of the video according to the user's stress level. The server then sends this cooking video to the device, allowing the user to play the video on their device and cook efficiently.

[0384] Prompt example

[0385] An example of a prompt is as follows:

[0386] Family information prompt: "My husband is 30 years old, I have a 5-year-old child, and my husband is a meat lover, but my child has a dairy allergy."

[0387] Emotional state prompt: "I'm stressed. I want a relaxing meal."

[0388] Delivery request prompt: "Please send next week's grocery list to the delivery service."

[0389] Cooking video prompt: "Create a video of the cooking process for grilled fish. The tone should be relaxed and the pace should be slow."

[0390] In this way, the system streamlines dinner preparation at home and provides support tailored to the user's emotional state.

[0391] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0392] Input of household composition information and menu generation

[0393] Step 1:

[0394] Entering household information

[0395] User: Enters household information (e.g., age, number of people, food preferences, allergy information) through the device's input interface. The input data is saved in the device's internal memory.

[0396] Input: Family information (age, number of people, preferences, allergy information)

[0397] Output: Home information stored in the device's internal memory

[0398] Step 2:

[0399] Sending home information

[0400] Terminal: Converts the entered household information into the appropriate format and sends it to the server. The data is transmitted using a secure protocol.

[0401] Input: Home information stored in the device's internal memory

[0402] Output: The converted household information is sent to the server.

[0403] Step 3:

[0404] Menu generation request

[0405] Server: Passes the received household information to the AI ​​module and requests it to generate a nutritionally balanced menu. The server waits for a response to the request.

[0406] Input: Household information after format conversion sent to the server

[0407] Output: Household information sent to the AI ​​module

[0408] Step 4:

[0409] Menu generation

[0410] AI module: Generates a week's worth of nutritionally balanced meals based on household composition information and user emotional information. The generated meals are stored in a database.

[0411] Input: Home information sent to the AI ​​module, emotional information provided by the server

[0412] Output: A week's worth of menus stored in a database

[0413] Step 5:

[0414] Emotional state analysis

[0415] Emotion Engine: Analyzes the user's emotional state and evaluates their current stress level and mood. The evaluation results are sent back to the server.

[0416] Input: User's emotional information

[0417] Output: Parsed emotional state information

[0418] Step 6:

[0419] Considering menu and emotional state

[0420] Emotion engine: Based on the analysis results, the menu is adjusted to reflect the user's emotional state. The adjusted menu is sent to the server.

[0421] Input: Analyzed emotional state information, weekly meal plans stored in a database

[0422] Output: Adjusted menu information

[0423] Step 7:

[0424] Sending menu information

[0425] Server: Sends the adjusted menu information to the terminal so that the user can check it.

[0426] Input: Adjusted menu information

[0427] Output: Menu information sent to the device

[0428] Step 8:

[0429] Display menu information

[0430] Terminal: The received menu information is displayed to the user, who can check the menu for one week on the application interface.

[0431] Input: Menu information sent to the device

[0432] Output: Menu information displayed to the user

[0433] Ingredient list generation and delivery

[0434] Step 9:

[0435] Generate an ingredient list

[0436] Server: Generates a list of ingredients based on the menu. The generated list is stored in a database.

[0437] Input: Menu information stored in the database

[0438] Output: List of ingredients stored in the database

[0439] Step 10:

[0440] Converting an Ingredient List

[0441] Server: Converts the generated ingredient list into a format suitable for the delivery service. The converted ingredient list is ready to be sent to the delivery service.

[0442] Input: A list of ingredients stored in a database

[0443] Output: Formatted ingredient list

[0444] Step 11:

[0445] Sending an Ingredient List

[0446] Server: Sends the properly formatted ingredient list to the delivery service.

[0447] Input: Formatted ingredient list

[0448] Output: Ingredient list sent to delivery service

[0449] Step 12:

[0450] Preparing ingredients

[0451] Delivery service: Based on the received ingredient list, the necessary ingredients are picked up from the warehouse and packaged.

[0452] Input: Ingredient list sent to delivery service

[0453] Output: Packaged ingredients

[0454] Step 13:

[0455] Food delivery

[0456] Delivery service: delivers packaged food to the user's address.

[0457] Input: Packaged ingredients

[0458] Output: Ingredients delivered to the user

[0459] Step 14:

[0460] Picking up ingredients

[0461] User: Receive ingredients at the specified address and check the contents.

[0462] Input: Ingredients delivered to the user

[0463] Output: Received ingredients

[0464] Cooking procedure animation and support

[0465] Step 15:

[0466] Collection of cooking instructions

[0467] Server: Collects cooking instructions corresponding to the menu generated from the AI ​​module.

[0468] Input: Menu information stored in the database

[0469] Output: Collected cooking instructions

[0470] Step 16:

[0471] Request for video of cooking procedure

[0472] Server: Again, ask the AI ​​module to animate the collected cooking instructions.

[0473] Input: Collected cooking instructions

[0474] Output: Cooking instructions sent to the AI ​​module

[0475] Step 17:

[0476] Cooking procedure video

[0477] AI module: Converts cooking instructions into a video, showing each step of the cooking process with images and diagrams, and adding necessary text explanations.

[0478] Input: Cooking procedure information sent from the server

[0479] Output: Generated cooking video

[0480] Step 18:

[0481] Adjusting the tone and speed of your cooking videos

[0482] Emotion engine: Adjusts the tone (e.g., calmness of the audio) and progression speed of the generated video depending on the user's emotional state.

[0483] Input: Generated cooking video, analyzed emotional state information

[0484] Output: Adjusted cooking video

[0485] Step 19:

[0486] Submit cooking videos

[0487] Server: Sends the adjusted cooking video to the device.

[0488] Input: Adjusted cooking video

[0489] Output: Cooking video sent to device

[0490] Step 20:

[0491] Check out the cooking video

[0492] Terminal: Displays the transmitted cooking video to the user and prepares it for playback.

[0493] Input: Cooking video sent to device

[0494] Output: Cooking video shown to the user

[0495] Step 21:

[0496] Executing cooking

[0497] User: Watch the video on the device and follow the instructions to cook. For example, grill fish and prepare seasonings according to the instructions in the video.

[0498] Input: A cooking video shown to the user

[0499] Output: Finished dish

[0500] As described above, by explaining the specific operations at each step in detail, the system can streamline dinner preparation at home and provide support according to the user's emotional state.

[0501] (Application example 2)

[0502] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0503] Preparing dinner at home requires a lot of time and effort, while planning an appropriate menu that takes into account household composition and nutritional balance is difficult. In today's busy and stressful society, meal preparation support that takes into account the user's emotional state is also needed. In addition, there is a need for a system that efficiently provides cooking instructions in video format, and also has the ability to customize menus and cooking instruction videos according to the user's emotional state.

[0504] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0505] In this invention, the server includes means for receiving household configuration information and generating a menu based on nutritional balance, means for generating a list of ingredients required for the menu, means for delivering ingredients based on the ingredient list, means for creating an animation of cooking steps for the menu and providing it to the user, means for analyzing the user's emotional state and reflecting this in the menu and cooking steps, and means for adjusting the tone and progression speed of the created animation of cooking steps according to the user's emotional state. This enables efficient dinner preparation that takes into account the household configuration information and emotional state.

[0506] "Family composition information" is information that indicates the characteristics of the entire household, such as the age group and number of family members, food preferences, and allergy information.

[0507] "Nutritional balance" refers to a state in which each nutrient necessary for maintaining health is appropriately distributed.

[0508] A "menu" is a plan for planning and arranging the series of dishes to be served at a particular meal.

[0509] An "ingredient list" is a list of ingredients needed to create a specific menu.

[0510] "Delivery" refers to the delivery of necessary goods or ingredients to a specific location.

[0511] A "cooking procedure" is a sequence of steps required to prepare a particular dish.

[0512] "Animation" means converting specific information or procedures into video in a format that is easy to understand visually.

[0513] "User" refers to an individual or household using the system.

[0514] "Emotional state" is information that indicates the emotional state and psychological condition of the user.

[0515] "Analysis" means examining given information in detail and extracting meaning and characteristics.

[0516] "Tone" refers to the emotional nuances and atmosphere in visual and audio expression.

[0517] "Progress speed" refers to the speed at which the video or work process progresses.

[0518] "Customize" means to adjust or change content or functionality to meet specific needs or requirements.

[0519] This invention relates to a system that streamlines dinner preparation at home and provides support according to the user's emotional state. This system collects household configuration information and the user's emotional state, creates nutritionally balanced menus, delivers the necessary ingredients, and provides cooking instructions in the form of videos.

[0520] The system consists of the following main elements:

[0521] 1. Entering household information and generating menus

[0522] User: Enters family member ages, number of people, food preferences, allergy information, etc. into a smartphone app.

[0523] Terminal: Formats the entered home information and sends it to the server.

[0524] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[0525] AI module: Creates a nutritionally balanced menu based on household composition information and the user's emotional state, and returns it to the server.

[0526] Emotional engine: Analyzes the user's emotional state and takes this information into account when generating menus.

[0527] Server: Sends the generated menu information to the terminal.

[0528] Terminal: Displays the menu so that the user can check it.

[0529] 2. Generating a list of ingredients and delivering

[0530] Server: Generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[0531] Server: Converts the ingredient list into a format suitable for the delivery service.

[0532] Server: Sends the converted ingredient list to the delivery service.

[0533] Delivery service: Prepare ingredients based on the ingredient list received from the server.

[0534] Delivery service: delivers groceries to the user's address.

[0535] User: Pick up ingredients at the specified address.

[0536] 3. Videos and support for cooking procedures

[0537] Server: Collects menus and cooking instructions received from the AI ​​module.

[0538] Server: Sends the cooking instructions to the AI ​​module and asks it to animate them.

[0539] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[0540] Emotion Engine: Adjusts the tone and speed of cooking instruction videos based on the user's emotional state.

[0541] Server: Sends the generated cooking video to the device.

[0542] Device: Displays the cooking video so that the user can proceed with the cooking process while watching the video.

[0543] User: Play the video on the device and follow along as you cook.

[0544] Hardware and software used

[0545] 1. Hardware: Smartphone (iOS, Android)

[0546] 2. Software: Server-based AI modules (e.g., machine learning models implemented in Python), emotion engines (e.g., NLP models), delivery integration APIs, and video generation software (e.g., FFmpeg).

[0547] Data processing and calculation procedures

[0548] 1. Data input: The user inputs household composition information and emotional state into the smartphone app.

[0549] 2. Sending home information: The app sends this information to the server.

[0550] 3. Menu generation: The AI ​​module generates nutritionally balanced menus based on household composition information and emotional state.

[0551] 4. Ingredient list and delivery: The server generates an ingredient list based on the menu and works with the delivery service to deliver the ingredients.

[0552] 5. Animated Cooking Instructions: The AI ​​module creates detailed cooking instructions and animates them using video generation software. The emotion engine adjusts the tone and speed of the video based on the user's emotional state. The resulting video is then delivered to the user's smartphone.

[0553] Specific scenario example

[0554] A user logs into a smartphone app and enters information such as, "I have a 30-year-old husband, myself, and a 5-year-old child. I'm a little tired today." The app sends this information to a server, and an AI module generates a relaxing menu of "grilled fish, rice, and miso soup." The server sends this information to a delivery service, and the ingredients are delivered to the user's home. A video of the cooking steps is then generated and displayed on the smartphone app. The user can watch the video and cook at a low-stress pace.

[0555] Prompt Sentence Examples

[0556] "My husband and I are 30 years old and we have a 5-year-old child. We're feeling a little tired today. Can you suggest a relaxing dinner menu?"

[0557] In this way, the present invention streamlines dinner preparation at home and provides support tailored to the user's emotional state.

[0558] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0559] Program processing flow

[0560] Step 1:

[0561] The user enters information about their household (age, number of people, food preferences, allergy information) and their emotional state into a smartphone app.

[0562] Input: age, number of people, food preferences, allergy information, emotional state

[0563] Action: Enter information through the UI and press the submit button.

[0564] Output: Formatted household information data

[0565] Step 2:

[0566] The terminal formats the entered home information and sends it to the server.

[0567] Input: Home information data received from the user

[0568] Operation: Converts household information data into JSON format or similar and sends it to the server via an HTTP request.

[0569] Output: Household information data sent to the server

[0570] Step 3:

[0571] The server passes the received household information to the AI ​​module and generates an appropriate menu.

[0572] Input: Household information data

[0573] How it works: Passes household information to the AI ​​module and runs the menu generation algorithm.

[0574] Output: Generated menu data

[0575] Step 4:

[0576] The AI ​​module creates a nutritionally balanced menu based on household configuration information and the user's emotional state and returns it to the server.

[0577] Input: household composition information, emotional state data

[0578] How it works: Optimizes menus using machine learning models.

[0579] Output: Optimal menu data

[0580] Step 5:

[0581] An emotional engine analyzes the user's emotional state and takes that information into account when generating menus.

[0582] Input: Emotional state data

[0583] How it works: Sentiment analysis is performed using an NLP model and reflected in menu generation.

[0584] Output: Emotionally-reflected menu data

[0585] Step 6:

[0586] The server transmits the generated menu information to the terminal.

[0587] Input: Menu data

[0588] Operation: Sends menu data to the terminal as an HTTP response.

[0589] Output: Menu data sent to the device

[0590] Step 7:

[0591] The device displays the menu for the user to review.

[0592] Input: Menu data

[0593] Behavior: Displays menu information in the UI.

[0594] Output: Menu display that can be viewed by the user

[0595] Step 8:

[0596] The server generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[0597] Input: Menu data

[0598] Operation: Analyzes menu data and creates a list of required ingredients.

[0599] Output: Ingredient list data

[0600] Step 9:

[0601] The server converts the ingredient list into a format suitable for the delivery service.

[0602] Input: Ingredient list data

[0603] What it does: Formats data to meet the delivery service API specifications.

[0604] Output: Converted ingredient list data

[0605] Step 10:

[0606] The server sends the converted ingredient list to the delivery service.

[0607] Input: Converted ingredient list data

[0608] How it works: Sends data to a delivery service using an HTTP request.

[0609] Output: Ingredient list sent to delivery service

[0610] Step 11:

[0611] The delivery service prepares ingredients based on the ingredient list received from the server.

[0612] Input: Ingredient list data

[0613] Action: Collect the required ingredients from the warehouse or store based on the ingredients list.

[0614] Output: Prepared ingredients

[0615] Step 12:

[0616] The delivery service delivers the ingredients to the user's address.

[0617] Input: Prepared ingredients

[0618] What it does: Deliver ingredients to the user's address based on a delivery schedule.

[0619] Output: Ingredients delivered to the user

[0620] Step 13:

[0621] The user receives the ingredients at the specified address.

[0622] Input: Delivered ingredients

[0623] Action: Receive and check delivered ingredients.

[0624] Output: Received ingredients

[0625] Step 14:

[0626] The server collects the menu and cooking instructions received from the AI ​​module.

[0627] Input: Menu data, cooking procedure data

[0628] What it does: Synchronizes menu data and cooking instructions data.

[0629] Output: Synchronized cooking instructions data

[0630] Step 15:

[0631] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[0632] Input: Cooking procedure data

[0633] Action: Sends cooking instructions data to the AI ​​module.

[0634] Output: Request to the AI ​​module

[0635] Step 16:

[0636] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[0637] Input: Cooking procedure data

[0638] How it works: Cooking instructions are converted into a video using video generation software (e.g. FFmpeg).

[0639] Output: Cooking procedure video data

[0640] Step 17:

[0641] The emotional engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state.

[0642] Input: User emotional state data, cooking procedure video data

[0643] How it works: Adjust the tone and pace of your video using NLP models.

[0644] Output: Adjusted cooking instructions video

[0645] Step 18:

[0646] The server sends the generated cooking video to the terminal.

[0647] Input: Adjusted cooking instructions video

[0648] Operation: The adjusted video data is sent to the device via an HTTP response.

[0649] Output: Cooking instruction video sent to device

[0650] Step 19:

[0651] The terminal displays the cooking video so that the user can proceed with the cooking while checking it.

[0652] Input: Cooking procedure video data

[0653] What it does: Provides video playback functionality in the UI and displays the video to the user.

[0654] Output: Cooking procedure video to be played

[0655] Step 20:

[0656] The user plays a video on the device and follows along as they cook.

[0657] Input: Cooking Instructions Video

[0658] Operation: Cooking proceeds according to the video playback.

[0659] Output: Finished dish

[0660] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0661] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0662] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0663] [Second embodiment]

[0664] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0665] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0666] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0667] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0668] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0669] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0670] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0671] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0672] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0673] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0674] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0675] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0676] This invention is a system that streamlines dinner preparation at home. The system includes an AI module that receives household composition information and generates a menu based on nutritional balance. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also creates videos of cooking procedures according to the menu, supporting users in cooking easily and efficiently.

[0677] Overall system overview

[0678] 1. Entering household information and generating menus

[0679] User: Enter household information (e.g., age, number of people, food preferences, allergy information) into the terminal.

[0680] Terminal: Sends the entered home information to the server.

[0681] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[0682] AI module: Creates a week's worth of nutritionally balanced meals tailored to the household's composition and sends them back to the server.

[0683] Server: Sends the generated menu to the terminal.

[0684] Terminal: Displays the menu so that the user can check it.

[0685] 2. Generating a list of ingredients and delivering

[0686] Server: Creates a list of ingredients based on the menu generated by the AI ​​module.

[0687] Delivery service: Prepares ingredients based on the ingredient list received from the server and delivers them to the user's address.

[0688] User: Receive the necessary ingredients.

[0689] 3. Videos and support for cooking procedures

[0690] Server: Receives cooking instructions from the AI ​​module and animates them.

[0691] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[0692] Server: Sends the generated cooking video to the device.

[0693] Device: Displays the video so that the user can proceed with cooking while watching the video.

[0694] User: Follow the video and perform the cooking.

[0695] Specific examples

[0696] For example, if a user inputs household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module. The AI ​​module takes nutritional balance into consideration and generates a weekly menu (e.g., "Monday: teriyaki chicken breast, rice, salad," "Tuesday: fish meunière, bread, soup," etc.). This menu information is sent via the server to the device, where the user can check it.

[0697] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service uses this list to collect the ingredients and delivers them to the user's address. By receiving the ingredients, the user can save time by not having to go shopping.

[0698] When cooking, the server sends the menu and cooking instructions to the AI ​​module, which then animates them. For example, it could show specific steps such as "preparing the chicken breast, how to cook it, and the order in which to season it," and the server sends this video to the device. Users can efficiently cook by playing the video on their device.

[0699] As described above, the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[0700] The processing flow will be explained below.

[0701] Menu planning process

[0702] Step 1:

[0703] The user accesses the terminal and inputs household information (age, number of people, food preferences, and allergy information).

[0704] Step 2:

[0705] The terminal formats the entered home information and sends it to the server.

[0706] Step 3:

[0707] The server receives the input information and transmits it to the AI ​​module.

[0708] Step 4:

[0709] The AI ​​module generates a weekly menu that takes nutritional balance into consideration based on household information.

[0710] Step 5:

[0711] The menu information generated by the AI ​​module is returned to the server.

[0712] Step 6:

[0713] The server receives the menu information and sends it to the terminal.

[0714] Step 7:

[0715] The device displays the menu information for the user to review.

[0716] Ingredient list generation and delivery

[0717] Step 1:

[0718] The server generates a list of necessary ingredients based on the menu received from the AI ​​module.

[0719] Step 2:

[0720] The server converts the ingredient list into a format suitable for the delivery service.

[0721] Step 3:

[0722] The server sends the converted ingredient list to the delivery service.

[0723] Step 4:

[0724] The delivery service prepares ingredients based on the ingredient list received from the server.

[0725] Step 5:

[0726] The delivery service delivers the ingredients to the user's address.

[0727] Step 6:

[0728] The user receives the ingredients at the specified address.

[0729] Cooking procedure animation and support

[0730] Step 1:

[0731] The server collects the menu and cooking instructions received from the AI ​​module.

[0732] Step 2:

[0733] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[0734] Step 3:

[0735] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[0736] Step 4:

[0737] The server sends the generated cooking video to the terminal.

[0738] Step 5:

[0739] The device displays the cooking video for the user to review.

[0740] Step 6:

[0741] The user plays a video on the device and follows along as they cook.

[0742] Through these steps, the present invention is a system that enables users to efficiently prepare dinner every day, providing healthy eating habits and freeing up time.

[0743] Example 1

[0744] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0745] In today's world, preparing dinner at home is a time-consuming and labor-intensive task for many families, and there is a need for efficient methods of preparation. However, planning a menu, purchasing the necessary ingredients, and then cooking with those ingredients requires a considerable amount of effort to manage and execute a large amount of information. For this reason, a system is needed to make meal preparation at home easier and healthier.

[0746] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0747] In this invention, the server includes a means for validating household composition information in real time and eliminating invalid data, a means for generating and sending prompts to the AI ​​module, and a calendar-format display means for integrating and displaying the generated menu information. This makes it possible to provide a system that efficiently generates nutritionally balanced menus based on household composition information, builds a list of necessary ingredients, and integrates ingredient delivery with video provision of cooking instructions.

[0748] "Family composition information" refers to detailed information about the household, including age, number of people, food preferences, and allergy information.

[0749] "Nutritional balance" refers to a state in which the necessary nutrients are contained in the right amounts.

[0750] A "menu" refers to a meal menu for a specific period (usually a week), and is a plan that includes the dishes to be served at each meal.

[0751] An "ingredient list" is a list of ingredients needed to prepare a specific menu.

[0752] "Delivery" refers to a service that delivers goods (in this case, food) to a specific location.

[0753] "Cooking procedure animation" refers to the process of recording cooking procedures and methods in video format and providing the video to users.

[0754] "Validation check" is the process of checking whether the entered data meets the specified standards and detecting and excluding invalid data.

[0755] A "prompt" is an instruction given to an AI to encourage it to perform a specific action.

[0756] "Calendar format display" is a method of visually displaying the generated menu information in the form of a calendar.

[0757] An "AI module" is a program that uses artificial intelligence technology to perform a specific task (in this case, generating a menu or animating cooking instructions).

[0758] This invention is a system for improving the efficiency of dinner preparation at home, and includes functions for receiving household configuration information, generating a menu based on nutritional balance, creating a list of ingredients based on the menu, and delivering the ingredients to the user via a delivery service.The system also creates a video of the cooking procedure according to the menu, supporting the user in cooking easily and efficiently.

[0759] System configuration

[0760] Hardware:

[0761] Server: This is the central processing device of the system, and is responsible for managing household composition information, generating menus, creating ingredient lists, linking with delivery services, and creating videos of cooking procedures.

[0762] Terminal: A device on which users can input household information and view menu information and cooking procedure videos. This includes smartphones, tablets, and PCs.

[0763] Delivery service: A service provider that delivers food ingredients to the user's address.

[0764] software:

[0765] AI module: An artificial intelligence program used to generate nutritionally balanced menus.

[0766] Prompt generator: A program that generates prompt sentences to send appropriate instructions to the AI ​​module.

[0767] Video generation program: A program for generating cooking instructions in video format.

[0768] Validation program: A program that validates the household configuration information entered by the user.

[0769] System Operation

[0770] The user uses a terminal to input household composition information (e.g., age, number of people, food preferences, allergy information). This input information is sent to the server via the terminal. The server receives this information, performs validation checks in real time, and eliminates invalid data. The prompt generation program then generates and sends a prompt to the AI ​​module: "Based on this household information, please generate a nutritionally balanced menu for one week."

[0771] The AI ​​module receives and analyzes the prompt text and generates a weekly menu that suits the household's configuration. The generated menu information is sent back to the server, which then sends it to the device to display in calendar format so that the user can check it. Examples include "Monday: Teriyaki chicken breast, rice, salad" and "Tuesday: Fish meunière, bread, soup."

[0772] Next, the server creates a list of ingredients based on the generated menu information and sends it to the delivery service. The delivery service prepares the ingredients based on the received ingredient list and delivers them to the user's address. By receiving these ingredients, the user can save time and effort in shopping.

[0773] Furthermore, the server generates and sends a prompt message to the AI ​​module requesting that it create a video of the cooking steps: "Please explain the cooking steps for teriyaki chicken breast in a video." The AI ​​module generates specific cooking steps in the form of a video and returns it to the server. The server then sends this video to the device and provides it to the user. The user can efficiently proceed with cooking while playing the video on the device.

[0774] As described above, the system of the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[0775] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0776] Step 1:

[0777] The user uses the terminal to input household configuration information.

[0778] Specifically, the user enters household information such as age, number of people, food preferences, and allergy information into an input form on the device. Once the input is complete, the device sends it to the server. The input data is sent to the server as JSON format data containing individual information for each household member.

[0779] Step 2:

[0780] The server performs a validation check on the received home configuration information.

[0781] Specifically, the server parses the JSON data it receives and checks whether each item has been entered in the correct format. For example, it verifies that age is a positive integer and that ingredient preferences have been entered in the correct list format. If invalid data is found, it generates an error message and returns it to the terminal. If validation is successful, it moves on to the next step.

[0782] Step 3:

[0783] The server generates and sends a prompt to the AI ​​module.

[0784] Specifically, a prompt is generated based on the household composition information, saying, "Based on this household information, please generate a nutritionally balanced menu for one week." The generated prompt is sent to the AI ​​module using a REST API or similar. The input is the validated household composition information, and the output is the prompt sent to the AI ​​module.

[0785] Step 4:

[0786] The AI ​​module generates a menu based on the prompt.

[0787] Specifically, the AI ​​module analyzes household configuration information and prompt text, and generates a weekly menu that takes nutritional balance into consideration. The generated menu is returned to the server as JSON data in a format such as "Monday: teriyaki chicken breast, rice, salad." The input is the prompt text, and the output is the generated weekly menu.

[0788] Step 5:

[0789] The server receives the generated menu data and transmits it to the terminal.

[0790] Specifically, the generated menu data is returned to the device and formatted in a format that can be viewed by the user. HTML and CSS are generated to display the menu in calendar or list format, and this is sent to the device. The input is the generated menu data, and the output is calendar-format HTML data that is sent to the device.

[0791] Step 6:

[0792] The terminal displays menu information to the user.

[0793] Specifically, the device displays the received HTML data in a browser, allowing the user to easily check a week's worth of menus. The input is the received HTML data, and the output is the displayed menu information.

[0794] Step 7:

[0795] The server creates an ingredient list based on the generated menu.

[0796] Specifically, the server analyzes the menu data and creates a list of ingredients needed for each dish. For example, it creates a list in the format "Monday: chicken breast, soy sauce, mirin, sesame oil, rice, lettuce, tomato." The input is the menu data, and the output is a list of ingredients.

[0797] Step 8:

[0798] The server sends the ingredient list to the delivery service.

[0799] Specifically, the created ingredient list is sent to the API endpoint of the delivery service using an HTTP POST request, etc. The input is the ingredient list, and the output is a request to the delivery service.

[0800] Step 9:

[0801] The delivery service prepares the ingredients and delivers them to the user.

[0802] Specifically, the delivery service collects the necessary ingredients based on the received ingredient list and delivers them to the user's address. The delivery status can be tracked in real time and checked from the terminal. The input is the ingredient list, and the output is the delivered ingredients.

[0803] Step 10:

[0804] The user receives the delivered ingredients.

[0805] Specifically, the user receives ingredients at a specified address and checks their quality. The received ingredients are then used for cooking. The input is the ingredients delivered by the delivery service, and the output is the received ingredients.

[0806] Step 11:

[0807] The server generates and sends a prompt to the AI ​​module requesting it to animate the cooking steps.

[0808] Specifically, a prompt message is generated that reads, "Please explain the cooking steps for teriyaki chicken breast in a video," and sent to the AI ​​module. The input is the menu data, and the output is a prompt message requesting the creation of a video of the cooking steps.

[0809] Step 12:

[0810] The AI ​​module animates the cooking process.

[0811] Specifically, based on the prompt sentence, the system efficiently generates specific cooking steps in the form of a video. For example, it generates a video showing steps such as "preparing chicken breast, cooking it, and the order in which to season it." The input is the prompt sentence, and the output is a video of the generated cooking steps.

[0812] Step 13:

[0813] The server receives the generated cooking video and sends it to the terminal.

[0814] Specifically, the generated video of the cooking instructions is sent to the device using an HTTP request, etc. The input is the video of the cooking instructions, and the output is a request to send the video to the device.

[0815] Step 14:

[0816] The device displays the cooking video to the user.

[0817] Specifically, a player is provided so that the device can play the received video data, allowing the user to check the cooking instructions while cooking. The video is played using a player that includes functions such as play, pause, rewind, and fast forward. The input is the received video data, and the output is a video of the cooking instructions displayed.

[0818] Step 15:

[0819] The user follows the video to perform cooking.

[0820] Specifically, the user watches a video played on the device and follows the cooking instructions. For example, when cooking chicken breast teriyaki, the user follows the steps shown in the video. The input is the video that is displayed, and the output is the cooked dish.

[0821] (Application example 1)

[0822] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0823] In today's busy households, preparing dinner every day takes a lot of time and effort. Planning a menu that takes into account the nutritional balance, preferences, and allergy information required for each household is extremely time-consuming. Purchasing each ingredient one by one is also a hassle, and guidance on how to efficiently execute cooking procedures is essential. However, conventional systems have faced challenges in consistently automating these processes and making them more efficient. In particular, they lacked the means to link with delivery services or display cooking procedures on a smartphone.

[0824] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0825] In this invention, the server includes a means for generating a nutritionally balanced menu based on household composition information, a means for creating an ingredient list for the generated menu, a means for sending the ingredient list to an affiliated delivery service, and a means for displaying cooking instructions in video form on a smartphone. This allows users to receive suggestions for efficient and balanced menus tailored to their household composition, automatically obtain the necessary ingredients through the delivery service, and further enable them to cook while checking the cooking instructions on their smartphone.

[0826] "Family composition information" refers to basic information about family members, including age, number of people, food preferences, and allergy information.

[0827] "Nutritional balance" means consuming an equal amount of nutrients necessary to maintain physical health.

[0828] A "menu" is a list of planned meals for a particular period of time (e.g., a week).

[0829] An "ingredient list" is a list of ingredients required based on a menu.

[0830] "Delivery" refers to the act of sending goods or ingredients to a specific location.

[0831] "Cooking instructions" are specific methods that show the procedures and steps for making a dish.

[0832] "Animation" refers to the presentation of specific information or procedures in the form of a video.

[0833] A "smartphone" is a type of mobile phone and a communications device with advanced computer functions and internet connectivity.

[0834] A "delivery service" is a service that delivers ingredients or products to a specific location.

[0835] An "AI module" refers to a program or algorithm that uses artificial intelligence and has functions such as data analysis and automation.

[0836] A "server" is a computer system that provides various services over a network.

[0837] This invention is a system that streamlines dinner preparation at home. The system includes an AI module that receives household composition information and generates a menu based on nutritional balance. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also creates videos of cooking procedures according to the menu, supporting users in cooking easily and efficiently.

[0838] Overall system overview

[0839] 1. Entering household information and generating menus

[0840] User: Enters household information (e.g., age, number of people, food preferences, allergy information) into a smartphone device.

[0841] Terminal: Sends the entered home information to the server.

[0842] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[0843] AI module: Using a generative AI model, it creates a nutritionally balanced menu that suits the household composition and returns it to the server.

[0844] Server: Sends the generated menu to the terminal.

[0845] Terminal: Displays the menu so that the user can check it.

[0846] 2. Generating a list of ingredients and delivering

[0847] Server: Creates a list of ingredients based on the menu generated by the AI ​​module.

[0848] Delivery service: Prepares ingredients based on the ingredient list received from the server and delivers them to the user's address.

[0849] User: Receive the necessary ingredients.

[0850] 3. Videos and support for cooking procedures

[0851] Server: Receives cooking instructions from the AI ​​module and animates them.

[0852] AI module: Using a generative AI model, the specific cooking steps are efficiently animated and sent back to the server.

[0853] Server: Sends the generated cooking video to the device.

[0854] Device: Displays the video so that the user can proceed with cooking while watching the video.

[0855] User: Follow the video and perform the cooking.

[0856] Hardware and Software Use

[0857] Hardware: Smartphone (device), delivery service server

[0858] Software: AI module using Python, database (e.g., SQLite), delivery service API (general delivery service)

[0859] Generative AI model: An AI model for generating menus that take nutritional balance into consideration

[0860] Specific examples

[0861] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a smartphone device, the device sends this information to a server. The server receives the information and passes it on to an AI module. The AI ​​module takes nutritional balance into consideration and generates a weekly menu (e.g., "Monday: teriyaki chicken breast, rice, salad," "Tuesday: fish meunière, bread, soup," etc.). This menu information is sent via the server to the device, where it can be viewed by the user.

[0862] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. By receiving the necessary ingredients, the user can save time and effort in shopping.

[0863] When cooking, the server sends the menu and cooking instructions to the AI ​​module, which then animates them. For example, the AI ​​module can show specific steps such as "preparing chicken breast, how to cook it, and the order in which to season it," and the server sends this video to the device. Users can efficiently cook by playing the video on their smartphone.

[0864] Prompt Sentence Examples

[0865] Examples of specific prompts include:

[0866] Generate a nutritionally balanced menu for one week based on your household composition information.

[0867] Age: 30

[0868] Number of people: 3

[0869] Allergies: None

[0870] As described above, the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[0871] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0872] Step 1:

[0873] Entering household information

[0874] Input: The user enters household composition information (age, number of people, food preferences, allergy information, etc.) into the smartphone device.

[0875] Operation: The terminal receives the entered home information.

[0876] Output: Send the received household information to the server.

[0877] Step 2:

[0878] Receiving household information and generating menus

[0879] Input: Family information (age, number of people, food preferences, allergy information).

[0880] Operation: The server passes the received household information to the AI ​​module and creates a prompt for menu generation. The prompt format might be something like, "Based on the household composition information, please generate a nutritionally balanced menu for one week. - Age: 30 - Number of people: 3 - Allergies: None."

[0881] Data processing and calculation: The AI ​​module generates a nutritionally balanced menu for one week based on household information. The generative AI model calculates ingredient combinations and nutritional values ​​to design the optimal menu.

[0882] Output: The generated menu is returned to the server.

[0883] Step 3:

[0884] Sending and displaying menus

[0885] Input: Menu returned from AI module.

[0886] Operation: The server receives the generated menu and sends it to the terminal, which displays the received menu information to the user.

[0887] Output: Display of menu information in a format that can be viewed by the user.

[0888] Step 4:

[0889] Generate an ingredient list

[0890] Input: Generated menu information.

[0891] Operation: The server creates a list of ingredients based on the menu information. The AI ​​module automatically generates the list of ingredients, so the server references a database of ingredients and lists the necessary ingredients.

[0892] Output: The created ingredient list.

[0893] Step 5:

[0894] Delivery service requests

[0895] Input: The created ingredient list.

[0896] Operation: The server sends the list of ingredients to the partner delivery service. Using the delivery service API, the order is sent based on the specified ingredient list.

[0897] Output: A food request to a delivery service.

[0898] Step 6:

[0899] Food delivery

[0900] Input: Incoming request from delivery service.

[0901] How it works: The delivery service prepares the food based on the received request and delivers it to the address specified by the user.

[0902] Output: Delivery of ingredients to the user.

[0903] Step 7:

[0904] Cooking procedure video

[0905] Input: Generated menu information.

[0906] How it works: The server sends menu information to the AI ​​module and instructs it to create a video of the specific cooking steps. The generative AI model analyzes the cooking steps and generates the video data.

[0907] Data processing and calculation: The AI ​​module creates video data based on specific cooking instructions and sends it back to the server.

[0908] Output: Video data of cooking instructions.

[0909] Step 8:

[0910] Send and display cooking videos

[0911] Input: Generated cooking videos.

[0912] Operation: The server sends the cooking video to the user's smartphone, where it displays the video for the user to review.

[0913] Output: Playback of cooking procedure video on smartphone.

[0914] The above is a specific description of the processing steps in the present invention.

[0915] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0916] This invention relates to a system that streamlines dinner preparation at home and takes user emotions into consideration. This system incorporates an AI module that receives household composition information and generates a menu based on nutritional balance, as well as an emotion engine, and includes a function that suggests optimal menus and cooking procedures based on the user's emotions. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. Furthermore, it supports users by creating videos of cooking procedures according to the menu, allowing them to cook easily and efficiently.

[0917] Overall system overview

[0918] 1. Entering household information and generating menus

[0919] User: Enter household information (e.g., age, number of people, food preferences, allergy information) into the terminal.

[0920] Terminal: Formats the entered home information and sends it to the server.

[0921] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[0922] AI module: Creates a nutritionally balanced menu for one week based on household composition and user emotional information, and returns it to the server.

[0923] Emotional engine: Analyzes the user's emotional state and takes this information into account when generating menus.

[0924] Server: Sends the generated menu information to the terminal.

[0925] Terminal: Displays the menu so that the user can check it.

[0926] 2. Generating a list of ingredients and delivering

[0927] Server: Generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[0928] Server: Converts the ingredient list into a format suitable for the delivery service.

[0929] Server: Sends the converted ingredient list to the delivery service.

[0930] Delivery service: Prepare ingredients based on the ingredient list received from the server.

[0931] Delivery service: delivers groceries to the user's address.

[0932] User: Pick up ingredients at the specified address.

[0933] 3. Videos and support for cooking procedures

[0934] Server: Collects menus and cooking instructions received from the AI ​​module.

[0935] Server: Sends the cooking instructions to the AI ​​module and asks it to animate them.

[0936] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[0937] Emotion Engine: Adjusts the tone and speed of cooking instruction videos based on the user's emotional state.

[0938] Server: Sends the generated cooking video to the device.

[0939] Device: Displays the cooking video so that the user can proceed with the cooking process while watching the video.

[0940] User: Play the video on the device and follow along as you cook.

[0941] Specific examples

[0942] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module and emotion engine. The emotion engine analyzes the user's emotional data, and if it determines that the user is under high stress, it generates a menu that will help the user relax (e.g., "Tuesday: grilled fish, rice, miso soup"). The generated menu information is sent to the device via the server, where the user can check it.

[0943] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. The user receives the ingredients they need, eliminating the need to go shopping.

[0944] When cooking, the server sends the menu and cooking steps to the AI ​​module, which then animates them. For example, specific steps such as "preparing grilled fish and adjusting the doneness" and "mixing seasonings" are shown in the video, and the emotion engine adjusts the tone and speed of the video according to the user's stress level. The server then sends this cooking video to the device, allowing the user to play the video on their device and cook efficiently.

[0945] In this way, the present invention is a system that streamlines dinner preparation at home and provides support according to the user's emotional state.

[0946] The processing flow will be explained below.

[0947] Menu planning and emotion engine processing

[0948] Step 1:

[0949] The user accesses the terminal and inputs household information (age, number of people, food preferences, and allergy information).

[0950] Step 2:

[0951] The terminal formats the home information and sends it to the server.

[0952] Step 3:

[0953] The user inputs emotional data (for example, heart rate data or facial expression data obtained by a smartwatch or smartphone) into the device.

[0954] Step 4:

[0955] The device transmits the emotion data to the server.

[0956] Step 5:

[0957] The server receives household information and emotion data and passes it to the AI ​​module and emotion engine.

[0958] Step 6:

[0959] The emotion engine analyzes the emotion data to identify the user's current emotional state (e.g., stress level, fatigue level, etc.).

[0960] Step 7:

[0961] Based on the information obtained from the emotion engine, the server sends instructions to the AI ​​module to generate a menu that takes into account the customer's emotional state.

[0962] Step 8:

[0963] The AI ​​module takes into account household information and emotional state to generate a nutritionally balanced menu for the week.

[0964] Step 9:

[0965] The menu information generated by the AI ​​module is returned to the server.

[0966] Step 10:

[0967] The server receives the menu information and sends it to the terminal.

[0968] Step 11:

[0969] The device displays the menu information for the user to review.

[0970] Ingredient list generation and delivery

[0971] Step 12:

[0972] The server generates a list of necessary ingredients based on the menu received from the AI ​​module.

[0973] Step 13:

[0974] The server converts the ingredient list into a format suitable for the delivery service.

[0975] Step 14:

[0976] The server sends the converted ingredient list to the delivery service.

[0977] Step 15:

[0978] The delivery service prepares ingredients based on the ingredient list received from the server.

[0979] Step 16:

[0980] The delivery service delivers the ingredients to the user's address.

[0981] Step 17:

[0982] The user receives the ingredients at the specified address.

[0983] Cooking procedure animation and support

[0984] Step 18:

[0985] The server collects the menu and cooking instructions received from the AI ​​module.

[0986] Step 19:

[0987] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[0988] Step 20:

[0989] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[0990] Step 21:

[0991] The emotional engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state.

[0992] Step 22:

[0993] The server sends the generated cooking video to the terminal.

[0994] Step 23:

[0995] The device displays the cooking video for the user to review.

[0996] Step 24:

[0997] The user plays a video on the device and follows along as they cook.

[0998] In this way, the present invention is a system that streamlines dinner preparation at home and provides support according to the user's emotional state.

[0999] Example 2

[1000] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1001] Modern households face the problem of inefficient dinner preparation. Planning a nutritionally balanced menu while taking into account various preferences and allergies within the household is burdensome, and providing meals that respond to the user's emotional state is also difficult. Conventional systems only provide simple menus without considering the user's emotions, and are unable to suggest menus aimed at stress relief or relaxation. Furthermore, purchasing the necessary ingredients and understanding cooking procedures are time-consuming, significantly reducing the efficiency of meal preparation at home.

[1002] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving household configuration information and generating a menu based on nutritional balance, a means for generating a list of ingredients required for the generated menu and transmitting it to a delivery service, a means for analyzing the user's emotional state and generating an optimal menu and cooking instructions based on the user's emotions, and a means for animating the cooking instructions for the menu, adjusting the tone and progression speed of the animation based on the user's emotional state, and providing the animation to the user. This enables efficient dinner preparation that takes the user's emotional state into consideration.

[1003] "Family composition information" refers to information about meals at home, such as the ages, number of people, food preferences, and allergy information of household members.

[1004] "Nutritional balance" refers to a balanced diet that maintains health by consuming appropriate amounts of each nutrient.

[1005] A "menu" is a set of meal menus served over a specific period of time (e.g., a week).

[1006] "Ingredient list" refers to a list of ingredients needed to create a specific menu.

[1007] "Delivery service" means a service that delivers food ingredients or goods to a designated location.

[1008] "User's emotional state" refers to the psychological or emotional state the user is feeling (e.g., stressed, relaxed, happy, sad).

[1009] An "emotion engine" refers to technology that analyzes a user's emotions and provides appropriate responses and suggestions based on that information.

[1010] "Animation" refers to the process of converting static or textual information into a dynamic, animated format.

[1011] "Tone" refers to the overall atmosphere or influential characteristics of a video or audio (e.g., calm, excited, relaxed).

[1012] "Progression speed" refers to the playback speed of video and audio, in other words, the speed at which information is presented.

[1013] This invention relates to a system that streamlines dinner preparation at home and takes the user's emotions into consideration. This system incorporates an AI module that inputs household composition information and generates a nutritionally balanced menu based on that information, and an emotion engine. It also includes a function that suggests optimal menus and cooking procedures based on the user's emotional state. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also supports the user by creating videos of cooking procedures according to the menu, allowing them to cook easily and efficiently.

[1014] The overall outline of the system is as follows:

[1015] 1. Entering household information and generating menus

[1016] The user enters household information (e.g., age, number of people, food preferences, allergy information) into the device. The device formats the entered household information and sends it to the server. The server passes the received household information to the AI ​​module, which generates an appropriate menu. The AI ​​module creates a nutritionally balanced menu for one week based on the household composition information and the user's emotional information, and returns it to the server. The emotion engine analyzes the user's emotional state and takes that information into consideration when generating the menu. The server sends the generated menu information to the device and displays it so that the user can check the menu.

[1017] 2. Generating a list of ingredients and delivering

[1018] The server generates a list of ingredients based on the menu generated by the AI ​​module, converts the list into a format suitable for the delivery service, and sends it. The delivery service prepares the ingredients based on the ingredient list received from the server and delivers them to the user's address. The user picks up the ingredients at the specified address.

[1019] 3. Videos and support for cooking procedures

[1020] The server collects the menu and cooking instructions received from the AI ​​module, sends the cooking instructions to the AI ​​module, and requests it to animate them. The AI ​​module efficiently animates the specific cooking instructions and returns them to the server. The emotion engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state. The server sends the generated cooking video to the device and displays it so that the user can watch the cooking video while cooking. The user plays the video on their device and cooks accordingly.

[1021] Specific examples

[1022] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module and emotion engine. The emotion engine analyzes the user's emotional data, and if it determines that the user is under high stress, it generates a menu that will help the user relax (e.g., "Tuesday: grilled fish, rice, miso soup"). The generated menu information is sent to the device via the server, where the user can check it.

[1023] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. The user receives the ingredients they need, eliminating the need to go shopping.

[1024] When cooking, the server sends the menu and cooking steps to the AI ​​module, which then animates them. For example, specific steps such as "preparing grilled fish and adjusting the doneness" and "mixing seasonings" are shown in the video, and the emotion engine adjusts the tone and speed of the video according to the user's stress level. The server then sends this cooking video to the device, allowing the user to play the video on their device and cook efficiently.

[1025] Prompt example

[1026] An example of a prompt is as follows:

[1027] Family information prompt: "My husband is 30 years old, I have a 5-year-old child, and my husband is a meat lover, but my child has a dairy allergy."

[1028] Emotional state prompt: "I'm stressed. I want a relaxing meal."

[1029] Delivery request prompt: "Please send next week's grocery list to the delivery service."

[1030] Cooking video prompt: "Create a video of the cooking process for grilled fish. The tone should be relaxed and the pace should be slow."

[1031] In this way, the system streamlines dinner preparation at home and provides support tailored to the user's emotional state.

[1032] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1033] Input of household composition information and menu generation

[1034] Step 1:

[1035] Entering household information

[1036] User: Enters household information (e.g., age, number of people, food preferences, allergy information) through the device's input interface. The input data is saved in the device's internal memory.

[1037] Input: Family information (age, number of people, preferences, allergy information)

[1038] Output: Home information stored in the device's internal memory

[1039] Step 2:

[1040] Sending home information

[1041] Terminal: Converts the entered household information into the appropriate format and sends it to the server. The data is transmitted using a secure protocol.

[1042] Input: Home information stored in the device's internal memory

[1043] Output: The converted household information is sent to the server.

[1044] Step 3:

[1045] Menu generation request

[1046] Server: Passes the received household information to the AI ​​module and requests it to generate a nutritionally balanced menu. The server waits for a response to the request.

[1047] Input: Household information after format conversion sent to the server

[1048] Output: Household information sent to the AI ​​module

[1049] Step 4:

[1050] Menu generation

[1051] AI module: Generates a week's worth of nutritionally balanced meals based on household composition information and user emotional information. The generated meals are stored in a database.

[1052] Input: Home information sent to the AI ​​module, emotional information provided by the server

[1053] Output: A week's worth of menus stored in a database

[1054] Step 5:

[1055] Emotional state analysis

[1056] Emotion Engine: Analyzes the user's emotional state and evaluates their current stress level and mood. The evaluation results are sent back to the server.

[1057] Input: User's emotional information

[1058] Output: Parsed emotional state information

[1059] Step 6:

[1060] Considering menu and emotional state

[1061] Emotion engine: Based on the analysis results, the menu is adjusted to reflect the user's emotional state. The adjusted menu is sent to the server.

[1062] Input: Analyzed emotional state information, weekly meal plans stored in a database

[1063] Output: Adjusted menu information

[1064] Step 7:

[1065] Sending menu information

[1066] Server: Sends the adjusted menu information to the terminal so that the user can check it.

[1067] Input: Adjusted menu information

[1068] Output: Menu information sent to the device

[1069] Step 8:

[1070] Display menu information

[1071] Terminal: The received menu information is displayed to the user, who can check the menu for one week on the application interface.

[1072] Input: Menu information sent to the device

[1073] Output: Menu information displayed to the user

[1074] Ingredient list generation and delivery

[1075] Step 9:

[1076] Generate an ingredient list

[1077] Server: Generates a list of ingredients based on the menu. The generated list is stored in a database.

[1078] Input: Menu information stored in the database

[1079] Output: List of ingredients stored in the database

[1080] Step 10:

[1081] Converting an Ingredient List

[1082] Server: Converts the generated ingredient list into a format suitable for the delivery service. The converted ingredient list is ready to be sent to the delivery service.

[1083] Input: A list of ingredients stored in a database

[1084] Output: Formatted ingredient list

[1085] Step 11:

[1086] Sending an Ingredient List

[1087] Server: Sends the properly formatted ingredient list to the delivery service.

[1088] Input: Formatted ingredient list

[1089] Output: Ingredient list sent to delivery service

[1090] Step 12:

[1091] Preparing ingredients

[1092] Delivery service: Based on the received ingredient list, the necessary ingredients are picked up from the warehouse and packaged.

[1093] Input: Ingredient list sent to delivery service

[1094] Output: Packaged ingredients

[1095] Step 13:

[1096] Food delivery

[1097] Delivery service: delivers packaged food to the user's address.

[1098] Input: Packaged ingredients

[1099] Output: Ingredients delivered to the user

[1100] Step 14:

[1101] Picking up ingredients

[1102] User: Receive ingredients at the specified address and check the contents.

[1103] Input: Ingredients delivered to the user

[1104] Output: Received ingredients

[1105] Cooking procedure animation and support

[1106] Step 15:

[1107] Collection of cooking instructions

[1108] Server: Collects cooking instructions corresponding to the menu generated from the AI ​​module.

[1109] Input: Menu information stored in the database

[1110] Output: Collected cooking instructions

[1111] Step 16:

[1112] Request for video of cooking procedure

[1113] Server: Again, ask the AI ​​module to animate the collected cooking instructions.

[1114] Input: Collected cooking instructions

[1115] Output: Cooking instructions sent to the AI ​​module

[1116] Step 17:

[1117] Cooking procedure video

[1118] AI module: Converts cooking instructions into a video, showing each step of the cooking process with images and diagrams, and adding necessary text explanations.

[1119] Input: Cooking procedure information sent from the server

[1120] Output: Generated cooking video

[1121] Step 18:

[1122] Adjusting the tone and speed of your cooking videos

[1123] Emotion engine: Adjusts the tone (e.g., calmness of the audio) and progression speed of the generated video depending on the user's emotional state.

[1124] Input: Generated cooking video, analyzed emotional state information

[1125] Output: Adjusted cooking video

[1126] Step 19:

[1127] Submit cooking videos

[1128] Server: Sends the adjusted cooking video to the device.

[1129] Input: Adjusted cooking video

[1130] Output: Cooking video sent to device

[1131] Step 20:

[1132] Check out the cooking video

[1133] Terminal: Displays the transmitted cooking video to the user and prepares it for playback.

[1134] Input: Cooking video sent to device

[1135] Output: Cooking video shown to the user

[1136] Step 21:

[1137] Executing cooking

[1138] User: Watch the video on the device and follow the instructions to cook. For example, grill fish and prepare seasonings according to the instructions in the video.

[1139] Input: A cooking video shown to the user

[1140] Output: Finished dish

[1141] As described above, by explaining the specific operations at each step in detail, the system can streamline dinner preparation at home and provide support according to the user's emotional state.

[1142] (Application example 2)

[1143] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1144] Preparing dinner at home requires a lot of time and effort, while planning an appropriate menu that takes into account household composition and nutritional balance is difficult. In today's busy and stressful society, meal preparation support that takes into account the user's emotional state is also needed. In addition, there is a need for a system that efficiently provides cooking instructions in video format, and also has the ability to customize menus and cooking instruction videos according to the user's emotional state.

[1145] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1146] In this invention, the server includes means for receiving household configuration information and generating a menu based on nutritional balance, means for generating a list of ingredients required for the menu, means for delivering ingredients based on the ingredient list, means for creating an animation of cooking steps for the menu and providing it to the user, means for analyzing the user's emotional state and reflecting this in the menu and cooking steps, and means for adjusting the tone and progression speed of the created animation of cooking steps according to the user's emotional state. This enables efficient dinner preparation that takes into account the household configuration information and emotional state.

[1147] "Family composition information" is information that indicates the characteristics of the entire household, such as the age group and number of family members, food preferences, and allergy information.

[1148] "Nutritional balance" refers to a state in which each nutrient necessary for maintaining health is appropriately distributed.

[1149] A "menu" is a plan for planning and arranging the series of dishes to be served at a particular meal.

[1150] An "ingredient list" is a list of ingredients needed to create a specific menu.

[1151] "Delivery" refers to the delivery of necessary goods or ingredients to a specific location.

[1152] A "cooking procedure" is a sequence of steps required to prepare a particular dish.

[1153] "Animation" means converting specific information or procedures into video in a format that is easy to understand visually.

[1154] "User" refers to an individual or household using the system.

[1155] "Emotional state" is information that indicates the emotional state and psychological condition of the user.

[1156] "Analysis" means examining given information in detail and extracting meaning and characteristics.

[1157] "Tone" refers to the emotional nuances and atmosphere in visual and audio expression.

[1158] "Progress speed" refers to the speed at which the video or work process progresses.

[1159] "Customize" means to adjust or change content or functionality to meet specific needs or requirements.

[1160] This invention relates to a system that streamlines dinner preparation at home and provides support according to the user's emotional state. This system collects household configuration information and the user's emotional state, creates nutritionally balanced menus, delivers the necessary ingredients, and provides cooking instructions in the form of videos.

[1161] The system consists of the following main elements:

[1162] 1. Entering household information and generating menus

[1163] User: Enters family member ages, number of people, food preferences, allergy information, etc. into a smartphone app.

[1164] Terminal: Formats the entered home information and sends it to the server.

[1165] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[1166] AI module: Creates a nutritionally balanced menu based on household composition information and the user's emotional state, and returns it to the server.

[1167] Emotional engine: Analyzes the user's emotional state and takes this information into account when generating menus.

[1168] Server: Sends the generated menu information to the terminal.

[1169] Terminal: Displays the menu so that the user can check it.

[1170] 2. Generating a list of ingredients and delivering

[1171] Server: Generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[1172] Server: Converts the ingredient list into a format suitable for the delivery service.

[1173] Server: Sends the converted ingredient list to the delivery service.

[1174] Delivery service: Prepare ingredients based on the ingredient list received from the server.

[1175] Delivery service: delivers groceries to the user's address.

[1176] User: Pick up ingredients at the specified address.

[1177] 3. Videos and support for cooking procedures

[1178] Server: Collects menus and cooking instructions received from the AI ​​module.

[1179] Server: Sends the cooking instructions to the AI ​​module and asks it to animate them.

[1180] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[1181] Emotion Engine: Adjusts the tone and speed of cooking instruction videos based on the user's emotional state.

[1182] Server: Sends the generated cooking video to the device.

[1183] Device: Displays the cooking video so that the user can proceed with the cooking process while watching the video.

[1184] User: Play the video on the device and follow along as you cook.

[1185] Hardware and software used

[1186] 1. Hardware: Smartphone (iOS, Android)

[1187] 2. Software: Server-based AI modules (e.g., machine learning models implemented in Python), emotion engines (e.g., NLP models), delivery integration APIs, and video generation software (e.g., FFmpeg).

[1188] Data processing and calculation procedures

[1189] 1. Data input: The user inputs household composition information and emotional state into the smartphone app.

[1190] 2. Sending home information: The app sends this information to the server.

[1191] 3. Menu generation: The AI ​​module generates nutritionally balanced menus based on household composition information and emotional state.

[1192] 4. Ingredient list and delivery: The server generates an ingredient list based on the menu and works with the delivery service to deliver the ingredients.

[1193] 5. Animated Cooking Instructions: The AI ​​module creates detailed cooking instructions and animates them using video generation software. The emotion engine adjusts the tone and speed of the video based on the user's emotional state. The resulting video is then delivered to the user's smartphone.

[1194] Specific scenario example

[1195] A user logs into a smartphone app and enters information such as, "I have a 30-year-old husband, myself, and a 5-year-old child. I'm a little tired today." The app sends this information to a server, and an AI module generates a relaxing menu of "grilled fish, rice, and miso soup." The server sends this information to a delivery service, and the ingredients are delivered to the user's home. A video of the cooking steps is then generated and displayed on the smartphone app. The user can watch the video and cook at a low-stress pace.

[1196] Prompt Sentence Examples

[1197] "My husband and I are 30 years old and we have a 5-year-old child. We're feeling a little tired today. Can you suggest a relaxing dinner menu?"

[1198] In this way, the present invention streamlines dinner preparation at home and provides support tailored to the user's emotional state.

[1199] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1200] Program processing flow

[1201] Step 1:

[1202] The user enters information about their household (age, number of people, food preferences, allergy information) and their emotional state into a smartphone app.

[1203] Input: age, number of people, food preferences, allergy information, emotional state

[1204] Action: Enter information through the UI and press the submit button.

[1205] Output: Formatted household information data

[1206] Step 2:

[1207] The terminal formats the entered home information and sends it to the server.

[1208] Input: Home information data received from the user

[1209] Operation: Converts household information data into JSON format or similar and sends it to the server via an HTTP request.

[1210] Output: Household information data sent to the server

[1211] Step 3:

[1212] The server passes the received household information to the AI ​​module and generates an appropriate menu.

[1213] Input: Household information data

[1214] How it works: Passes household information to the AI ​​module and runs the menu generation algorithm.

[1215] Output: Generated menu data

[1216] Step 4:

[1217] The AI ​​module creates a nutritionally balanced menu based on household configuration information and the user's emotional state and returns it to the server.

[1218] Input: household composition information, emotional state data

[1219] How it works: Optimizes menus using machine learning models.

[1220] Output: Optimal menu data

[1221] Step 5:

[1222] An emotional engine analyzes the user's emotional state and takes that information into account when generating menus.

[1223] Input: Emotional state data

[1224] How it works: Sentiment analysis is performed using an NLP model and reflected in menu generation.

[1225] Output: Emotionally-reflected menu data

[1226] Step 6:

[1227] The server transmits the generated menu information to the terminal.

[1228] Input: Menu data

[1229] Operation: Sends menu data to the terminal as an HTTP response.

[1230] Output: Menu data sent to the device

[1231] Step 7:

[1232] The device displays the menu for the user to review.

[1233] Input: Menu data

[1234] Behavior: Displays menu information in the UI.

[1235] Output: Menu display that can be viewed by the user

[1236] Step 8:

[1237] The server generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[1238] Input: Menu data

[1239] Operation: Analyzes menu data and creates a list of required ingredients.

[1240] Output: Ingredient list data

[1241] Step 9:

[1242] The server converts the ingredient list into a format suitable for the delivery service.

[1243] Input: Ingredient list data

[1244] What it does: Formats data to meet the delivery service API specifications.

[1245] Output: Converted ingredient list data

[1246] Step 10:

[1247] The server sends the converted ingredient list to the delivery service.

[1248] Input: Converted ingredient list data

[1249] How it works: Sends data to a delivery service using an HTTP request.

[1250] Output: Ingredient list sent to delivery service

[1251] Step 11:

[1252] The delivery service prepares ingredients based on the ingredient list received from the server.

[1253] Input: Ingredient list data

[1254] Action: Collect the required ingredients from the warehouse or store based on the ingredients list.

[1255] Output: Prepared ingredients

[1256] Step 12:

[1257] The delivery service delivers the ingredients to the user's address.

[1258] Input: Prepared ingredients

[1259] What it does: Deliver ingredients to the user's address based on a delivery schedule.

[1260] Output: Ingredients delivered to the user

[1261] Step 13:

[1262] The user receives the ingredients at the specified address.

[1263] Input: Delivered ingredients

[1264] Action: Receive and check delivered ingredients.

[1265] Output: Received ingredients

[1266] Step 14:

[1267] The server collects the menu and cooking instructions received from the AI ​​module.

[1268] Input: Menu data, cooking procedure data

[1269] What it does: Synchronizes menu data and cooking instructions data.

[1270] Output: Synchronized cooking instructions data

[1271] Step 15:

[1272] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[1273] Input: Cooking procedure data

[1274] Action: Sends cooking instructions data to the AI ​​module.

[1275] Output: Request to the AI ​​module

[1276] Step 16:

[1277] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[1278] Input: Cooking procedure data

[1279] How it works: Cooking instructions are converted into a video using video generation software (e.g. FFmpeg).

[1280] Output: Cooking procedure video data

[1281] Step 17:

[1282] The emotional engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state.

[1283] Input: User emotional state data, cooking procedure video data

[1284] How it works: Adjust the tone and pace of your video using NLP models.

[1285] Output: Adjusted cooking instructions video

[1286] Step 18:

[1287] The server sends the generated cooking video to the terminal.

[1288] Input: Adjusted cooking instructions video

[1289] Operation: The adjusted video data is sent to the device via an HTTP response.

[1290] Output: Cooking instruction video sent to device

[1291] Step 19:

[1292] The terminal displays the cooking video so that the user can proceed with the cooking while checking it.

[1293] Input: Cooking procedure video data

[1294] What it does: Provides video playback functionality in the UI and displays the video to the user.

[1295] Output: Cooking procedure video to be played

[1296] Step 20:

[1297] The user plays a video on the device and follows along as they cook.

[1298] Input: Cooking Instructions Video

[1299] Operation: Cooking proceeds according to the video playback.

[1300] Output: Finished dish

[1301] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1302] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1303] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1304] [Third embodiment]

[1305] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1306] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1307] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1308] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1309] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1310] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1311] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1312] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1313] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1314] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1315] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1316] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1317] This invention is a system that streamlines dinner preparation at home. The system includes an AI module that receives household composition information and generates a menu based on nutritional balance. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also creates videos of cooking procedures according to the menu, supporting users in cooking easily and efficiently.

[1318] Overall system overview

[1319] 1. Entering household information and generating menus

[1320] User: Enter household information (e.g., age, number of people, food preferences, allergy information) into the terminal.

[1321] Terminal: Sends the entered home information to the server.

[1322] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[1323] AI module: Creates a week's worth of nutritionally balanced meals tailored to the household's composition and sends them back to the server.

[1324] Server: Sends the generated menu to the terminal.

[1325] Terminal: Displays the menu so that the user can check it.

[1326] 2. Generating a list of ingredients and delivering

[1327] Server: Creates a list of ingredients based on the menu generated by the AI ​​module.

[1328] Delivery service: Prepares ingredients based on the ingredient list received from the server and delivers them to the user's address.

[1329] User: Receive the necessary ingredients.

[1330] 3. Videos and support for cooking procedures

[1331] Server: Receives cooking instructions from the AI ​​module and animates them.

[1332] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[1333] Server: Sends the generated cooking video to the device.

[1334] Device: Displays the video so that the user can proceed with cooking while watching the video.

[1335] User: Follow the video and perform the cooking.

[1336] Specific examples

[1337] For example, if a user inputs household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module. The AI ​​module takes nutritional balance into consideration and generates a weekly menu (e.g., "Monday: teriyaki chicken breast, rice, salad," "Tuesday: fish meunière, bread, soup," etc.). This menu information is sent via the server to the device, where the user can check it.

[1338] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service uses this list to collect the ingredients and delivers them to the user's address. By receiving the ingredients, the user can save time by not having to go shopping.

[1339] When cooking, the server sends the menu and cooking instructions to the AI ​​module, which then animates them. For example, it could show specific steps such as "preparing the chicken breast, how to cook it, and the order in which to season it," and the server sends this video to the device. Users can efficiently cook by playing the video on their device.

[1340] As described above, the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[1341] The processing flow will be explained below.

[1342] Menu planning process

[1343] Step 1:

[1344] The user accesses the terminal and inputs household information (age, number of people, food preferences, and allergy information).

[1345] Step 2:

[1346] The terminal formats the entered home information and sends it to the server.

[1347] Step 3:

[1348] The server receives the input information and transmits it to the AI ​​module.

[1349] Step 4:

[1350] The AI ​​module generates a weekly menu that takes nutritional balance into consideration based on household information.

[1351] Step 5:

[1352] The menu information generated by the AI ​​module is returned to the server.

[1353] Step 6:

[1354] The server receives the menu information and sends it to the terminal.

[1355] Step 7:

[1356] The device displays the menu information for the user to review.

[1357] Ingredient list generation and delivery

[1358] Step 1:

[1359] The server generates a list of necessary ingredients based on the menu received from the AI ​​module.

[1360] Step 2:

[1361] The server converts the ingredient list into a format suitable for the delivery service.

[1362] Step 3:

[1363] The server sends the converted ingredient list to the delivery service.

[1364] Step 4:

[1365] The delivery service prepares ingredients based on the ingredient list received from the server.

[1366] Step 5:

[1367] The delivery service delivers the ingredients to the user's address.

[1368] Step 6:

[1369] The user receives the ingredients at the specified address.

[1370] Cooking procedure animation and support

[1371] Step 1:

[1372] The server collects the menu and cooking instructions received from the AI ​​module.

[1373] Step 2:

[1374] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[1375] Step 3:

[1376] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[1377] Step 4:

[1378] The server sends the generated cooking video to the terminal.

[1379] Step 5:

[1380] The device displays the cooking video for the user to review.

[1381] Step 6:

[1382] The user plays a video on the device and follows along as they cook.

[1383] Through these steps, the present invention is a system that enables users to efficiently prepare dinner every day, providing healthy eating habits and freeing up time.

[1384] Example 1

[1385] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1386] In today's world, preparing dinner at home is a time-consuming and labor-intensive task for many families, and there is a need for efficient methods of preparation. However, planning a menu, purchasing the necessary ingredients, and then cooking with those ingredients requires a considerable amount of effort to manage and execute a large amount of information. For this reason, a system is needed to make meal preparation at home easier and healthier.

[1387] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1388] In this invention, the server includes a means for validating household composition information in real time and eliminating invalid data, a means for generating and sending prompts to the AI ​​module, and a calendar-format display means for integrating and displaying the generated menu information. This makes it possible to provide a system that efficiently generates nutritionally balanced menus based on household composition information, builds a list of necessary ingredients, and integrates ingredient delivery with video provision of cooking instructions.

[1389] "Family composition information" refers to detailed information about the household, including age, number of people, food preferences, and allergy information.

[1390] "Nutritional balance" refers to a state in which the necessary nutrients are contained in the right amounts.

[1391] A "menu" refers to a meal menu for a specific period (usually a week), and is a plan that includes the dishes to be served at each meal.

[1392] An "ingredient list" is a list of ingredients needed to prepare a specific menu.

[1393] "Delivery" refers to a service that delivers goods (in this case, food) to a specific location.

[1394] "Cooking procedure animation" refers to the process of recording cooking procedures and methods in video format and providing the video to users.

[1395] "Validation check" is the process of checking whether the entered data meets the specified standards and detecting and excluding invalid data.

[1396] A "prompt" is an instruction given to an AI to encourage it to perform a specific action.

[1397] "Calendar format display" is a method of visually displaying the generated menu information in the form of a calendar.

[1398] An "AI module" is a program that uses artificial intelligence technology to perform a specific task (in this case, generating a menu or animating cooking instructions).

[1399] This invention is a system for improving the efficiency of dinner preparation at home, and includes functions for receiving household configuration information, generating a menu based on nutritional balance, creating a list of ingredients based on the menu, and delivering the ingredients to the user via a delivery service.The system also creates a video of the cooking procedure according to the menu, supporting the user in cooking easily and efficiently.

[1400] System configuration

[1401] Hardware:

[1402] Server: This is the central processing device of the system, and is responsible for managing household composition information, generating menus, creating ingredient lists, linking with delivery services, and creating videos of cooking procedures.

[1403] Terminal: A device on which users can input household information and view menu information and cooking procedure videos. This includes smartphones, tablets, and PCs.

[1404] Delivery service: A service provider that delivers food ingredients to the user's address.

[1405] software:

[1406] AI module: An artificial intelligence program used to generate nutritionally balanced menus.

[1407] Prompt generator: A program that generates prompt sentences to send appropriate instructions to the AI ​​module.

[1408] Video generation program: A program for generating cooking instructions in video format.

[1409] Validation program: A program that validates the household configuration information entered by the user.

[1410] System Operation

[1411] The user uses a terminal to input household composition information (e.g., age, number of people, food preferences, allergy information). This input information is sent to the server via the terminal. The server receives this information, performs validation checks in real time, and eliminates invalid data. The prompt generation program then generates and sends a prompt to the AI ​​module: "Based on this household information, please generate a nutritionally balanced menu for one week."

[1412] The AI ​​module receives and analyzes the prompt text and generates a weekly menu that suits the household's configuration. The generated menu information is sent back to the server, which then sends it to the device to display in calendar format so that the user can check it. Examples include "Monday: Teriyaki chicken breast, rice, salad" and "Tuesday: Fish meunière, bread, soup."

[1413] Next, the server creates a list of ingredients based on the generated menu information and sends it to the delivery service. The delivery service prepares the ingredients based on the received ingredient list and delivers them to the user's address. By receiving these ingredients, the user can save time and effort in shopping.

[1414] Furthermore, the server generates and sends a prompt message to the AI ​​module requesting that it create a video of the cooking steps: "Please explain the cooking steps for teriyaki chicken breast in a video." The AI ​​module generates specific cooking steps in the form of a video and returns it to the server. The server then sends this video to the device and provides it to the user. The user can efficiently proceed with cooking while playing the video on the device.

[1415] As described above, the system of the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[1416] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1417] Step 1:

[1418] The user uses the terminal to input household configuration information.

[1419] Specifically, the user enters household information such as age, number of people, food preferences, and allergy information into an input form on the device. Once the input is complete, the device sends it to the server. The input data is sent to the server as JSON format data containing individual information for each household member.

[1420] Step 2:

[1421] The server performs a validation check on the received home configuration information.

[1422] Specifically, the server parses the JSON data it receives and checks whether each item has been entered in the correct format. For example, it verifies that age is a positive integer and that ingredient preferences have been entered in the correct list format. If invalid data is found, it generates an error message and returns it to the terminal. If validation is successful, it moves on to the next step.

[1423] Step 3:

[1424] The server generates and sends a prompt to the AI ​​module.

[1425] Specifically, a prompt is generated based on the household composition information, saying, "Based on this household information, please generate a nutritionally balanced menu for one week." The generated prompt is sent to the AI ​​module using a REST API or similar. The input is the validated household composition information, and the output is the prompt sent to the AI ​​module.

[1426] Step 4:

[1427] The AI ​​module generates a menu based on the prompt.

[1428] Specifically, the AI ​​module analyzes household configuration information and prompt text, and generates a weekly menu that takes nutritional balance into consideration. The generated menu is returned to the server as JSON data in a format such as "Monday: teriyaki chicken breast, rice, salad." The input is the prompt text, and the output is the generated weekly menu.

[1429] Step 5:

[1430] The server receives the generated menu data and transmits it to the terminal.

[1431] Specifically, the generated menu data is returned to the device and formatted in a format that can be viewed by the user. HTML and CSS are generated to display the menu in calendar or list format, and this is sent to the device. The input is the generated menu data, and the output is calendar-format HTML data that is sent to the device.

[1432] Step 6:

[1433] The terminal displays menu information to the user.

[1434] Specifically, the device displays the received HTML data in a browser, allowing the user to easily check a week's worth of menus. The input is the received HTML data, and the output is the displayed menu information.

[1435] Step 7:

[1436] The server creates an ingredient list based on the generated menu.

[1437] Specifically, the server analyzes the menu data and creates a list of ingredients needed for each dish. For example, it creates a list in the format "Monday: chicken breast, soy sauce, mirin, sesame oil, rice, lettuce, tomato." The input is the menu data, and the output is a list of ingredients.

[1438] Step 8:

[1439] The server sends the ingredient list to the delivery service.

[1440] Specifically, the created ingredient list is sent to the API endpoint of the delivery service using an HTTP POST request, etc. The input is the ingredient list, and the output is a request to the delivery service.

[1441] Step 9:

[1442] The delivery service prepares the ingredients and delivers them to the user.

[1443] Specifically, the delivery service collects the necessary ingredients based on the received ingredient list and delivers them to the user's address. The delivery status can be tracked in real time and checked from the terminal. The input is the ingredient list, and the output is the delivered ingredients.

[1444] Step 10:

[1445] The user receives the delivered ingredients.

[1446] Specifically, the user receives ingredients at a specified address and checks their quality. The received ingredients are then used for cooking. The input is the ingredients delivered by the delivery service, and the output is the received ingredients.

[1447] Step 11:

[1448] The server generates and sends a prompt to the AI ​​module requesting it to animate the cooking steps.

[1449] Specifically, a prompt message is generated that reads, "Please explain the cooking steps for teriyaki chicken breast in a video," and sent to the AI ​​module. The input is the menu data, and the output is a prompt message requesting the creation of a video of the cooking steps.

[1450] Step 12:

[1451] The AI ​​module animates the cooking process.

[1452] Specifically, based on the prompt sentence, the system efficiently generates specific cooking steps in the form of a video. For example, it generates a video showing steps such as "preparing chicken breast, cooking it, and the order in which to season it." The input is the prompt sentence, and the output is a video of the generated cooking steps.

[1453] Step 13:

[1454] The server receives the generated cooking video and sends it to the terminal.

[1455] Specifically, the generated video of the cooking instructions is sent to the device using an HTTP request, etc. The input is the video of the cooking instructions, and the output is a request to send the video to the device.

[1456] Step 14:

[1457] The device displays the cooking video to the user.

[1458] Specifically, a player is provided so that the device can play the received video data, allowing the user to check the cooking instructions while cooking. The video is played using a player that includes functions such as play, pause, rewind, and fast forward. The input is the received video data, and the output is a video of the cooking instructions displayed.

[1459] Step 15:

[1460] The user follows the video to perform cooking.

[1461] Specifically, the user watches a video played on the device and follows the cooking instructions. For example, when cooking chicken breast teriyaki, the user follows the steps shown in the video. The input is the video that is displayed, and the output is the cooked dish.

[1462] (Application example 1)

[1463] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1464] In today's busy households, preparing dinner every day takes a lot of time and effort. Planning a menu that takes into account the nutritional balance, preferences, and allergy information required for each household is extremely time-consuming. Purchasing each ingredient one by one is also a hassle, and guidance on how to efficiently execute cooking procedures is essential. However, conventional systems have faced challenges in consistently automating these processes and making them more efficient. In particular, they lacked the means to link with delivery services or display cooking procedures on a smartphone.

[1465] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1466] In this invention, the server includes a means for generating a nutritionally balanced menu based on household composition information, a means for creating an ingredient list for the generated menu, a means for sending the ingredient list to an affiliated delivery service, and a means for displaying cooking instructions in video form on a smartphone. This allows users to receive suggestions for efficient and balanced menus tailored to their household composition, automatically obtain the necessary ingredients through the delivery service, and further enable them to cook while checking the cooking instructions on their smartphone.

[1467] "Family composition information" refers to basic information about family members, including age, number of people, food preferences, and allergy information.

[1468] "Nutritional balance" means consuming an equal amount of nutrients necessary to maintain physical health.

[1469] A "menu" is a list of planned meals for a particular period of time (e.g., a week).

[1470] An "ingredient list" is a list of ingredients required based on a menu.

[1471] "Delivery" refers to the act of sending goods or ingredients to a specific location.

[1472] "Cooking instructions" are specific methods that show the procedures and steps for making a dish.

[1473] "Animation" refers to the presentation of specific information or procedures in the form of a video.

[1474] A "smartphone" is a type of mobile phone and a communications device with advanced computer functions and internet connectivity.

[1475] A "delivery service" is a service that delivers ingredients or products to a specific location.

[1476] An "AI module" refers to a program or algorithm that uses artificial intelligence and has functions such as data analysis and automation.

[1477] A "server" is a computer system that provides various services over a network.

[1478] This invention is a system that streamlines dinner preparation at home. The system includes an AI module that receives household composition information and generates a menu based on nutritional balance. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also creates videos of cooking procedures according to the menu, supporting users in cooking easily and efficiently.

[1479] Overall system overview

[1480] 1. Entering household information and generating menus

[1481] User: Enters household information (e.g., age, number of people, food preferences, allergy information) into a smartphone device.

[1482] Terminal: Sends the entered home information to the server.

[1483] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[1484] AI module: Using a generative AI model, it creates a nutritionally balanced menu that suits the household composition and returns it to the server.

[1485] Server: Sends the generated menu to the terminal.

[1486] Terminal: Displays the menu so that the user can check it.

[1487] 2. Generating a list of ingredients and delivering

[1488] Server: Creates a list of ingredients based on the menu generated by the AI ​​module.

[1489] Delivery service: Prepares ingredients based on the ingredient list received from the server and delivers them to the user's address.

[1490] User: Receive the necessary ingredients.

[1491] 3. Videos and support for cooking procedures

[1492] Server: Receives cooking instructions from the AI ​​module and animates them.

[1493] AI module: Using a generative AI model, the specific cooking steps are efficiently animated and sent back to the server.

[1494] Server: Sends the generated cooking video to the device.

[1495] Device: Displays the video so that the user can proceed with cooking while watching the video.

[1496] User: Follow the video and perform the cooking.

[1497] Hardware and Software Use

[1498] Hardware: Smartphone (device), delivery service server

[1499] Software: AI module using Python, database (e.g., SQLite), delivery service API (general delivery service)

[1500] Generative AI model: An AI model for generating menus that take nutritional balance into consideration

[1501] Specific examples

[1502] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a smartphone device, the device sends this information to a server. The server receives the information and passes it on to an AI module. The AI ​​module takes nutritional balance into consideration and generates a weekly menu (e.g., "Monday: teriyaki chicken breast, rice, salad," "Tuesday: fish meunière, bread, soup," etc.). This menu information is sent via the server to the device, where it can be viewed by the user.

[1503] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. By receiving the necessary ingredients, the user can save time and effort in shopping.

[1504] When cooking, the server sends the menu and cooking instructions to the AI ​​module, which then animates them. For example, the AI ​​module can show specific steps such as "preparing chicken breast, how to cook it, and the order in which to season it," and the server sends this video to the device. Users can efficiently cook by playing the video on their smartphone.

[1505] Prompt Sentence Examples

[1506] Examples of specific prompts include:

[1507] Generate a nutritionally balanced menu for one week based on your household composition information.

[1508] Age: 30

[1509] Number of people: 3

[1510] Allergies: None

[1511] As described above, the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[1512] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1513] Step 1:

[1514] Entering household information

[1515] Input: The user enters household composition information (age, number of people, food preferences, allergy information, etc.) into the smartphone device.

[1516] Operation: The terminal receives the entered home information.

[1517] Output: Send the received household information to the server.

[1518] Step 2:

[1519] Receiving household information and generating menus

[1520] Input: Family information (age, number of people, food preferences, allergy information).

[1521] Operation: The server passes the received household information to the AI ​​module and creates a prompt for menu generation. The prompt format might be something like, "Based on the household composition information, please generate a nutritionally balanced menu for one week. - Age: 30 - Number of people: 3 - Allergies: None."

[1522] Data processing and calculation: The AI ​​module generates a nutritionally balanced menu for one week based on household information. The generative AI model calculates ingredient combinations and nutritional values ​​to design the optimal menu.

[1523] Output: The generated menu is returned to the server.

[1524] Step 3:

[1525] Sending and displaying menus

[1526] Input: Menu returned from AI module.

[1527] Operation: The server receives the generated menu and sends it to the terminal, which displays the received menu information to the user.

[1528] Output: Display of menu information in a format that can be viewed by the user.

[1529] Step 4:

[1530] Generate an ingredient list

[1531] Input: Generated menu information.

[1532] Operation: The server creates a list of ingredients based on the menu information. The AI ​​module automatically generates the list of ingredients, so the server references a database of ingredients and lists the necessary ingredients.

[1533] Output: The created ingredient list.

[1534] Step 5:

[1535] Delivery service requests

[1536] Input: The created ingredient list.

[1537] Operation: The server sends the list of ingredients to the partner delivery service. Using the delivery service API, the order is sent based on the specified ingredient list.

[1538] Output: A food request to a delivery service.

[1539] Step 6:

[1540] Food delivery

[1541] Input: Incoming request from delivery service.

[1542] How it works: The delivery service prepares the food based on the received request and delivers it to the address specified by the user.

[1543] Output: Delivery of ingredients to the user.

[1544] Step 7:

[1545] Cooking procedure video

[1546] Input: Generated menu information.

[1547] How it works: The server sends menu information to the AI ​​module and instructs it to create a video of the specific cooking steps. The generative AI model analyzes the cooking steps and generates the video data.

[1548] Data processing and calculation: The AI ​​module creates video data based on specific cooking instructions and sends it back to the server.

[1549] Output: Video data of cooking instructions.

[1550] Step 8:

[1551] Send and display cooking videos

[1552] Input: Generated cooking videos.

[1553] Operation: The server sends the cooking video to the user's smartphone, where it displays the video for the user to review.

[1554] Output: Playback of cooking procedure video on smartphone.

[1555] The above is a specific description of the processing steps in the present invention.

[1556] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1557] This invention relates to a system that streamlines dinner preparation at home and takes user emotions into consideration. This system incorporates an AI module that receives household composition information and generates a menu based on nutritional balance, as well as an emotion engine, and includes a function that suggests optimal menus and cooking procedures based on the user's emotions. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. Furthermore, it supports users by creating videos of cooking procedures according to the menu, allowing them to cook easily and efficiently.

[1558] Overall system overview

[1559] 1. Entering household information and generating menus

[1560] User: Enter household information (e.g., age, number of people, food preferences, allergy information) into the terminal.

[1561] Terminal: Formats the entered home information and sends it to the server.

[1562] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[1563] AI module: Creates a nutritionally balanced menu for one week based on household composition and user emotional information, and returns it to the server.

[1564] Emotional engine: Analyzes the user's emotional state and takes this information into account when generating menus.

[1565] Server: Sends the generated menu information to the terminal.

[1566] Terminal: Displays the menu so that the user can check it.

[1567] 2. Generating a list of ingredients and delivering

[1568] Server: Generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[1569] Server: Converts the ingredient list into a format suitable for the delivery service.

[1570] Server: Sends the converted ingredient list to the delivery service.

[1571] Delivery service: Prepare ingredients based on the ingredient list received from the server.

[1572] Delivery service: delivers groceries to the user's address.

[1573] User: Pick up ingredients at the specified address.

[1574] 3. Videos and support for cooking procedures

[1575] Server: Collects menus and cooking instructions received from the AI ​​module.

[1576] Server: Sends the cooking instructions to the AI ​​module and asks it to animate them.

[1577] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[1578] Emotion Engine: Adjusts the tone and speed of cooking instruction videos based on the user's emotional state.

[1579] Server: Sends the generated cooking video to the device.

[1580] Device: Displays the cooking video so that the user can proceed with the cooking process while watching the video.

[1581] User: Play the video on the device and follow along as you cook.

[1582] Specific examples

[1583] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module and emotion engine. The emotion engine analyzes the user's emotional data, and if it determines that the user is under high stress, it generates a menu that will help the user relax (e.g., "Tuesday: grilled fish, rice, miso soup"). The generated menu information is sent to the device via the server, where the user can check it.

[1584] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. The user receives the ingredients they need, eliminating the need to go shopping.

[1585] When cooking, the server sends the menu and cooking steps to the AI ​​module, which then animates them. For example, specific steps such as "preparing grilled fish and adjusting the doneness" and "mixing seasonings" are shown in the video, and the emotion engine adjusts the tone and speed of the video according to the user's stress level. The server then sends this cooking video to the device, allowing the user to play the video on their device and cook efficiently.

[1586] In this way, the present invention is a system that streamlines dinner preparation at home and provides support according to the user's emotional state.

[1587] The processing flow will be explained below.

[1588] Menu planning and emotion engine processing

[1589] Step 1:

[1590] The user accesses the terminal and inputs household information (age, number of people, food preferences, and allergy information).

[1591] Step 2:

[1592] The terminal formats the home information and sends it to the server.

[1593] Step 3:

[1594] The user inputs emotional data (for example, heart rate data or facial expression data obtained by a smartwatch or smartphone) into the device.

[1595] Step 4:

[1596] The device transmits the emotion data to the server.

[1597] Step 5:

[1598] The server receives household information and emotion data and passes it to the AI ​​module and emotion engine.

[1599] Step 6:

[1600] The emotion engine analyzes the emotion data to identify the user's current emotional state (e.g., stress level, fatigue level, etc.).

[1601] Step 7:

[1602] Based on the information obtained from the emotion engine, the server sends instructions to the AI ​​module to generate a menu that takes into account the customer's emotional state.

[1603] Step 8:

[1604] The AI ​​module takes into account household information and emotional state to generate a nutritionally balanced menu for the week.

[1605] Step 9:

[1606] The menu information generated by the AI ​​module is returned to the server.

[1607] Step 10:

[1608] The server receives the menu information and sends it to the terminal.

[1609] Step 11:

[1610] The device displays the menu information for the user to review.

[1611] Ingredient list generation and delivery

[1612] Step 12:

[1613] The server generates a list of necessary ingredients based on the menu received from the AI ​​module.

[1614] Step 13:

[1615] The server converts the ingredient list into a format suitable for the delivery service.

[1616] Step 14:

[1617] The server sends the converted ingredient list to the delivery service.

[1618] Step 15:

[1619] The delivery service prepares ingredients based on the ingredient list received from the server.

[1620] Step 16:

[1621] The delivery service delivers the ingredients to the user's address.

[1622] Step 17:

[1623] The user receives the ingredients at the specified address.

[1624] Cooking procedure animation and support

[1625] Step 18:

[1626] The server collects the menu and cooking instructions received from the AI ​​module.

[1627] Step 19:

[1628] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[1629] Step 20:

[1630] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[1631] Step 21:

[1632] The emotional engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state.

[1633] Step 22:

[1634] The server sends the generated cooking video to the terminal.

[1635] Step 23:

[1636] The device displays the cooking video for the user to review.

[1637] Step 24:

[1638] The user plays a video on the device and follows along as they cook.

[1639] In this way, the present invention is a system that streamlines dinner preparation at home and provides support according to the user's emotional state.

[1640] Example 2

[1641] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1642] Modern households face the problem of inefficient dinner preparation. Planning a nutritionally balanced menu while taking into account various preferences and allergies within the household is burdensome, and providing meals that respond to the user's emotional state is also difficult. Conventional systems only provide simple menus without considering the user's emotions, and are unable to suggest menus aimed at stress relief or relaxation. Furthermore, purchasing the necessary ingredients and understanding cooking procedures are time-consuming, significantly reducing the efficiency of meal preparation at home.

[1643] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving household configuration information and generating a menu based on nutritional balance, a means for generating a list of ingredients required for the generated menu and transmitting it to a delivery service, a means for analyzing the user's emotional state and generating an optimal menu and cooking instructions based on the user's emotions, and a means for animating the cooking instructions for the menu, adjusting the tone and progression speed of the animation based on the user's emotional state, and providing the animation to the user. This enables efficient dinner preparation that takes the user's emotional state into consideration.

[1644] "Family composition information" refers to information about meals at home, such as the ages, number of people, food preferences, and allergy information of household members.

[1645] "Nutritional balance" refers to a balanced diet that maintains health by consuming appropriate amounts of each nutrient.

[1646] A "menu" is a set of meal menus served over a specific period of time (e.g., a week).

[1647] "Ingredient list" refers to a list of ingredients needed to create a specific menu.

[1648] "Delivery service" means a service that delivers food ingredients or goods to a designated location.

[1649] "User's emotional state" refers to the psychological or emotional state the user is feeling (e.g., stressed, relaxed, happy, sad).

[1650] An "emotion engine" refers to technology that analyzes a user's emotions and provides appropriate responses and suggestions based on that information.

[1651] "Animation" refers to the process of converting static or textual information into a dynamic, animated format.

[1652] "Tone" refers to the overall atmosphere or influential characteristics of a video or audio (e.g., calm, excited, relaxed).

[1653] "Progression speed" refers to the playback speed of video and audio, in other words, the speed at which information is presented.

[1654] This invention relates to a system that streamlines dinner preparation at home and takes the user's emotions into consideration. This system incorporates an AI module that inputs household composition information and generates a nutritionally balanced menu based on that information, and an emotion engine. It also includes a function that suggests optimal menus and cooking procedures based on the user's emotional state. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also supports the user by creating videos of cooking procedures according to the menu, allowing them to cook easily and efficiently.

[1655] The overall outline of the system is as follows:

[1656] 1. Entering household information and generating menus

[1657] The user enters household information (e.g., age, number of people, food preferences, allergy information) into the device. The device formats the entered household information and sends it to the server. The server passes the received household information to the AI ​​module, which generates an appropriate menu. The AI ​​module creates a nutritionally balanced menu for one week based on the household composition information and the user's emotional information, and returns it to the server. The emotion engine analyzes the user's emotional state and takes that information into consideration when generating the menu. The server sends the generated menu information to the device and displays it so that the user can check the menu.

[1658] 2. Generating a list of ingredients and delivering

[1659] The server generates a list of ingredients based on the menu generated by the AI ​​module, converts the list into a format suitable for the delivery service, and sends it. The delivery service prepares the ingredients based on the ingredient list received from the server and delivers them to the user's address. The user picks up the ingredients at the specified address.

[1660] 3. Videos and support for cooking procedures

[1661] The server collects the menu and cooking instructions received from the AI ​​module, sends the cooking instructions to the AI ​​module, and requests it to animate them. The AI ​​module efficiently animates the specific cooking instructions and returns them to the server. The emotion engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state. The server sends the generated cooking video to the device and displays it so that the user can watch the cooking video while cooking. The user plays the video on their device and cooks accordingly.

[1662] Specific examples

[1663] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module and emotion engine. The emotion engine analyzes the user's emotional data, and if it determines that the user is under high stress, it generates a menu that will help the user relax (e.g., "Tuesday: grilled fish, rice, miso soup"). The generated menu information is sent to the device via the server, where the user can check it.

[1664] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. The user receives the ingredients they need, eliminating the need to go shopping.

[1665] When cooking, the server sends the menu and cooking steps to the AI ​​module, which then animates them. For example, specific steps such as "preparing grilled fish and adjusting the doneness" and "mixing seasonings" are shown in the video, and the emotion engine adjusts the tone and speed of the video according to the user's stress level. The server then sends this cooking video to the device, allowing the user to play the video on their device and cook efficiently.

[1666] Prompt example

[1667] An example of a prompt is as follows:

[1668] Family information prompt: "My husband is 30 years old, I have a 5-year-old child, and my husband is a meat lover, but my child has a dairy allergy."

[1669] Emotional state prompt: "I'm stressed. I want a relaxing meal."

[1670] Delivery request prompt: "Please send next week's grocery list to the delivery service."

[1671] Cooking video prompt: "Create a video of the cooking process for grilled fish. The tone should be relaxed and the pace should be slow."

[1672] In this way, the system streamlines dinner preparation at home and provides support tailored to the user's emotional state.

[1673] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1674] Input of household composition information and menu generation

[1675] Step 1:

[1676] Entering household information

[1677] User: Enters household information (e.g., age, number of people, food preferences, allergy information) through the device's input interface. The input data is saved in the device's internal memory.

[1678] Input: Family information (age, number of people, preferences, allergy information)

[1679] Output: Home information stored in the device's internal memory

[1680] Step 2:

[1681] Sending home information

[1682] Terminal: Converts the entered household information into the appropriate format and sends it to the server. The data is transmitted using a secure protocol.

[1683] Input: Home information stored in the device's internal memory

[1684] Output: The converted household information is sent to the server.

[1685] Step 3:

[1686] Menu generation request

[1687] Server: Passes the received household information to the AI ​​module and requests it to generate a nutritionally balanced menu. The server waits for a response to the request.

[1688] Input: Household information after format conversion sent to the server

[1689] Output: Household information sent to the AI ​​module

[1690] Step 4:

[1691] Menu generation

[1692] AI module: Generates a week's worth of nutritionally balanced meals based on household composition information and user emotional information. The generated meals are stored in a database.

[1693] Input: Home information sent to the AI ​​module, emotional information provided by the server

[1694] Output: A week's worth of menus stored in a database

[1695] Step 5:

[1696] Emotional state analysis

[1697] Emotion Engine: Analyzes the user's emotional state and evaluates their current stress level and mood. The evaluation results are sent back to the server.

[1698] Input: User's emotional information

[1699] Output: Parsed emotional state information

[1700] Step 6:

[1701] Considering menu and emotional state

[1702] Emotion engine: Based on the analysis results, the menu is adjusted to reflect the user's emotional state. The adjusted menu is sent to the server.

[1703] Input: Analyzed emotional state information, weekly meal plans stored in a database

[1704] Output: Adjusted menu information

[1705] Step 7:

[1706] Sending menu information

[1707] Server: Sends the adjusted menu information to the terminal so that the user can check it.

[1708] Input: Adjusted menu information

[1709] Output: Menu information sent to the device

[1710] Step 8:

[1711] Display menu information

[1712] Terminal: The received menu information is displayed to the user, who can check the menu for one week on the application interface.

[1713] Input: Menu information sent to the device

[1714] Output: Menu information displayed to the user

[1715] Ingredient list generation and delivery

[1716] Step 9:

[1717] Generate an ingredient list

[1718] Server: Generates a list of ingredients based on the menu. The generated list is stored in a database.

[1719] Input: Menu information stored in the database

[1720] Output: List of ingredients stored in the database

[1721] Step 10:

[1722] Converting an Ingredient List

[1723] Server: Converts the generated ingredient list into a format suitable for the delivery service. The converted ingredient list is ready to be sent to the delivery service.

[1724] Input: A list of ingredients stored in a database

[1725] Output: Formatted ingredient list

[1726] Step 11:

[1727] Sending an Ingredient List

[1728] Server: Sends the properly formatted ingredient list to the delivery service.

[1729] Input: Formatted ingredient list

[1730] Output: Ingredient list sent to delivery service

[1731] Step 12:

[1732] Preparing ingredients

[1733] Delivery service: Based on the received ingredient list, the necessary ingredients are picked up from the warehouse and packaged.

[1734] Input: Ingredient list sent to delivery service

[1735] Output: Packaged ingredients

[1736] Step 13:

[1737] Food delivery

[1738] Delivery service: delivers packaged food to the user's address.

[1739] Input: Packaged ingredients

[1740] Output: Ingredients delivered to the user

[1741] Step 14:

[1742] Picking up ingredients

[1743] User: Receive ingredients at the specified address and check the contents.

[1744] Input: Ingredients delivered to the user

[1745] Output: Received ingredients

[1746] Cooking procedure animation and support

[1747] Step 15:

[1748] Collection of cooking instructions

[1749] Server: Collects cooking instructions corresponding to the menu generated from the AI ​​module.

[1750] Input: Menu information stored in the database

[1751] Output: Collected cooking instructions

[1752] Step 16:

[1753] Request for video of cooking procedure

[1754] Server: Again, ask the AI ​​module to animate the collected cooking instructions.

[1755] Input: Collected cooking instructions

[1756] Output: Cooking instructions sent to the AI ​​module

[1757] Step 17:

[1758] Cooking procedure video

[1759] AI module: Converts cooking instructions into a video, showing each step of the cooking process with images and diagrams, and adding necessary text explanations.

[1760] Input: Cooking procedure information sent from the server

[1761] Output: Generated cooking video

[1762] Step 18:

[1763] Adjusting the tone and speed of your cooking videos

[1764] Emotion engine: Adjusts the tone (e.g., calmness of the audio) and progression speed of the generated video depending on the user's emotional state.

[1765] Input: Generated cooking video, analyzed emotional state information

[1766] Output: Adjusted cooking video

[1767] Step 19:

[1768] Submit cooking videos

[1769] Server: Sends the adjusted cooking video to the device.

[1770] Input: Adjusted cooking video

[1771] Output: Cooking video sent to device

[1772] Step 20:

[1773] Check out the cooking video

[1774] Terminal: Displays the transmitted cooking video to the user and prepares it for playback.

[1775] Input: Cooking video sent to device

[1776] Output: Cooking video shown to the user

[1777] Step 21:

[1778] Executing cooking

[1779] User: Watch the video on the device and follow the instructions to cook. For example, grill fish and prepare seasonings according to the instructions in the video.

[1780] Input: A cooking video shown to the user

[1781] Output: Finished dish

[1782] As described above, by explaining the specific operations at each step in detail, the system can streamline dinner preparation at home and provide support according to the user's emotional state.

[1783] (Application example 2)

[1784] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1785] Preparing dinner at home requires a lot of time and effort, while planning an appropriate menu that takes into account household composition and nutritional balance is difficult. In today's busy and stressful society, meal preparation support that takes into account the user's emotional state is also needed. In addition, there is a need for a system that efficiently provides cooking instructions in video format, and also has the ability to customize menus and cooking instruction videos according to the user's emotional state.

[1786] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1787] In this invention, the server includes means for receiving household configuration information and generating a menu based on nutritional balance, means for generating a list of ingredients required for the menu, means for delivering ingredients based on the ingredient list, means for creating an animation of cooking steps for the menu and providing it to the user, means for analyzing the user's emotional state and reflecting this in the menu and cooking steps, and means for adjusting the tone and progression speed of the created animation of cooking steps according to the user's emotional state. This enables efficient dinner preparation that takes into account the household configuration information and emotional state.

[1788] "Family composition information" is information that indicates the characteristics of the entire household, such as the age group and number of family members, food preferences, and allergy information.

[1789] "Nutritional balance" refers to a state in which each nutrient necessary for maintaining health is appropriately distributed.

[1790] A "menu" is a plan for planning and arranging the series of dishes to be served at a particular meal.

[1791] An "ingredient list" is a list of ingredients needed to create a specific menu.

[1792] "Delivery" refers to the delivery of necessary goods or ingredients to a specific location.

[1793] A "cooking procedure" is a sequence of steps required to prepare a particular dish.

[1794] "Animation" means converting specific information or procedures into video in a format that is easy to understand visually.

[1795] "User" refers to an individual or household using the system.

[1796] "Emotional state" is information that indicates the emotional state and psychological condition of the user.

[1797] "Analysis" means examining given information in detail and extracting meaning and characteristics.

[1798] "Tone" refers to the emotional nuances and atmosphere in visual and audio expression.

[1799] "Progress speed" refers to the speed at which the video or work process progresses.

[1800] "Customize" means to adjust or change content or functionality to meet specific needs or requirements.

[1801] This invention relates to a system that streamlines dinner preparation at home and provides support according to the user's emotional state. This system collects household configuration information and the user's emotional state, creates nutritionally balanced menus, delivers the necessary ingredients, and provides cooking instructions in the form of videos.

[1802] The system consists of the following main elements:

[1803] 1. Entering household information and generating menus

[1804] User: Enters family member ages, number of people, food preferences, allergy information, etc. into a smartphone app.

[1805] Terminal: Formats the entered home information and sends it to the server.

[1806] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[1807] AI module: Creates a nutritionally balanced menu based on household composition information and the user's emotional state, and returns it to the server.

[1808] Emotional engine: Analyzes the user's emotional state and takes this information into account when generating menus.

[1809] Server: Sends the generated menu information to the terminal.

[1810] Terminal: Displays the menu so that the user can check it.

[1811] 2. Generating a list of ingredients and delivering

[1812] Server: Generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[1813] Server: Converts the ingredient list into a format suitable for the delivery service.

[1814] Server: Sends the converted ingredient list to the delivery service.

[1815] Delivery service: Prepare ingredients based on the ingredient list received from the server.

[1816] Delivery service: delivers groceries to the user's address.

[1817] User: Pick up ingredients at the specified address.

[1818] 3. Videos and support for cooking procedures

[1819] Server: Collects menus and cooking instructions received from the AI ​​module.

[1820] Server: Sends the cooking instructions to the AI ​​module and asks it to animate them.

[1821] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[1822] Emotion Engine: Adjusts the tone and speed of cooking instruction videos based on the user's emotional state.

[1823] Server: Sends the generated cooking video to the device.

[1824] Device: Displays the cooking video so that the user can proceed with the cooking process while watching the video.

[1825] User: Play the video on the device and follow along as you cook.

[1826] Hardware and software used

[1827] 1. Hardware: Smartphone (iOS, Android)

[1828] 2. Software: Server-based AI modules (e.g., machine learning models implemented in Python), emotion engines (e.g., NLP models), delivery integration APIs, and video generation software (e.g., FFmpeg).

[1829] Data processing and calculation procedures

[1830] 1. Data input: The user inputs household composition information and emotional state into the smartphone app.

[1831] 2. Sending home information: The app sends this information to the server.

[1832] 3. Menu generation: The AI ​​module generates nutritionally balanced menus based on household composition information and emotional state.

[1833] 4. Ingredient list and delivery: The server generates an ingredient list based on the menu and works with the delivery service to deliver the ingredients.

[1834] 5. Animated Cooking Instructions: The AI ​​module creates detailed cooking instructions and animates them using video generation software. The emotion engine adjusts the tone and speed of the video based on the user's emotional state. The resulting video is then delivered to the user's smartphone.

[1835] Specific scenario example

[1836] A user logs into a smartphone app and enters information such as, "I have a 30-year-old husband, myself, and a 5-year-old child. I'm a little tired today." The app sends this information to a server, and an AI module generates a relaxing menu of "grilled fish, rice, and miso soup." The server sends this information to a delivery service, and the ingredients are delivered to the user's home. A video of the cooking steps is then generated and displayed on the smartphone app. The user can watch the video and cook at a low-stress pace.

[1837] Prompt Sentence Examples

[1838] "My husband and I are 30 years old and we have a 5-year-old child. We're feeling a little tired today. Can you suggest a relaxing dinner menu?"

[1839] In this way, the present invention streamlines dinner preparation at home and provides support tailored to the user's emotional state.

[1840] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1841] Program processing flow

[1842] Step 1:

[1843] The user enters information about their household (age, number of people, food preferences, allergy information) and their emotional state into a smartphone app.

[1844] Input: age, number of people, food preferences, allergy information, emotional state

[1845] Action: Enter information through the UI and press the submit button.

[1846] Output: Formatted household information data

[1847] Step 2:

[1848] The terminal formats the entered home information and sends it to the server.

[1849] Input: Home information data received from the user

[1850] Operation: Converts household information data into JSON format or similar and sends it to the server via an HTTP request.

[1851] Output: Household information data sent to the server

[1852] Step 3:

[1853] The server passes the received household information to the AI ​​module and generates an appropriate menu.

[1854] Input: Household information data

[1855] How it works: Passes household information to the AI ​​module and runs the menu generation algorithm.

[1856] Output: Generated menu data

[1857] Step 4:

[1858] The AI ​​module creates a nutritionally balanced menu based on household configuration information and the user's emotional state and returns it to the server.

[1859] Input: household composition information, emotional state data

[1860] How it works: Optimizes menus using machine learning models.

[1861] Output: Optimal menu data

[1862] Step 5:

[1863] An emotional engine analyzes the user's emotional state and takes that information into account when generating menus.

[1864] Input: Emotional state data

[1865] How it works: Sentiment analysis is performed using an NLP model and reflected in menu generation.

[1866] Output: Emotionally-reflected menu data

[1867] Step 6:

[1868] The server transmits the generated menu information to the terminal.

[1869] Input: Menu data

[1870] Operation: Sends menu data to the terminal as an HTTP response.

[1871] Output: Menu data sent to the device

[1872] Step 7:

[1873] The device displays the menu for the user to review.

[1874] Input: Menu data

[1875] Behavior: Displays menu information in the UI.

[1876] Output: Menu display that can be viewed by the user

[1877] Step 8:

[1878] The server generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[1879] Input: Menu data

[1880] Operation: Analyzes menu data and creates a list of required ingredients.

[1881] Output: Ingredient list data

[1882] Step 9:

[1883] The server converts the ingredient list into a format suitable for the delivery service.

[1884] Input: Ingredient list data

[1885] What it does: Formats data to meet the delivery service API specifications.

[1886] Output: Converted ingredient list data

[1887] Step 10:

[1888] The server sends the converted ingredient list to the delivery service.

[1889] Input: Converted ingredient list data

[1890] How it works: Sends data to a delivery service using an HTTP request.

[1891] Output: Ingredient list sent to delivery service

[1892] Step 11:

[1893] The delivery service prepares ingredients based on the ingredient list received from the server.

[1894] Input: Ingredient list data

[1895] Action: Collect the required ingredients from the warehouse or store based on the ingredients list.

[1896] Output: Prepared ingredients

[1897] Step 12:

[1898] The delivery service delivers the ingredients to the user's address.

[1899] Input: Prepared ingredients

[1900] What it does: Deliver ingredients to the user's address based on a delivery schedule.

[1901] Output: Ingredients delivered to the user

[1902] Step 13:

[1903] The user receives the ingredients at the specified address.

[1904] Input: Delivered ingredients

[1905] Action: Receive and check delivered ingredients.

[1906] Output: Received ingredients

[1907] Step 14:

[1908] The server collects the menu and cooking instructions received from the AI ​​module.

[1909] Input: Menu data, cooking procedure data

[1910] What it does: Synchronizes menu data and cooking instructions data.

[1911] Output: Synchronized cooking instructions data

[1912] Step 15:

[1913] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[1914] Input: Cooking procedure data

[1915] Action: Sends cooking instructions data to the AI ​​module.

[1916] Output: Request to the AI ​​module

[1917] Step 16:

[1918] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[1919] Input: Cooking procedure data

[1920] How it works: Cooking instructions are converted into a video using video generation software (e.g. FFmpeg).

[1921] Output: Cooking procedure video data

[1922] Step 17:

[1923] The emotional engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state.

[1924] Input: User emotional state data, cooking procedure video data

[1925] How it works: Adjust the tone and pace of your video using NLP models.

[1926] Output: Adjusted cooking instructions video

[1927] Step 18:

[1928] The server sends the generated cooking video to the terminal.

[1929] Input: Adjusted cooking instructions video

[1930] Operation: The adjusted video data is sent to the device via an HTTP response.

[1931] Output: Cooking instruction video sent to device

[1932] Step 19:

[1933] The terminal displays the cooking video so that the user can proceed with the cooking while checking it.

[1934] Input: Cooking procedure video data

[1935] What it does: Provides video playback functionality in the UI and displays the video to the user.

[1936] Output: Cooking procedure video to be played

[1937] Step 20:

[1938] The user plays a video on the device and follows along as they cook.

[1939] Input: Cooking Instructions Video

[1940] Operation: Cooking proceeds according to the video playback.

[1941] Output: Finished dish

[1942] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1943] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1944] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1945] [Fourth embodiment]

[1946] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1947] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1948] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1949] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1950] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1951] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1952] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1953] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1954] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1955] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1956] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1957] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1958] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1959] This invention is a system that streamlines dinner preparation at home. The system includes an AI module that receives household composition information and generates a menu based on nutritional balance. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also creates videos of cooking procedures according to the menu, supporting users in cooking easily and efficiently.

[1960] Overall system overview

[1961] 1. Entering household information and generating menus

[1962] User: Enter household information (e.g., age, number of people, food preferences, allergy information) into the terminal.

[1963] Terminal: Sends the entered home information to the server.

[1964] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[1965] AI module: Creates a week's worth of nutritionally balanced meals tailored to the household's composition and sends them back to the server.

[1966] Server: Sends the generated menu to the terminal.

[1967] Terminal: Displays the menu so that the user can check it.

[1968] 2. Generating a list of ingredients and delivering

[1969] Server: Creates a list of ingredients based on the menu generated by the AI ​​module.

[1970] Delivery service: Prepares ingredients based on the ingredient list received from the server and delivers them to the user's address.

[1971] User: Receive the necessary ingredients.

[1972] 3. Videos and support for cooking procedures

[1973] Server: Receives cooking instructions from the AI ​​module and animates them.

[1974] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[1975] Server: Sends the generated cooking video to the device.

[1976] Device: Displays the video so that the user can proceed with cooking while watching the video.

[1977] User: Follow the video and perform the cooking.

[1978] Specific examples

[1979] For example, if a user inputs household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module. The AI ​​module takes nutritional balance into consideration and generates a weekly menu (e.g., "Monday: teriyaki chicken breast, rice, salad," "Tuesday: fish meunière, bread, soup," etc.). This menu information is sent via the server to the device, where the user can check it.

[1980] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service uses this list to collect the ingredients and delivers them to the user's address. By receiving the ingredients, the user can save time by not having to go shopping.

[1981] When cooking, the server sends the menu and cooking instructions to the AI ​​module, which then animates them. For example, it could show specific steps such as "preparing the chicken breast, how to cook it, and the order in which to season it," and the server sends this video to the device. Users can efficiently cook by playing the video on their device.

[1982] As described above, the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[1983] The processing flow will be explained below.

[1984] Menu planning process

[1985] Step 1:

[1986] The user accesses the terminal and inputs household information (age, number of people, food preferences, and allergy information).

[1987] Step 2:

[1988] The terminal formats the entered home information and sends it to the server.

[1989] Step 3:

[1990] The server receives the input information and transmits it to the AI ​​module.

[1991] Step 4:

[1992] The AI ​​module generates a weekly menu that takes nutritional balance into consideration based on household information.

[1993] Step 5:

[1994] The menu information generated by the AI ​​module is returned to the server.

[1995] Step 6:

[1996] The server receives the menu information and sends it to the terminal.

[1997] Step 7:

[1998] The device displays the menu information for the user to review.

[1999] Ingredient list generation and delivery

[2000] Step 1:

[2001] The server generates a list of necessary ingredients based on the menu received from the AI ​​module.

[2002] Step 2:

[2003] The server converts the ingredient list into a format suitable for the delivery service.

[2004] Step 3:

[2005] The server sends the converted ingredient list to the delivery service.

[2006] Step 4:

[2007] The delivery service prepares ingredients based on the ingredient list received from the server.

[2008] Step 5:

[2009] The delivery service delivers the ingredients to the user's address.

[2010] Step 6:

[2011] The user receives the ingredients at the specified address.

[2012] Cooking procedure animation and support

[2013] Step 1:

[2014] The server collects the menu and cooking instructions received from the AI ​​module.

[2015] Step 2:

[2016] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[2017] Step 3:

[2018] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[2019] Step 4:

[2020] The server sends the generated cooking video to the terminal.

[2021] Step 5:

[2022] The device displays the cooking video for the user to review.

[2023] Step 6:

[2024] The user plays a video on the device and follows along as they cook.

[2025] Through these steps, the present invention is a system that enables users to efficiently prepare dinner every day, providing healthy eating habits and freeing up time.

[2026] Example 1

[2027] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2028] In today's world, preparing dinner at home is a time-consuming and labor-intensive task for many families, and there is a need for efficient methods of preparation. However, planning a menu, purchasing the necessary ingredients, and then cooking with those ingredients requires a considerable amount of effort to manage and execute a large amount of information. For this reason, a system is needed to make meal preparation at home easier and healthier.

[2029] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2030] In this invention, the server includes a means for validating household composition information in real time and eliminating invalid data, a means for generating and sending prompts to the AI ​​module, and a calendar-format display means for integrating and displaying the generated menu information. This makes it possible to provide a system that efficiently generates nutritionally balanced menus based on household composition information, builds a list of necessary ingredients, and integrates ingredient delivery with video provision of cooking instructions.

[2031] "Family composition information" refers to detailed information about the household, including age, number of people, food preferences, and allergy information.

[2032] "Nutritional balance" refers to a state in which the necessary nutrients are contained in the right amounts.

[2033] A "menu" refers to a meal menu for a specific period (usually a week), and is a plan that includes the dishes to be served at each meal.

[2034] An "ingredient list" is a list of ingredients needed to prepare a specific menu.

[2035] "Delivery" refers to a service that delivers goods (in this case, food) to a specific location.

[2036] "Cooking procedure animation" refers to the process of recording cooking procedures and methods in video format and providing the video to users.

[2037] "Validation check" is the process of checking whether the entered data meets the specified standards and detecting and excluding invalid data.

[2038] A "prompt" is an instruction given to an AI to encourage it to perform a specific action.

[2039] "Calendar format display" is a method of visually displaying the generated menu information in the form of a calendar.

[2040] An "AI module" is a program that uses artificial intelligence technology to perform a specific task (in this case, generating a menu or animating cooking instructions).

[2041] This invention is a system for improving the efficiency of dinner preparation at home, and includes functions for receiving household configuration information, generating a menu based on nutritional balance, creating a list of ingredients based on the menu, and delivering the ingredients to the user via a delivery service.The system also creates a video of the cooking procedure according to the menu, supporting the user in cooking easily and efficiently.

[2042] System configuration

[2043] Hardware:

[2044] Server: This is the central processing device of the system, and is responsible for managing household composition information, generating menus, creating ingredient lists, linking with delivery services, and creating videos of cooking procedures.

[2045] Terminal: A device on which users can input household information and view menu information and cooking procedure videos. This includes smartphones, tablets, and PCs.

[2046] Delivery service: A service provider that delivers food ingredients to the user's address.

[2047] software:

[2048] AI module: An artificial intelligence program used to generate nutritionally balanced menus.

[2049] Prompt generator: A program that generates prompt sentences to send appropriate instructions to the AI ​​module.

[2050] Video generation program: A program for generating cooking instructions in video format.

[2051] Validation program: A program that validates the household configuration information entered by the user.

[2052] System Operation

[2053] The user uses a terminal to input household composition information (e.g., age, number of people, food preferences, allergy information). This input information is sent to the server via the terminal. The server receives this information, performs validation checks in real time, and eliminates invalid data. The prompt generation program then generates and sends a prompt to the AI ​​module: "Based on this household information, please generate a nutritionally balanced menu for one week."

[2054] The AI ​​module receives and analyzes the prompt text and generates a weekly menu that suits the household's configuration. The generated menu information is sent back to the server, which then sends it to the device to display in calendar format so that the user can check it. Examples include "Monday: Teriyaki chicken breast, rice, salad" and "Tuesday: Fish meunière, bread, soup."

[2055] Next, the server creates a list of ingredients based on the generated menu information and sends it to the delivery service. The delivery service prepares the ingredients based on the received ingredient list and delivers them to the user's address. By receiving these ingredients, the user can save time and effort in shopping.

[2056] Furthermore, the server generates and sends a prompt message to the AI ​​module requesting that it create a video of the cooking steps: "Please explain the cooking steps for teriyaki chicken breast in a video." The AI ​​module generates specific cooking steps in the form of a video and returns it to the server. The server then sends this video to the device and provides it to the user. The user can efficiently proceed with cooking while playing the video on the device.

[2057] As described above, the system of the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[2058] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2059] Step 1:

[2060] The user uses the terminal to input household configuration information.

[2061] Specifically, the user enters household information such as age, number of people, food preferences, and allergy information into an input form on the device. Once the input is complete, the device sends it to the server. The input data is sent to the server as JSON format data containing individual information for each household member.

[2062] Step 2:

[2063] The server performs a validation check on the received home configuration information.

[2064] Specifically, the server parses the JSON data it receives and checks whether each item has been entered in the correct format. For example, it verifies that age is a positive integer and that ingredient preferences have been entered in the correct list format. If invalid data is found, it generates an error message and returns it to the terminal. If validation is successful, it moves on to the next step.

[2065] Step 3:

[2066] The server generates and sends a prompt to the AI ​​module.

[2067] Specifically, a prompt is generated based on the household composition information, saying, "Based on this household information, please generate a nutritionally balanced menu for one week." The generated prompt is sent to the AI ​​module using a REST API or similar. The input is the validated household composition information, and the output is the prompt sent to the AI ​​module.

[2068] Step 4:

[2069] The AI ​​module generates a menu based on the prompt.

[2070] Specifically, the AI ​​module analyzes household configuration information and prompt text, and generates a weekly menu that takes nutritional balance into consideration. The generated menu is returned to the server as JSON data in a format such as "Monday: teriyaki chicken breast, rice, salad." The input is the prompt text, and the output is the generated weekly menu.

[2071] Step 5:

[2072] The server receives the generated menu data and transmits it to the terminal.

[2073] Specifically, the generated menu data is returned to the device and formatted in a format that can be viewed by the user. HTML and CSS are generated to display the menu in calendar or list format, and this is sent to the device. The input is the generated menu data, and the output is calendar-format HTML data that is sent to the device.

[2074] Step 6:

[2075] The terminal displays menu information to the user.

[2076] Specifically, the device displays the received HTML data in a browser, allowing the user to easily check a week's worth of menus. The input is the received HTML data, and the output is the displayed menu information.

[2077] Step 7:

[2078] The server creates an ingredient list based on the generated menu.

[2079] Specifically, the server analyzes the menu data and creates a list of ingredients needed for each dish. For example, it creates a list in the format "Monday: chicken breast, soy sauce, mirin, sesame oil, rice, lettuce, tomato." The input is the menu data, and the output is a list of ingredients.

[2080] Step 8:

[2081] The server sends the ingredient list to the delivery service.

[2082] Specifically, the created ingredient list is sent to the API endpoint of the delivery service using an HTTP POST request, etc. The input is the ingredient list, and the output is a request to the delivery service.

[2083] Step 9:

[2084] The delivery service prepares the ingredients and delivers them to the user.

[2085] Specifically, the delivery service collects the necessary ingredients based on the received ingredient list and delivers them to the user's address. The delivery status can be tracked in real time and checked from the terminal. The input is the ingredient list, and the output is the delivered ingredients.

[2086] Step 10:

[2087] The user receives the delivered ingredients.

[2088] Specifically, the user receives ingredients at a specified address and checks their quality. The received ingredients are then used for cooking. The input is the ingredients delivered by the delivery service, and the output is the received ingredients.

[2089] Step 11:

[2090] The server generates and sends a prompt to the AI ​​module requesting it to animate the cooking steps.

[2091] Specifically, a prompt message is generated that reads, "Please explain the cooking steps for teriyaki chicken breast in a video," and sent to the AI ​​module. The input is the menu data, and the output is a prompt message requesting the creation of a video of the cooking steps.

[2092] Step 12:

[2093] The AI ​​module animates the cooking process.

[2094] Specifically, based on the prompt sentence, the system efficiently generates specific cooking steps in the form of a video. For example, it generates a video showing steps such as "preparing chicken breast, cooking it, and the order in which to season it." The input is the prompt sentence, and the output is a video of the generated cooking steps.

[2095] Step 13:

[2096] The server receives the generated cooking video and sends it to the terminal.

[2097] Specifically, the generated video of the cooking instructions is sent to the device using an HTTP request, etc. The input is the video of the cooking instructions, and the output is a request to send the video to the device.

[2098] Step 14:

[2099] The device displays the cooking video to the user.

[2100] Specifically, a player is provided so that the device can play the received video data, allowing the user to check the cooking instructions while cooking. The video is played using a player that includes functions such as play, pause, rewind, and fast forward. The input is the received video data, and the output is a video of the cooking instructions displayed.

[2101] Step 15:

[2102] The user follows the video to perform cooking.

[2103] Specifically, the user watches a video played on the device and follows the cooking instructions. For example, when cooking chicken breast teriyaki, the user follows the steps shown in the video. The input is the video that is displayed, and the output is the cooked dish.

[2104] (Application example 1)

[2105] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2106] In today's busy households, preparing dinner every day takes a lot of time and effort. Planning a menu that takes into account the nutritional balance, preferences, and allergy information required for each household is extremely time-consuming. Purchasing each ingredient one by one is also a hassle, and guidance on how to efficiently execute cooking procedures is essential. However, conventional systems have faced challenges in consistently automating these processes and making them more efficient. In particular, they lacked the means to link with delivery services or display cooking procedures on a smartphone.

[2107] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2108] In this invention, the server includes a means for generating a nutritionally balanced menu based on household composition information, a means for creating an ingredient list for the generated menu, a means for sending the ingredient list to an affiliated delivery service, and a means for displaying cooking instructions in video form on a smartphone. This allows users to receive suggestions for efficient and balanced menus tailored to their household composition, automatically obtain the necessary ingredients through the delivery service, and further enable them to cook while checking the cooking instructions on their smartphone.

[2109] "Family composition information" refers to basic information about family members, including age, number of people, food preferences, and allergy information.

[2110] "Nutritional balance" means consuming an equal amount of nutrients necessary to maintain physical health.

[2111] A "menu" is a list of planned meals for a particular period of time (e.g., a week).

[2112] An "ingredient list" is a list of ingredients required based on a menu.

[2113] "Delivery" refers to the act of sending goods or ingredients to a specific location.

[2114] "Cooking instructions" are specific methods that show the procedures and steps for making a dish.

[2115] "Animation" refers to the presentation of specific information or procedures in the form of a video.

[2116] A "smartphone" is a type of mobile phone and a communications device with advanced computer functions and internet connectivity.

[2117] A "delivery service" is a service that delivers ingredients or products to a specific location.

[2118] An "AI module" refers to a program or algorithm that uses artificial intelligence and has functions such as data analysis and automation.

[2119] A "server" is a computer system that provides various services over a network.

[2120] This invention is a system that streamlines dinner preparation at home. The system includes an AI module that receives household composition information and generates a menu based on nutritional balance. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also creates videos of cooking procedures according to the menu, supporting users in cooking easily and efficiently.

[2121] Overall system overview

[2122] 1. Entering household information and generating menus

[2123] User: Enters household information (e.g., age, number of people, food preferences, allergy information) into a smartphone device.

[2124] Terminal: Sends the entered home information to the server.

[2125] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[2126] AI module: Using a generative AI model, it creates a nutritionally balanced menu that suits the household composition and returns it to the server.

[2127] Server: Sends the generated menu to the terminal.

[2128] Terminal: Displays the menu so that the user can check it.

[2129] 2. Generating a list of ingredients and delivering

[2130] Server: Creates a list of ingredients based on the menu generated by the AI ​​module.

[2131] Delivery service: Prepares ingredients based on the ingredient list received from the server and delivers them to the user's address.

[2132] User: Receive the necessary ingredients.

[2133] 3. Videos and support for cooking procedures

[2134] Server: Receives cooking instructions from the AI ​​module and animates them.

[2135] AI module: Using a generative AI model, the specific cooking steps are efficiently animated and sent back to the server.

[2136] Server: Sends the generated cooking video to the device.

[2137] Device: Displays the video so that the user can proceed with cooking while watching the video.

[2138] User: Follow the video and perform the cooking.

[2139] Hardware and Software Use

[2140] Hardware: Smartphone (device), delivery service server

[2141] Software: AI module using Python, database (e.g., SQLite), delivery service API (general delivery service)

[2142] Generative AI model: An AI model for generating menus that take nutritional balance into consideration

[2143] Specific examples

[2144] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a smartphone device, the device sends this information to a server. The server receives the information and passes it on to an AI module. The AI ​​module takes nutritional balance into consideration and generates a weekly menu (e.g., "Monday: teriyaki chicken breast, rice, salad," "Tuesday: fish meunière, bread, soup," etc.). This menu information is sent via the server to the device, where it can be viewed by the user.

[2145] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. By receiving the necessary ingredients, the user can save time and effort in shopping.

[2146] When cooking, the server sends the menu and cooking instructions to the AI ​​module, which then animates them. For example, the AI ​​module can show specific steps such as "preparing chicken breast, how to cook it, and the order in which to season it," and the server sends this video to the device. Users can efficiently cook by playing the video on their smartphone.

[2147] Prompt Sentence Examples

[2148] Examples of specific prompts include:

[2149] Generate a nutritionally balanced menu for one week based on your household composition information.

[2150] Age: 30

[2151] Number of people: 3

[2152] Allergies: None

[2153] As described above, the present invention improves the efficiency of dinner preparation at home and provides users with a healthy and quick diet.

[2154] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2155] Step 1:

[2156] Entering household information

[2157] Input: The user enters household composition information (age, number of people, food preferences, allergy information, etc.) into the smartphone device.

[2158] Operation: The terminal receives the entered home information.

[2159] Output: Send the received household information to the server.

[2160] Step 2:

[2161] Receiving household information and generating menus

[2162] Input: Family information (age, number of people, food preferences, allergy information).

[2163] Operation: The server passes the received household information to the AI ​​module and creates a prompt for menu generation. The prompt format might be something like, "Based on the household composition information, please generate a nutritionally balanced menu for one week. - Age: 30 - Number of people: 3 - Allergies: None."

[2164] Data processing and calculation: The AI ​​module generates a nutritionally balanced menu for one week based on household information. The generative AI model calculates ingredient combinations and nutritional values ​​to design the optimal menu.

[2165] Output: The generated menu is returned to the server.

[2166] Step 3:

[2167] Sending and displaying menus

[2168] Input: Menu returned from AI module.

[2169] Operation: The server receives the generated menu and sends it to the terminal, which displays the received menu information to the user.

[2170] Output: Display of menu information in a format that can be viewed by the user.

[2171] Step 4:

[2172] Generate an ingredient list

[2173] Input: Generated menu information.

[2174] Operation: The server creates a list of ingredients based on the menu information. The AI ​​module automatically generates the list of ingredients, so the server references a database of ingredients and lists the necessary ingredients.

[2175] Output: The created ingredient list.

[2176] Step 5:

[2177] Delivery service requests

[2178] Input: The created ingredient list.

[2179] Operation: The server sends the list of ingredients to the partner delivery service. Using the delivery service API, the order is sent based on the specified ingredient list.

[2180] Output: A food request to a delivery service.

[2181] Step 6:

[2182] Food delivery

[2183] Input: Incoming request from delivery service.

[2184] How it works: The delivery service prepares the food based on the received request and delivers it to the address specified by the user.

[2185] Output: Delivery of ingredients to the user.

[2186] Step 7:

[2187] Cooking procedure video

[2188] Input: Generated menu information.

[2189] How it works: The server sends menu information to the AI ​​module and instructs it to create a video of the specific cooking steps. The generative AI model analyzes the cooking steps and generates the video data.

[2190] Data processing and calculation: The AI ​​module creates video data based on specific cooking instructions and sends it back to the server.

[2191] Output: Video data of cooking instructions.

[2192] Step 8:

[2193] Send and display cooking videos

[2194] Input: Generated cooking videos.

[2195] Operation: The server sends the cooking video to the user's smartphone, where it displays the video for the user to review.

[2196] Output: Playback of cooking procedure video on smartphone.

[2197] The above is a specific description of the processing steps in the present invention.

[2198] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2199] This invention relates to a system that streamlines dinner preparation at home and takes user emotions into consideration. This system incorporates an AI module that receives household composition information and generates a menu based on nutritional balance, as well as an emotion engine, and includes a function that suggests optimal menus and cooking procedures based on the user's emotions. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. Furthermore, it supports users by creating videos of cooking procedures according to the menu, allowing them to cook easily and efficiently.

[2200] Overall system overview

[2201] 1. Entering household information and generating menus

[2202] User: Enter household information (e.g., age, number of people, food preferences, allergy information) into the terminal.

[2203] Terminal: Formats the entered home information and sends it to the server.

[2204] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[2205] AI module: Creates a nutritionally balanced menu for one week based on household composition and user emotional information, and returns it to the server.

[2206] Emotional engine: Analyzes the user's emotional state and takes this information into account when generating menus.

[2207] Server: Sends the generated menu information to the terminal.

[2208] Terminal: Displays the menu so that the user can check it.

[2209] 2. Generating a list of ingredients and delivering

[2210] Server: Generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[2211] Server: Converts the ingredient list into a format suitable for the delivery service.

[2212] Server: Sends the converted ingredient list to the delivery service.

[2213] Delivery service: Prepare ingredients based on the ingredient list received from the server.

[2214] Delivery service: delivers groceries to the user's address.

[2215] User: Pick up ingredients at the specified address.

[2216] 3. Videos and support for cooking procedures

[2217] Server: Collects menus and cooking instructions received from the AI ​​module.

[2218] Server: Sends the cooking instructions to the AI ​​module and asks it to animate them.

[2219] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[2220] Emotion Engine: Adjusts the tone and speed of cooking instruction videos based on the user's emotional state.

[2221] Server: Sends the generated cooking video to the device.

[2222] Device: Displays the cooking video so that the user can proceed with the cooking process while watching the video.

[2223] User: Play the video on the device and follow along as you cook.

[2224] Specific examples

[2225] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module and emotion engine. The emotion engine analyzes the user's emotional data, and if it determines that the user is under high stress, it generates a menu that will help the user relax (e.g., "Tuesday: grilled fish, rice, miso soup"). The generated menu information is sent to the device via the server, where the user can check it.

[2226] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. The user receives the ingredients they need, eliminating the need to go shopping.

[2227] When cooking, the server sends the menu and cooking steps to the AI ​​module, which then animates them. For example, specific steps such as "preparing grilled fish and adjusting the doneness" and "mixing seasonings" are shown in the video, and the emotion engine adjusts the tone and speed of the video according to the user's stress level. The server then sends this cooking video to the device, allowing the user to play the video on their device and cook efficiently.

[2228] In this way, the present invention is a system that streamlines dinner preparation at home and provides support according to the user's emotional state.

[2229] The processing flow will be explained below.

[2230] Menu planning and emotion engine processing

[2231] Step 1:

[2232] The user accesses the terminal and inputs household information (age, number of people, food preferences, and allergy information).

[2233] Step 2:

[2234] The terminal formats the home information and sends it to the server.

[2235] Step 3:

[2236] The user inputs emotional data (for example, heart rate data or facial expression data obtained by a smartwatch or smartphone) into the device.

[2237] Step 4:

[2238] The device transmits the emotion data to the server.

[2239] Step 5:

[2240] The server receives household information and emotion data and passes it to the AI ​​module and emotion engine.

[2241] Step 6:

[2242] The emotion engine analyzes the emotion data to identify the user's current emotional state (e.g., stress level, fatigue level, etc.).

[2243] Step 7:

[2244] Based on the information obtained from the emotion engine, the server sends instructions to the AI ​​module to generate a menu that takes into account the customer's emotional state.

[2245] Step 8:

[2246] The AI ​​module takes into account household information and emotional state to generate a nutritionally balanced menu for the week.

[2247] Step 9:

[2248] The menu information generated by the AI ​​module is returned to the server.

[2249] Step 10:

[2250] The server receives the menu information and sends it to the terminal.

[2251] Step 11:

[2252] The device displays the menu information for the user to review.

[2253] Ingredient list generation and delivery

[2254] Step 12:

[2255] The server generates a list of necessary ingredients based on the menu received from the AI ​​module.

[2256] Step 13:

[2257] The server converts the ingredient list into a format suitable for the delivery service.

[2258] Step 14:

[2259] The server sends the converted ingredient list to the delivery service.

[2260] Step 15:

[2261] The delivery service prepares ingredients based on the ingredient list received from the server.

[2262] Step 16:

[2263] The delivery service delivers the ingredients to the user's address.

[2264] Step 17:

[2265] The user receives the ingredients at the specified address.

[2266] Cooking procedure animation and support

[2267] Step 18:

[2268] The server collects the menu and cooking instructions received from the AI ​​module.

[2269] Step 19:

[2270] The server sends the cooking instructions to the AI ​​module and asks it to animate them.

[2271] Step 20:

[2272] The AI ​​module efficiently animates the specific cooking steps and sends them back to the server.

[2273] Step 21:

[2274] The emotional engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state.

[2275] Step 22:

[2276] The server sends the generated cooking video to the terminal.

[2277] Step 23:

[2278] The device displays the cooking video for the user to review.

[2279] Step 24:

[2280] The user plays a video on the device and follows along as they cook.

[2281] In this way, the present invention is a system that streamlines dinner preparation at home and provides support according to the user's emotional state.

[2282] Example 2

[2283] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2284] Modern households face the problem of inefficient dinner preparation. Planning a nutritionally balanced menu while taking into account various preferences and allergies within the household is burdensome, and providing meals that respond to the user's emotional state is also difficult. Conventional systems only provide simple menus without considering the user's emotions, and are unable to suggest menus aimed at stress relief or relaxation. Furthermore, purchasing the necessary ingredients and understanding cooking procedures are time-consuming, significantly reducing the efficiency of meal preparation at home.

[2285] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving household configuration information and generating a menu based on nutritional balance, a means for generating a list of ingredients required for the generated menu and transmitting it to a delivery service, a means for analyzing the user's emotional state and generating an optimal menu and cooking instructions based on the user's emotions, and a means for animating the cooking instructions for the menu, adjusting the tone and progression speed of the animation based on the user's emotional state, and providing the animation to the user. This enables efficient dinner preparation that takes the user's emotional state into consideration.

[2286] "Family composition information" refers to information about meals at home, such as the ages, number of people, food preferences, and allergy information of household members.

[2287] "Nutritional balance" refers to a balanced diet that maintains health by consuming appropriate amounts of each nutrient.

[2288] A "menu" is a set of meal menus served over a specific period of time (e.g., a week).

[2289] "Ingredient list" refers to a list of ingredients needed to create a specific menu.

[2290] "Delivery service" means a service that delivers food ingredients or goods to a designated location.

[2291] "User's emotional state" refers to the psychological or emotional state the user is feeling (e.g., stressed, relaxed, happy, sad).

[2292] An "emotion engine" refers to technology that analyzes a user's emotions and provides appropriate responses and suggestions based on that information.

[2293] "Animation" refers to the process of converting static or textual information into a dynamic, animated format.

[2294] "Tone" refers to the overall atmosphere or influential characteristics of a video or audio (e.g., calm, excited, relaxed).

[2295] "Progression speed" refers to the playback speed of video and audio, in other words, the speed at which information is presented.

[2296] This invention relates to a system that streamlines dinner preparation at home and takes the user's emotions into consideration. This system incorporates an AI module that inputs household composition information and generates a nutritionally balanced menu based on that information, and an emotion engine. It also includes a function that suggests optimal menus and cooking procedures based on the user's emotional state. It also includes a function that creates a list of ingredients based on the generated menu and delivers those ingredients to the user via a delivery service. It also supports the user by creating videos of cooking procedures according to the menu, allowing them to cook easily and efficiently.

[2297] The overall outline of the system is as follows:

[2298] 1. Entering household information and generating menus

[2299] The user enters household information (e.g., age, number of people, food preferences, allergy information) into the device. The device formats the entered household information and sends it to the server. The server passes the received household information to the AI ​​module, which generates an appropriate menu. The AI ​​module creates a nutritionally balanced menu for one week based on the household composition information and the user's emotional information, and returns it to the server. The emotion engine analyzes the user's emotional state and takes that information into consideration when generating the menu. The server sends the generated menu information to the device and displays it so that the user can check the menu.

[2300] 2. Generating a list of ingredients and delivering

[2301] The server generates a list of ingredients based on the menu generated by the AI ​​module, converts the list into a format suitable for the delivery service, and sends it. The delivery service prepares the ingredients based on the ingredient list received from the server and delivers them to the user's address. The user picks up the ingredients at the specified address.

[2302] 3. Videos and support for cooking procedures

[2303] The server collects the menu and cooking instructions received from the AI ​​module, sends the cooking instructions to the AI ​​module, and requests it to animate them. The AI ​​module efficiently animates the specific cooking instructions and returns them to the server. The emotion engine adjusts the tone and speed of the cooking instruction video depending on the user's emotional state. The server sends the generated cooking video to the device and displays it so that the user can watch the cooking video while cooking. The user plays the video on their device and cooks accordingly.

[2304] Specific examples

[2305] For example, if a user enters household information such as "I have a 30-year-old husband, myself, and a 5-year-old child" into a device, the device sends this information to the server. The server receives the information and passes it on to the AI ​​module and emotion engine. The emotion engine analyzes the user's emotional data, and if it determines that the user is under high stress, it generates a menu that will help the user relax (e.g., "Tuesday: grilled fish, rice, miso soup"). The generated menu information is sent to the device via the server, where the user can check it.

[2306] Next, the server creates a list of ingredients based on the menu and sends it to the delivery service. The delivery service collects the ingredients based on this list and delivers them to the user's address. The user receives the ingredients they need, eliminating the need to go shopping.

[2307] When cooking, the server sends the menu and cooking steps to the AI ​​module, which then animates them. For example, specific steps such as "preparing grilled fish and adjusting the doneness" and "mixing seasonings" are shown in the video, and the emotion engine adjusts the tone and speed of the video according to the user's stress level. The server then sends this cooking video to the device, allowing the user to play the video on their device and cook efficiently.

[2308] Prompt example

[2309] An example of a prompt is as follows:

[2310] Family information prompt: "My husband is 30 years old, I have a 5-year-old child, and my husband is a meat lover, but my child has a dairy allergy."

[2311] Emotional state prompt: "I'm stressed. I want a relaxing meal."

[2312] Delivery request prompt: "Please send next week's grocery list to the delivery service."

[2313] Cooking video prompt: "Create a video of the cooking process for grilled fish. The tone should be relaxed and the pace should be slow."

[2314] In this way, the system streamlines dinner preparation at home and provides support tailored to the user's emotional state.

[2315] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2316] Input of household composition information and menu generation

[2317] Step 1:

[2318] Entering household information

[2319] User: Enters household information (e.g., age, number of people, food preferences, allergy information) through the device's input interface. The input data is saved in the device's internal memory.

[2320] Input: Family information (age, number of people, preferences, allergy information)

[2321] Output: Home information stored in the device's internal memory

[2322] Step 2:

[2323] Sending home information

[2324] Terminal: Converts the entered household information into the appropriate format and sends it to the server. The data is transmitted using a secure protocol.

[2325] Input: Home information stored in the device's internal memory

[2326] Output: The converted household information is sent to the server.

[2327] Step 3:

[2328] Menu generation request

[2329] Server: Passes the received household information to the AI ​​module and requests it to generate a nutritionally balanced menu. The server waits for a response to the request.

[2330] Input: Household information after format conversion sent to the server

[2331] Output: Household information sent to the AI ​​module

[2332] Step 4:

[2333] Menu generation

[2334] AI module: Generates a week's worth of nutritionally balanced meals based on household composition information and user emotional information. The generated meals are stored in a database.

[2335] Input: Home information sent to the AI ​​module, emotional information provided by the server

[2336] Output: A week's worth of menus stored in a database

[2337] Step 5:

[2338] Emotional state analysis

[2339] Emotion Engine: Analyzes the user's emotional state and evaluates their current stress level and mood. The evaluation results are sent back to the server.

[2340] Input: User's emotional information

[2341] Output: Parsed emotional state information

[2342] Step 6:

[2343] Considering menu and emotional state

[2344] Emotion engine: Based on the analysis results, the menu is adjusted to reflect the user's emotional state. The adjusted menu is sent to the server.

[2345] Input: Analyzed emotional state information, weekly meal plans stored in a database

[2346] Output: Adjusted menu information

[2347] Step 7:

[2348] Sending menu information

[2349] Server: Sends the adjusted menu information to the terminal so that the user can check it.

[2350] Input: Adjusted menu information

[2351] Output: Menu information sent to the device

[2352] Step 8:

[2353] Display menu information

[2354] Terminal: The received menu information is displayed to the user, who can check the menu for one week on the application interface.

[2355] Input: Menu information sent to the device

[2356] Output: Menu information displayed to the user

[2357] Ingredient list generation and delivery

[2358] Step 9:

[2359] Generate an ingredient list

[2360] Server: Generates a list of ingredients based on the menu. The generated list is stored in a database.

[2361] Input: Menu information stored in the database

[2362] Output: List of ingredients stored in the database

[2363] Step 10:

[2364] Converting an Ingredient List

[2365] Server: Converts the generated ingredient list into a format suitable for the delivery service. The converted ingredient list is ready to be sent to the delivery service.

[2366] Input: A list of ingredients stored in a database

[2367] Output: Formatted ingredient list

[2368] Step 11:

[2369] Sending an Ingredient List

[2370] Server: Sends the properly formatted ingredient list to the delivery service.

[2371] Input: Formatted ingredient list

[2372] Output: Ingredient list sent to delivery service

[2373] Step 12:

[2374] Preparing ingredients

[2375] Delivery service: Based on the received ingredient list, the necessary ingredients are picked up from the warehouse and packaged.

[2376] Input: Ingredient list sent to delivery service

[2377] Output: Packaged ingredients

[2378] Step 13:

[2379] Food delivery

[2380] Delivery service: delivers packaged food to the user's address.

[2381] Input: Packaged ingredients

[2382] Output: Ingredients delivered to the user

[2383] Step 14:

[2384] Picking up ingredients

[2385] User: Receive ingredients at the specified address and check the contents.

[2386] Input: Ingredients delivered to the user

[2387] Output: Received ingredients

[2388] Cooking procedure animation and support

[2389] Step 15:

[2390] Collection of cooking instructions

[2391] Server: Collects cooking instructions corresponding to the menu generated from the AI ​​module.

[2392] Input: Menu information stored in the database

[2393] Output: Collected cooking instructions

[2394] Step 16:

[2395] Request for video of cooking procedure

[2396] Server: Again, ask the AI ​​module to animate the collected cooking instructions.

[2397] Input: Collected cooking instructions

[2398] Output: Cooking instructions sent to the AI ​​module

[2399] Step 17:

[2400] Cooking procedure video

[2401] AI module: Converts cooking instructions into a video, showing each step of the cooking process with images and diagrams, and adding necessary text explanations.

[2402] Input: Cooking procedure information sent from the server

[2403] Output: Generated cooking video

[2404] Step 18:

[2405] Adjusting the tone and speed of your cooking videos

[2406] Emotion engine: Adjusts the tone (e.g., calmness of the audio) and progression speed of the generated video depending on the user's emotional state.

[2407] Input: Generated cooking video, analyzed emotional state information

[2408] Output: Adjusted cooking video

[2409] Step 19:

[2410] Submit cooking videos

[2411] Server: Sends the adjusted cooking video to the device.

[2412] Input: Adjusted cooking video

[2413] Output: Cooking video sent to device

[2414] Step 20:

[2415] Check out the cooking video

[2416] Terminal: Displays the transmitted cooking video to the user and prepares it for playback.

[2417] Input: Cooking video sent to device

[2418] Output: Cooking video shown to the user

[2419] Step 21:

[2420] Executing cooking

[2421] User: Watch the video on the device and follow the instructions to cook. For example, grill fish and prepare seasonings according to the instructions in the video.

[2422] Input: A cooking video shown to the user

[2423] Output: Finished dish

[2424] As described above, by explaining the specific operations at each step in detail, the system can streamline dinner preparation at home and provide support according to the user's emotional state.

[2425] (Application example 2)

[2426] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2427] Preparing dinner at home requires a lot of time and effort, while planning an appropriate menu that takes into account household composition and nutritional balance is difficult. In today's busy and stressful society, meal preparation support that takes into account the user's emotional state is also needed. In addition, there is a need for a system that efficiently provides cooking instructions in video format, and also has the ability to customize menus and cooking instruction videos according to the user's emotional state.

[2428] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2429] In this invention, the server includes means for receiving household configuration information and generating a menu based on nutritional balance, means for generating a list of ingredients required for the menu, means for delivering ingredients based on the ingredient list, means for creating an animation of cooking steps for the menu and providing it to the user, means for analyzing the user's emotional state and reflecting this in the menu and cooking steps, and means for adjusting the tone and progression speed of the created animation of cooking steps according to the user's emotional state. This enables efficient dinner preparation that takes into account the household configuration information and emotional state.

[2430] "Family composition information" is information that indicates the characteristics of the entire household, such as the age group and number of family members, food preferences, and allergy information.

[2431] "Nutritional balance" refers to a state in which each nutrient necessary for maintaining health is appropriately distributed.

[2432] A "menu" is a plan for planning and arranging the series of dishes to be served at a particular meal.

[2433] An "ingredient list" is a list of ingredients needed to create a specific menu.

[2434] "Delivery" refers to the delivery of necessary goods or ingredients to a specific location.

[2435] A "cooking procedure" is a sequence of steps required to prepare a particular dish.

[2436] "Animation" means converting specific information or procedures into video in a format that is easy to understand visually.

[2437] "User" refers to an individual or household using the system.

[2438] "Emotional state" is information that indicates the emotional state and psychological condition of the user.

[2439] "Analysis" means examining given information in detail and extracting meaning and characteristics.

[2440] "Tone" refers to the emotional nuances and atmosphere in visual and audio expression.

[2441] "Progress speed" refers to the speed at which the video or work process progresses.

[2442] "Customize" means to adjust or change content or functionality to meet specific needs or requirements.

[2443] This invention relates to a system that streamlines dinner preparation at home and provides support according to the user's emotional state. This system collects household configuration information and the user's emotional state, creates nutritionally balanced menus, delivers the necessary ingredients, and provides cooking instructions in the form of videos.

[2444] The system consists of the following main elements:

[2445] 1. Entering household information and generating menus

[2446] User: Enters family member ages, number of people, food preferences, allergy information, etc. into a smartphone app.

[2447] Terminal: Formats the entered home information and sends it to the server.

[2448] Server: Passes the received household information to the AI ​​module and generates an appropriate menu.

[2449] AI module: Creates a nutritionally balanced menu based on household composition information and the user's emotional state, and returns it to the server.

[2450] Emotional engine: Analyzes the user's emotional state and takes this information into account when generating menus.

[2451] Server: Sends the generated menu information to the terminal.

[2452] Terminal: Displays the menu so that the user can check it.

[2453] 2. Generating a list of ingredients and delivering

[2454] Server: Generates a list of necessary ingredients based on the menu generated by the AI ​​module.

[2455] Server: Converts the ingredient list into a format suitable for the delivery service.

[2456] Server: Sends the converted ingredient list to the delivery service.

[2457] Delivery service: Prepare ingredients based on the ingredient list received from the server.

[2458] Delivery service: delivers groceries to the user's address.

[2459] User: Pick up ingredients at the specified address.

[2460] 3. Videos and support for cooking procedures

[2461] Server: Collects menus and cooking instructions received from the AI ​​module.

[2462] Server: Sends the cooking instructions to the AI ​​module and asks it to animate them.

[2463] AI module: Efficiently animates specific cooking steps and sends them back to the server.

[2464] Emotion Engine: Adjusts the tone and speed of cooking instruction videos based on the user's emotional state.

[2465] Server: Sends the generated cooking video to the device.

[2466] Device: Displays the cooking video so that the user can proceed with the cooking process while watching the video.

[2467] User: Play the video on the device and follow along as you cook.

[2468] Hardware and software used

[2469] 1. Hardware: Smartphone (iOS, Android)

[2470] 2. Software: Server-based AI modules (e.g., machine learning models implemented in Python), emotion engines (e.g., NLP models), delivery integration APIs, and video generation software (e.g., FFmpeg).

[2471] Data processing and calculation procedures

[2472] 1. Data input: The user inputs household composition information and emotional state into the smartphone app.

[2473] 2. Sending home information: The app sends this information to the server.

[2474] 3. Menu generation: The AI ​​module generates nutritionally balanced menus based on household composition information and emotional state.

[2475] 4. Ingredient list and delivery: The server generates an ingredient list based on the menu and works with the delivery service to deliver the ingredients.

[2476] 5. Animated Cooking Instructions: The AI ​​module creates detailed cooking instructions and animates them using video generation software. The emotion engine adjusts the tone and speed of the video based on the user's emotional state. The resulting video is then delivered to the user's smartphone.

[2477] Specific scenario example

[2478] A user logs into a smartphone app and enters information such as, "I have a 30-year-old husband, myself, and a 5-year-old child. I'm a little tired today." The app sends this information to a server, and an AI module generates a relaxing menu of "grilled fish, rice, and miso soup." The server sends this information to a delivery service, and the ingredients are delivered to the user's home. A video of the cooking steps is then generated and displayed on the smartphone app. The user can watch the video and cook at a low-stress pace.

[2479] Prompt Sentence Examples

[2480] "My husband and I are 30 years old and we have a 5-year-old child. We're feeling a little tired today. Can you suggest a relaxing dinner menu?"

[2481] In this way, the present invention streamlines dinner preparation at home and provides support tailored to the user's emotional state.

[2482] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2483] Program processing flow

[2484] Step 1:

[2485] The user enters information about their household (age, number of people, food preferences, allergy information) and their emotional state into a smartphone app.

[2486] Input: age, number of people, food preferences, allergy information, emotional state

[2487] Action: Enter information through the UI and press the submit button.

[2488] Output: Formatted household information data

[2489] Step 2:

[2490] The terminal formats the entered home information and sends it to the server.

[2491] Input: Home information data received from the user

[2492] Operation: Converts household information data into JSON format or similar and sends it to the server via an HTTP request.

[2493] Output: Household information data sent to the server

[2494] Step 3:

[2495] The server passes the received household information to the AI ​​module and generates an appropriate menu.

[2496] Input: Household information data

[2497] How it works: Passes household information to the AI ​​module and runs the menu generation algorithm.

[2498] Output: Generated menu data

[2499] Step 4:

[2500] The AI ​​module creates a nutritionally balanced menu based on household configuration information and the user's emotional state and returns it to the server.

[2501] ...

Claims

1. A means for receiving household composition information and generating a menu based on nutritional balance; A means for generating a list of ingredients required for the menu; a means for delivering ingredients based on the ingredient list; A means for creating an animation of the cooking procedure of the menu and providing it to a user; A system including:

2. The system according to claim 1 , wherein the household configuration information includes age, number of people, food preferences, and allergy information.

3. 10. The system of claim 1, further comprising means for transmitting the ingredient list to a delivery service.

Images