system

Abstract

Provide a system. [Solution] an input means for the user to order the food they desire; location information acquisition means for acquiring user location information; a means of transportation that moves to a designated location using an automatic driving means; cooking means for cooking the food ordered by the user; A generating means for generating digital decorations that match the atmosphere desired by a user; and a serving means for serving the ordered food to the user.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional restaurants and delivery services have had problems in that it was difficult to provide the food and atmosphere desired by the user in real time, and it took time to serve freshly cooked food. In addition, it was difficult to quickly arrive at the location where the user ordered, so providing prompt service to users was an issue. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing a system that provides the food and atmosphere desired by a user in real time and quickly arrives at the location where the order was placed. Specifically, the system includes an input means for ordering the food desired by the user, a location information acquisition means for acquiring the user's location information, a transportation means for moving to the specified location using an automatic driving means, a cooking means for cooking the food ordered by the user, a generation means for generating digital decorations that match the user's desired atmosphere, and a delivery means for delivering the ordered food to the user, thereby providing a fast and high-quality service that meets the user's needs.

[0006] In addition, by analyzing the information input by the user using the analysis means and sending it to the generation means, it is possible to automatically reflect the user's desired atmosphere and details of the food. Furthermore, by calculating the optimal route for transportation using the route calculation means, travel time to the destination can be minimized, and prompt service can be provided.

[0007] "Input means" refers to a device or interface that allows a user to order the food and atmosphere they desire.

[0008] The "location information acquisition means" is a system for acquiring information on the user's current location or a specified location.

[0009] "Automatic driving means" refers to a system for automatically moving to a specified destination.

[0010] "Transportation" means a device or vehicle that uses automated driving means to reach a designated location.

[0011] The "cooking means" is a device or robot that automatically cooks the food ordered by the user.

[0012] The "generation means" is a system for generating digital decorations and background music that match the atmosphere desired by the user.

[0013] The "providing means" is a device or interface for providing the cooked food to the user.

[0014] The "analysis means" is a system that analyzes the information input by the user and transmits it to the generation means.

[0015] The "route calculation means" is a system for calculating the optimum route to a specified destination. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention is a system that can provide the food and atmosphere desired by the user in real time and quickly arrive at the specified location.

[0038] 1. User operations

[0039] Using a dedicated application, the user inputs the food they want and the atmosphere they want. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." Once this input is complete, the user presses the "Confirm Order" button.

[0040] 2. Server Processing

[0041] The server receives and analyzes the user's input data. Using analytical methods, it generates recipes and digital decoration data for the user's desired cuisine and atmosphere. Generative AI is used to generate a specific recipe for tomato sauce pasta, as well as background music and images to recreate an Italian trattoria.

[0042] Furthermore, the server acquires the user's location information and calculates the optimal route. The route calculation means determines the optimal route for sending instructions to the automated driving system.

[0043] 3. Autonomous Driving and Transportation

[0044] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. This means of transportation quickly reaches the user's designated location based on the optimal route.

[0045] 4. Start cooking

[0046] When the AI ​​food stall arrives at its destination, the terminal begins cooking. The robotic arm picks up ingredients, simmers tomato sauce, and boils pasta. An Italian salad is also prepared as a side dish. The cooking device then prepares the food according to the user's order.

[0047] 5. Creating the atmosphere and serving the food

[0048] Once the cooking is complete, the device will set up digital decorations to match the user's chosen atmosphere, including background music and images displayed on the display. In this example, the device recreates the atmosphere of an Italian trattoria. Once the food is ready, the device will serve it to the user.

[0049] 6. Specific Examples

[0050] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates a recipe for the tomato sauce pasta and Italian salad, as well as Italian music and digital decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food cart to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once cooking is complete, the user is served their freshly cooked tomato sauce pasta and salad, enjoying the background music and digital decorations.

[0051] In this way, the present invention realizes a system that allows users to enjoy a fast, high-quality dining experience by being provided with the food and atmosphere they desire in real time.

[0052] The processing flow will be explained below.

[0053] Step 1:

[0054] The user launches a dedicated smartphone app and inputs the food and atmosphere they want. They select pasta with tomato sauce and an "Italian trattoria atmosphere" and confirm their order.

[0055] Step 2:

[0056] The server receives the user's input data. The information about the cuisine and atmosphere selected by the user is sent to the server.

[0057] Step 3:

[0058] The server uses an analytical tool to analyze the user's input data and inputs the data into the generation AI, which then generates a recipe and digital decoration data according to the user's wishes. For example, it generates a recipe for tomato sauce pasta and background music and image data to recreate the atmosphere of an Italian trattoria.

[0059] Step 4:

[0060] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the means of transportation. The optimal route is calculated and sent to the AI ​​stall.

[0061] Step 5:

[0062] The terminal (AI stall) activates the autonomous driving system and begins moving towards the location specified by the user based on the optimal route.

[0063] Step 6:

[0064] The terminal (AI food stall) arrives at its destination. The terminal's cooking function is activated, and the built-in robotic arm picks up ingredients and begins cooking them. Specifically, it simmers tomato sauce, boils pasta, and prepares salad.

[0065] Step 7:

[0066] The terminal (AI stall) uses a generation means to set digital decorations that match the user's desired atmosphere, including background music and images to be displayed on the screen.

[0067] Step 8:

[0068] The terminal (AI food stall) provides the food to the user through the serving means. After the cooking is completed, a notification is sent to the user, and the user receives the food.

[0069] Step 9:

[0070] Users receive freshly made tomato sauce pasta and salad from the AI ​​stall and enjoy the atmosphere of an Italian trattoria.

[0071] The above are the specific processing steps of the program according to the present invention, which allow the user to enjoy the food and atmosphere they desire in real time.

[0072] Example 1

[0073] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0074] In today's busy lifestyles, consumers want to enjoy high-quality meals at home or at a specific location. However, it is difficult to simultaneously provide specific cuisine and ambiance, and there is no system that can achieve this quickly and efficiently. Therefore, consumers need a way to provide cuisine and ambiance tailored to their preferences in real time.

[0075] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0076] In this invention, the server includes an input means for ordering a dish desired by a user, a location information acquisition means for acquiring location information of the user, a transportation means for moving to a specified location using an automatic driving means, a cooking means for cooking the dish ordered by the user, a generation means for generating digital decorations that match the user's desired atmosphere, a serving means for providing the ordered dish to the user, a recipe generation means for generating a recipe for the dish desired by the user using an analytical model, and a cooking and serving means, having at least one transportation means, for cooking and serving the specified dish at a specified location. This allows the user to enjoy a speedy and high-quality dining experience by being provided with the desired dish and atmosphere in real time.

[0077] The "input means" refers to a device or interface for inputting order information such as the food and atmosphere desired by the user.

[0078] "Location information acquisition means" refers to a system or technology for acquiring the user's current location, such as GPS or geolocation services.

[0079] "Transportation means" refers to a device or system that uses autonomous driving technology to travel to a designated location.

[0080] The "cooking means" refers to a mechanical device or cooking robot for cooking the food ordered by the user.

[0081] The "creation means" refers to a system or software for generating digital decorations that match the user's desired atmosphere.

[0082] The "providing means" is a device or system for providing cooked food to the user.

[0083] An "analysis model" is a statistical model or machine learning model that analyzes user order information and generates the necessary data.

[0084] "Recipe generation means" refers to a system or software for generating recipes for dishes desired by the user.

[0085] "Transportation" refers to a device, such as an autonomous vehicle or drone, that transports the specified food to the specified location.

[0086] The "cooking and serving means" refers to a complex system or device for cooking and serving a specified dish at a specified location.

[0087] The present invention provides a system that can provide the food and atmosphere desired by a user in real time and quickly arrive at a specified location. Specific embodiments of this system will be described in this specification.

[0088] User operations

[0089] The user uses a dedicated application to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and presses the "Confirm Order" button. This operation starts the system's processing.

[0090] Server Processing

[0091] The server receives the user's input data and analyzes it. Specifically, it performs the following processes:

[0092] The system analyzes user input data and generates recipes and digital decoration data for the desired cuisine and atmosphere. This analysis is performed using generative AI models. For example, OpenAI® models are used to generate a tomato sauce pasta recipe and background music and images to recreate an Italian trattoria.

[0093] The system obtains the user's location information and calculates the optimal route. This is done using a geolocation service (e.g., a map API). Based on the obtained location information, the system calculates the route the AI ​​food stall will take.

[0094] Autonomous driving and transportation

[0095] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and heads to the designated location. The autonomous driving system uses commonly used autonomous driving technology (e.g., autonomous vehicle systems). The terminal quickly moves to the user's designated location based on the optimal route.

[0096] Start cooking

[0097] When the terminal arrives at its destination, cooking begins. A robotic arm (such as an industrial robotic arm) picks up the ingredients, simmers the tomato sauce, and boils the pasta. An Italian salad is also prepared as a side dish. All of these cooking processes are automated.

[0098] Creating the atmosphere and serving the food

[0099] Once cooking is complete, the device will digitally decorate the food to match the user's specified ambiance, including background music and images displayed on the display, using the audio speaker and display. Once the food is ready, the device will serve it to the user.

[0100] Specific examples

[0101] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates recipes for the pasta with tomato sauce and Italian salad, as well as Italian music and digital decoration data. The server then uses a map API to calculate the optimal route and autonomously drives the AI ​​food cart to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once the dish is ready, it is served to the user, who can enjoy the background music and digital decorations.

[0102] Prompt Sentence Examples

[0103] "Based on the user's order, generate a tomato sauce pasta recipe and digital decoration data to recreate the atmosphere of an Italian trattoria."

[0104] In this way, the system allows users to enjoy a fast, high-quality dining experience by providing the food and atmosphere they desire in real time.

[0105] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0106] Step 1:

[0107] Using a dedicated application, the user inputs the food they want to eat and the atmosphere they desire. They enter the "food name" and "atmosphere name" in the input fields as input data and press the order confirmation button. For example, they input "pasta with tomato sauce" and "Italian trattoria atmosphere." This input data is sent to the server.

[0108] Step 2:

[0109] The server receives and analyzes input data sent by the user. Specifically, it generates digital decoration data for the recipe and atmosphere of the dish desired by the user. First, the input data is entered as a prompt into the generative AI model, requesting analysis. The generative AI model analyzes the data and outputs a "tomato sauce pasta recipe" and "background music and image data of an Italian trattoria."

[0110] Step 3:

[0111] The server obtains the user's current location. To obtain the location information, a location information acquisition means (e.g., GPS) is used. Based on the location information, a process to calculate the optimal route is initiated. A geolocation information service API is used for the calculation, and the destination route is generated. The output is "optimal route information."

[0112] Step 4:

[0113] The server sends the generated optimal route information to the AI ​​stall. The AI ​​stall activates its autonomous driving system based on the received route information. It then uses autonomous driving technology (for example, an autonomous vehicle system) to head to the specified location. The AI ​​stall's sensors monitor the surrounding environment in real time and move while checking for obstacles along the route.

[0114] Step 5:

[0115] After arriving at the destination, the terminal (AI food stall) sends an arrival notification to the user. Once the user confirms, the AI ​​food stall begins cooking. A robotic arm (e.g., an industrial robotic arm) performs specific cooking operations such as picking out ingredients, simmering tomato sauce, and boiling pasta. An Italian salad is also prepared as a side dish. Based on the user's input, the finished dish is output after going through the optimal cooking procedure.

[0116] Step 6:

[0117] After the cooking is complete, the terminal (AI food stall) sets digital decorations to match the atmosphere specified by the user. The generated background music and image data to be displayed on the display are input to a playback device (e.g., audio speakers and a display), which plays the music and displays the images. This provides the "atmosphere of an Italian trattoria" as the output. At the same time, the prepared food is served to the user.

[0118] This allows users to complete all steps and enjoy their desired food and atmosphere in real time.

[0119] (Application example 1)

[0120] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0121] Conventional food delivery services only deliver food, making it difficult to provide the specific atmosphere or experience desired by the user. This can result in users being unable to have a truly satisfying dining experience, leading to dissatisfaction. Furthermore, impersonal services make it difficult for users to enjoy the atmosphere of the place. Thus, there is a need for a method to provide not only food but also the desired atmosphere and experience.

[0122] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0123] In this invention, the server includes an analysis means for analyzing the user's input information and sending it to the generation means, a generation means for generating a food recipe and digital decoration data based on the input information using a generative AI model, and a route calculation means for calculating an optimal route, activating the autonomous driving system, and generating prompts to reach the specified location, thereby providing the user with the food and atmosphere they desire in real time, enabling them to enjoy a fast and high-quality dining experience.

[0124] A "user" is someone who uses the system to order food and ambiance.

[0125] "Input means" refers to a device or interface that allows a user to input the desired cuisine and atmosphere.

[0126] The "location information acquisition means" is a function or device that acquires the user's current location.

[0127] "Automatic driving means" refers to an automatic driving system for automatically moving to a designated location.

[0128] "Means of transportation" refers to mechanisms or devices for traveling to designated locations, including automated driving systems.

[0129] "Cooking means" refers to a device or system used to cook the food ordered by the user.

[0130] "Digital decoration" refers to digital content such as background music and images that match the user's desired atmosphere.

[0131] The "creation means" refers to a function or device for generating digital decorations that match the atmosphere desired by the user.

[0132] The "providing means" is a system or device for providing cooked food to the user.

[0133] The "analysis means" is a function or device that analyzes the information input by the user and transmits the data required by the generation means.

[0134] A "generative AI model" is an artificial intelligence system that generates cooking recipes and digital decoration data based on input information.

[0135] A "prompt sentence" is an instruction sentence that is input to a generative AI model to generate specific content.

[0136] A "route calculation means" is a function or device that calculates an optimal route and generates instructions for moving to a specified location using an automated driving system.

[0137] A "system" is a configuration that includes all the devices and functions necessary for a user to order food and ambiance and provide it.

[0138] This invention is a system that can provide the food and atmosphere desired by the user in real time and quickly rush to the specified location. Specific forms are shown below.

[0139] 1. User operation method

[0140] A user uses a smartphone app to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." Once this input is complete, the user presses the "Confirm Order" button. The application, acting as the input means, receives the user's selection and sends it to the server.

[0141] 2. How the server handles the process

[0142] The server first uses an analytical means to analyze the user's input data. Based on this analytical data, a generative AI model is used to generate the user's desired recipe and digital decoration data to recreate the ambiance. For example, a generative AI model such as GPT-4 (registered trademark) generates a recipe for pasta with tomato sauce, and a generative AI model such as DALL-E generates digital decorations and background music appropriate for the ambiance of an Italian trattoria.

[0143] 3. Autonomous Driving and Transportation

[0144] The server acquires the user's location information using a location information acquisition means. It then calculates the optimal route using a route calculation means and sends instructions to the autonomous driving system. Following these instructions, the AI ​​stall terminal begins moving to the user's specified location. The autonomous driving system includes hardware such as LiDAR, GPS, and NVIDIA DRIVE.

[0145] 4. Start cooking

[0146] When the AI ​​food stall arrives at the designated location, the cooking means, including the robotic arm, will begin cooking according to the generated recipe. Specifically, the robotic arm, such as KUKA or Fanuc, will pick up the ingredients and proceed with the cooking. It will simmer the tomato sauce, boil the pasta, and prepare an Italian salad as a side dish.

[0147] 5. Creating the atmosphere and serving the food

[0148] Once cooking is complete, the AI ​​food stall uses a generation means to digitally decorate the food in accordance with the specified atmosphere, including background music and images displayed on the display, to recreate, for example, the atmosphere of an Italian trattoria. The food is then served to the user by a serving means.

[0149] Specific example explanation

[0150] For example, if a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere," the user selects these options in the app and presses the order confirmation button. The server generates recipes for the tomato pasta and Italian salad, as well as Italian music and digital decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food cart to the user's location. Upon arrival, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once cooking is complete, the user is served freshly cooked pasta with tomato sauce and salad, enjoying the background music and digital decorations.

[0151] Prompt Sentence Examples

[0152] Example of a prompt to input to GPT-4 (recipe generation)

[0153] text

[0154] The user wants "pasta with tomato sauce." Generate a specific recipe for this dish.

[0155] Example of prompts to input to DALL-E (digital decoration generation)

[0156] text

[0157] A user wants an "Italian trattoria atmosphere." Generate background music and images to recreate this atmosphere.

[0158] In this way, each of these means works together to realize a system that provides the food and atmosphere desired by the user in real time. This system allows the user to enjoy the food and atmosphere desired in real time, resulting in a high-quality dining experience.

[0159] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0160] Step 1:

[0161] The user launches the smartphone app and inputs the desired dish (e.g., "pasta with tomato sauce") and desired atmosphere (e.g., "Italian trattoria atmosphere"). The application acts as an input means and sends the data to the server. The input in this step is the user's desired dish and atmosphere, and the output is the order data sent by the application to the server.

[0162] Step 2:

[0163] When the server receives the order data, it uses an analysis means to analyze the data. Specifically, it analyzes the details of the user's desired dishes and ambiance and extracts the necessary information. The input for this step is the order data, and the output is the analyzed information on dishes and ambiance.

[0164] Step 3:

[0165] The server uses a generative AI model to generate a recipe and digital decoration data based on the analyzed data. GPT-4 is used to generate a recipe for tomato sauce pasta, and DALL-E is used to generate digital decoration data that recreates the atmosphere of an Italian trattoria. The input of this step is the analyzed data, and the output is the generated recipe and digital decoration data.

[0166] Step 4:

[0167] The server acquires the user's location information using a location information acquisition means. Specifically, it identifies the user's current location using the GPS function. The input of this step is the user's location information request, and the output is the acquired location information.

[0168] Step 5:

[0169] The server uses a route calculation means to calculate the optimal route based on the acquired location information, generates a prompt message, and sends it to the autonomous driving system. Specifically, it calculates the optimal route by combining LiDAR and GPS data, and sends a movement command to the NVIDIA DRIVE system. The input to this step is the user's location information and a movement command to the autonomous driving system, and the output is the optimal route and a prompt message.

[0170] Step 6:

[0171] The terminal (AI stall) follows the optimal route instructions received from the server, begins autonomous driving, and moves to the user's specified location. The autonomous driving system uses LiDAR, GPS, and NVIDIA DRIVE. The input for this step is the optimal route instructions, and the output is for the AI ​​stall to start moving.

[0172] Step 7:

[0173] When the AI ​​food stall arrives at the designated location, the cooking means, including the robotic arm, begins cooking. Based on the generated recipe, the robotic arm, such as that from KUKA or Fanuc, picks up ingredients and proceeds with the cooking. Specifically, it simmers the tomato sauce and boils the pasta. The input for this step is the generated recipe, and the output is the cooked dish.

[0174] Step 8:

[0175] Once cooking is complete, the AI ​​food cart uses the generated digital decoration data to recreate the atmosphere of the designated location. Specifically, it displays an image of an Italian trattoria on the display and plays background music. The input of this step is the digital decoration data, and the output is the recreated atmosphere.

[0176] Step 9:

[0177] Finally, the cooked food is served to the user. The serving means hands the user freshly cooked pasta with tomato sauce and salad. The input of this step is the cooked food, and the output is the food served to the user.

[0178] The above steps realize a system that allows users to enjoy their desired food and atmosphere in real time.

[0179] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0180] This invention is a system that provides the user with the food and atmosphere they desire in real time, and further customizes the service based on the user's emotional recognition.

[0181] 1. User operations

[0182] Using a dedicated application, users input the food they want and the atmosphere they desire. For example, they select "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirm their order. In addition, emotion recognition means analyzes the user's facial expressions and voice to recognize their emotions, providing a more personalized experience.

[0183] 2. Server Processing

[0184] The server receives and analyzes the user's input data. Using the analysis means, it generates a recipe and digital decoration data for the user's desired dish and atmosphere. A generation AI is used, which generates a specific recipe for tomato sauce pasta and background music and image data to recreate an Italian trattoria. Furthermore, an emotion recognition means analyzes the user's emotion data and reflects it in the generated atmosphere data. For example, if the user is relaxed, it selects more upbeat music and digital decorations.

[0185] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the transportation means. The optimal route is calculated and sent to the AI ​​stall.

[0186] 3. Autonomous Driving and Transportation

[0187] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. This means of transportation quickly reaches the user's designated location based on the optimal route.

[0188] 4. Start cooking

[0189] When the AI ​​food stall arrives at its destination, the terminal begins cooking. The robotic arm picks ingredients, simmers tomato sauce, boils pasta, and prepares salad. The cooking means prepares the food according to the user's order.

[0190] 5. Creating the atmosphere and serving the food

[0191] Once cooking is complete, the device generates digital decorations that match the user's desired atmosphere, including background music and images to be displayed on the display. The generated digital decorations and music are optimized based on the user's emotions as determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set.

[0192] 6. Specific Examples

[0193] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates recipes for the pasta with tomato sauce and Italian salad, as well as Italian music and digital decoration data. Furthermore, an emotion recognition means detects the user's smile and selects cheerful music and decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food stall to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, cheerful music and digital decorations that reinforce the Italian trattoria atmosphere are set.

[0194] Once cooking is complete, the user is served freshly cooked tomato sauce pasta and salad, accompanied by background music and digital decorations. In this way, this invention allows users to enjoy a customized experience in real time based on their desired food, atmosphere, and even emotion.

[0195] The processing flow will be explained below.

[0196] Step 1:

[0197] The user launches a dedicated smartphone app and inputs the food and atmosphere they want to eat. For example, the user selects pasta with tomato sauce and an "Italian trattoria atmosphere" and confirms their order.

[0198] Step 2:

[0199] When the user sends the input data, the server receives it and analyzes the data related to the order content and the specified atmosphere using an analysis means.

[0200] Step 3:

[0201] The server uses generative AI to generate specific recipes and digital decoration data that match the user's desired dish (e.g., pasta with tomato sauce) and atmosphere (e.g., Italian trattoria), including background music and image data.

[0202] Step 4:

[0203] The user's facial expressions and voice data are sent to the server via the app. The server then uses emotion recognition to analyze the user's emotions. For example, if the user is smiling, it is determined that the user is feeling relaxed.

[0204] Step 5:

[0205] Based on the emotion recognition results, the server optimizes the digital decoration data it generates. For example, if the user is relaxed, upbeat music and images are selected.

[0206] Step 6:

[0207] The server acquires the user's current location using the location information acquisition means. Based on this, the route calculation means calculates the optimal route for sending instructions to the transportation means. The calculated optimal route is sent to the AI ​​stall.

[0208] Step 7:

[0209] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the location specified by the user based on the optimal route.

[0210] Step 8:

[0211] When the terminal (AI food stall) arrives at its destination, the cooking function is activated and the built-in robotic arm picks up ingredients and begins cooking them: simmering tomato sauce, boiling pasta, and preparing salad.

[0212] Step 9:

[0213] Once cooking is complete, the terminal (AI stall) uses a generating means to set digital decorations that match the user's desired atmosphere, such as background music and images to be displayed on the screen.

[0214] Step 10:

[0215] The terminal (AI food stall) serves the finished food to the user using the serving means, and notifies the user that the food is ready.

[0216] Step 11:

[0217] Users receive freshly cooked pasta and salad from the AI ​​food stall and enjoy emotionally-responsive digital decorations and background music. If the user smiles when receiving the food, upbeat music and images are displayed, providing a better experience.

[0218] These are the specific processing steps of the AI ​​food stall, which combines an emotion engine, allowing users to enjoy a customized experience based on their desired food, atmosphere, and emotions.

[0219] Example 2

[0220] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0221] Conventional food delivery systems can deliver the food a user desires, but it is difficult to customize the food to suit the user's desired atmosphere or real-time emotions. Furthermore, they lack the functionality to analyze the user's emotions and optimize the atmosphere, making it impossible to maximize user satisfaction. This issue needs to be resolved.

[0222] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an input means for ordering a dish desired by the user, a location information acquisition means for acquiring the user's location information, an analysis means for analyzing the user's emotion using an emotion recognition means, and an optimization means for optimizing the generated atmosphere data based on the user's emotion. This makes it possible to provide the user's desired dish and atmosphere in real time and further customize it according to the emotion.

[0223] Ok, I've created definitions for some important words below.

[0224] "Input means" refers to an interface that allows a user to input information about the cuisine and atmosphere they desire, and specifically refers to an application or web form.

[0225] "Location information acquisition means" refers to a device or system for acquiring the user's current location, and specifically refers to a GPS module or location information service API.

[0226] "Transportation" refers to systems or vehicles that use autonomous driving technology to travel to designated locations.

[0227] "Cooking means" refers to a device or system for automatically cooking the food ordered by the user, and specifically refers to a robotic arm or an automatic cooking system.

[0228] "Generation means" refers to a system for automatically generating digital decorations that match the atmosphere desired by the user.

[0229] "Emotion recognition means" refers to a device or system that analyzes a user's facial expressions and voice to identify their emotions.

[0230] "Analysis means" refers to a system for analyzing the user's input information and emotional data and generating the necessary instructions.

[0231] The "optimization means" refers to a system for adjusting the generated atmosphere data based on the user's emotions and providing an optimal atmosphere.

[0232] "Providing means" refers to a device or system for providing cooked food to a user.

[0233] The present invention is a system that provides a user with the food and atmosphere desired in real time, and further customizes the service based on the user's emotion recognition. The embodiments for carrying out the present invention will be described in detail below.

[0234] First, a user uses a dedicated application to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirms their order. At this time, the emotion recognition means analyzes the user's facial expressions and voice to recognize their emotions. This emotion data is collected using the smartphone's camera and microphone and analyzed by emotion recognition software such as Affectiva.

[0235] The server receives and analyzes the user's input data. Using a data analysis engine (e.g., Apache (registered trademark) Flink), it generates a recipe and digital decoration data for the user's desired dish and atmosphere. A GPT-4-based model is used as the generative AI, which generates a specific recipe for tomato sauce pasta, as well as background music and image data to recreate an Italian trattoria. The prompt text in this case is as follows:

[0236] The user wants "pasta with tomato sauce" and "an Italian trattoria atmosphere." Generate recipes, music, and image data accordingly. Additionally, because the user is smiling, select upbeat music and digital decoration data.

[0237] Furthermore, the server uses emotion recognition means to analyze the user's emotional data and reflect it in the generated atmosphere data. For example, if the user is relaxed, it selects more upbeat music and digital decorations. Next, it uses location services (e.g., Google® Maps API) to obtain the user's current location and calculates the optimal route. This optimal route data is sent to the AI ​​food stall.

[0238] The terminal (AI food stall) receives instructions from the server, activates its autonomous driving system (e.g., NVIDIA DRIVE), and begins moving toward its destination. Upon arrival, the terminal begins cooking. A robotic arm (e.g., Universal Robots) picks the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad. A cooking system (e.g., Moley Robotics) is used for this.

[0239] Once cooking is complete, the device generates digital decorations that match the user's desired atmosphere. Background music and images to be displayed on the display are set, and the generated digital decorations and music are optimized based on the user's emotions as determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set.

[0240] As a specific example, if a user orders "Pasta with tomato sauce" and "Italian trattoria atmosphere," when the user selects these in the app and presses the order confirmation button, the server performs the following process.

[0241] 1. Generate recipes for tomato pasta and Italian salad.

[0242] 2. Generate Italian music and digital decoration data.

[0243] 3. The emotion recognition means detects the user's smile and selects cheerful music and decorative data.

[0244] 4. The optimal route is calculated and the AI ​​stall automatically drives to the user's location.

[0245] 5. Upon arrival, the robotic arm simmers the tomato sauce, cooks the pasta, and prepares the salad.

[0246] 6. At the same time, upbeat music and digital decorations will be set to enhance the Italian trattoria atmosphere.

[0247] Once cooking is complete, the user is served freshly cooked tomato pasta and salad, accompanied by background music and digital decorations. In this way, this invention allows users to enjoy a customized experience in real time based on their desired food, atmosphere, and even emotion.

[0248] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0249] Step 1:

[0250] Using a dedicated application, users input the food they want to eat and the atmosphere they desire.

[0251] Input: Information about the user's desired cuisine and atmosphere (e.g., "pasta with tomato sauce" or "Italian trattoria atmosphere")

[0252] Output: The data package that contains the entered information and is saved in the application and sent to the server.

[0253] Specific behavior:

[0254] The user opens the app on their smartphone and taps "New Order."

[0255] On the food selection screen, select "Pasta with Tomato Sauce," and on the atmosphere selection screen, select "Italian Trattoria."

[0256] Press the order confirmation button and the input information will be saved in the application.

[0257] Step 2:

[0258] The user's device collects emotional data.

[0259] Input: User's facial expressions and voice data

[0260] Output: Parsed emotion data

[0261] Specific behavior:

[0262] The smartphone camera captures the user's facial expressions.

[0263] The smartphone's microphone captures the user's voice.

[0264] Emotion recognition software (e.g., Affectiva) analyzes facial expressions and voice to generate emotional data.

[0265] Step 3:

[0266] The server receives and analyzes the user's input data.

[0267] Input: User's desired food and atmosphere information, emotional data

[0268] Output: Recipe and digital decoration data

[0269] Specific behavior:

[0270] The data package sent from the application reaches the server.

[0271] A data analysis engine (e.g., Apache Flink) analyzes the input data and extracts the necessary information.

[0272] A generative AI model (e.g., GPT-4) generates recipes and digital decoration data based on the prompt.

[0273] Prompt: The user wants "pasta with tomato sauce" and "an Italian trattoria atmosphere." Generate recipes, music, and image data accordingly.

[0274] Step 4:

[0275] The server optimizes the atmosphere data based on the emotion data.

[0276] Input: Generated atmosphere data, emotion data

[0277] Output: Optimized atmosphere data

[0278] Specific behavior:

[0279] Emotional data (e.g., user is relaxed) is analyzed.

[0280] The generated digital decoration data and music data are optimized according to emotions (e.g., selecting upbeat music).

[0281] Step 5:

[0282] The server uses location services to obtain the user's current location and calculate the optimal route.

[0283] Input: User's current location data

[0284] Output: Optimal route data

[0285] Specific behavior:

[0286] A location information acquisition means (e.g., a GPS module) acquires the user's current location.

[0287] Location services (e.g. Google Maps API) calculate the optimal route and generate route data.

[0288] Step 6:

[0289] The terminal (AI stall) activates the autonomous driving system and begins moving to the destination.

[0290] Input: Optimal route data

[0291] Output: AI food stall movement status

[0292] Specific behavior:

[0293] Receive optimal route data sent from the server.

[0294] An autonomous driving system (e.g., NVIDIA DRIVE) navigates the AI ​​food cart along a route to its destination.

[0295] Step 7:

[0296] When the terminal (AI food stall) arrives at its destination, it begins cooking.

[0297] Input: User's order details (recipe data)

[0298] Output: Finished dish

[0299] Specific behavior:

[0300] A robotic arm (e.g., Universal Robots) removes the ingredients.

[0301] A cooking system (e.g., Moley Robotics) simmers tomato sauce, boils pasta, and prepares salads.

[0302] Step 8:

[0303] The terminal (AI stall) generates digital decorations that match the user's desired atmosphere.

[0304] Input: Optimized atmosphere data

[0305] Output: Set background music and digital decorations

[0306] Specific behavior:

[0307] Display a background image on a digital display.

[0308] Plays the specified music from the speaker.

[0309] Step 9:

[0310] The terminal (AI stall) serves the food once it has been cooked.

[0311] Input: Finished dish

[0312] Output: Available dishes

[0313] Specific behavior:

[0314] To serve freshly cooked tomato sauce pasta and salad, the tray is handed to the user.

[0315] This is the flow of the system program's processing. Through this process, the user can experience the food and atmosphere they desire in real time.

[0316] (Application example 2)

[0317] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0318] In the modern food service industry, providing the food and environment desired by the user in real time is a technically difficult challenge. In particular, recognizing the user's emotions in real time and customizing the service based on them has been difficult with conventional technologies. Furthermore, delivering food at the user's specified location using transportation combined with an autonomous driving system is an equally difficult problem.

[0319] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0320] In this invention, the server includes an analysis means for analyzing the user's input information and emotion recognition information and sending them to the generation means, an emotion recognition means for recognizing the user's emotion, and a generative AI model utilization means for generating cooking recipes and digital decoration data using the generative AI model, thereby making it possible to provide a customized experience in real time that matches the user's desired cuisine, atmosphere, and emotions.

[0321] "User" refers to a person who uses the system to order food or services.

[0322] "Input means" refers to a device that allows a user to input their desired cuisine and atmosphere into the system.

[0323] "Location information acquisition means" refers to a device or software for acquiring the user's current location in real time.

[0324] "Emotion recognition means" refers to technology that analyzes a user's facial expressions, voice, etc. to recognize the user's emotions.

[0325] An "autonomous driving system" refers to a control system that automatically moves a vehicle to a designated location.

[0326] "Transportation means" refers to a physical device that travels to a user-specified location using an automated driving system.

[0327] "Cooking means" refers to a device or equipment for automatically cooking the food ordered by the user.

[0328] "Generation means" refers to the technology or device for generating digital decorations that match the atmosphere desired by the user.

[0329] "Means for utilizing generative AI models" refers to technologies and systems for generating cooking recipes and digital decoration data using generative AI models.

[0330] "Providing means" refers to the technology and devices used to provide cooked food to users.

[0331] "Analysis means" refers to a technology or system that analyzes the user's input information and emotion recognition information and transmits it to the generation means.

[0332] "Route calculation means" refers to the technology or system that an autonomous driving system uses to calculate the optimal route.

[0333] This invention is a system that provides a user's desired cuisine and atmosphere in real time and further customizes the service based on the user's emotion recognition. The system includes a user input means, a location information acquisition means, an emotion recognition means, an autonomous driving system, a cooking means, a generation means, a generation AI model utilization means, and a provision means.

[0334] 1. User operations

[0335] A user uses a smartphone application to select the food they want to eat and the atmosphere they desire, and then confirms their order. For example, a user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirms their order. Furthermore, the emotion recognition means analyzes the user's facial expressions and voice to recognize the user's emotions in real time.

[0336] 2. Server Processing

[0337] The server receives the user's input data and emotion recognition data and analyzes them using the analysis means. The generative AI model utilization means generates a recipe and digital decoration data for the user's desired dish. This generative AI includes, for example, a specific recipe for tomato sauce pasta, as well as background music and image data for recreating an Italian trattoria. The emotion recognition means also analyzes the user's emotion data and reflects it in the generated atmosphere data. For example, if the user is relaxed, more upbeat music and digital decorations are selected.

[0338] 3. Autonomous Driving and Transportation

[0339] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the transportation means. The optimal route is calculated and sent to the automated driving system. The transportation means activates the automated driving system and starts moving toward the specified location.

[0340] 4. Start cooking

[0341] When the AI ​​food stall arrives at its destination, the cooking mechanism activates and prepares the food ordered by the user: the robotic arm retrieves the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad.

[0342] 5. Creating the atmosphere and serving the food

[0343] Once cooking is complete, the generation means generates digital decorations that match the user's desired atmosphere. Background music, images to be displayed on the display, etc. are set. The generated digital decorations and music are optimized based on the user's emotions determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set. The user is served freshly cooked food and can enjoy the background music and digital decorations.

[0344] Examples of concrete examples and prompts

[0345] As a concrete example, if the user selects "Pasta with tomato sauce" and "Italian trattoria atmosphere," the prompt text might be:

[0346] Recipe: Pasta with tomato sauce

[0347] Ambience: Italian Trattoria

[0348] Emotion: Relaxed

[0349] Based on this information, the server generates a specific recipe for tomato pasta and digital Italian-style decoration data. At the same time, it analyzes this information and sends instructions to the autonomous driving system, which calculates the optimal route and quickly travels to the user's designated location. Once it arrives, it can provide an experience optimized for the user's emotions.

[0350] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0351] Step 1:

[0352] A user uses a smartphone application to input the desired dish and atmosphere. At this time, the user confirms the order using an input means. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." The dish name and information about the atmosphere are sent to the server as input data.

[0353] Step 2:

[0354] The server recognizes the user's emotions using specialized emotion recognition means, which captures the user's facial expressions and voice using a camera and microphone, analyzes the data, and identifies the user's emotions (relaxed, stressed, happy, etc.). This information is also sent to the server.

[0355] Step 3:

[0356] The server analyzes the user's input data and emotion recognition data. The analysis means processes this data and generates digital decoration data related to the recipe and atmosphere of the dish through the generative AI model utilization means. For example, a specific recipe for "pasta with tomato sauce" and background music and image data to recreate an Italian trattoria are generated. This data is compiled in the server and transferred to the next step.

[0357] Step 4:

[0358] The server uses location information acquisition means to obtain the user's current location. This data is obtained from a GPS sensor, etc. The acquired location information is also sent to the server, and the user's current location is identified.

[0359] Step 5:

[0360] The server calculates the optimal route for sending instructions to the means of transportation. The server's route calculation means calculates the shortest and most optimal route based on the user's location information and destination. The calculated route information is sent to the autonomous driving system.

[0361] Step 6:

[0362] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. The vehicle follows the autonomous driving system and moves to the specified location. Data on traffic conditions and obstacles along the way is also collected in real time, and the route is optimized.

[0363] Step 7:

[0364] When the device arrives at its destination, the cooking unit activates and begins preparing the food ordered by the user. Specifically, the robotic arm retrieves the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad. Each step of the cooking process is pre-programmed, ensuring the food is prepared exactly as the user ordered.

[0365] Step 8:

[0366] Once cooking is complete, the generation means generates digital decorations that match the user's desired atmosphere, including background music and images displayed on the display. The server optimizes the generated digital decorations and music based on emotion recognition data. For example, if the user is feeling relaxed, more upbeat music and decorations are set.

[0367] Step 9:

[0368] The device will then deliver the cooked food to the user, allowing the user to enjoy the food and atmosphere they desire. The device will also provide background music and digital decorations, providing a comprehensive experience for the user.

[0369] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0370] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0371] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0372] [Second embodiment]

[0373] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0374] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0375] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0376] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0377] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0378] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0379] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0380] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0381] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0382] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0383] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0384] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0385] This invention is a system that can provide the food and atmosphere desired by the user in real time and quickly arrive at the specified location.

[0386] 1. User operations

[0387] Using a dedicated application, the user inputs the food they want and the atmosphere they want. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." Once this input is complete, the user presses the "Confirm Order" button.

[0388] 2. Server Processing

[0389] The server receives and analyzes the user's input data. Using analytical methods, it generates recipes and digital decoration data for the user's desired cuisine and atmosphere. Generative AI is used to generate a specific recipe for tomato sauce pasta, as well as background music and images to recreate an Italian trattoria.

[0390] Furthermore, the server acquires the user's location information and calculates the optimal route. The route calculation means determines the optimal route for sending instructions to the automated driving system.

[0391] 3. Autonomous Driving and Transportation

[0392] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. This means of transportation quickly reaches the user's designated location based on the optimal route.

[0393] 4. Start cooking

[0394] When the AI ​​food stall arrives at its destination, the terminal begins cooking. The robotic arm picks up ingredients, simmers tomato sauce, and boils pasta. An Italian salad is also prepared as a side dish. The cooking device then prepares the food according to the user's order.

[0395] 5. Creating the atmosphere and serving the food

[0396] Once the cooking is complete, the device will set up digital decorations to match the user's chosen atmosphere, including background music and images displayed on the display. In this example, the device recreates the atmosphere of an Italian trattoria. Once the food is ready, the device will serve it to the user.

[0397] 6. Specific Examples

[0398] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates a recipe for the tomato sauce pasta and Italian salad, as well as Italian music and digital decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food cart to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once cooking is complete, the user is served their freshly cooked tomato sauce pasta and salad, enjoying the background music and digital decorations.

[0399] In this way, the present invention realizes a system that allows users to enjoy a fast, high-quality dining experience by being provided with the food and atmosphere they desire in real time.

[0400] The processing flow will be explained below.

[0401] Step 1:

[0402] The user launches a dedicated smartphone app and inputs the food and atmosphere they want. They select pasta with tomato sauce and an "Italian trattoria atmosphere" and confirm their order.

[0403] Step 2:

[0404] The server receives the user's input data. The information about the cuisine and atmosphere selected by the user is sent to the server.

[0405] Step 3:

[0406] The server uses an analytical tool to analyze the user's input data and inputs the data into the generation AI, which then generates a recipe and digital decoration data according to the user's wishes. For example, it generates a recipe for tomato sauce pasta and background music and image data to recreate the atmosphere of an Italian trattoria.

[0407] Step 4:

[0408] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the means of transportation. The optimal route is calculated and sent to the AI ​​stall.

[0409] Step 5:

[0410] The terminal (AI stall) activates the autonomous driving system and begins moving towards the location specified by the user based on the optimal route.

[0411] Step 6:

[0412] The terminal (AI food stall) arrives at its destination. The terminal's cooking function is activated, and the built-in robotic arm picks up ingredients and begins cooking them. Specifically, it simmers tomato sauce, boils pasta, and prepares salad.

[0413] Step 7:

[0414] The terminal (AI stall) uses a generation means to set digital decorations that match the user's desired atmosphere, including background music and images to be displayed on the screen.

[0415] Step 8:

[0416] The terminal (AI food stall) provides the food to the user through the serving means. After the cooking is completed, a notification is sent to the user, and the user receives the food.

[0417] Step 9:

[0418] Users receive freshly made tomato sauce pasta and salad from the AI ​​stall and enjoy the atmosphere of an Italian trattoria.

[0419] The above are the specific processing steps of the program according to the present invention, which allow the user to enjoy the food and atmosphere they desire in real time.

[0420] Example 1

[0421] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0422] In today's busy lifestyles, consumers want to enjoy high-quality meals at home or at a specific location. However, it is difficult to simultaneously provide specific cuisine and ambiance, and there is no system that can achieve this quickly and efficiently. Therefore, consumers need a way to provide cuisine and ambiance tailored to their preferences in real time.

[0423] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0424] In this invention, the server includes an input means for ordering a dish desired by a user, a location information acquisition means for acquiring location information of the user, a transportation means for moving to a specified location using an automatic driving means, a cooking means for cooking the dish ordered by the user, a generation means for generating digital decorations that match the user's desired atmosphere, a serving means for providing the ordered dish to the user, a recipe generation means for generating a recipe for the dish desired by the user using an analytical model, and a cooking and serving means, having at least one transportation means, for cooking and serving the specified dish at a specified location. This allows the user to enjoy a speedy and high-quality dining experience by being provided with the desired dish and atmosphere in real time.

[0425] The "input means" refers to a device or interface for inputting order information such as the food and atmosphere desired by the user.

[0426] "Location information acquisition means" refers to a system or technology for acquiring the user's current location, such as GPS or geolocation services.

[0427] "Transportation means" refers to a device or system that uses autonomous driving technology to travel to a designated location.

[0428] The "cooking means" refers to a mechanical device or cooking robot for cooking the food ordered by the user.

[0429] The "creation means" refers to a system or software for generating digital decorations that match the user's desired atmosphere.

[0430] The "providing means" is a device or system for providing cooked food to the user.

[0431] An "analysis model" is a statistical model or machine learning model that analyzes user order information and generates the necessary data.

[0432] "Recipe generation means" refers to a system or software for generating recipes for dishes desired by the user.

[0433] "Transportation" refers to a device, such as an autonomous vehicle or drone, that transports the specified food to the specified location.

[0434] The "cooking and serving means" refers to a complex system or device for cooking and serving a specified dish at a specified location.

[0435] The present invention provides a system that can provide the food and atmosphere desired by a user in real time and quickly arrive at a specified location. Specific embodiments of this system will be described in this specification.

[0436] User operations

[0437] The user uses a dedicated application to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and presses the "Confirm Order" button. This operation starts the system's processing.

[0438] Server Processing

[0439] The server receives the user's input data and analyzes it. Specifically, it performs the following processes:

[0440] The system analyzes user input data and generates recipes and digital decoration data for the desired cuisine and atmosphere using generative AI models. For example, OpenAI's model can be used to generate a tomato sauce pasta recipe and background music and images to recreate an Italian trattoria.

[0441] The system obtains the user's location information and calculates the optimal route. This is done using a geolocation service (e.g., a map API). Based on the obtained location information, the system calculates the route the AI ​​food stall will take.

[0442] Autonomous driving and transportation

[0443] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and heads to the designated location. The autonomous driving system uses commonly used autonomous driving technology (e.g., autonomous vehicle systems). The terminal quickly moves to the user's designated location based on the optimal route.

[0444] Start cooking

[0445] When the terminal arrives at its destination, cooking begins. A robotic arm (such as an industrial robotic arm) picks up the ingredients, simmers the tomato sauce, and boils the pasta. An Italian salad is also prepared as a side dish. All of these cooking processes are automated.

[0446] Creating the atmosphere and serving the food

[0447] Once cooking is complete, the device will digitally decorate the food to match the user's specified ambiance, including background music and images displayed on the display, using the audio speaker and display. Once the food is ready, the device will serve it to the user.

[0448] Specific examples

[0449] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates recipes for the pasta with tomato sauce and Italian salad, as well as Italian music and digital decoration data. The server then uses a map API to calculate the optimal route and autonomously drives the AI ​​food cart to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once the dish is ready, it is served to the user, who can enjoy the background music and digital decorations.

[0450] Prompt Sentence Examples

[0451] "Based on the user's order, generate a tomato sauce pasta recipe and digital decoration data to recreate the atmosphere of an Italian trattoria."

[0452] In this way, the system allows users to enjoy a fast, high-quality dining experience by providing the food and atmosphere they desire in real time.

[0453] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0454] Step 1:

[0455] Using a dedicated application, the user inputs the food they want to eat and the atmosphere they desire. They enter the "food name" and "atmosphere name" in the input fields as input data and press the order confirmation button. For example, they input "pasta with tomato sauce" and "Italian trattoria atmosphere." This input data is sent to the server.

[0456] Step 2:

[0457] The server receives and analyzes input data sent by the user. Specifically, it generates digital decoration data for the recipe and atmosphere of the dish desired by the user. First, the input data is entered as a prompt into the generative AI model, requesting analysis. The generative AI model analyzes the data and outputs a "tomato sauce pasta recipe" and "background music and image data of an Italian trattoria."

[0458] Step 3:

[0459] The server obtains the user's current location. To obtain the location information, a location information acquisition means (e.g., GPS) is used. Based on the location information, a process to calculate the optimal route is initiated. A geolocation information service API is used for the calculation, and the destination route is generated. The output is "optimal route information."

[0460] Step 4:

[0461] The server sends the generated optimal route information to the AI ​​stall. The AI ​​stall activates its autonomous driving system based on the received route information. It then uses autonomous driving technology (for example, an autonomous vehicle system) to head to the specified location. The AI ​​stall's sensors monitor the surrounding environment in real time and move while checking for obstacles along the route.

[0462] Step 5:

[0463] After arriving at the destination, the terminal (AI food stall) sends an arrival notification to the user. Once the user confirms, the AI ​​food stall begins cooking. A robotic arm (e.g., an industrial robotic arm) performs specific cooking operations such as picking out ingredients, simmering tomato sauce, and boiling pasta. An Italian salad is also prepared as a side dish. Based on the user's input, the finished dish is output after going through the optimal cooking procedure.

[0464] Step 6:

[0465] After the cooking is complete, the terminal (AI food stall) sets digital decorations to match the atmosphere specified by the user. The generated background music and image data to be displayed on the display are input to a playback device (e.g., audio speakers and a display), which plays the music and displays the images. This provides the "atmosphere of an Italian trattoria" as the output. At the same time, the prepared food is served to the user.

[0466] This allows users to complete all steps and enjoy their desired food and atmosphere in real time.

[0467] (Application example 1)

[0468] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0469] Conventional food delivery services only deliver food, making it difficult to provide the specific atmosphere or experience desired by the user. This can result in users being unable to have a truly satisfying dining experience, leading to dissatisfaction. Furthermore, impersonal services make it difficult for users to enjoy the atmosphere of the place. Thus, there is a need for a method to provide not only food but also the desired atmosphere and experience.

[0470] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0471] In this invention, the server includes an analysis means for analyzing the user's input information and sending it to the generation means, a generation means for generating a food recipe and digital decoration data based on the input information using a generative AI model, and a route calculation means for calculating an optimal route, activating the autonomous driving system, and generating prompts to reach the specified location, thereby providing the user with the food and atmosphere they desire in real time, enabling them to enjoy a fast and high-quality dining experience.

[0472] A "user" is someone who uses the system to order food and ambiance.

[0473] "Input means" refers to a device or interface that allows a user to input the desired cuisine and atmosphere.

[0474] The "location information acquisition means" is a function or device that acquires the user's current location.

[0475] "Automatic driving means" refers to an automatic driving system for automatically moving to a designated location.

[0476] "Means of transportation" refers to mechanisms or devices for traveling to designated locations, including automated driving systems.

[0477] "Cooking means" refers to a device or system used to cook the food ordered by the user.

[0478] "Digital decoration" refers to digital content such as background music and images that match the user's desired atmosphere.

[0479] The "creation means" refers to a function or device for generating digital decorations that match the atmosphere desired by the user.

[0480] The "providing means" is a system or device for providing cooked food to the user.

[0481] The "analysis means" is a function or device that analyzes the information input by the user and transmits the data required by the generation means.

[0482] A "generative AI model" is an artificial intelligence system that generates cooking recipes and digital decoration data based on input information.

[0483] A "prompt sentence" is an instruction sentence that is input to a generative AI model to generate specific content.

[0484] A "route calculation means" is a function or device that calculates an optimal route and generates instructions for moving to a specified location using an automated driving system.

[0485] A "system" is a configuration that includes all the devices and functions necessary for a user to order food and ambiance and provide it.

[0486] This invention is a system that can provide the food and atmosphere desired by the user in real time and quickly rush to the specified location. Specific forms are shown below.

[0487] 1. User operation method

[0488] A user uses a smartphone app to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." Once this input is complete, the user presses the "Confirm Order" button. The application, acting as the input means, receives the user's selection and sends it to the server.

[0489] 2. How the server handles the process

[0490] The server first uses an analytical tool to analyze the user's input data. Based on this analytical data, a generative AI model is used to generate the user's desired recipe and digital decoration data to recreate the atmosphere. For example, a generative AI model such as GPT-4 generates a recipe for pasta with tomato sauce, while a generative AI model such as DALL-E generates digital decorations and background music suitable for the atmosphere of an Italian trattoria.

[0491] 3. Autonomous Driving and Transportation

[0492] The server acquires the user's location information using a location information acquisition means. It then calculates the optimal route using a route calculation means and sends instructions to the autonomous driving system. Following these instructions, the AI ​​stall terminal begins moving to the user's specified location. The autonomous driving system includes hardware such as LiDAR, GPS, and NVIDIA DRIVE.

[0493] 4. Start cooking

[0494] When the AI ​​food stall arrives at the designated location, the cooking means, including the robotic arm, will begin cooking according to the generated recipe. Specifically, the robotic arm, such as KUKA or Fanuc, will pick up the ingredients and proceed with the cooking. It will simmer the tomato sauce, boil the pasta, and prepare an Italian salad as a side dish.

[0495] 5. Creating the atmosphere and serving the food

[0496] Once cooking is complete, the AI ​​food stall uses a generation means to digitally decorate the food in accordance with the specified atmosphere, including background music and images displayed on the display, to recreate, for example, the atmosphere of an Italian trattoria. The food is then served to the user by a serving means.

[0497] Specific example explanation

[0498] For example, if a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere," the user selects these options in the app and presses the order confirmation button. The server generates recipes for the tomato pasta and Italian salad, as well as Italian music and digital decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food cart to the user's location. Upon arrival, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once cooking is complete, the user is served freshly cooked pasta with tomato sauce and salad, enjoying the background music and digital decorations.

[0499] Prompt Sentence Examples

[0500] Example of a prompt to input to GPT-4 (recipe generation)

[0501] text

[0502] The user wants "pasta with tomato sauce." Generate a specific recipe for this dish.

[0503] Example of prompts to input to DALL-E (digital decoration generation)

[0504] text

[0505] A user wants an "Italian trattoria atmosphere." Generate background music and images to recreate this atmosphere.

[0506] In this way, each of these means works together to realize a system that provides the food and atmosphere desired by the user in real time. This system allows the user to enjoy the food and atmosphere desired in real time, resulting in a high-quality dining experience.

[0507] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0508] Step 1:

[0509] The user launches the smartphone app and inputs the desired dish (e.g., "pasta with tomato sauce") and desired atmosphere (e.g., "Italian trattoria atmosphere"). The application acts as an input means and sends the data to the server. The input in this step is the user's desired dish and atmosphere, and the output is the order data sent by the application to the server.

[0510] Step 2:

[0511] When the server receives the order data, it uses an analysis means to analyze the data. Specifically, it analyzes the details of the user's desired dishes and ambiance and extracts the necessary information. The input for this step is the order data, and the output is the analyzed information on dishes and ambiance.

[0512] Step 3:

[0513] The server uses a generative AI model to generate a recipe and digital decoration data based on the analyzed data. GPT-4 is used to generate a recipe for tomato sauce pasta, and DALL-E is used to generate digital decoration data that recreates the atmosphere of an Italian trattoria. The input of this step is the analyzed data, and the output is the generated recipe and digital decoration data.

[0514] Step 4:

[0515] The server acquires the user's location information using a location information acquisition means. Specifically, it identifies the user's current location using the GPS function. The input of this step is the user's location information request, and the output is the acquired location information.

[0516] Step 5:

[0517] The server uses a route calculation means to calculate the optimal route based on the acquired location information, generates a prompt message, and sends it to the autonomous driving system. Specifically, it calculates the optimal route by combining LiDAR and GPS data, and sends a movement command to the NVIDIA DRIVE system. The input to this step is the user's location information and a movement command to the autonomous driving system, and the output is the optimal route and a prompt message.

[0518] Step 6:

[0519] The terminal (AI stall) follows the optimal route instructions received from the server, begins autonomous driving, and moves to the user's specified location. The autonomous driving system uses LiDAR, GPS, and NVIDIA DRIVE. The input for this step is the optimal route instructions, and the output is for the AI ​​stall to start moving.

[0520] Step 7:

[0521] When the AI ​​food stall arrives at the designated location, the cooking means, including the robotic arm, begins cooking. Based on the generated recipe, the robotic arm, such as that from KUKA or Fanuc, picks up ingredients and proceeds with the cooking. Specifically, it simmers the tomato sauce and boils the pasta. The input for this step is the generated recipe, and the output is the cooked dish.

[0522] Step 8:

[0523] Once cooking is complete, the AI ​​food cart uses the generated digital decoration data to recreate the atmosphere of the designated location. Specifically, it displays an image of an Italian trattoria on the display and plays background music. The input of this step is the digital decoration data, and the output is the recreated atmosphere.

[0524] Step 9:

[0525] Finally, the cooked food is served to the user. The serving means hands the user freshly cooked pasta with tomato sauce and salad. The input of this step is the cooked food, and the output is the food served to the user.

[0526] The above steps realize a system that allows users to enjoy their desired food and atmosphere in real time.

[0527] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0528] This invention is a system that provides the user with the food and atmosphere they desire in real time, and further customizes the service based on the user's emotional recognition.

[0529] 1. User operations

[0530] Using a dedicated application, users input the food they want and the atmosphere they desire. For example, they select "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirm their order. In addition, emotion recognition means analyzes the user's facial expressions and voice to recognize their emotions, providing a more personalized experience.

[0531] 2. Server Processing

[0532] The server receives and analyzes the user's input data. Using the analysis means, it generates a recipe and digital decoration data for the user's desired dish and atmosphere. A generation AI is used, which generates a specific recipe for tomato sauce pasta and background music and image data to recreate an Italian trattoria. Furthermore, an emotion recognition means analyzes the user's emotion data and reflects it in the generated atmosphere data. For example, if the user is relaxed, it selects more upbeat music and digital decorations.

[0533] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the transportation means. The optimal route is calculated and sent to the AI ​​stall.

[0534] 3. Autonomous Driving and Transportation

[0535] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. This means of transportation quickly reaches the user's designated location based on the optimal route.

[0536] 4. Start cooking

[0537] When the AI ​​food stall arrives at its destination, the terminal begins cooking. The robotic arm picks ingredients, simmers tomato sauce, boils pasta, and prepares salad. The cooking means prepares the food according to the user's order.

[0538] 5. Creating the atmosphere and serving the food

[0539] Once cooking is complete, the device generates digital decorations that match the user's desired atmosphere, including background music and images to be displayed on the display. The generated digital decorations and music are optimized based on the user's emotions as determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set.

[0540] 6. Specific Examples

[0541] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates recipes for the pasta with tomato sauce and Italian salad, as well as Italian music and digital decoration data. Furthermore, an emotion recognition means detects the user's smile and selects cheerful music and decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food stall to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, cheerful music and digital decorations that reinforce the Italian trattoria atmosphere are set.

[0542] Once cooking is complete, the user is served freshly cooked tomato sauce pasta and salad, accompanied by background music and digital decorations. In this way, this invention allows users to enjoy a customized experience in real time based on their desired food, atmosphere, and even emotion.

[0543] The processing flow will be explained below.

[0544] Step 1:

[0545] The user launches a dedicated smartphone app and inputs the food and atmosphere they want to eat. For example, the user selects pasta with tomato sauce and an "Italian trattoria atmosphere" and confirms their order.

[0546] Step 2:

[0547] When the user sends the input data, the server receives it and analyzes the data related to the order content and the specified atmosphere using an analysis means.

[0548] Step 3:

[0549] The server uses generative AI to generate specific recipes and digital decoration data that match the user's desired dish (e.g., pasta with tomato sauce) and atmosphere (e.g., Italian trattoria), including background music and image data.

[0550] Step 4:

[0551] The user's facial expressions and voice data are sent to the server via the app. The server then uses emotion recognition to analyze the user's emotions. For example, if the user is smiling, it is determined that the user is feeling relaxed.

[0552] Step 5:

[0553] Based on the emotion recognition results, the server optimizes the digital decoration data it generates. For example, if the user is relaxed, upbeat music and images are selected.

[0554] Step 6:

[0555] The server acquires the user's current location using the location information acquisition means. Based on this, the route calculation means calculates the optimal route for sending instructions to the transportation means. The calculated optimal route is sent to the AI ​​stall.

[0556] Step 7:

[0557] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the location specified by the user based on the optimal route.

[0558] Step 8:

[0559] When the terminal (AI food stall) arrives at its destination, the cooking function is activated and the built-in robotic arm picks up ingredients and begins cooking them: simmering tomato sauce, boiling pasta, and preparing salad.

[0560] Step 9:

[0561] Once cooking is complete, the terminal (AI stall) uses a generating means to set digital decorations that match the user's desired atmosphere, such as background music and images to be displayed on the screen.

[0562] Step 10:

[0563] The terminal (AI food stall) serves the finished food to the user using the serving means, and notifies the user that the food is ready.

[0564] Step 11:

[0565] Users receive freshly cooked pasta and salad from the AI ​​food stall and enjoy emotionally-responsive digital decorations and background music. If the user smiles when receiving the food, upbeat music and images are displayed, providing a better experience.

[0566] These are the specific processing steps of the AI ​​food stall, which combines an emotion engine, allowing users to enjoy a customized experience based on their desired food, atmosphere, and emotions.

[0567] Example 2

[0568] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0569] Conventional food delivery systems can deliver the food a user desires, but it is difficult to customize the food to suit the user's desired atmosphere or real-time emotions. Furthermore, they lack the functionality to analyze the user's emotions and optimize the atmosphere, making it impossible to maximize user satisfaction. This issue needs to be resolved.

[0570] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an input means for ordering a dish desired by the user, a location information acquisition means for acquiring the user's location information, an analysis means for analyzing the user's emotion using an emotion recognition means, and an optimization means for optimizing the generated atmosphere data based on the user's emotion. This makes it possible to provide the user's desired dish and atmosphere in real time and further customize it according to the emotion.

[0571] Ok, I've created definitions for some important words below.

[0572] "Input means" refers to an interface that allows a user to input information about the cuisine and atmosphere they desire, and specifically refers to an application or web form.

[0573] "Location information acquisition means" refers to a device or system for acquiring the user's current location, and specifically refers to a GPS module or location information service API.

[0574] "Transportation" refers to systems or vehicles that use autonomous driving technology to travel to designated locations.

[0575] "Cooking means" refers to a device or system for automatically cooking the food ordered by the user, and specifically refers to a robotic arm or an automatic cooking system.

[0576] "Generation means" refers to a system for automatically generating digital decorations that match the atmosphere desired by the user.

[0577] "Emotion recognition means" refers to a device or system that analyzes a user's facial expressions and voice to identify their emotions.

[0578] "Analysis means" refers to a system for analyzing the user's input information and emotional data and generating the necessary instructions.

[0579] The "optimization means" refers to a system for adjusting the generated atmosphere data based on the user's emotions and providing an optimal atmosphere.

[0580] "Providing means" refers to a device or system for providing cooked food to a user.

[0581] The present invention is a system that provides a user with the food and atmosphere desired in real time, and further customizes the service based on the user's emotion recognition. The embodiments for carrying out the present invention will be described in detail below.

[0582] First, a user uses a dedicated application to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirms their order. At this time, the emotion recognition means analyzes the user's facial expressions and voice to recognize their emotions. This emotion data is collected using the smartphone's camera and microphone and analyzed by emotion recognition software such as Affectiva.

[0583] The server receives and analyzes the user's input data. Using a data analysis engine (e.g., Apache Flink), it generates a recipe and digital decoration data for the user's desired cuisine and atmosphere. A GPT-4-based model is used as the generative AI, which generates a specific recipe for tomato sauce pasta, as well as background music and image data to recreate an Italian trattoria. The prompt text in this case is as follows:

[0584] The user wants "pasta with tomato sauce" and "an Italian trattoria atmosphere." Generate recipes, music, and image data accordingly. Additionally, because the user is smiling, select upbeat music and digital decoration data.

[0585] Furthermore, the server uses emotion recognition to analyze the user's emotional data and reflect it in the generated atmosphere data. For example, if the user is feeling relaxed, it selects more upbeat music and digital decorations. Next, it obtains the user's current location using a location service (e.g., Google Maps API) and calculates the optimal route. This optimal route data is sent to the AI ​​stall.

[0586] The terminal (AI food stall) receives instructions from the server, activates its autonomous driving system (e.g., NVIDIA DRIVE), and begins moving toward its destination. Upon arrival, the terminal begins cooking. A robotic arm (e.g., Universal Robots) picks the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad. A cooking system (e.g., Moley Robotics) is used for this.

[0587] Once cooking is complete, the device generates digital decorations that match the user's desired atmosphere. Background music and images to be displayed on the display are set, and the generated digital decorations and music are optimized based on the user's emotions as determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set.

[0588] As a specific example, if a user orders "Pasta with tomato sauce" and "Italian trattoria atmosphere," when the user selects these in the app and presses the order confirmation button, the server performs the following process.

[0589] 1. Generate recipes for tomato pasta and Italian salad.

[0590] 2. Generate Italian music and digital decoration data.

[0591] 3. The emotion recognition means detects the user's smile and selects cheerful music and decorative data.

[0592] 4. The optimal route is calculated and the AI ​​stall automatically drives to the user's location.

[0593] 5. Upon arrival, the robotic arm simmers the tomato sauce, cooks the pasta, and prepares the salad.

[0594] 6. At the same time, upbeat music and digital decorations will be set to enhance the Italian trattoria atmosphere.

[0595] Once cooking is complete, the user is served freshly cooked tomato pasta and salad, accompanied by background music and digital decorations. In this way, this invention allows users to enjoy a customized experience in real time based on their desired food, atmosphere, and even emotion.

[0596] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0597] Step 1:

[0598] Using a dedicated application, users input the food they want to eat and the atmosphere they desire.

[0599] Input: Information about the user's desired cuisine and atmosphere (e.g., "pasta with tomato sauce" or "Italian trattoria atmosphere")

[0600] Output: The data package that contains the entered information and is saved in the application and sent to the server.

[0601] Specific behavior:

[0602] The user opens the app on their smartphone and taps "New Order."

[0603] On the food selection screen, select "Pasta with Tomato Sauce," and on the atmosphere selection screen, select "Italian Trattoria."

[0604] Press the order confirmation button and the input information will be saved in the application.

[0605] Step 2:

[0606] The user's device collects emotional data.

[0607] Input: User's facial expressions and voice data

[0608] Output: Parsed emotion data

[0609] Specific behavior:

[0610] The smartphone camera captures the user's facial expressions.

[0611] The smartphone's microphone captures the user's voice.

[0612] Emotion recognition software (e.g., Affectiva) analyzes facial expressions and voice to generate emotional data.

[0613] Step 3:

[0614] The server receives and analyzes the user's input data.

[0615] Input: User's desired food and atmosphere information, emotional data

[0616] Output: Recipe and digital decoration data

[0617] Specific behavior:

[0618] The data package sent from the application reaches the server.

[0619] A data analysis engine (e.g., Apache Flink) analyzes the input data and extracts the necessary information.

[0620] A generative AI model (e.g., GPT-4) generates recipes and digital decoration data based on the prompt.

[0621] Prompt: The user wants "pasta with tomato sauce" and "an Italian trattoria atmosphere." Generate recipes, music, and image data accordingly.

[0622] Step 4:

[0623] The server optimizes the atmosphere data based on the emotion data.

[0624] Input: Generated atmosphere data, emotion data

[0625] Output: Optimized atmosphere data

[0626] Specific behavior:

[0627] Emotional data (e.g., user is relaxed) is analyzed.

[0628] The generated digital decoration data and music data are optimized according to emotions (e.g., selecting upbeat music).

[0629] Step 5:

[0630] The server uses location services to obtain the user's current location and calculate the optimal route.

[0631] Input: User's current location data

[0632] Output: Optimal route data

[0633] Specific behavior:

[0634] A location information acquisition means (e.g., a GPS module) acquires the user's current location.

[0635] Location services (e.g. Google Maps API) calculate the optimal route and generate route data.

[0636] Step 6:

[0637] The terminal (AI stall) activates the autonomous driving system and begins moving to the destination.

[0638] Input: Optimal route data

[0639] Output: AI food stall movement status

[0640] Specific behavior:

[0641] Receive optimal route data sent from the server.

[0642] An autonomous driving system (e.g., NVIDIA DRIVE) navigates the AI ​​food cart along a route to its destination.

[0643] Step 7:

[0644] When the terminal (AI food stall) arrives at its destination, it begins cooking.

[0645] Input: User's order details (recipe data)

[0646] Output: Finished dish

[0647] Specific behavior:

[0648] A robotic arm (e.g., Universal Robots) removes the ingredients.

[0649] A cooking system (e.g., Moley Robotics) simmers tomato sauce, boils pasta, and prepares salads.

[0650] Step 8:

[0651] The terminal (AI stall) generates digital decorations that match the user's desired atmosphere.

[0652] Input: Optimized atmosphere data

[0653] Output: Set background music and digital decorations

[0654] Specific behavior:

[0655] Display a background image on a digital display.

[0656] Plays the specified music from the speaker.

[0657] Step 9:

[0658] The terminal (AI stall) serves the food once it has been cooked.

[0659] Input: Finished dish

[0660] Output: Available dishes

[0661] Specific behavior:

[0662] To serve freshly cooked tomato sauce pasta and salad, the tray is handed to the user.

[0663] This is the flow of the system program's processing. Through this process, the user can experience the food and atmosphere they desire in real time.

[0664] (Application example 2)

[0665] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0666] In the modern food service industry, providing the food and environment desired by the user in real time is a technically difficult challenge. In particular, recognizing the user's emotions in real time and customizing the service based on them has been difficult with conventional technologies. Furthermore, delivering food at the user's specified location using transportation combined with an autonomous driving system is an equally difficult problem.

[0667] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0668] In this invention, the server includes an analysis means for analyzing the user's input information and emotion recognition information and sending them to the generation means, an emotion recognition means for recognizing the user's emotion, and a generative AI model utilization means for generating cooking recipes and digital decoration data using the generative AI model, thereby making it possible to provide a customized experience in real time that matches the user's desired cuisine, atmosphere, and emotions.

[0669] "User" refers to a person who uses the system to order food or services.

[0670] "Input means" refers to a device that allows a user to input their desired cuisine and atmosphere into the system.

[0671] "Location information acquisition means" refers to a device or software for acquiring the user's current location in real time.

[0672] "Emotion recognition means" refers to technology that analyzes a user's facial expressions, voice, etc. to recognize the user's emotions.

[0673] An "autonomous driving system" refers to a control system that automatically moves a vehicle to a designated location.

[0674] "Transportation means" refers to a physical device that travels to a user-specified location using an automated driving system.

[0675] "Cooking means" refers to a device or equipment for automatically cooking the food ordered by the user.

[0676] "Generation means" refers to the technology or device for generating digital decorations that match the atmosphere desired by the user.

[0677] "Means for utilizing generative AI models" refers to technologies and systems for generating cooking recipes and digital decoration data using generative AI models.

[0678] "Providing means" refers to the technology and devices used to provide cooked food to users.

[0679] "Analysis means" refers to a technology or system that analyzes the user's input information and emotion recognition information and transmits it to the generation means.

[0680] "Route calculation means" refers to the technology or system that an autonomous driving system uses to calculate the optimal route.

[0681] This invention is a system that provides a user's desired cuisine and atmosphere in real time and further customizes the service based on the user's emotion recognition. The system includes a user input means, a location information acquisition means, an emotion recognition means, an autonomous driving system, a cooking means, a generation means, a generation AI model utilization means, and a provision means.

[0682] 1. User operations

[0683] A user uses a smartphone application to select the food they want to eat and the atmosphere they desire, and then confirms their order. For example, a user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirms their order. Furthermore, the emotion recognition means analyzes the user's facial expressions and voice to recognize the user's emotions in real time.

[0684] 2. Server Processing

[0685] The server receives the user's input data and emotion recognition data and analyzes them using the analysis means. The generative AI model utilization means generates a recipe and digital decoration data for the user's desired dish. This generative AI includes, for example, a specific recipe for tomato sauce pasta, as well as background music and image data for recreating an Italian trattoria. The emotion recognition means also analyzes the user's emotion data and reflects it in the generated atmosphere data. For example, if the user is relaxed, more upbeat music and digital decorations are selected.

[0686] 3. Autonomous Driving and Transportation

[0687] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the transportation means. The optimal route is calculated and sent to the automated driving system. The transportation means activates the automated driving system and starts moving toward the specified location.

[0688] 4. Start cooking

[0689] When the AI ​​food stall arrives at its destination, the cooking mechanism activates and prepares the food ordered by the user: the robotic arm retrieves the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad.

[0690] 5. Creating the atmosphere and serving the food

[0691] Once cooking is complete, the generation means generates digital decorations that match the user's desired atmosphere. Background music, images to be displayed on the display, etc. are set. The generated digital decorations and music are optimized based on the user's emotions determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set. The user is served freshly cooked food and can enjoy the background music and digital decorations.

[0692] Examples of concrete examples and prompts

[0693] As a concrete example, if the user selects "Pasta with tomato sauce" and "Italian trattoria atmosphere," the prompt text might be:

[0694] Recipe: Pasta with tomato sauce

[0695] Ambience: Italian Trattoria

[0696] Emotion: Relaxed

[0697] Based on this information, the server generates a specific recipe for tomato pasta and digital Italian-style decoration data. At the same time, it analyzes this information and sends instructions to the autonomous driving system, which calculates the optimal route and quickly travels to the user's designated location. Once it arrives, it can provide an experience optimized for the user's emotions.

[0698] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0699] Step 1:

[0700] A user uses a smartphone application to input the desired dish and atmosphere. At this time, the user confirms the order using an input means. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." The dish name and information about the atmosphere are sent to the server as input data.

[0701] Step 2:

[0702] The server recognizes the user's emotions using specialized emotion recognition means, which captures the user's facial expressions and voice using a camera and microphone, analyzes the data, and identifies the user's emotions (relaxed, stressed, happy, etc.). This information is also sent to the server.

[0703] Step 3:

[0704] The server analyzes the user's input data and emotion recognition data. The analysis means processes this data and generates digital decoration data related to the recipe and atmosphere of the dish through the generative AI model utilization means. For example, a specific recipe for "pasta with tomato sauce" and background music and image data to recreate an Italian trattoria are generated. This data is compiled in the server and transferred to the next step.

[0705] Step 4:

[0706] The server uses location information acquisition means to obtain the user's current location. This data is obtained from a GPS sensor, etc. The acquired location information is also sent to the server, and the user's current location is identified.

[0707] Step 5:

[0708] The server calculates the optimal route for sending instructions to the means of transportation. The server's route calculation means calculates the shortest and most optimal route based on the user's location information and destination. The calculated route information is sent to the autonomous driving system.

[0709] Step 6:

[0710] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. The vehicle follows the autonomous driving system and moves to the specified location. Data on traffic conditions and obstacles along the way is also collected in real time, and the route is optimized.

[0711] Step 7:

[0712] When the device arrives at its destination, the cooking unit activates and begins preparing the food ordered by the user. Specifically, the robotic arm retrieves the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad. Each step of the cooking process is pre-programmed, ensuring the food is prepared exactly as the user ordered.

[0713] Step 8:

[0714] Once cooking is complete, the generation means generates digital decorations that match the user's desired atmosphere, including background music and images displayed on the display. The server optimizes the generated digital decorations and music based on emotion recognition data. For example, if the user is feeling relaxed, more upbeat music and decorations are set.

[0715] Step 9:

[0716] The device will then deliver the cooked food to the user, allowing the user to enjoy the food and atmosphere they desire. The device will also provide background music and digital decorations, providing a comprehensive experience for the user.

[0717] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0718] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0719] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0720] [Third embodiment]

[0721] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0722] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0723] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0724] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0725] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0726] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0727] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0728] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0729] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0730] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0731] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0732] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0733] This invention is a system that can provide the food and atmosphere desired by the user in real time and quickly arrive at the specified location.

[0734] 1. User operations

[0735] Using a dedicated application, the user inputs the food they want and the atmosphere they want. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." Once this input is complete, the user presses the "Confirm Order" button.

[0736] 2. Server Processing

[0737] The server receives and analyzes the user's input data. Using analytical methods, it generates recipes and digital decoration data for the user's desired cuisine and atmosphere. Generative AI is used to generate a specific recipe for tomato sauce pasta, as well as background music and images to recreate an Italian trattoria.

[0738] Furthermore, the server acquires the user's location information and calculates the optimal route. The route calculation means determines the optimal route for sending instructions to the automated driving system.

[0739] 3. Autonomous Driving and Transportation

[0740] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. This means of transportation quickly reaches the user's designated location based on the optimal route.

[0741] 4. Start cooking

[0742] When the AI ​​food stall arrives at its destination, the terminal begins cooking. The robotic arm picks up ingredients, simmers tomato sauce, and boils pasta. An Italian salad is also prepared as a side dish. The cooking device then prepares the food according to the user's order.

[0743] 5. Creating the atmosphere and serving the food

[0744] Once the cooking is complete, the device will set up digital decorations to match the user's chosen atmosphere, including background music and images displayed on the display. In this example, the device recreates the atmosphere of an Italian trattoria. Once the food is ready, the device will serve it to the user.

[0745] 6. Specific Examples

[0746] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates a recipe for the tomato sauce pasta and Italian salad, as well as Italian music and digital decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food cart to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once cooking is complete, the user is served their freshly cooked tomato sauce pasta and salad, enjoying the background music and digital decorations.

[0747] In this way, the present invention realizes a system that allows users to enjoy a fast, high-quality dining experience by being provided with the food and atmosphere they desire in real time.

[0748] The processing flow will be explained below.

[0749] Step 1:

[0750] The user launches a dedicated smartphone app and inputs the food and atmosphere they want. They select pasta with tomato sauce and an "Italian trattoria atmosphere" and confirm their order.

[0751] Step 2:

[0752] The server receives the user's input data. The information about the cuisine and atmosphere selected by the user is sent to the server.

[0753] Step 3:

[0754] The server uses an analytical tool to analyze the user's input data and inputs the data into the generation AI, which then generates a recipe and digital decoration data according to the user's wishes. For example, it generates a recipe for tomato sauce pasta and background music and image data to recreate the atmosphere of an Italian trattoria.

[0755] Step 4:

[0756] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the means of transportation. The optimal route is calculated and sent to the AI ​​stall.

[0757] Step 5:

[0758] The terminal (AI stall) activates the autonomous driving system and begins moving towards the location specified by the user based on the optimal route.

[0759] Step 6:

[0760] The terminal (AI food stall) arrives at its destination. The terminal's cooking function is activated, and the built-in robotic arm picks up ingredients and begins cooking them. Specifically, it simmers tomato sauce, boils pasta, and prepares salad.

[0761] Step 7:

[0762] The terminal (AI stall) uses a generation means to set digital decorations that match the user's desired atmosphere, including background music and images to be displayed on the screen.

[0763] Step 8:

[0764] The terminal (AI food stall) provides the food to the user through the serving means. After the cooking is completed, a notification is sent to the user, and the user receives the food.

[0765] Step 9:

[0766] Users receive freshly made tomato sauce pasta and salad from the AI ​​stall and enjoy the atmosphere of an Italian trattoria.

[0767] The above are the specific processing steps of the program according to the present invention, which allow the user to enjoy the food and atmosphere they desire in real time.

[0768] Example 1

[0769] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0770] In today's busy lifestyles, consumers want to enjoy high-quality meals at home or at a specific location. However, it is difficult to simultaneously provide specific cuisine and ambiance, and there is no system that can achieve this quickly and efficiently. Therefore, consumers need a way to provide cuisine and ambiance tailored to their preferences in real time.

[0771] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0772] In this invention, the server includes an input means for ordering a dish desired by a user, a location information acquisition means for acquiring location information of the user, a transportation means for moving to a specified location using an automatic driving means, a cooking means for cooking the dish ordered by the user, a generation means for generating digital decorations that match the user's desired atmosphere, a serving means for providing the ordered dish to the user, a recipe generation means for generating a recipe for the dish desired by the user using an analytical model, and a cooking and serving means, having at least one transportation means, for cooking and serving the specified dish at a specified location. This allows the user to enjoy a speedy and high-quality dining experience by being provided with the desired dish and atmosphere in real time.

[0773] The "input means" refers to a device or interface for inputting order information such as the food and atmosphere desired by the user.

[0774] "Location information acquisition means" refers to a system or technology for acquiring the user's current location, such as GPS or geolocation services.

[0775] "Transportation means" refers to a device or system that uses autonomous driving technology to travel to a designated location.

[0776] The "cooking means" refers to a mechanical device or cooking robot for cooking the food ordered by the user.

[0777] The "creation means" refers to a system or software for generating digital decorations that match the user's desired atmosphere.

[0778] The "providing means" is a device or system for providing cooked food to the user.

[0779] An "analysis model" is a statistical model or machine learning model that analyzes user order information and generates the necessary data.

[0780] "Recipe generation means" refers to a system or software for generating recipes for dishes desired by the user.

[0781] "Transportation" refers to a device, such as an autonomous vehicle or drone, that transports the specified food to the specified location.

[0782] The "cooking and serving means" refers to a complex system or device for cooking and serving a specified dish at a specified location.

[0783] The present invention provides a system that can provide the food and atmosphere desired by a user in real time and quickly arrive at a specified location. Specific embodiments of this system will be described in this specification.

[0784] User operations

[0785] The user uses a dedicated application to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and presses the "Confirm Order" button. This operation starts the system's processing.

[0786] Server Processing

[0787] The server receives the user's input data and analyzes it. Specifically, it performs the following processes:

[0788] The system analyzes user input data and generates recipes and digital decoration data for the desired cuisine and atmosphere using generative AI models. For example, OpenAI's model can be used to generate a tomato sauce pasta recipe and background music and images to recreate an Italian trattoria.

[0789] The system obtains the user's location information and calculates the optimal route. This is done using a geolocation service (e.g., a map API). Based on the obtained location information, the system calculates the route the AI ​​food stall will take.

[0790] Autonomous driving and transportation

[0791] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and heads to the designated location. The autonomous driving system uses commonly used autonomous driving technology (e.g., autonomous vehicle systems). The terminal quickly moves to the user's designated location based on the optimal route.

[0792] Start cooking

[0793] When the terminal arrives at its destination, cooking begins. A robotic arm (such as an industrial robotic arm) picks up the ingredients, simmers the tomato sauce, and boils the pasta. An Italian salad is also prepared as a side dish. All of these cooking processes are automated.

[0794] Creating the atmosphere and serving the food

[0795] Once cooking is complete, the device will digitally decorate the food to match the user's specified ambiance, including background music and images displayed on the display, using the audio speaker and display. Once the food is ready, the device will serve it to the user.

[0796] Specific examples

[0797] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates recipes for the pasta with tomato sauce and Italian salad, as well as Italian music and digital decoration data. The server then uses a map API to calculate the optimal route and autonomously drives the AI ​​food cart to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once the dish is ready, it is served to the user, who can enjoy the background music and digital decorations.

[0798] Prompt Sentence Examples

[0799] "Based on the user's order, generate a tomato sauce pasta recipe and digital decoration data to recreate the atmosphere of an Italian trattoria."

[0800] In this way, the system allows users to enjoy a fast, high-quality dining experience by providing the food and atmosphere they desire in real time.

[0801] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0802] Step 1:

[0803] Using a dedicated application, the user inputs the food they want to eat and the atmosphere they desire. They enter the "food name" and "atmosphere name" in the input fields as input data and press the order confirmation button. For example, they input "pasta with tomato sauce" and "Italian trattoria atmosphere." This input data is sent to the server.

[0804] Step 2:

[0805] The server receives and analyzes input data sent by the user. Specifically, it generates digital decoration data for the recipe and atmosphere of the dish desired by the user. First, the input data is entered as a prompt into the generative AI model, requesting analysis. The generative AI model analyzes the data and outputs a "tomato sauce pasta recipe" and "background music and image data of an Italian trattoria."

[0806] Step 3:

[0807] The server obtains the user's current location. To obtain the location information, a location information acquisition means (e.g., GPS) is used. Based on the location information, a process to calculate the optimal route is initiated. A geolocation information service API is used for the calculation, and the destination route is generated. The output is "optimal route information."

[0808] Step 4:

[0809] The server sends the generated optimal route information to the AI ​​stall. The AI ​​stall activates its autonomous driving system based on the received route information. It then uses autonomous driving technology (for example, an autonomous vehicle system) to head to the specified location. The AI ​​stall's sensors monitor the surrounding environment in real time and move while checking for obstacles along the route.

[0810] Step 5:

[0811] After arriving at the destination, the terminal (AI food stall) sends an arrival notification to the user. Once the user confirms, the AI ​​food stall begins cooking. A robotic arm (e.g., an industrial robotic arm) performs specific cooking operations such as picking out ingredients, simmering tomato sauce, and boiling pasta. An Italian salad is also prepared as a side dish. Based on the user's input, the finished dish is output after going through the optimal cooking procedure.

[0812] Step 6:

[0813] After the cooking is complete, the terminal (AI food stall) sets digital decorations to match the atmosphere specified by the user. The generated background music and image data to be displayed on the display are input to a playback device (e.g., audio speakers and a display), which plays the music and displays the images. This provides the "atmosphere of an Italian trattoria" as the output. At the same time, the prepared food is served to the user.

[0814] This allows users to complete all steps and enjoy their desired food and atmosphere in real time.

[0815] (Application example 1)

[0816] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0817] Conventional food delivery services only deliver food, making it difficult to provide the specific atmosphere or experience desired by the user. This can result in users being unable to have a truly satisfying dining experience, leading to dissatisfaction. Furthermore, impersonal services make it difficult for users to enjoy the atmosphere of the place. Thus, there is a need for a method to provide not only food but also the desired atmosphere and experience.

[0818] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0819] In this invention, the server includes an analysis means for analyzing the user's input information and sending it to the generation means, a generation means for generating a food recipe and digital decoration data based on the input information using a generative AI model, and a route calculation means for calculating an optimal route, activating the autonomous driving system, and generating prompts to reach the specified location, thereby providing the user with the food and atmosphere they desire in real time, enabling them to enjoy a fast and high-quality dining experience.

[0820] A "user" is someone who uses the system to order food and ambiance.

[0821] "Input means" refers to a device or interface that allows a user to input the desired cuisine and atmosphere.

[0822] The "location information acquisition means" is a function or device that acquires the user's current location.

[0823] "Automatic driving means" refers to an automatic driving system for automatically moving to a designated location.

[0824] "Means of transportation" refers to mechanisms or devices for traveling to designated locations, including automated driving systems.

[0825] "Cooking means" refers to a device or system used to cook the food ordered by the user.

[0826] "Digital decoration" refers to digital content such as background music and images that match the user's desired atmosphere.

[0827] The "creation means" refers to a function or device for generating digital decorations that match the atmosphere desired by the user.

[0828] The "providing means" is a system or device for providing cooked food to the user.

[0829] The "analysis means" is a function or device that analyzes the information input by the user and transmits the data required by the generation means.

[0830] A "generative AI model" is an artificial intelligence system that generates cooking recipes and digital decoration data based on input information.

[0831] A "prompt sentence" is an instruction sentence that is input to a generative AI model to generate specific content.

[0832] A "route calculation means" is a function or device that calculates an optimal route and generates instructions for moving to a specified location using an automated driving system.

[0833] A "system" is a configuration that includes all the devices and functions necessary for a user to order food and ambiance and provide it.

[0834] This invention is a system that can provide the food and atmosphere desired by the user in real time and quickly rush to the specified location. Specific forms are shown below.

[0835] 1. User operation method

[0836] A user uses a smartphone app to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." Once this input is complete, the user presses the "Confirm Order" button. The application, acting as the input means, receives the user's selection and sends it to the server.

[0837] 2. How the server handles the process

[0838] The server first uses an analytical tool to analyze the user's input data. Based on this analytical data, a generative AI model is used to generate the user's desired recipe and digital decoration data to recreate the atmosphere. For example, a generative AI model such as GPT-4 generates a recipe for pasta with tomato sauce, while a generative AI model such as DALL-E generates digital decorations and background music suitable for the atmosphere of an Italian trattoria.

[0839] 3. Autonomous Driving and Transportation

[0840] The server acquires the user's location information using a location information acquisition means. It then calculates the optimal route using a route calculation means and sends instructions to the autonomous driving system. Following these instructions, the AI ​​stall terminal begins moving to the user's specified location. The autonomous driving system includes hardware such as LiDAR, GPS, and NVIDIA DRIVE.

[0841] 4. Start cooking

[0842] When the AI ​​food stall arrives at the designated location, the cooking means, including the robotic arm, will begin cooking according to the generated recipe. Specifically, the robotic arm, such as KUKA or Fanuc, will pick up the ingredients and proceed with the cooking. It will simmer the tomato sauce, boil the pasta, and prepare an Italian salad as a side dish.

[0843] 5. Creating the atmosphere and serving the food

[0844] Once cooking is complete, the AI ​​food stall uses a generation means to digitally decorate the food in accordance with the specified atmosphere, including background music and images displayed on the display, to recreate, for example, the atmosphere of an Italian trattoria. The food is then served to the user by a serving means.

[0845] Specific example explanation

[0846] For example, if a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere," the user selects these options in the app and presses the order confirmation button. The server generates recipes for the tomato pasta and Italian salad, as well as Italian music and digital decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food cart to the user's location. Upon arrival, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once cooking is complete, the user is served freshly cooked pasta with tomato sauce and salad, enjoying the background music and digital decorations.

[0847] Prompt Sentence Examples

[0848] Example of a prompt to input to GPT-4 (recipe generation)

[0849] text

[0850] The user wants "pasta with tomato sauce." Generate a specific recipe for this dish.

[0851] Example of prompts to input to DALL-E (digital decoration generation)

[0852] text

[0853] A user wants an "Italian trattoria atmosphere." Generate background music and images to recreate this atmosphere.

[0854] In this way, each of these means works together to realize a system that provides the food and atmosphere desired by the user in real time. This system allows the user to enjoy the food and atmosphere desired in real time, resulting in a high-quality dining experience.

[0855] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0856] Step 1:

[0857] The user launches the smartphone app and inputs the desired dish (e.g., "pasta with tomato sauce") and desired atmosphere (e.g., "Italian trattoria atmosphere"). The application acts as an input means and sends the data to the server. The input in this step is the user's desired dish and atmosphere, and the output is the order data sent by the application to the server.

[0858] Step 2:

[0859] When the server receives the order data, it uses an analysis means to analyze the data. Specifically, it analyzes the details of the user's desired dishes and ambiance and extracts the necessary information. The input for this step is the order data, and the output is the analyzed information on dishes and ambiance.

[0860] Step 3:

[0861] The server uses a generative AI model to generate a recipe and digital decoration data based on the analyzed data. GPT-4 is used to generate a recipe for tomato sauce pasta, and DALL-E is used to generate digital decoration data that recreates the atmosphere of an Italian trattoria. The input of this step is the analyzed data, and the output is the generated recipe and digital decoration data.

[0862] Step 4:

[0863] The server acquires the user's location information using a location information acquisition means. Specifically, it identifies the user's current location using the GPS function. The input of this step is the user's location information request, and the output is the acquired location information.

[0864] Step 5:

[0865] The server uses a route calculation means to calculate the optimal route based on the acquired location information, generates a prompt message, and sends it to the autonomous driving system. Specifically, it calculates the optimal route by combining LiDAR and GPS data, and sends a movement command to the NVIDIA DRIVE system. The input to this step is the user's location information and a movement command to the autonomous driving system, and the output is the optimal route and a prompt message.

[0866] Step 6:

[0867] The terminal (AI stall) follows the optimal route instructions received from the server, begins autonomous driving, and moves to the user's specified location. The autonomous driving system uses LiDAR, GPS, and NVIDIA DRIVE. The input for this step is the optimal route instructions, and the output is for the AI ​​stall to start moving.

[0868] Step 7:

[0869] When the AI ​​food stall arrives at the designated location, the cooking means, including the robotic arm, begins cooking. Based on the generated recipe, the robotic arm, such as that from KUKA or Fanuc, picks up ingredients and proceeds with the cooking. Specifically, it simmers the tomato sauce and boils the pasta. The input for this step is the generated recipe, and the output is the cooked dish.

[0870] Step 8:

[0871] Once cooking is complete, the AI ​​food cart uses the generated digital decoration data to recreate the atmosphere of the designated location. Specifically, it displays an image of an Italian trattoria on the display and plays background music. The input of this step is the digital decoration data, and the output is the recreated atmosphere.

[0872] Step 9:

[0873] Finally, the cooked food is served to the user. The serving means hands the user freshly cooked pasta with tomato sauce and salad. The input of this step is the cooked food, and the output is the food served to the user.

[0874] The above steps realize a system that allows users to enjoy their desired food and atmosphere in real time.

[0875] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0876] This invention is a system that provides the user with the food and atmosphere they desire in real time, and further customizes the service based on the user's emotional recognition.

[0877] 1. User operations

[0878] Using a dedicated application, users input the food they want and the atmosphere they desire. For example, they select "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirm their order. In addition, emotion recognition means analyzes the user's facial expressions and voice to recognize their emotions, providing a more personalized experience.

[0879] 2. Server Processing

[0880] The server receives and analyzes the user's input data. Using the analysis means, it generates a recipe and digital decoration data for the user's desired dish and atmosphere. A generation AI is used, which generates a specific recipe for tomato sauce pasta and background music and image data to recreate an Italian trattoria. Furthermore, an emotion recognition means analyzes the user's emotion data and reflects it in the generated atmosphere data. For example, if the user is relaxed, it selects more upbeat music and digital decorations.

[0881] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the transportation means. The optimal route is calculated and sent to the AI ​​stall.

[0882] 3. Autonomous Driving and Transportation

[0883] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. This means of transportation quickly reaches the user's designated location based on the optimal route.

[0884] 4. Start cooking

[0885] When the AI ​​food stall arrives at its destination, the terminal begins cooking. The robotic arm picks ingredients, simmers tomato sauce, boils pasta, and prepares salad. The cooking means prepares the food according to the user's order.

[0886] 5. Creating the atmosphere and serving the food

[0887] Once cooking is complete, the device generates digital decorations that match the user's desired atmosphere, including background music and images to be displayed on the display. The generated digital decorations and music are optimized based on the user's emotions as determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set.

[0888] 6. Specific Examples

[0889] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates recipes for the pasta with tomato sauce and Italian salad, as well as Italian music and digital decoration data. Furthermore, an emotion recognition means detects the user's smile and selects cheerful music and decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food stall to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, cheerful music and digital decorations that reinforce the Italian trattoria atmosphere are set.

[0890] Once cooking is complete, the user is served freshly cooked tomato sauce pasta and salad, accompanied by background music and digital decorations. In this way, this invention allows users to enjoy a customized experience in real time based on their desired food, atmosphere, and even emotion.

[0891] The processing flow will be explained below.

[0892] Step 1:

[0893] The user launches a dedicated smartphone app and inputs the food and atmosphere they want to eat. For example, the user selects pasta with tomato sauce and an "Italian trattoria atmosphere" and confirms their order.

[0894] Step 2:

[0895] When the user sends the input data, the server receives it and analyzes the data related to the order content and the specified atmosphere using an analysis means.

[0896] Step 3:

[0897] The server uses generative AI to generate specific recipes and digital decoration data that match the user's desired dish (e.g., pasta with tomato sauce) and atmosphere (e.g., Italian trattoria), including background music and image data.

[0898] Step 4:

[0899] The user's facial expressions and voice data are sent to the server via the app. The server then uses emotion recognition to analyze the user's emotions. For example, if the user is smiling, it is determined that the user is feeling relaxed.

[0900] Step 5:

[0901] Based on the emotion recognition results, the server optimizes the digital decoration data it generates. For example, if the user is relaxed, upbeat music and images are selected.

[0902] Step 6:

[0903] The server acquires the user's current location using the location information acquisition means. Based on this, the route calculation means calculates the optimal route for sending instructions to the transportation means. The calculated optimal route is sent to the AI ​​stall.

[0904] Step 7:

[0905] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the location specified by the user based on the optimal route.

[0906] Step 8:

[0907] When the terminal (AI food stall) arrives at its destination, the cooking function is activated and the built-in robotic arm picks up ingredients and begins cooking them: simmering tomato sauce, boiling pasta, and preparing salad.

[0908] Step 9:

[0909] Once cooking is complete, the terminal (AI stall) uses a generating means to set digital decorations that match the user's desired atmosphere, such as background music and images to be displayed on the screen.

[0910] Step 10:

[0911] The terminal (AI food stall) serves the finished food to the user using the serving means, and notifies the user that the food is ready.

[0912] Step 11:

[0913] Users receive freshly cooked pasta and salad from the AI ​​food stall and enjoy emotionally-responsive digital decorations and background music. If the user smiles when receiving the food, upbeat music and images are displayed, providing a better experience.

[0914] These are the specific processing steps of the AI ​​food stall, which combines an emotion engine, allowing users to enjoy a customized experience based on their desired food, atmosphere, and emotions.

[0915] Example 2

[0916] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0917] Conventional food delivery systems can deliver the food a user desires, but it is difficult to customize the food to suit the user's desired atmosphere or real-time emotions. Furthermore, they lack the functionality to analyze the user's emotions and optimize the atmosphere, making it impossible to maximize user satisfaction. This issue needs to be resolved.

[0918] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an input means for ordering a dish desired by the user, a location information acquisition means for acquiring the user's location information, an analysis means for analyzing the user's emotion using an emotion recognition means, and an optimization means for optimizing the generated atmosphere data based on the user's emotion. This makes it possible to provide the user's desired dish and atmosphere in real time and further customize it according to the emotion.

[0919] Ok, I've created definitions for some important words below.

[0920] "Input means" refers to an interface that allows a user to input information about the cuisine and atmosphere they desire, and specifically refers to an application or web form.

[0921] "Location information acquisition means" refers to a device or system for acquiring the user's current location, and specifically refers to a GPS module or location information service API.

[0922] "Transportation" refers to systems or vehicles that use autonomous driving technology to travel to designated locations.

[0923] "Cooking means" refers to a device or system for automatically cooking the food ordered by the user, and specifically refers to a robotic arm or an automatic cooking system.

[0924] "Generation means" refers to a system for automatically generating digital decorations that match the atmosphere desired by the user.

[0925] "Emotion recognition means" refers to a device or system that analyzes a user's facial expressions and voice to identify their emotions.

[0926] "Analysis means" refers to a system for analyzing the user's input information and emotional data and generating the necessary instructions.

[0927] The "optimization means" refers to a system for adjusting the generated atmosphere data based on the user's emotions and providing an optimal atmosphere.

[0928] "Providing means" refers to a device or system for providing cooked food to a user.

[0929] The present invention is a system that provides a user with the food and atmosphere desired in real time, and further customizes the service based on the user's emotion recognition. The embodiments for carrying out the present invention will be described in detail below.

[0930] First, a user uses a dedicated application to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirms their order. At this time, the emotion recognition means analyzes the user's facial expressions and voice to recognize their emotions. This emotion data is collected using the smartphone's camera and microphone and analyzed by emotion recognition software such as Affectiva.

[0931] The server receives and analyzes the user's input data. Using a data analysis engine (e.g., Apache Flink), it generates a recipe and digital decoration data for the user's desired cuisine and atmosphere. A GPT-4-based model is used as the generative AI, which generates a specific recipe for tomato sauce pasta, as well as background music and image data to recreate an Italian trattoria. The prompt text in this case is as follows:

[0932] The user wants "pasta with tomato sauce" and "an Italian trattoria atmosphere." Generate recipes, music, and image data accordingly. Additionally, because the user is smiling, select upbeat music and digital decoration data.

[0933] Furthermore, the server uses emotion recognition to analyze the user's emotional data and reflect it in the generated atmosphere data. For example, if the user is feeling relaxed, it selects more upbeat music and digital decorations. Next, it obtains the user's current location using a location service (e.g., Google Maps API) and calculates the optimal route. This optimal route data is sent to the AI ​​stall.

[0934] The terminal (AI food stall) receives instructions from the server, activates its autonomous driving system (e.g., NVIDIA DRIVE), and begins moving toward its destination. Upon arrival, the terminal begins cooking. A robotic arm (e.g., Universal Robots) picks the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad. A cooking system (e.g., Moley Robotics) is used for this.

[0935] Once cooking is complete, the device generates digital decorations that match the user's desired atmosphere. Background music and images to be displayed on the display are set, and the generated digital decorations and music are optimized based on the user's emotions as determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set.

[0936] As a specific example, if a user orders "Pasta with tomato sauce" and "Italian trattoria atmosphere," when the user selects these in the app and presses the order confirmation button, the server performs the following process.

[0937] 1. Generate recipes for tomato pasta and Italian salad.

[0938] 2. Generate Italian music and digital decoration data.

[0939] 3. The emotion recognition means detects the user's smile and selects cheerful music and decorative data.

[0940] 4. The optimal route is calculated and the AI ​​stall automatically drives to the user's location.

[0941] 5. Upon arrival, the robotic arm simmers the tomato sauce, cooks the pasta, and prepares the salad.

[0942] 6. At the same time, upbeat music and digital decorations will be set to enhance the Italian trattoria atmosphere.

[0943] Once cooking is complete, the user is served freshly cooked tomato pasta and salad, accompanied by background music and digital decorations. In this way, this invention allows users to enjoy a customized experience in real time based on their desired food, atmosphere, and even emotion.

[0944] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0945] Step 1:

[0946] Using a dedicated application, users input the food they want to eat and the atmosphere they desire.

[0947] Input: Information about the user's desired cuisine and atmosphere (e.g., "pasta with tomato sauce" or "Italian trattoria atmosphere")

[0948] Output: The data package that contains the entered information and is saved in the application and sent to the server.

[0949] Specific behavior:

[0950] The user opens the app on their smartphone and taps "New Order."

[0951] On the food selection screen, select "Pasta with Tomato Sauce," and on the atmosphere selection screen, select "Italian Trattoria."

[0952] Press the order confirmation button and the input information will be saved in the application.

[0953] Step 2:

[0954] The user's device collects emotional data.

[0955] Input: User's facial expressions and voice data

[0956] Output: Parsed emotion data

[0957] Specific behavior:

[0958] The smartphone camera captures the user's facial expressions.

[0959] The smartphone's microphone captures the user's voice.

[0960] Emotion recognition software (e.g., Affectiva) analyzes facial expressions and voice to generate emotional data.

[0961] Step 3:

[0962] The server receives and analyzes the user's input data.

[0963] Input: User's desired food and atmosphere information, emotional data

[0964] Output: Recipe and digital decoration data

[0965] Specific behavior:

[0966] The data package sent from the application reaches the server.

[0967] A data analysis engine (e.g., Apache Flink) analyzes the input data and extracts the necessary information.

[0968] A generative AI model (e.g., GPT-4) generates recipes and digital decoration data based on the prompt.

[0969] Prompt: The user wants "pasta with tomato sauce" and "an Italian trattoria atmosphere." Generate recipes, music, and image data accordingly.

[0970] Step 4:

[0971] The server optimizes the atmosphere data based on the emotion data.

[0972] Input: Generated atmosphere data, emotion data

[0973] Output: Optimized atmosphere data

[0974] Specific behavior:

[0975] Emotional data (e.g., user is relaxed) is analyzed.

[0976] The generated digital decoration data and music data are optimized according to emotions (e.g., selecting upbeat music).

[0977] Step 5:

[0978] The server uses location services to obtain the user's current location and calculate the optimal route.

[0979] Input: User's current location data

[0980] Output: Optimal route data

[0981] Specific behavior:

[0982] A location information acquisition means (e.g., a GPS module) acquires the user's current location.

[0983] Location services (e.g. Google Maps API) calculate the optimal route and generate route data.

[0984] Step 6:

[0985] The terminal (AI stall) activates the autonomous driving system and begins moving to the destination.

[0986] Input: Optimal route data

[0987] Output: AI food stall movement status

[0988] Specific behavior:

[0989] Receive optimal route data sent from the server.

[0990] An autonomous driving system (e.g., NVIDIA DRIVE) navigates the AI ​​food cart along a route to its destination.

[0991] Step 7:

[0992] When the terminal (AI food stall) arrives at its destination, it begins cooking.

[0993] Input: User's order details (recipe data)

[0994] Output: Finished dish

[0995] Specific behavior:

[0996] A robotic arm (e.g., Universal Robots) removes the ingredients.

[0997] A cooking system (e.g., Moley Robotics) simmers tomato sauce, boils pasta, and prepares salads.

[0998] Step 8:

[0999] The terminal (AI stall) generates digital decorations that match the user's desired atmosphere.

[1000] Input: Optimized atmosphere data

[1001] Output: Set background music and digital decorations

[1002] Specific behavior:

[1003] Display a background image on a digital display.

[1004] Plays the specified music from the speaker.

[1005] Step 9:

[1006] The terminal (AI stall) serves the food once it has been cooked.

[1007] Input: Finished dish

[1008] Output: Available dishes

[1009] Specific behavior:

[1010] To serve freshly cooked tomato sauce pasta and salad, the tray is handed to the user.

[1011] This is the flow of the system program's processing. Through this process, the user can experience the food and atmosphere they desire in real time.

[1012] (Application example 2)

[1013] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1014] In the modern food service industry, providing the food and environment desired by the user in real time is a technically difficult challenge. In particular, recognizing the user's emotions in real time and customizing the service based on them has been difficult with conventional technologies. Furthermore, delivering food at the user's specified location using transportation combined with an autonomous driving system is an equally difficult problem.

[1015] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1016] In this invention, the server includes an analysis means for analyzing the user's input information and emotion recognition information and sending them to the generation means, an emotion recognition means for recognizing the user's emotion, and a generative AI model utilization means for generating cooking recipes and digital decoration data using the generative AI model, thereby making it possible to provide a customized experience in real time that matches the user's desired cuisine, atmosphere, and emotions.

[1017] "User" refers to a person who uses the system to order food or services.

[1018] "Input means" refers to a device that allows a user to input their desired cuisine and atmosphere into the system.

[1019] "Location information acquisition means" refers to a device or software for acquiring the user's current location in real time.

[1020] "Emotion recognition means" refers to technology that analyzes a user's facial expressions, voice, etc. to recognize the user's emotions.

[1021] An "autonomous driving system" refers to a control system that automatically moves a vehicle to a designated location.

[1022] "Transportation means" refers to a physical device that travels to a user-specified location using an automated driving system.

[1023] "Cooking means" refers to a device or equipment for automatically cooking the food ordered by the user.

[1024] "Generation means" refers to the technology or device for generating digital decorations that match the atmosphere desired by the user.

[1025] "Means for utilizing generative AI models" refers to technologies and systems for generating cooking recipes and digital decoration data using generative AI models.

[1026] "Providing means" refers to the technology and devices used to provide cooked food to users.

[1027] "Analysis means" refers to a technology or system that analyzes the user's input information and emotion recognition information and transmits it to the generation means.

[1028] "Route calculation means" refers to the technology or system that an autonomous driving system uses to calculate the optimal route.

[1029] This invention is a system that provides a user's desired cuisine and atmosphere in real time and further customizes the service based on the user's emotion recognition. The system includes a user input means, a location information acquisition means, an emotion recognition means, an autonomous driving system, a cooking means, a generation means, a generation AI model utilization means, and a provision means.

[1030] 1. User operations

[1031] A user uses a smartphone application to select the food they want to eat and the atmosphere they desire, and then confirms their order. For example, a user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirms their order. Furthermore, the emotion recognition means analyzes the user's facial expressions and voice to recognize the user's emotions in real time.

[1032] 2. Server Processing

[1033] The server receives the user's input data and emotion recognition data and analyzes them using the analysis means. The generative AI model utilization means generates a recipe and digital decoration data for the user's desired dish. This generative AI includes, for example, a specific recipe for tomato sauce pasta, as well as background music and image data for recreating an Italian trattoria. The emotion recognition means also analyzes the user's emotion data and reflects it in the generated atmosphere data. For example, if the user is relaxed, more upbeat music and digital decorations are selected.

[1034] 3. Autonomous Driving and Transportation

[1035] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the transportation means. The optimal route is calculated and sent to the automated driving system. The transportation means activates the automated driving system and starts moving toward the specified location.

[1036] 4. Start cooking

[1037] When the AI ​​food stall arrives at its destination, the cooking mechanism activates and prepares the food ordered by the user: the robotic arm retrieves the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad.

[1038] 5. Creating the atmosphere and serving the food

[1039] Once cooking is complete, the generation means generates digital decorations that match the user's desired atmosphere. Background music, images to be displayed on the display, etc. are set. The generated digital decorations and music are optimized based on the user's emotions determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set. The user is served freshly cooked food and can enjoy the background music and digital decorations.

[1040] Examples of concrete examples and prompts

[1041] As a concrete example, if the user selects "Pasta with tomato sauce" and "Italian trattoria atmosphere," the prompt text might be:

[1042] Recipe: Pasta with tomato sauce

[1043] Ambience: Italian Trattoria

[1044] Emotion: Relaxed

[1045] Based on this information, the server generates a specific recipe for tomato pasta and digital Italian-style decoration data. At the same time, it analyzes this information and sends instructions to the autonomous driving system, which calculates the optimal route and quickly travels to the user's designated location. Once it arrives, it can provide an experience optimized for the user's emotions.

[1046] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1047] Step 1:

[1048] A user uses a smartphone application to input the desired dish and atmosphere. At this time, the user confirms the order using an input means. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." The dish name and information about the atmosphere are sent to the server as input data.

[1049] Step 2:

[1050] The server recognizes the user's emotions using specialized emotion recognition means, which captures the user's facial expressions and voice using a camera and microphone, analyzes the data, and identifies the user's emotions (relaxed, stressed, happy, etc.). This information is also sent to the server.

[1051] Step 3:

[1052] The server analyzes the user's input data and emotion recognition data. The analysis means processes this data and generates digital decoration data related to the recipe and atmosphere of the dish through the generative AI model utilization means. For example, a specific recipe for "pasta with tomato sauce" and background music and image data to recreate an Italian trattoria are generated. This data is compiled in the server and transferred to the next step.

[1053] Step 4:

[1054] The server uses location information acquisition means to obtain the user's current location. This data is obtained from a GPS sensor, etc. The acquired location information is also sent to the server, and the user's current location is identified.

[1055] Step 5:

[1056] The server calculates the optimal route for sending instructions to the means of transportation. The server's route calculation means calculates the shortest and most optimal route based on the user's location information and destination. The calculated route information is sent to the autonomous driving system.

[1057] Step 6:

[1058] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. The vehicle follows the autonomous driving system and moves to the specified location. Data on traffic conditions and obstacles along the way is also collected in real time, and the route is optimized.

[1059] Step 7:

[1060] When the device arrives at its destination, the cooking unit activates and begins preparing the food ordered by the user. Specifically, the robotic arm retrieves the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad. Each step of the cooking process is pre-programmed, ensuring the food is prepared exactly as the user ordered.

[1061] Step 8:

[1062] Once cooking is complete, the generation means generates digital decorations that match the user's desired atmosphere, including background music and images displayed on the display. The server optimizes the generated digital decorations and music based on emotion recognition data. For example, if the user is feeling relaxed, more upbeat music and decorations are set.

[1063] Step 9:

[1064] The device will then deliver the cooked food to the user, allowing the user to enjoy the food and atmosphere they desire. The device will also provide background music and digital decorations, providing a comprehensive experience for the user.

[1065] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1066] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1067] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1068] [Fourth embodiment]

[1069] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1070] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1071] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1072] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1073] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1074] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1075] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1076] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1077] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1078] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1079] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1080] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1081] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1082] This invention is a system that can provide the food and atmosphere desired by the user in real time and quickly arrive at the specified location.

[1083] 1. User operations

[1084] Using a dedicated application, the user inputs the food they want and the atmosphere they want. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." Once this input is complete, the user presses the "Confirm Order" button.

[1085] 2. Server Processing

[1086] The server receives and analyzes the user's input data. Using analytical methods, it generates recipes and digital decoration data for the user's desired cuisine and atmosphere. Generative AI is used to generate a specific recipe for tomato sauce pasta, as well as background music and images to recreate an Italian trattoria.

[1087] Furthermore, the server acquires the user's location information and calculates the optimal route. The route calculation means determines the optimal route for sending instructions to the automated driving system.

[1088] 3. Autonomous Driving and Transportation

[1089] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. This means of transportation quickly reaches the user's designated location based on the optimal route.

[1090] 4. Start cooking

[1091] When the AI ​​food stall arrives at its destination, the terminal begins cooking. The robotic arm picks up ingredients, simmers tomato sauce, and boils pasta. An Italian salad is also prepared as a side dish. The cooking device then prepares the food according to the user's order.

[1092] 5. Creating the atmosphere and serving the food

[1093] Once the cooking is complete, the device will set up digital decorations to match the user's chosen atmosphere, including background music and images displayed on the display. In this example, the device recreates the atmosphere of an Italian trattoria. Once the food is ready, the device will serve it to the user.

[1094] 6. Specific Examples

[1095] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates a recipe for the tomato sauce pasta and Italian salad, as well as Italian music and digital decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food cart to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once cooking is complete, the user is served their freshly cooked tomato sauce pasta and salad, enjoying the background music and digital decorations.

[1096] In this way, the present invention realizes a system that allows users to enjoy a fast, high-quality dining experience by being provided with the food and atmosphere they desire in real time.

[1097] The processing flow will be explained below.

[1098] Step 1:

[1099] The user launches a dedicated smartphone app and inputs the food and atmosphere they want. They select pasta with tomato sauce and an "Italian trattoria atmosphere" and confirm their order.

[1100] Step 2:

[1101] The server receives the user's input data. The information about the cuisine and atmosphere selected by the user is sent to the server.

[1102] Step 3:

[1103] The server uses an analytical tool to analyze the user's input data and inputs the data into the generation AI, which then generates a recipe and digital decoration data according to the user's wishes. For example, it generates a recipe for tomato sauce pasta and background music and image data to recreate the atmosphere of an Italian trattoria.

[1104] Step 4:

[1105] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the means of transportation. The optimal route is calculated and sent to the AI ​​stall.

[1106] Step 5:

[1107] The terminal (AI stall) activates the autonomous driving system and begins moving towards the location specified by the user based on the optimal route.

[1108] Step 6:

[1109] The terminal (AI food stall) arrives at its destination. The terminal's cooking function is activated, and the built-in robotic arm picks up ingredients and begins cooking them. Specifically, it simmers tomato sauce, boils pasta, and prepares salad.

[1110] Step 7:

[1111] The terminal (AI stall) uses a generation means to set digital decorations that match the user's desired atmosphere, including background music and images to be displayed on the screen.

[1112] Step 8:

[1113] The terminal (AI food stall) provides the food to the user through the serving means. After the cooking is completed, a notification is sent to the user, and the user receives the food.

[1114] Step 9:

[1115] Users receive freshly made tomato sauce pasta and salad from the AI ​​stall and enjoy the atmosphere of an Italian trattoria.

[1116] The above are the specific processing steps of the program according to the present invention, which allow the user to enjoy the food and atmosphere they desire in real time.

[1117] Example 1

[1118] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1119] In today's busy lifestyles, consumers want to enjoy high-quality meals at home or at a specific location. However, it is difficult to simultaneously provide specific cuisine and ambiance, and there is no system that can achieve this quickly and efficiently. Therefore, consumers need a way to provide cuisine and ambiance tailored to their preferences in real time.

[1120] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1121] In this invention, the server includes an input means for ordering a dish desired by a user, a location information acquisition means for acquiring location information of the user, a transportation means for moving to a specified location using an automatic driving means, a cooking means for cooking the dish ordered by the user, a generation means for generating digital decorations that match the user's desired atmosphere, a serving means for providing the ordered dish to the user, a recipe generation means for generating a recipe for the dish desired by the user using an analytical model, and a cooking and serving means, having at least one transportation means, for cooking and serving the specified dish at a specified location. This allows the user to enjoy a speedy and high-quality dining experience by being provided with the desired dish and atmosphere in real time.

[1122] The "input means" refers to a device or interface for inputting order information such as the food and atmosphere desired by the user.

[1123] "Location information acquisition means" refers to a system or technology for acquiring the user's current location, such as GPS or geolocation services.

[1124] "Transportation means" refers to a device or system that uses autonomous driving technology to travel to a designated location.

[1125] The "cooking means" refers to a mechanical device or cooking robot for cooking the food ordered by the user.

[1126] The "creation means" refers to a system or software for generating digital decorations that match the user's desired atmosphere.

[1127] The "providing means" is a device or system for providing cooked food to the user.

[1128] An "analysis model" is a statistical model or machine learning model that analyzes user order information and generates the necessary data.

[1129] "Recipe generation means" refers to a system or software for generating recipes for dishes desired by the user.

[1130] "Transportation" refers to a device, such as an autonomous vehicle or drone, that transports the specified food to the specified location.

[1131] The "cooking and serving means" refers to a complex system or device for cooking and serving a specified dish at a specified location.

[1132] The present invention provides a system that can provide the food and atmosphere desired by a user in real time and quickly arrive at a specified location. Specific embodiments of this system will be described in this specification.

[1133] User operations

[1134] The user uses a dedicated application to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and presses the "Confirm Order" button. This operation starts the system's processing.

[1135] Server Processing

[1136] The server receives the user's input data and analyzes it. Specifically, it performs the following processes:

[1137] The system analyzes user input data and generates recipes and digital decoration data for the desired cuisine and atmosphere using generative AI models. For example, OpenAI's model can be used to generate a tomato sauce pasta recipe and background music and images to recreate an Italian trattoria.

[1138] The system obtains the user's location information and calculates the optimal route. This is done using a geolocation service (e.g., a map API). Based on the obtained location information, the system calculates the route the AI ​​food stall will take.

[1139] Autonomous driving and transportation

[1140] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and heads to the designated location. The autonomous driving system uses commonly used autonomous driving technology (e.g., autonomous vehicle systems). The terminal quickly moves to the user's designated location based on the optimal route.

[1141] Start cooking

[1142] When the terminal arrives at its destination, cooking begins. A robotic arm (such as an industrial robotic arm) picks up the ingredients, simmers the tomato sauce, and boils the pasta. An Italian salad is also prepared as a side dish. All of these cooking processes are automated.

[1143] Creating the atmosphere and serving the food

[1144] Once cooking is complete, the device will digitally decorate the food to match the user's specified ambiance, including background music and images displayed on the display, using the audio speaker and display. Once the food is ready, the device will serve it to the user.

[1145] Specific examples

[1146] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates recipes for the pasta with tomato sauce and Italian salad, as well as Italian music and digital decoration data. The server then uses a map API to calculate the optimal route and autonomously drives the AI ​​food cart to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once the dish is ready, it is served to the user, who can enjoy the background music and digital decorations.

[1147] Prompt Sentence Examples

[1148] "Based on the user's order, generate a tomato sauce pasta recipe and digital decoration data to recreate the atmosphere of an Italian trattoria."

[1149] In this way, the system allows users to enjoy a fast, high-quality dining experience by providing the food and atmosphere they desire in real time.

[1150] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1151] Step 1:

[1152] Using a dedicated application, the user inputs the food they want to eat and the atmosphere they desire. They enter the "food name" and "atmosphere name" in the input fields as input data and press the order confirmation button. For example, they input "pasta with tomato sauce" and "Italian trattoria atmosphere." This input data is sent to the server.

[1153] Step 2:

[1154] The server receives and analyzes input data sent by the user. Specifically, it generates digital decoration data for the recipe and atmosphere of the dish desired by the user. First, the input data is entered as a prompt into the generative AI model, requesting analysis. The generative AI model analyzes the data and outputs a "tomato sauce pasta recipe" and "background music and image data of an Italian trattoria."

[1155] Step 3:

[1156] The server obtains the user's current location. To obtain the location information, a location information acquisition means (e.g., GPS) is used. Based on the location information, a process to calculate the optimal route is initiated. A geolocation information service API is used for the calculation, and the destination route is generated. The output is "optimal route information."

[1157] Step 4:

[1158] The server sends the generated optimal route information to the AI ​​stall. The AI ​​stall activates its autonomous driving system based on the received route information. It then uses autonomous driving technology (for example, an autonomous vehicle system) to head to the specified location. The AI ​​stall's sensors monitor the surrounding environment in real time and move while checking for obstacles along the route.

[1159] Step 5:

[1160] After arriving at the destination, the terminal (AI food stall) sends an arrival notification to the user. Once the user confirms, the AI ​​food stall begins cooking. A robotic arm (e.g., an industrial robotic arm) performs specific cooking operations such as picking out ingredients, simmering tomato sauce, and boiling pasta. An Italian salad is also prepared as a side dish. Based on the user's input, the finished dish is output after going through the optimal cooking procedure.

[1161] Step 6:

[1162] After the cooking is complete, the terminal (AI food stall) sets digital decorations to match the atmosphere specified by the user. The generated background music and image data to be displayed on the display are input to a playback device (e.g., audio speakers and a display), which plays the music and displays the images. This provides the "atmosphere of an Italian trattoria" as the output. At the same time, the prepared food is served to the user.

[1163] This allows users to complete all steps and enjoy their desired food and atmosphere in real time.

[1164] (Application example 1)

[1165] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1166] Conventional food delivery services only deliver food, making it difficult to provide the specific atmosphere or experience desired by the user. This can result in users being unable to have a truly satisfying dining experience, leading to dissatisfaction. Furthermore, impersonal services make it difficult for users to enjoy the atmosphere of the place. Thus, there is a need for a method to provide not only food but also the desired atmosphere and experience.

[1167] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1168] In this invention, the server includes an analysis means for analyzing the user's input information and sending it to the generation means, a generation means for generating a food recipe and digital decoration data based on the input information using a generative AI model, and a route calculation means for calculating an optimal route, activating the autonomous driving system, and generating prompts to reach the specified location, thereby providing the user with the food and atmosphere they desire in real time, enabling them to enjoy a fast and high-quality dining experience.

[1169] A "user" is someone who uses the system to order food and ambiance.

[1170] "Input means" refers to a device or interface that allows a user to input the desired cuisine and atmosphere.

[1171] The "location information acquisition means" is a function or device that acquires the user's current location.

[1172] "Automatic driving means" refers to an automatic driving system for automatically moving to a designated location.

[1173] "Means of transportation" refers to mechanisms or devices for traveling to designated locations, including automated driving systems.

[1174] "Cooking means" refers to a device or system used to cook the food ordered by the user.

[1175] "Digital decoration" refers to digital content such as background music and images that match the user's desired atmosphere.

[1176] The "creation means" refers to a function or device for generating digital decorations that match the atmosphere desired by the user.

[1177] The "providing means" is a system or device for providing cooked food to the user.

[1178] The "analysis means" is a function or device that analyzes the information input by the user and transmits the data required by the generation means.

[1179] A "generative AI model" is an artificial intelligence system that generates cooking recipes and digital decoration data based on input information.

[1180] A "prompt sentence" is an instruction sentence that is input to a generative AI model to generate specific content.

[1181] A "route calculation means" is a function or device that calculates an optimal route and generates instructions for moving to a specified location using an automated driving system.

[1182] A "system" is a configuration that includes all the devices and functions necessary for a user to order food and ambiance and provide it.

[1183] This invention is a system that can provide the food and atmosphere desired by the user in real time and quickly rush to the specified location. Specific forms are shown below.

[1184] 1. User operation method

[1185] A user uses a smartphone app to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." Once this input is complete, the user presses the "Confirm Order" button. The application, acting as the input means, receives the user's selection and sends it to the server.

[1186] 2. How the server handles the process

[1187] The server first uses an analytical tool to analyze the user's input data. Based on this analytical data, a generative AI model is used to generate the user's desired recipe and digital decoration data to recreate the atmosphere. For example, a generative AI model such as GPT-4 generates a recipe for pasta with tomato sauce, while a generative AI model such as DALL-E generates digital decorations and background music suitable for the atmosphere of an Italian trattoria.

[1188] 3. Autonomous Driving and Transportation

[1189] The server acquires the user's location information using a location information acquisition means. It then calculates the optimal route using a route calculation means and sends instructions to the autonomous driving system. Following these instructions, the AI ​​stall terminal begins moving to the user's specified location. The autonomous driving system includes hardware such as LiDAR, GPS, and NVIDIA DRIVE.

[1190] 4. Start cooking

[1191] When the AI ​​food stall arrives at the designated location, the cooking means, including the robotic arm, will begin cooking according to the generated recipe. Specifically, the robotic arm, such as KUKA or Fanuc, will pick up the ingredients and proceed with the cooking. It will simmer the tomato sauce, boil the pasta, and prepare an Italian salad as a side dish.

[1192] 5. Creating the atmosphere and serving the food

[1193] Once cooking is complete, the AI ​​food stall uses a generation means to digitally decorate the food in accordance with the specified atmosphere, including background music and images displayed on the display, to recreate, for example, the atmosphere of an Italian trattoria. The food is then served to the user by a serving means.

[1194] Specific example explanation

[1195] For example, if a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere," the user selects these options in the app and presses the order confirmation button. The server generates recipes for the tomato pasta and Italian salad, as well as Italian music and digital decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food cart to the user's location. Upon arrival, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, digital decorations are set to match the atmosphere of an Italian trattoria. Once cooking is complete, the user is served freshly cooked pasta with tomato sauce and salad, enjoying the background music and digital decorations.

[1196] Prompt Sentence Examples

[1197] Example of a prompt to input to GPT-4 (recipe generation)

[1198] text

[1199] The user wants "pasta with tomato sauce." Generate a specific recipe for this dish.

[1200] Example of prompts to input to DALL-E (digital decoration generation)

[1201] text

[1202] A user wants an "Italian trattoria atmosphere." Generate background music and images to recreate this atmosphere.

[1203] In this way, each of these means works together to realize a system that provides the food and atmosphere desired by the user in real time. This system allows the user to enjoy the food and atmosphere desired in real time, resulting in a high-quality dining experience.

[1204] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1205] Step 1:

[1206] The user launches the smartphone app and inputs the desired dish (e.g., "pasta with tomato sauce") and desired atmosphere (e.g., "Italian trattoria atmosphere"). The application acts as an input means and sends the data to the server. The input in this step is the user's desired dish and atmosphere, and the output is the order data sent by the application to the server.

[1207] Step 2:

[1208] When the server receives the order data, it uses an analysis means to analyze the data. Specifically, it analyzes the details of the user's desired dishes and ambiance and extracts the necessary information. The input for this step is the order data, and the output is the analyzed information on dishes and ambiance.

[1209] Step 3:

[1210] The server uses a generative AI model to generate a recipe and digital decoration data based on the analyzed data. GPT-4 is used to generate a recipe for tomato sauce pasta, and DALL-E is used to generate digital decoration data that recreates the atmosphere of an Italian trattoria. The input of this step is the analyzed data, and the output is the generated recipe and digital decoration data.

[1211] Step 4:

[1212] The server acquires the user's location information using a location information acquisition means. Specifically, it identifies the user's current location using the GPS function. The input of this step is the user's location information request, and the output is the acquired location information.

[1213] Step 5:

[1214] The server uses a route calculation means to calculate the optimal route based on the acquired location information, generates a prompt message, and sends it to the autonomous driving system. Specifically, it calculates the optimal route by combining LiDAR and GPS data, and sends a movement command to the NVIDIA DRIVE system. The input to this step is the user's location information and a movement command to the autonomous driving system, and the output is the optimal route and a prompt message.

[1215] Step 6:

[1216] The terminal (AI stall) follows the optimal route instructions received from the server, begins autonomous driving, and moves to the user's specified location. The autonomous driving system uses LiDAR, GPS, and NVIDIA DRIVE. The input for this step is the optimal route instructions, and the output is for the AI ​​stall to start moving.

[1217] Step 7:

[1218] When the AI ​​food stall arrives at the designated location, the cooking means, including the robotic arm, begins cooking. Based on the generated recipe, the robotic arm, such as that from KUKA or Fanuc, picks up ingredients and proceeds with the cooking. Specifically, it simmers the tomato sauce and boils the pasta. The input for this step is the generated recipe, and the output is the cooked dish.

[1219] Step 8:

[1220] Once cooking is complete, the AI ​​food cart uses the generated digital decoration data to recreate the atmosphere of the designated location. Specifically, it displays an image of an Italian trattoria on the display and plays background music. The input of this step is the digital decoration data, and the output is the recreated atmosphere.

[1221] Step 9:

[1222] Finally, the cooked food is served to the user. The serving means hands the user freshly cooked pasta with tomato sauce and salad. The input of this step is the cooked food, and the output is the food served to the user.

[1223] The above steps realize a system that allows users to enjoy their desired food and atmosphere in real time.

[1224] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1225] This invention is a system that provides the user with the food and atmosphere they desire in real time, and further customizes the service based on the user's emotional recognition.

[1226] 1. User operations

[1227] Using a dedicated application, users input the food they want and the atmosphere they desire. For example, they select "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirm their order. In addition, emotion recognition means analyzes the user's facial expressions and voice to recognize their emotions, providing a more personalized experience.

[1228] 2. Server Processing

[1229] The server receives and analyzes the user's input data. Using the analysis means, it generates a recipe and digital decoration data for the user's desired dish and atmosphere. A generation AI is used, which generates a specific recipe for tomato sauce pasta and background music and image data to recreate an Italian trattoria. Furthermore, an emotion recognition means analyzes the user's emotion data and reflects it in the generated atmosphere data. For example, if the user is relaxed, it selects more upbeat music and digital decorations.

[1230] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the transportation means. The optimal route is calculated and sent to the AI ​​stall.

[1231] 3. Autonomous Driving and Transportation

[1232] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. This means of transportation quickly reaches the user's designated location based on the optimal route.

[1233] 4. Start cooking

[1234] When the AI ​​food stall arrives at its destination, the terminal begins cooking. The robotic arm picks ingredients, simmers tomato sauce, boils pasta, and prepares salad. The cooking means prepares the food according to the user's order.

[1235] 5. Creating the atmosphere and serving the food

[1236] Once cooking is complete, the device generates digital decorations that match the user's desired atmosphere, including background music and images to be displayed on the display. The generated digital decorations and music are optimized based on the user's emotions as determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set.

[1237] 6. Specific Examples

[1238] As a concrete example, consider the case where a user orders "pasta with tomato sauce" and "Italian trattoria atmosphere." When the user selects these options in the app and presses the order confirmation button, the server generates recipes for the pasta with tomato sauce and Italian salad, as well as Italian music and digital decoration data. Furthermore, an emotion recognition means detects the user's smile and selects cheerful music and decoration data. The server then calculates the optimal route and autonomously drives the AI ​​food stall to the user's location. After arriving, the robotic arm simmers the tomato sauce, boils the pasta, and prepares the salad. At the same time, cheerful music and digital decorations that reinforce the Italian trattoria atmosphere are set.

[1239] Once cooking is complete, the user is served freshly cooked tomato sauce pasta and salad, accompanied by background music and digital decorations. In this way, this invention allows users to enjoy a customized experience in real time based on their desired food, atmosphere, and even emotion.

[1240] The processing flow will be explained below.

[1241] Step 1:

[1242] The user launches a dedicated smartphone app and inputs the food and atmosphere they want to eat. For example, the user selects pasta with tomato sauce and an "Italian trattoria atmosphere" and confirms their order.

[1243] Step 2:

[1244] When the user sends the input data, the server receives it and analyzes the data related to the order content and the specified atmosphere using an analysis means.

[1245] Step 3:

[1246] The server uses generative AI to generate specific recipes and digital decoration data that match the user's desired dish (e.g., pasta with tomato sauce) and atmosphere (e.g., Italian trattoria), including background music and image data.

[1247] Step 4:

[1248] The user's facial expressions and voice data are sent to the server via the app. The server then uses emotion recognition to analyze the user's emotions. For example, if the user is smiling, it is determined that the user is feeling relaxed.

[1249] Step 5:

[1250] Based on the emotion recognition results, the server optimizes the digital decoration data it generates. For example, if the user is relaxed, upbeat music and images are selected.

[1251] Step 6:

[1252] The server acquires the user's current location using the location information acquisition means. Based on this, the route calculation means calculates the optimal route for sending instructions to the transportation means. The calculated optimal route is sent to the AI ​​stall.

[1253] Step 7:

[1254] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the location specified by the user based on the optimal route.

[1255] Step 8:

[1256] When the terminal (AI food stall) arrives at its destination, the cooking function is activated and the built-in robotic arm picks up ingredients and begins cooking them: simmering tomato sauce, boiling pasta, and preparing salad.

[1257] Step 9:

[1258] Once cooking is complete, the terminal (AI stall) uses a generating means to set digital decorations that match the user's desired atmosphere, such as background music and images to be displayed on the screen.

[1259] Step 10:

[1260] The terminal (AI food stall) serves the finished food to the user using the serving means, and notifies the user that the food is ready.

[1261] Step 11:

[1262] Users receive freshly cooked pasta and salad from the AI ​​food stall and enjoy emotionally-responsive digital decorations and background music. If the user smiles when receiving the food, upbeat music and images are displayed, providing a better experience.

[1263] These are the specific processing steps of the AI ​​food stall, which combines an emotion engine, allowing users to enjoy a customized experience based on their desired food, atmosphere, and emotions.

[1264] Example 2

[1265] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1266] Conventional food delivery systems can deliver the food a user desires, but it is difficult to customize the food to suit the user's desired atmosphere or real-time emotions. Furthermore, they lack the functionality to analyze the user's emotions and optimize the atmosphere, making it impossible to maximize user satisfaction. This issue needs to be resolved.

[1267] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an input means for ordering a dish desired by the user, a location information acquisition means for acquiring the user's location information, an analysis means for analyzing the user's emotion using an emotion recognition means, and an optimization means for optimizing the generated atmosphere data based on the user's emotion. This makes it possible to provide the user's desired dish and atmosphere in real time and further customize it according to the emotion.

[1268] Ok, I've created definitions for some important words below.

[1269] "Input means" refers to an interface that allows a user to input information about the cuisine and atmosphere they desire, and specifically refers to an application or web form.

[1270] "Location information acquisition means" refers to a device or system for acquiring the user's current location, and specifically refers to a GPS module or location information service API.

[1271] "Transportation" refers to systems or vehicles that use autonomous driving technology to travel to designated locations.

[1272] "Cooking means" refers to a device or system for automatically cooking the food ordered by the user, and specifically refers to a robotic arm or an automatic cooking system.

[1273] "Generation means" refers to a system for automatically generating digital decorations that match the atmosphere desired by the user.

[1274] "Emotion recognition means" refers to a device or system that analyzes a user's facial expressions and voice to identify their emotions.

[1275] "Analysis means" refers to a system for analyzing the user's input information and emotional data and generating the necessary instructions.

[1276] The "optimization means" refers to a system for adjusting the generated atmosphere data based on the user's emotions and providing an optimal atmosphere.

[1277] "Providing means" refers to a device or system for providing cooked food to a user.

[1278] The present invention is a system that provides a user with the food and atmosphere desired in real time, and further customizes the service based on the user's emotion recognition. The embodiments for carrying out the present invention will be described in detail below.

[1279] First, a user uses a dedicated application to input the food they want to eat and the atmosphere they desire. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirms their order. At this time, the emotion recognition means analyzes the user's facial expressions and voice to recognize their emotions. This emotion data is collected using the smartphone's camera and microphone and analyzed by emotion recognition software such as Affectiva.

[1280] The server receives and analyzes the user's input data. Using a data analysis engine (e.g., Apache Flink), it generates a recipe and digital decoration data for the user's desired cuisine and atmosphere. A GPT-4-based model is used as the generative AI, which generates a specific recipe for tomato sauce pasta, as well as background music and image data to recreate an Italian trattoria. The prompt text in this case is as follows:

[1281] The user wants "pasta with tomato sauce" and "an Italian trattoria atmosphere." Generate recipes, music, and image data accordingly. Additionally, because the user is smiling, select upbeat music and digital decoration data.

[1282] Furthermore, the server uses emotion recognition to analyze the user's emotional data and reflect it in the generated atmosphere data. For example, if the user is feeling relaxed, it selects more upbeat music and digital decorations. Next, it obtains the user's current location using a location service (e.g., Google Maps API) and calculates the optimal route. This optimal route data is sent to the AI ​​stall.

[1283] The terminal (AI food stall) receives instructions from the server, activates its autonomous driving system (e.g., NVIDIA DRIVE), and begins moving toward its destination. Upon arrival, the terminal begins cooking. A robotic arm (e.g., Universal Robots) picks the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad. A cooking system (e.g., Moley Robotics) is used for this.

[1284] Once cooking is complete, the device generates digital decorations that match the user's desired atmosphere. Background music and images to be displayed on the display are set, and the generated digital decorations and music are optimized based on the user's emotions as determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set.

[1285] As a specific example, if a user orders "Pasta with tomato sauce" and "Italian trattoria atmosphere," when the user selects these in the app and presses the order confirmation button, the server performs the following process.

[1286] 1. Generate recipes for tomato pasta and Italian salad.

[1287] 2. Generate Italian music and digital decoration data.

[1288] 3. The emotion recognition means detects the user's smile and selects cheerful music and decorative data.

[1289] 4. The optimal route is calculated and the AI ​​stall automatically drives to the user's location.

[1290] 5. Upon arrival, the robotic arm simmers the tomato sauce, cooks the pasta, and prepares the salad.

[1291] 6. At the same time, upbeat music and digital decorations will be set to enhance the Italian trattoria atmosphere.

[1292] Once cooking is complete, the user is served freshly cooked tomato pasta and salad, accompanied by background music and digital decorations. In this way, this invention allows users to enjoy a customized experience in real time based on their desired food, atmosphere, and even emotion.

[1293] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1294] Step 1:

[1295] Using a dedicated application, users input the food they want to eat and the atmosphere they desire.

[1296] Input: Information about the user's desired cuisine and atmosphere (e.g., "pasta with tomato sauce" or "Italian trattoria atmosphere")

[1297] Output: The data package that contains the entered information and is saved in the application and sent to the server.

[1298] Specific behavior:

[1299] The user opens the app on their smartphone and taps "New Order."

[1300] On the food selection screen, select "Pasta with Tomato Sauce," and on the atmosphere selection screen, select "Italian Trattoria."

[1301] Press the order confirmation button and the input information will be saved in the application.

[1302] Step 2:

[1303] The user's device collects emotional data.

[1304] Input: User's facial expressions and voice data

[1305] Output: Parsed emotion data

[1306] Specific behavior:

[1307] The smartphone camera captures the user's facial expressions.

[1308] The smartphone's microphone captures the user's voice.

[1309] Emotion recognition software (e.g., Affectiva) analyzes facial expressions and voice to generate emotional data.

[1310] Step 3:

[1311] The server receives and analyzes the user's input data.

[1312] Input: User's desired food and atmosphere information, emotional data

[1313] Output: Recipe and digital decoration data

[1314] Specific behavior:

[1315] The data package sent from the application reaches the server.

[1316] A data analysis engine (e.g., Apache Flink) analyzes the input data and extracts the necessary information.

[1317] A generative AI model (e.g., GPT-4) generates recipes and digital decoration data based on the prompt.

[1318] Prompt: The user wants "pasta with tomato sauce" and "an Italian trattoria atmosphere." Generate recipes, music, and image data accordingly.

[1319] Step 4:

[1320] The server optimizes the atmosphere data based on the emotion data.

[1321] Input: Generated atmosphere data, emotion data

[1322] Output: Optimized atmosphere data

[1323] Specific behavior:

[1324] Emotional data (e.g., user is relaxed) is analyzed.

[1325] The generated digital decoration data and music data are optimized according to emotions (e.g., selecting upbeat music).

[1326] Step 5:

[1327] The server uses location services to obtain the user's current location and calculate the optimal route.

[1328] Input: User's current location data

[1329] Output: Optimal route data

[1330] Specific behavior:

[1331] A location information acquisition means (e.g., a GPS module) acquires the user's current location.

[1332] Location services (e.g. Google Maps API) calculate the optimal route and generate route data.

[1333] Step 6:

[1334] The terminal (AI stall) activates the autonomous driving system and begins moving to the destination.

[1335] Input: Optimal route data

[1336] Output: AI food stall movement status

[1337] Specific behavior:

[1338] Receive optimal route data sent from the server.

[1339] An autonomous driving system (e.g., NVIDIA DRIVE) navigates the AI ​​food cart along a route to its destination.

[1340] Step 7:

[1341] When the terminal (AI food stall) arrives at its destination, it begins cooking.

[1342] Input: User's order details (recipe data)

[1343] Output: Finished dish

[1344] Specific behavior:

[1345] A robotic arm (e.g., Universal Robots) removes the ingredients.

[1346] A cooking system (e.g., Moley Robotics) simmers tomato sauce, boils pasta, and prepares salads.

[1347] Step 8:

[1348] The terminal (AI stall) generates digital decorations that match the user's desired atmosphere.

[1349] Input: Optimized atmosphere data

[1350] Output: Set background music and digital decorations

[1351] Specific behavior:

[1352] Display a background image on a digital display.

[1353] Plays the specified music from the speaker.

[1354] Step 9:

[1355] The terminal (AI stall) serves the food once it has been cooked.

[1356] Input: Finished dish

[1357] Output: Available dishes

[1358] Specific behavior:

[1359] To serve freshly cooked tomato sauce pasta and salad, the tray is handed to the user.

[1360] This is the flow of the system program's processing. Through this process, the user can experience the food and atmosphere they desire in real time.

[1361] (Application example 2)

[1362] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1363] In the modern food service industry, providing the food and environment desired by the user in real time is a technically difficult challenge. In particular, recognizing the user's emotions in real time and customizing the service based on them has been difficult with conventional technologies. Furthermore, delivering food at the user's specified location using transportation combined with an autonomous driving system is an equally difficult problem.

[1364] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1365] In this invention, the server includes an analysis means for analyzing the user's input information and emotion recognition information and sending them to the generation means, an emotion recognition means for recognizing the user's emotion, and a generative AI model utilization means for generating cooking recipes and digital decoration data using the generative AI model, thereby making it possible to provide a customized experience in real time that matches the user's desired cuisine, atmosphere, and emotions.

[1366] "User" refers to a person who uses the system to order food or services.

[1367] "Input means" refers to a device that allows a user to input their desired cuisine and atmosphere into the system.

[1368] "Location information acquisition means" refers to a device or software for acquiring the user's current location in real time.

[1369] "Emotion recognition means" refers to technology that analyzes a user's facial expressions, voice, etc. to recognize the user's emotions.

[1370] An "autonomous driving system" refers to a control system that automatically moves a vehicle to a designated location.

[1371] "Transportation means" refers to a physical device that travels to a user-specified location using an automated driving system.

[1372] "Cooking means" refers to a device or equipment for automatically cooking the food ordered by the user.

[1373] "Generation means" refers to the technology or device for generating digital decorations that match the atmosphere desired by the user.

[1374] "Means for utilizing generative AI models" refers to technologies and systems for generating cooking recipes and digital decoration data using generative AI models.

[1375] "Providing means" refers to the technology and devices used to provide cooked food to users.

[1376] "Analysis means" refers to a technology or system that analyzes the user's input information and emotion recognition information and transmits it to the generation means.

[1377] "Route calculation means" refers to the technology or system that an autonomous driving system uses to calculate the optimal route.

[1378] This invention is a system that provides a user's desired cuisine and atmosphere in real time and further customizes the service based on the user's emotion recognition. The system includes a user input means, a location information acquisition means, an emotion recognition means, an autonomous driving system, a cooking means, a generation means, a generation AI model utilization means, and a provision means.

[1379] 1. User operations

[1380] A user uses a smartphone application to select the food they want to eat and the atmosphere they desire, and then confirms their order. For example, a user selects "pasta with tomato sauce" and "Italian trattoria atmosphere" and confirms their order. Furthermore, the emotion recognition means analyzes the user's facial expressions and voice to recognize the user's emotions in real time.

[1381] 2. Server Processing

[1382] The server receives the user's input data and emotion recognition data and analyzes them using the analysis means. The generative AI model utilization means generates a recipe and digital decoration data for the user's desired dish. This generative AI includes, for example, a specific recipe for tomato sauce pasta, as well as background music and image data for recreating an Italian trattoria. The emotion recognition means also analyzes the user's emotion data and reflects it in the generated atmosphere data. For example, if the user is relaxed, more upbeat music and digital decorations are selected.

[1383] 3. Autonomous Driving and Transportation

[1384] The server acquires the user's current location using the user's location information acquisition means and calculates the optimal route for sending instructions to the transportation means. The optimal route is calculated and sent to the automated driving system. The transportation means activates the automated driving system and starts moving toward the specified location.

[1385] 4. Start cooking

[1386] When the AI ​​food stall arrives at its destination, the cooking mechanism activates and prepares the food ordered by the user: the robotic arm retrieves the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad.

[1387] 5. Creating the atmosphere and serving the food

[1388] Once cooking is complete, the generation means generates digital decorations that match the user's desired atmosphere. Background music, images to be displayed on the display, etc. are set. The generated digital decorations and music are optimized based on the user's emotions determined by the emotion recognition means. For example, if the user is feeling stressed, music and decorations with a relaxing effect are set. The user is served freshly cooked food and can enjoy the background music and digital decorations.

[1389] Examples of concrete examples and prompts

[1390] As a concrete example, if the user selects "Pasta with tomato sauce" and "Italian trattoria atmosphere," the prompt text might be:

[1391] Recipe: Pasta with tomato sauce

[1392] Ambience: Italian Trattoria

[1393] Emotion: Relaxed

[1394] Based on this information, the server generates a specific recipe for tomato pasta and digital Italian-style decoration data. At the same time, it analyzes this information and sends instructions to the autonomous driving system, which calculates the optimal route and quickly travels to the user's designated location. Once it arrives, it can provide an experience optimized for the user's emotions.

[1395] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1396] Step 1:

[1397] A user uses a smartphone application to input the desired dish and atmosphere. At this time, the user confirms the order using an input means. For example, the user selects "pasta with tomato sauce" and "Italian trattoria atmosphere." The dish name and information about the atmosphere are sent to the server as input data.

[1398] Step 2:

[1399] The server recognizes the user's emotions using specialized emotion recognition means, which captures the user's facial expressions and voice using a camera and microphone, analyzes the data, and identifies the user's emotions (relaxed, stressed, happy, etc.). This information is also sent to the server.

[1400] Step 3:

[1401] The server analyzes the user's input data and emotion recognition data. The analysis means processes this data and generates digital decoration data related to the recipe and atmosphere of the dish through the generative AI model utilization means. For example, a specific recipe for "pasta with tomato sauce" and background music and image data to recreate an Italian trattoria are generated. This data is compiled in the server and transferred to the next step.

[1402] Step 4:

[1403] The server uses location information acquisition means to obtain the user's current location. This data is obtained from a GPS sensor, etc. The acquired location information is also sent to the server, and the user's current location is identified.

[1404] Step 5:

[1405] The server calculates the optimal route for sending instructions to the means of transportation. The server's route calculation means calculates the shortest and most optimal route based on the user's location information and destination. The calculated route information is sent to the autonomous driving system.

[1406] Step 6:

[1407] The terminal (AI stall) receives instructions from the server, activates the autonomous driving system, and begins moving toward the destination. The vehicle follows the autonomous driving system and moves to the specified location. Data on traffic conditions and obstacles along the way is also collected in real time, and the route is optimized.

[1408] Step 7:

[1409] When the device arrives at its destination, the cooking unit activates and begins preparing the food ordered by the user. Specifically, the robotic arm retrieves the ingredients, simmers the tomato sauce, boils the pasta, and prepares the salad. Each step of the cooking process is pre-programmed, ensuring the food is prepared exactly as the user ordered.

[1410] Step 8:

[1411] Once cooking is complete, the generation means generates digital decorations that match the user's desired atmosphere, including background music and images displayed on the display. The server optimizes the generated digital decorations and music based on emotion recognition data. For example, if the user is feeling relaxed, more upbeat music and decorations are set.

[1412] Step 9:

[1413] The device will then deliver the cooked food to the user, allowing the user to enjoy the food and atmosphere they desire. The device will also provide background music and digital decorations, providing a comprehensive experience for the user.

[1414] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1415] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1416] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1417] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1418] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1419] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1420] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1421] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1422] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1423] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1424] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1425] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1426] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1427] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1428] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1429] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1430] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1431] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1432] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1433] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1434] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1435] The following is further disclosed regarding the above embodiment.

[1436] (Claim 1)

[1437] an input means for the user to order the food they desire;

[1438] location information acquisition means for acquiring user location information;

[1439] a means of transportation that moves to a designated location using an automatic driving means;

[1440] cooking means for cooking the food ordered by the user;

[1441] A generating means for generating digital decorations that match the atmosphere desired by a user;

[1442] The system includes a serving means for serving the ordered food to the user.

[1443] (Claim 2)

[1444] 2. The system according to claim 1, further comprising an analysis means for analyzing information input by the user and transmitting the information to the generation means.

[1445] (Claim 3)

[1446] 10. The system of claim 1, wherein the transportation means further comprises a route calculation means for calculating an optimal route using an automated driving system.

[1447] "Example 1"

[1448] (Claim 1)

[1449] an input means for the user to order the food they desire;

[1450] location information acquisition means for acquiring user location information;

[1451] a means of transportation that moves to a designated location using an automatic driving means;

[1452] cooking means for cooking the food ordered by the user;

[1453] A generating means for generating digital decorations that match the atmosphere desired by a user;

[1454] providing means for providing the ordered food to the user;

[1455] a recipe generation means for generating a recipe for a dish desired by a user using the analytical model;

[1456] A system having at least one transportation means and including a cooking and serving means for cooking and serving a specified dish at a specified location.

[1457] (Claim 2)

[1458] 2. The system according to claim 1, further comprising an analysis means for analyzing information input by the user and transmitting the information to the generation means.

[1459] (Claim 3)

[1460] 10. The system of claim 1, wherein the transportation means further comprises a route calculation means for calculating an optimal route using an automated driving system.

[1461] "Application Example 1"

[1462] (Claim 1)

[1463] An input means for the user to order the desired food and atmosphere;

[1464] location information acquisition means for acquiring user location information;

[1465] a means of transportation that moves to a designated location using an automatic driving means;

[1466] cooking means for cooking the food ordered by the user;

[1467] A generating means for generating digital decorations that match the atmosphere desired by a user;

[1468] providing means for providing the ordered food to the user;

[1469] A generating means for generating a cooking recipe and digital decoration data based on input information using a generating AI model;

[1470] The system includes a route calculation means for calculating an optimal route and generating prompts to activate the automated driving system and reach the specified location.

[1471] (Claim 2)

[1472] 2. The system according to claim 1, further comprising an analysis means for analyzing information input by the user and transmitting the information to the generation means.

[1473] (Claim 3)

[1474] 10. The system of claim 1, wherein the transportation means further comprises a route calculation means for calculating an optimal route using an automated driving system.

[1475] "Example 2: Combining Emotion Engines"

[1476] (Claim 1)

[1477] an input means for the user to order the food they desire;

[1478] location information acquisition means for acquiring user location information;

[1479] a means of transportation that moves to a designated location using an automatic driving means;

[1480] cooking means for cooking the food ordered by the user;

[1481] A generating means for generating digital decorations that match the atmosphere desired by a user;

[1482] analysis means for analyzing the user's emotions using emotion recognition means;

[1483] an optimization means for optimizing the generated atmosphere data based on the user's emotions;

[1484] The system includes a serving means for serving the ordered food to the user.

[1485] (Claim 2)

[1486] 2. The system according to claim 1, further comprising an analysis means for analyzing information input by the user and transmitting the information to the generation means.

[1487] (Claim 3)

[1488] 10. The system of claim 1, wherein the transportation means further comprises a route calculation means for calculating an optimal route using an automated driving system.

[1489] "Application example 2 when combining emotion engines"

[1490] (Claim 1)

[1491] an input means for the user to order the food they desire;

[1492] location information acquisition means for acquiring user location information;

[1493] emotion recognition means for recognizing an emotion of a user;

[1494] A means of transportation that moves to a designated location using an automated driving system;

[1495] cooking means for cooking the food ordered by the user;

[1496] A generating means for generating digital decorations that match the atmosphere desired by a user;

[1497] A generative AI model utilization means for generating recipes and digital decoration data for cooking using the generative AI model;

[1498] The system includes a serving means for serving the ordered food to the user.

[1499] (Claim 2)

[1500] 2. The system according to claim 1, further comprising an analysis means for analyzing the user's input information and emotion recognition information and transmitting the information to the generation means.

[1501] (Claim 3)

[1502] 10. The system of claim 1, wherein the transportation means further comprises a route calculation means for calculating an optimal route using an automated driving system. [Explanation of symbols]

[1503] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. an input means for the user to order the food they desire; location information acquisition means for acquiring user location information; a means of transportation that moves to a designated location using an automatic driving means; cooking means for cooking the food ordered by the user; A generating means for generating digital decorations that match the atmosphere desired by a user; and a serving means for serving the ordered food to the user.

2. 2. The system according to claim 1, further comprising an analyzing means for analyzing the input information of the user and transmitting the analyzed information to the generating means.

3. The system of claim 1 , wherein the transportation means further comprises a route calculation means for calculating an optimal route using an automated driving system.

Images