System
A system collects and analyzes dietary information to optimize meal plans for gatherings, reducing waste and enhancing guest satisfaction by serving tailored meals.
Patent Information
- Application Number
- JP2024121499
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-26
- Publication Date
- 2026-02-05
AI Technical Summary
At large gatherings such as banquets and parties, accurately grasping individual guests' food intake, preferences, and allergy information is difficult, leading to excessive food preparation and waste, increasing costs and reducing guest satisfaction.
A system that collects participants' dietary information through health apps, integrates and analyzes this data, and uses a generation AI to optimize meal plans, which are then reviewed and served by a restaurant system.
Significantly reduces food waste and improves participant satisfaction by providing meals tailored to individual needs.
Smart Images

Figure 2026019751000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] At large gatherings such as banquets and parties, it is difficult to accurately grasp the food intake, preferences, and allergy information of each individual guest, which leads to excessive food being served and food waste. Furthermore, as the number of guests increases, it becomes more difficult to integrate the requests of all the guests. As a result, more food than necessary is prepared and wasted. This increases costs for the caterers and reduces the satisfaction of the guests. New methods and means to solve these problems are needed. [Means for solving the problem]
[0005] This invention proposes a system that works in conjunction with a terminal that provides health information, includes a means for collecting participants' dietary information, a means for integrating and analyzing the collected dietary information, a means for optimizing the content and quantity of food served at a banquet based on the analysis results, and a means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This system collects participants' dietary history, allergy information, and dietary preferences from their health apps, integrates the health information and banquet information, and sends the integrated information to a generation AI. The generation AI generates a banquet meal plan based on the analysis results and provides it to the organizer terminal. The organizer terminal then reviews the generated meal plan, makes any necessary modifications, and sends the final plan to the restaurant system. The restaurant system then prepares and serves the food based on the final plan. This system significantly reduces food waste and improves participant satisfaction.
[0006] A "health information device" is an application or device used by participants to input and manage their health-related data, such as their dietary history, allergy information, and dietary preferences.
[0007] "Collected dietary information" refers to data such as participants' dietary history, allergy information, and food preferences obtained from a terminal that provides health information.
[0008] "Means of integration and analysis" refers to the process of aggregating collected dietary information and conducting analysis based on that data.
[0009] "Means for optimizing the content and quantity of food served at a banquet based on the analysis results" refers to a process for determining the optimal type and quantity of food to be served for participants based on the analysis results of the integrated meal information.
[0010] "Means for providing an optimized meal plan to the banquet organizer terminal and the restaurant system" refers to the process of communicating the meal plan to the organizer and the restaurant based on the optimized dish contents and quantities.
[0011] "Means for collecting dietary history, allergy information, and dietary preferences from health apps" refers to the mechanism for obtaining the necessary data from the health information apps used by participants.
[0012] The "means for integrating health information and banquet information and sending it to the generation AI" is the process of integrating the collected health information with banquet attendee information and sending that data to the generation AI.
[0013] "Means for generating a banquet menu plan based on the results of analysis by the generative AI" refers to the process by which the generative AI analyzes the data it receives and creates the optimal menu plan for the banquet based on that analysis.
[0014] The "means for the organizer terminal to review and modify the generated recipe plan" is the process by which the organizer reviews the recommended recipe plan and makes changes as necessary.
[0015] The "means for transmitting the final revised plan to the restaurant system" is a process for notifying the restaurant of the final revised meal plan.
[0016] "Means by which the provider system prepares and serves food based on the final plan" refers to the process by which the provider prepares and serves food in accordance with the final meal plan. [Brief explanation of the drawings]
[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0019] First, the terms used in the following description will be explained.
[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0025] [First embodiment]
[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0038] The present invention is a system that works in conjunction with a terminal that provides health information to reduce food waste at banquets and parties and provide optimal meals for participants. This system collects dietary information from participants and is able to optimize the content and quantity of dishes based on that information. Specific embodiments of the present invention are described below.
[0039] Overall system configuration
[0040] The system consists of the following components:
[0041] 1. Device that provides health information (user device)
[0042] 2. Server
[0043] 3. Generation AI
[0044] 4. Manager terminal
[0045] 5. Store system
[0046] Terminal that provides health information (user terminal)
[0047] Users use the health support app to input their health information, such as their dietary history, allergy information, and food preferences. This information is used to provide the optimal dishes for the banquet the user is attending. When the user indicates their intention to attend the banquet, the device sends the information to the server.
[0048] server
[0049] The server receives and integrates health information and party participation information sent from user terminals. The server processes and organizes the received data and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[0050] Generation AI
[0051] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, and preferences. The AI then sends the analysis results back to the server, providing the optimized meal plan to the organizer and the restaurant.
[0052] Organizer terminal
[0053] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[0054] Store system provided
[0055] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[0056] Specific examples
[0057] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending, enters party information on the organizer's terminal and sends invitations to the participants. Mr. Tanaka indicates his intention to attend the party through the app and sends this information to the server.
[0058] The server combines Tanaka's health information with the banquet information entered by Suzuki and sends it to the AI generator. The AI then generates an optimal meal plan that takes into account Tanaka's allergies and disliked foods, as well as the information of the other guests, and sends the results to the server.
[0059] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer terminal and makes any necessary changes. The final plan is then sent to the restaurant system via the server.
[0060] The restaurant system will prepare the food based on the final plan and provide the optimal dishes on the day of the banquet. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and other guests can enjoy meals that accommodate their individual preferences and allergies.
[0061] In this way, the system provides meals tailored to the individual needs of participants and significantly reduces food waste.
[0062] The processing flow will be explained below.
[0063] Step 1:
[0064] The user logs into the health support app and enters data such as their allergy information, dietary history, and food preferences.
[0065] Step 2:
[0066] The user selects the party event they plan to attend using the app, indicates their intention to participate, and transmits party participation information to the server.
[0067] Step 3:
[0068] The organizer logs in to the banquet information management system from the organizer's terminal and creates a new banquet event. The organizer enters the details of the banquet (date, time, location, and participant list) and sends them to the server.
[0069] Step 4:
[0070] The server receives the health information and participation intention information sent from the user terminal, and also receives detailed information about the party from the organizer terminal.
[0071] Step 5:
[0072] The server integrates the collected health information and banquet information, and compares and adjusts them, allowing for analysis of each participant's dietary history and preference trends.
[0073] Step 6:
[0074] The server sends the integrated data to the generation AI, which generates the optimal cooking plan based on each participant's data.
[0075] Step 7:
[0076] The generative AI analyzes the data sent and determines the contents and portions of meals tailored to each participant's individual needs, taking into account allergies and preferences for specific ingredients, for example.
[0077] Step 8:
[0078] The generation AI sends the optimized meal plan back to the server, which receives the plan and sends it to the host terminal and the restaurant system.
[0079] Step 9:
[0080] The organizer checks the generated meal plan on the organizer's terminal. If any corrections are needed, the organizer makes changes to the plan.
[0081] Step 10:
[0082] The organizer sends the finalized party plan to the server, which then sends this information to the provider's system.
[0083] Step 11:
[0084] Based on the final plan received from the server, the provider store system arranges for the necessary ingredients and prepares cooking.
[0085] Step 12:
[0086] The restaurant system will provide the food according to the final plan on the day of the banquet, allowing each participant to enjoy the food that is best suited to them.
[0087] This reduces food waste and increases participant satisfaction.
[0088] Example 1
[0089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0090] In traditional banquets and parties, creating a meal plan that takes into account the dietary preferences and allergy information of the participants is time-consuming, and the meals served are often not fully optimized. There were also many cases where the appropriate amount of ingredients was not prepared, resulting in food waste. Furthermore, when meal plans needed to be revised, the process was cumbersome, making it difficult to respond in a timely manner.
[0091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0092] In this invention, the server includes a means for receiving health information sent from a user terminal, a means for sending the information to the generation AI, and a means for the server to send the optimized meal plan provided by the generation AI to the organizer terminal and the provider store system. This allows for the automatic generation of an optimal meal plan for a banquet or party that takes into account the dietary preferences and allergy information of each participant, reducing food waste and enabling quick and accurate meal plan revisions.
[0093] A "device that provides health information" is a device that allows a user to input and manage their own health information and send it to a server.
[0094] "Participant's dietary information" refers to all diet-related information related to each user, such as allergy information, dietary preferences, and past dietary history.
[0095] "Means for integrating and analyzing" refers to a system for compiling multiple pieces of collected dietary information into a single dataset and analyzing it.
[0096] The "means for optimizing the content and quantity of food served at a banquet" is a system that calculates the type and quantity of food appropriate for each participant based on the analysis results.
[0097] "Means for providing optimized meal plans to the banquet organizer terminal and the restaurant system" refers to a mechanism for transmitting the optimal meal plan obtained from the generation AI to the organizer terminal and the restaurant system.
[0098] "Generative AI" is an artificial intelligence system that analyzes participants' dietary information and automatically generates the optimal cooking plan.
[0099] The "organizer's terminal" is a device used by the organizer to input banquet information and check and modify the menu plan.
[0100] The "store serving system" is a store system that prepares and serves food, and has the function of preparing food based on the optimized cooking plan provided by the generation AI.
[0101] "Data integrity" refers to the standards and methods by which a server handles data sent by a user while maintaining consistency and completeness.
[0102] "Modifying the meal plan" refers to the act of the organizer or the restaurant making necessary changes to the meal plan provided by the generation AI.
[0103] MODE FOR CARRYING OUT THE INVENTION
[0104] The present invention is a system that works in conjunction with a terminal that provides health information, reduces food waste at banquets and parties, and provides optimal meals to participants. Specific embodiments are described below.
[0105] Overall system configuration
[0106] The system consists of the following components:
[0107] 1. Device that provides health information (user device)
[0108] 2. Server
[0109] 3. Generation AI
[0110] 4. Manager terminal
[0111] 5. Store system
[0112] Terminal that provides health information (user terminal)
[0113] Users use the health support app to input their health information, such as their dietary history, allergy information, and food preferences. This information is used to provide the optimal dishes for the banquet the user is attending. When the user indicates their intention to attend the banquet, the device sends the information to the server.
[0114] server
[0115] The server receives and integrates health information and party participation information sent from user devices. The server checks the integrity of the received data, processes and organizes it, and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[0116] Generation AI
[0117] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, and preferences. The AI then sends the analysis results back to the server, providing the optimized meal plan to the organizer and the restaurant.
[0118] Organizer terminal
[0119] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[0120] Store system provided
[0121] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[0122] Specific examples
[0123] For example, suppose User A logs in to a health support app and registers his or her allergies (shrimp) and disliked foods (broccoli). User B, who is the organizer of a party that User A will be attending, enters party information on the organizer's terminal and sends invitations to participants. User A indicates his or her intention to attend the party through the app and sends this information to the server.
[0124] The server combines User A's health information with the banquet information entered by the organizer and sends it to the generation AI. The generation AI takes User A's allergies and disliked foods into consideration, generates an optimal meal plan that also includes information on other participants, and sends the results to the server.
[0125] The planner checks the meal plan created on the planner's terminal and makes any necessary changes. The final plan is then sent to the restaurant's system via the server.
[0126] The restaurant system prepares the food based on the final plan and provides the optimal dishes on the day of the banquet. For example, User A can be served a dish that does not contain shrimp or broccoli, and other guests can also enjoy meals that accommodate their individual preferences and allergies.
[0127] Prompt Sentence Examples
[0128] Below are some example prompts to input to a generative AI model:
[0129] Consider the health information and preferences of banquet attendees to generate an optimal meal plan that reduces food waste.
[0130] Participant list:
[0131] User A: Allergic to shrimp, hates broccoli
[0132] User B: Vegetarian
[0133] User C: Gluten intolerance
[0134] Banquet information:
[0135] Date: December 25, 2023
[0136] Venue: Restaurant in Tokyo
[0137] Number of participants: 10 people
[0138] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0139] Program processing flow
[0140] Step 1: Enter and submit user information
[0141] The user logs in to the health support app and enters their own health information.
[0142] Input: Individual health data such as dietary history, allergy information, and food preferences
[0143] Data processing: The entered health information is stored in a database and the intention to attend the banquet is registered.
[0144] Output: Organized health information data
[0145] When the user presses the "Join" button, the terminal sends this information to the server.
[0146] Specific behavior: When a user registers that they are allergic to shrimp and dislike broccoli, that information is sent to the server.
[0147] Step 2: Data reception and integration by the server
[0148] The server receives the health information and party participation information sent from the user terminal.
[0149] Input: Individual health data and participation intention information sent from the device
[0150] Data processing: Check data integrity and generate a unified dataset
[0151] Output: Integrated health and participation data set
[0152] The server will then format the data as needed and prepare it for transmission to the generating AI.
[0153] Specific actions: Integrate Tanaka's shrimp allergy information and banquet attendance information and organize the data.
[0154] Step 3: Sending data to the generative AI
[0155] The server sends the integrated data, which has been confirmed to be consistent, to the generation AI.
[0156] Input: Integrated health and participation data set
[0157] Data processing: Converting data formats into a format suitable for generative AI
[0158] Output: Data sent to the generative AI
[0159] The server generates the prompt sentences required for analysis and sends them along with the data.
[0160] Specific operation: Based on the integrated data, the AI is instructed to "generate the optimal meal plan taking into account the participants' allergy information."
[0161] Step 4: Data analysis and meal plan generation using generative AI
[0162] The generation AI analyzes the data received from the server and generates the optimal cooking plan.
[0163] Input: Integrated health information and analysis prompts
[0164] Data calculation: Calculate the optimal ingredient selection and dish composition based on each participant's allergy information and preferences
[0165] Output: The optimal cooking plan generated
[0166] The generation AI sends the generated cooking plan back to the server.
[0167] Specific action: Suggest shrimp-free dishes to Tanaka and vegetarian dishes to Suzuki.
[0168] Step 5: Send the generated plan to the server
[0169] The generation AI sends the generated cooking plan to the server.
[0170] Input: Optimal Meal Plan
[0171] Data processing: Preparation of the meal plan sent from the generative AI
[0172] Output: Meal plan sent to the organizing terminal and the restaurant system
[0173] The server receives the meal plan and prepares to provide it to the organizer terminal and the provider store system.
[0174] Specific operation: Prepare to send the meal plan received from the generation AI to the host terminal and the restaurant system
[0175] Step 6: Check and modify the plan on the master terminal
[0176] The organizer accesses the system from the organizer's terminal and checks the cooking plan sent by the generation AI.
[0177] Input: Generated Meal Plan
[0178] Data processing: Modifying plans based on user preferences and party details
[0179] Output: Revised final meal plan
[0180] The plan is amended as necessary, and the final plan is sent to the provider store system via the server.
[0181] Specific operation: The planner makes modifications such as adding desserts, and sends the final plan to the store's system.
[0182] Step 7: Prepare food using the restaurant's system
[0183] The restaurant system prepares and serves food based on the confirmed meal plan.
[0184] Input: Final meal plan
[0185] Data processing: Arranging ingredients and adjusting cooking arrangements based on the plan
[0186] Output: The best dishes to be served on the day of the banquet
[0187] The provider store system arranges the necessary ingredients and cooks the food based on the final plan.
[0188] Specific actions: On the day of the banquet, Tanaka will be served a dish that does not contain shrimp or broccoli, and the other participants will be served dishes that cater to their individual preferences and allergies.
[0189] (Application example 1)
[0190] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0191] At banquets and parties, providing optimal dishes that meet the health conditions and preferences of each guest is a difficult task. Furthermore, preparing food without considering the health and allergy information of guests is one of the causes of food waste. Furthermore, conventional methods require a lot of time and effort to create optimal meal plans, which makes it difficult to efficiently serve food in brick-and-mortar stores. The present invention aims to solve these problems.
[0192] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0193] In this invention, the server includes: means for linking with a terminal that provides health information and collecting meal information of participants; means for integrating the collected meal information and banquet information and sending it to a cloud server; means for integrating and analyzing the data on the cloud server and sending it to a generative AI model; means for optimizing the content and quantity of dishes to be served at the banquet based on the results of the analysis by the generative AI model; and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to efficiently generate meal plans optimized for the health conditions and preferences of participants, reducing food waste in physical restaurants and providing a high-quality dining experience.
[0194] A "terminal for providing health information" is a device that serves to input and provide health information such as a user's dietary history, allergy information, and dietary preferences.
[0195] "Participant" refers to an individual who attends a banquet or party and enters or provides their own health information.
[0196] The "organizer terminal" is a device used to manage banquet and party information and to confirm and modify the meal plans provided by the generation AI.
[0197] "Store system" refers to the store's computer system for preparing and serving food based on the optimized cooking plan.
[0198] The "server" is a central processing unit that receives data sent from user terminals and organizing terminals and sends it to the generation AI.
[0199] "Generative AI" is an artificial intelligence model used to analyze the integrated data received from the server and generate optimal cooking plans.
[0200] A "cloud server" is a distributed computing system for storing and analyzing data over the Internet.
[0201] A "meal plan" is a plan that indicates the content and quantity of meals optimized based on each participant's health information and preferences.
[0202] A system for realizing the present invention comprises the following components:
[0203] 1. Devices that provide health information
[0204] Users install a health support app on their smartphone and enter their health information, such as their dietary history, allergies, and food preferences, which is then sent to the server.
[0205] 2. Server
[0206] The server is built on the cloud and receives and integrates health and banquet information sent from user devices, using cloud services such as Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure.
[0207] 3. Generation AI
[0208] The generation AI analyzes the integrated data sent from the server and generates a cooking plan optimized for each participant. This AI model can be, for example, GPT-4. The analysis results are then sent back to the server.
[0209] 4. Manager terminal
[0210] The organizer checks and modifies the meal plan sent from the AI via the organizer's terminal. The modifications are sent to the restaurant's system via the server.
[0211] 5. Store system
[0212] The restaurant system prepares and serves the food based on the final meal plan. The system is operated by a computer installed in the restaurant, receives data from the cloud, and makes the necessary preparations.
[0213] Specific examples
[0214] For example, User A (let's call him Tanaka) logs in to a health support app and registers his allergy information (shrimp), disliked foods (broccoli), and favorite foods (salmon, avocado). The organizer of a party that Tanaka will be attending uses the organizer's terminal to enter party information (date, time, location, attendees, etc.) and send invitations to the participants. Tanaka receives the invitation and indicates his intention to attend on the app.
[0215] The server combines Tanaka's health information with the banquet information entered by the organizer and sends it to the AI generator, which then takes Tanaka's allergies and disliked foods into consideration to generate the optimal meal plan and sends the results to the server.
[0216] The organizer checks the meal plan created on the organizer's terminal and makes any necessary corrections. The final plan is then sent to the restaurant's system via the server.
[0217] The restaurant system will prepare and serve meals based on the final plan. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and other participants will be able to enjoy meals that accommodate their individual preferences and allergies.
[0218] Prompt Sentence Examples
[0219] An example of a prompt for the generative AI model is as follows:
[0220] User A (Mr. Tanaka) will be attending the party. Mr. Tanaka's health information is as follows:
[0221] Allergy: Shrimp
[0222] Disliked food: Broccoli
[0223] Favorite foods: salmon, avocado
[0224] Recent health checkup results: Cholesterol is slightly high
[0225] Include information from other participants to generate the best meal plan.
[0226] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0227] Step 1:
[0228] User enters health information
[0229] Input: The user opens a health support app installed on their smartphone and enters their dietary history, allergy information, dietary preferences, etc.
[0230] Data processing: The entered health information is converted into JSON format.
[0231] Output: The health information data generated by the health support app is sent to the server in JSON format.
[0232] Step 2:
[0233] The server receives and stores health information
[0234] Input: Health information data sent from the health support app (JSON format)
[0235] Data calculation: The server stores the received data in a database and classifies and organizes it for each participant.
[0236] Output: Organized health information data available for the next processing step.
[0237] Step 3:
[0238] The organizer enters the banquet information
[0239] Input: The organizer uses the organizer terminal to input information such as the date, location, and participant list of the banquet.
[0240] Data processing: The entered banquet information is converted into JSON format and linked to the health information of each participant.
[0241] Output: The linked banquet information data is sent to the server.
[0242] Step 4:
[0243] The server sends the integrated data to the generative AI model.
[0244] Input: Banquet information and associated attendee health information
[0245] Data calculation: The server integrates banquet information and health information to generate a prompt sentence suitable for the generative AI model.
[0246] Output: Send the generated prompt sentence to the generative AI model.
[0247] Step 5:
[0248] Generative AI model generates analysis and cooking plans
[0249] Input: Prompt text sent from the server
[0250] Data calculation: The generative AI model analyzes the prompts and generates an optimal meal plan, taking into account allergies and preferences and calculating the dish contents and quantities appropriate for each participant.
[0251] Output: The generated cooking plan is sent back to the server.
[0252] Step 6:
[0253] The organizer's terminal checks and modifies the meal plan
[0254] Input: Cooking plans sent from a generative AI model
[0255] Data calculation: The organizer terminal presents the displayed cooking plan to the organizer, who can make corrections as necessary.
[0256] Output: The final revised cooking plan is sent to the server.
[0257] Step 7:
[0258] The server sends the final meal plan to the restaurant system.
[0259] Input: Final recipe plan sent from the organizer's terminal
[0260] Data Calculation: The server converts the final meal plan into the appropriate format for sending to the restaurant system.
[0261] Output: The final meal plan is sent to the restaurant system.
[0262] Step 8:
[0263] The restaurant system prepares and serves the food
[0264] Input: The final meal plan sent by the server
[0265] Data calculation: Based on the final plan, the store system arranges the necessary ingredients and starts the cooking process.
[0266] Output: On the day of the banquet, each guest will be served an optimized meal.
[0267] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0268] The present invention is a system for providing optimal meal plans for banquets and parties in cooperation with a device that provides health information and emotions. This system collects dietary information and emotional information from participants and can optimize the content and quantity of dishes based on that information. Specific embodiments of the present invention are described below.
[0269] Overall system configuration
[0270] The system consists of the following components:
[0271] 1. Device that provides health information and emotions (user device)
[0272] 2. Server
[0273] 3. Generation AI
[0274] 4. Emotion Engine
[0275] 5. Manager terminal
[0276] 6. Store System
[0277] Terminal that provides health information and emotions (user terminal)
[0278] Using a health support app, users input health information such as their dietary history, allergies, and food preferences. The device is also equipped with an emotion engine that recognizes emotions from the user's facial expressions, tone of voice, text messages, and other factors. This information is used to provide optimal dishes for banquets that the user is attending. When the user indicates their intention to attend a banquet, the device sends that information to the server.
[0279] server
[0280] The server receives and integrates the health information, emotional information, and participation intention information sent from the user terminal. The server processes and organizes the received data and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[0281] Generation AI
[0282] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, preferences, and emotional information. The AI then sends the analysis results back to the server, providing an optimized meal plan to the organizer and the restaurants.
[0283] Emotion Engine
[0284] The emotion engine has the ability to analyze users' emotions from their facial expressions, tone of voice, text messages, etc. This allows participants' emotional states (e.g., stress, joy, sadness, etc.) to be grasped in real time and reflected in the cooking plan as needed.
[0285] Organizer terminal
[0286] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[0287] Store system provided
[0288] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[0289] Specific examples
[0290] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending, enters party information on the organizer's terminal and sends invitations to the participants. Mr. Tanaka indicates his intention to attend the party through the app and sends this information to the server.
[0291] The emotion engine analyzes Tanaka's facial expressions and tone of voice to determine his stress level and happiness, and obtains that information.
[0292] The server combines Tanaka's health and emotional information with the banquet information entered by Suzuki and sends it to the AI generator. The AI then generates an optimal meal plan that takes into account Tanaka's allergies, disliked foods, and even his emotions, and also integrates information about the other guests, and sends the results to the server.
[0293] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer terminal and makes any necessary changes. The final plan is then sent to the restaurant system via the server.
[0294] The restaurant system will prepare the food based on the final plan and provide the optimal dishes on the day of the banquet. At this time, ingredients and cooking methods that have a relaxing effect may be selected to reflect Tanaka's emotional state.
[0295] In this way, meals tailored to the individual needs of participants are provided based on health and emotional information, significantly reducing food waste and improving emotional satisfaction.
[0296] The processing flow will be explained below.
[0297] Step 1:
[0298] A user logs in to the health support app and enters health information such as their allergy information, dietary history, and food preferences. In addition, the emotion engine collects emotional information from the user's facial expressions, tone of voice, text messages, etc.
[0299] Step 2:
[0300] The user selects a party event they plan to attend using the app, indicates their intention to participate, and transmits party participation information, health information, and emotional information to the server.
[0301] Step 3:
[0302] The organizer logs in to the banquet information management system from the organizer's terminal and creates a new banquet event. The organizer enters the details of the banquet (date, time, location, participant list) and sends them to the server.
[0303] Step 4:
[0304] The server receives the health information, emotional information, and participation intention information sent from the user terminal, and also receives detailed information about the party from the organizer terminal.
[0305] Step 5:
[0306] The server integrates the collected health information, emotional information, and banquet information, compares and adjusts them, and sends the data to the generation AI.
[0307] Step 6:
[0308] The generative AI analyzes the integrated data sent from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, preferences, and emotional information. The generative AI takes into account ingredients and cooking methods to optimize the meal plan.
[0309] Step 7:
[0310] The generation AI sends the optimized meal plan back to the server, which receives the plan and sends it to the host terminal and the restaurant system.
[0311] Step 8:
[0312] The organizer checks the generated meal plan on the organizer's terminal. If any corrections are needed, the organizer makes changes to the plan.
[0313] Step 9:
[0314] The organizer sends the finalized party plan to the server, which then sends this information to the provider's system.
[0315] Step 10:
[0316] Based on the final plan received from the server, the provider store system arranges for the necessary ingredients and prepares cooking.
[0317] Step 11:
[0318] The restaurant system will provide the food according to the final plan on the day of the banquet, allowing each participant to enjoy the food that is best suited to them.
[0319] Specific examples
[0320] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). When User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending via the app, expresses his intention to attend based on the party information managed on the organizer's device, the emotion engine analyzes Mr. Tanaka's facial expressions and tone of voice and sends this information to the server.
[0321] The server combines Tanaka's health and emotional information with the banquet information entered by Suzuki and sends it to the generation AI.
[0322] The AI generates an optimal cooking plan that takes into account Tanaka's allergies, disliked foods, and emotions, and also integrates information from other participants. For example, if Tanaka is feeling stressed, it generates a plan that incorporates herbs and ingredients with a relaxing effect. The AI then sends the results to the server.
[0323] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer's terminal and makes any necessary changes. The final plan is sent to the restaurant's system via the server.
[0324] The restaurant system will prepare the food based on the final plan and provide the most suitable dishes on the day of the banquet. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and will use herbs that have a relaxing effect.
[0325] In this way, meals tailored to the individual needs of participants are provided based on health and emotional information, significantly reducing food waste and improving emotional satisfaction.
[0326] Example 2
[0327] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0328] Currently, at many banquets and parties, it is difficult to consider the individual dietary restrictions, preferences, and emotions of each participant, resulting in food waste and reduced participant satisfaction. Providing a safe and satisfying meal is particularly difficult for participants with allergies or dietary restrictions. Furthermore, meal plans that take into account the emotional state of participants are rarely provided, which does not lead to improved overall satisfaction. To solve these issues, a system is needed that provides optimal meal plans based on participants' health and emotional information.
[0329] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting meal information and emotional information of participants in cooperation with the terminal that provides health information and emotional information, means for integrating and analyzing the collected meal information and emotional information, means for optimizing the content and quantity of dishes to be served at the banquet based on the analysis results, and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to provide an optimal meal plan that takes into account the health information and emotional state of each participant, thereby reducing food waste and improving participant satisfaction.
[0330] "Health information" is data related to the user's health condition, such as the user's dietary history, allergy information, and dietary preferences.
[0331] "Emotional information" is data about the user's emotional state, analyzed based on the user's facial expressions, tone of voice, text messages, etc.
[0332] A "terminal" is a device used by a user to input and transmit health information and emotional information, such as a smartphone or tablet.
[0333] The "server" is a central system that receives health and emotional information sent from user devices and processes, organizes, integrates, and transmits it.
[0334] "Generative AI" is an artificial intelligence that analyzes data received from the server and generates optimal cooking plans based on the individual health and emotional information of each participant.
[0335] The "organizer's terminal" is a device used by the organizer of a banquet or party to check and modify the generated menu plan.
[0336] The "store system" is a system for preparing and serving food based on a confirmed meal plan.
[0337] A "meal plan" is a plan that indicates the content and quantity of meals optimized based on the participant's health and emotional information.
[0338] "Synthesis" is the process of combining collected data into a coherent whole.
[0339] "Analysis" is the process of examining and examining collected data to derive meaningful information.
[0340] "Optimization" refers to adjusting to the most effective or efficient state based on specific conditions.
[0341] The present invention is a system for providing optimal meal plans for banquets and parties in cooperation with a terminal that provides health information and emotional information. Specific embodiments of the present invention will be described below.
[0342] Hardware and software used
[0343] 1. Devices that provide health and emotional information (user devices)
[0344] Users use a smartphone or tablet with a health support app installed.
[0345] Emotion analysis software (e.g., Microsoft Azure Emotion API) is built into the user's device to recognize emotions from the user's facial expressions, tone of voice, and text messages.
[0346] 2. Server
[0347] Use cloud-based integrated systems, e.g., AWS, Google Cloud.
[0348] The server receives health and emotional information sent from the user's device and processes, organizes, and integrates the data.
[0349] 3. Generation AI
[0350] As a generative AI model, e.g., OpenAI GPT-3 is used.
[0351] The data received from the server is analyzed and the optimal cooking plan is generated.
[0352] 4. Manager terminal
[0353] The organizer will use a smartphone or tablet with a banquet management app installed.
[0354] The organizer's terminal can check and modify the cooking plan sent from the generation AI.
[0355] 5. Store system
[0356] The store system uses computers or tablets with reservation and cooking management software installed.
[0357] Prepare and serve food based on the final meal plan.
[0358] System Operation
[0359] In this system, users use a health support app to input their own health information (e.g., dietary history, allergy information, food preferences) and emotional information. The terminal sends this information to a server. The server processes and organizes the received information and sends it to a generation AI. The generation AI generates an optimal meal plan based on the analysis results and sends it back to the server. The server provides the optimized meal plan to the host terminal and the restaurant system. The restaurant system prepares the food based on the final meal plan and serves it on the day of the banquet.
[0360] Specific examples
[0361] For example, User A (Mr. Tanaka) logs into a health support app and registers his or her allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Tanaka will be attending, enters party information on his or her organizer device and sends invitations to the participants. Tanaka indicates his or her intention to attend the party through the app and sends this information to the server. The emotion engine analyzes Tanaka's facial expressions and tone of voice to indicate his or her stress level and happiness, and acquires this information. The server combines Tanaka's health and emotional information with the party information entered by Suzuki and sends it to the generation AI. The generation AI generates an optimal meal plan that takes into account Tanaka's allergies, disliked foods, and emotions, as well as the information of other participants, and sends the result to the server. Organizer B (Mr. Suzuki) reviews the meal plan generated on his or her organizer device and makes changes as necessary. The final plan is then sent via the server to the restaurant system. The restaurant system prepares the food based on the final plan and serves the optimal dishes on the day of the party.
[0362] Prompt Sentence Examples
[0363] "Generate a stress-reducing meal plan that excludes shrimp based on the following participant information:
[0364] Participant: Tanaka-san
[0365] Allergy: Shrimp
[0366] Disliked food: Broccoli
[0367] Emotional information: High stress level
[0368] Please combine this information with other participants' information to come up with a plan that everyone can enjoy.
[0369] In this way, the system of the present invention can provide meals tailored to the individual needs of participants based on health and emotional information, significantly reducing food waste while improving emotional satisfaction.
[0370] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0371] Step 1:
[0372] A user enters their own health information (e.g., dietary history, allergy information, food preferences) and emotional information (e.g., facial expressions, tone of voice, text messages) into a health support app. The input information is entered into a form within the app and confirmed by pressing the submit button. The input data includes specific allergens and favorite dishes.
[0373] Input: User-entered health and emotional information
[0374] Output: Health and emotional information stored on the device
[0375] Step 2:
[0376] The device automatically transmits the entered health and emotional information to the server, where the data is encrypted and securely transferred to the server.
[0377] Input: Health and emotional information stored on the device
[0378] Output: Health and emotion information sent to the server
[0379] Step 3:
[0380] The server receives the health and emotional information sent from the device and processes and organizes the data, such as removing duplicate data and filling in missing data. The server then integrates each user's data and converts it into a consistent format.
[0381] Input: Health and emotional information sent from the device
[0382] Output: Formatted and processed health and emotional information
[0383] Step 4:
[0384] The server sends the formatted and processed data to the generation AI, which then formats the data into a format that the generation AI can understand, and generates and sends a prompt.
[0385] Input: Formatted and processed health and emotional information
[0386] Output: The aggregated data and prompt sent to the generative AI
[0387] Step 5:
[0388] The AI then analyzes the integrated data and generates an optimal meal plan, taking into account each participant's allergies, dietary preferences, and emotional state.
[0389] Input: Integrated data and prompt sent from the server
[0390] Output: The optimal cooking plan generated
[0391] Step 6:
[0392] The generation AI returns the generated meal plan to the server, which receives the plan and sends it to the organizer terminal and the restaurant system.
[0393] Input: Generated optimal cooking plan
[0394] Output: Meal plan sent to the manager terminal and the restaurant system
[0395] Step 7:
[0396] The organizer uses the organizer terminal to check the generated meal plan, make any necessary corrections, and finalize the meal plan. The organizer terminal can make changes through a simple user interface.
[0397] Input: Meal plan sent to the organizer's terminal
[0398] Output: Revised final meal plan
[0399] Step 8:
[0400] The organizer terminal transmits the final plan to the provider store system via the server, and the provider store system prepares the dishes based on the final plan.
[0401] Input: Revised final meal plan
[0402] Output: Final meal plan sent to the restaurant system
[0403] Step 9:
[0404] Based on the final plan, the restaurant system will arrange for the necessary ingredients and cooking arrangements, and provide the food on the day of the banquet. The kitchen staff will prepare the food according to the plan provided, providing the best possible food for each guest.
[0405] Input: Final meal plan sent to the restaurant system
[0406] Output: The best dishes to be served on the day of the banquet
[0407] (Application example 2)
[0408] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0409] Currently, there is no system for providing optimal meal plans at banquets and parties based on the individual health and emotional information of each participant. As a result, the food provided may not be suitable for the participant's health or mood, which increases food waste and reduces participant satisfaction.
[0410] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting meal information and emotional information of participants in cooperation with a terminal that provides health information and emotional information, means for integrating and analyzing the collected meal information and emotional information, means for optimizing the content and quantity of dishes to be served at the banquet based on the analysis results, means for notifying participants of the optimized meal plan using a smartphone application to support their ordering, and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to provide an optimal meal plan tailored to the health status and emotional state of participants, thereby reducing food waste and improving participant satisfaction.
[0411] "Health information" refers to data such as participants' allergy information, dietary preferences, and dietary history.
[0412] "Emotional information" refers to data that indicates a participant's emotional state, such as facial expressions, tone of voice, or text messages.
[0413] "Terminal" refers to devices used to collect health and emotional information, including smartphones and tablets.
[0414] "Means of collection" refers to the method of obtaining data using the device that provides health information and emotional information.
[0415] "Means of integration and analysis" refers to the process of organizing, integrating, and analyzing the collected health and emotional information.
[0416] "Optimization means" refers to methods for adjusting the content and quantity of food served based on the analysis results.
[0417] "Smartphone application" refers to software that runs on a smartphone and allows participants to input and collect health and emotional information and notify them of the optimal cooking plan.
[0418] "Means for notifying and supporting ordering" refers to a method of using a smartphone application to communicate the generated meal plan to participants and support their ordering.
[0419] "Organizer terminal" refers to a device used by the organizer of a banquet to review and modify the generated menu plan.
[0420] "Provider System" refers to the system used by restaurants and food delivery companies to prepare and serve food based on an optimized meal plan.
[0421] "Generative AI" refers to artificial intelligence used to analyze collected data and generate optimal cooking plans.
[0422] A "prompt" refers to the input text used to provide instructions to the generation AI, and is used to generate optimal cooking plans based on the user's health and emotional information.
[0423] This invention is a system for providing optimal food delivery menus based on participants' health and emotional information. This system consists of a user terminal, a server, a generation AI, an emotion engine, a manager terminal, and a provider store system. The following explains the details of each component and the overall flow.
[0424] User terminal
[0425] User devices are mainly smartphones and perform the following functions:
[0426] Entering health information: Users enter their allergy information, dietary preferences, and dietary history.
[0427] Emotional information collection: Uses the smartphone's camera, microphone, and text input to collect the user's emotional information (facial expressions, tone of voice, text messages, etc.).
[0428] Data transmission: The entered health and emotional information is transmitted to the server.
[0429] server
[0430] The server has the following roles:
[0431] Data integration: Integrate and organize health and emotional information received from user devices.
[0432] Prepare data for analysis: Send the combined data to the generative AI for analysis.
[0433] Information distribution: Receives the analysis results of the generating AI and sends them to the master terminal and the provider store system.
[0434] Generation AI
[0435] The generation AI plays the following roles:
[0436] Data analysis: Generates optimal food delivery menus based on health and emotional information sent from the server.
[0437] Return result: The generated menu is returned to the server.
[0438] Emotion Engine
[0439] The emotion engine analyzes the user's emotions and has the following roles:
[0440] Facial expression analysis: Analyzes the user's facial expressions from image data collected through the camera.
[0441] Voice analysis: Analyzes the tone of voice from audio data collected through a microphone.
[0442] Text analysis: Analyze text messages to infer the user's emotional state.
[0443] Organizer terminal
[0444] The organizer terminal is used by the organizer of the party and fulfills the following roles:
[0445] Review and modify the meal plan: Review the meal plan sent by the generation AI and modify it as necessary.
[0446] Sending the revised results: Send the revised final plan to the store system.
[0447] Store system provided
[0448] The provider store system will have the following roles:
[0449] Order Receipt: Receiving food delivery orders based on the optimized meal plan sent by the server.
[0450] Food preparation and serving: Prepare food based on the final plan and deliver it to the user.
[0451] Specific examples
[0452] For example, a user uses a health app to register their allergy information (wheat allergy) and input their emotion, such as "I want to relieve stress today." This information is sent to a server via their smartphone. The emotion engine analyzes the user's feelings from images taken with the camera and text messages they input, and determines that they are slightly tired. The server then sends this information to a generation AI, which then generates an optimal food delivery menu (e.g., gluten-free carbonara and herbal tea). This information is then sent via the server to the restaurant's system and delivered to the user.
[0453] Prompt Sentence Examples
[0454] "I feel like relaxing today."
[0455] In this way, the present invention provides optimal cooking plans tailored to the needs of each individual user, reducing food waste and increasing participant satisfaction.
[0456] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0457] Step 1:
[0458] The user terminal displays a health information input screen, and the user inputs their allergy information, dietary preferences, and dietary history. The input data is saved in the terminal and passed to the next processing step. The input data is the user's allergy information, dietary preferences, and dietary history, and is converted into an appropriate format.
[0459] Step 2:
[0460] The user device collects the user's emotional information using a camera, microphone, and text input. Specifically, the camera captures the user's facial expressions, the microphone records the tone of voice, and the user enters their mood through text input. The resulting data are facial expression images, audio files, and text data, which are then converted into a format that is easy to analyze by the emotion engine.
[0461] Step 3:
[0462] The user device sends the collected health and emotional information to the server. The input data is the health and emotional information stored in the device, and the server receives it. After receiving it, the data is checked for consistency and formatted if necessary.
[0463] Step 4:
[0464] The server integrates the received health and emotional information and sends it to the generation AI for analysis. The server converts these data into an appropriate format and performs data integration and pre-analysis. The input data is the collected health and emotional information, and the output data is the integrated health and emotional information.
[0465] Step 5:
[0466] The Generative AI analyzes the integrated data sent from the server and generates the optimal food delivery menu for each user. The input data is integrated health and emotional information, and the output data is an optimized food delivery menu. The Generative AI analyzes this data and proposes the optimal menu for each user.
[0467] Step 6:
[0468] The server sends the optimal menu received from the generation AI to the organizing terminal and the store system. The input data is the generated optimal menu, and the output data is the optimal menu sent to the organizing terminal and the store system. Here, the server converts the received data into an appropriate format and delivers the necessary information to the organizing terminal and the store system.
[0469] Step 7:
[0470] The organizer terminal checks the generated recipe plan and makes corrections as necessary. The input data is the generated recipe plan, which the organizer checks and corrects if necessary. The output data is the corrected final plan.
[0471] Step 8:
[0472] The organizer terminal sends the revised final plan to the provider store system via the server. The input data is the revised meal plan, and the output data is the final plan sent to the provider store system. The server receives this and sends it to the provider store system in the appropriate format.
[0473] Step 9:
[0474] The provider store system prepares food based on the final plan and serves it to the user. The input data is the final plan, and the output data is the prepared food. The provider store system arranges for the necessary ingredients based on the final plan, cooks the food, and delivers it to the user.
[0475] In this way, the present invention provides users with an optimal food delivery menu based on health information and emotional information, thereby reducing food waste and increasing participant satisfaction.
[0476] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0477] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0478] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0479] [Second embodiment]
[0480] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0481] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0482] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0483] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0484] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0485] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0486] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0487] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0488] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0489] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0490] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0491] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0492] The present invention is a system that works in conjunction with a terminal that provides health information to reduce food waste at banquets and parties and provide optimal meals for participants. This system collects dietary information from participants and is able to optimize the content and quantity of dishes based on that information. Specific embodiments of the present invention are described below.
[0493] Overall system configuration
[0494] The system consists of the following components:
[0495] 1. Device that provides health information (user device)
[0496] 2. Server
[0497] 3. Generation AI
[0498] 4. Manager terminal
[0499] 5. Store system
[0500] Terminal that provides health information (user terminal)
[0501] Users use the health support app to input their health information, such as their dietary history, allergy information, and food preferences. This information is used to provide the optimal dishes for the banquet the user is attending. When the user indicates their intention to attend the banquet, the device sends the information to the server.
[0502] server
[0503] The server receives and integrates health information and party participation information sent from user terminals. The server processes and organizes the received data and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[0504] Generation AI
[0505] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, and preferences. The AI then sends the analysis results back to the server, providing the optimized meal plan to the organizer and the restaurant.
[0506] Organizer terminal
[0507] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[0508] Store system provided
[0509] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[0510] Specific examples
[0511] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending, enters party information on the organizer's terminal and sends invitations to the participants. Mr. Tanaka indicates his intention to attend the party through the app and sends this information to the server.
[0512] The server combines Tanaka's health information with the banquet information entered by Suzuki and sends it to the AI generator. The AI then generates an optimal meal plan that takes into account Tanaka's allergies and disliked foods, as well as the information of the other guests, and sends the results to the server.
[0513] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer terminal and makes any necessary changes. The final plan is then sent to the restaurant system via the server.
[0514] The restaurant system will prepare the food based on the final plan and provide the optimal dishes on the day of the banquet. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and other guests can enjoy meals that accommodate their individual preferences and allergies.
[0515] In this way, the system provides meals tailored to the individual needs of participants and significantly reduces food waste.
[0516] The processing flow will be explained below.
[0517] Step 1:
[0518] The user logs into the health support app and enters data such as their allergy information, dietary history, and food preferences.
[0519] Step 2:
[0520] The user selects the party event they plan to attend using the app, indicates their intention to participate, and transmits party participation information to the server.
[0521] Step 3:
[0522] The organizer logs in to the banquet information management system from the organizer's terminal and creates a new banquet event. The organizer enters the details of the banquet (date, time, location, participant list) and sends them to the server.
[0523] Step 4:
[0524] The server receives the health information and participation intention information sent from the user terminal, and also receives detailed information about the party from the organizer terminal.
[0525] Step 5:
[0526] The server integrates the collected health information and banquet information, and compares and adjusts them, allowing for analysis of each participant's dietary history and preference trends.
[0527] Step 6:
[0528] The server sends the integrated data to the generation AI, which generates the optimal cooking plan based on each participant's data.
[0529] Step 7:
[0530] The generative AI analyzes the data sent and determines the contents and portions of meals tailored to each participant's individual needs, taking into account allergies and preferences for specific ingredients, for example.
[0531] Step 8:
[0532] The generation AI sends the optimized meal plan back to the server, which receives the plan and sends it to the host terminal and the restaurant system.
[0533] Step 9:
[0534] The organizer checks the generated meal plan on the organizer's terminal. If any corrections are needed, the organizer makes changes to the plan.
[0535] Step 10:
[0536] The organizer sends the finalized party plan to the server, which then sends this information to the provider's system.
[0537] Step 11:
[0538] Based on the final plan received from the server, the provider store system arranges for the necessary ingredients and prepares cooking.
[0539] Step 12:
[0540] The restaurant system will provide the food according to the final plan on the day of the banquet, allowing each participant to enjoy the food that is best suited to them.
[0541] This reduces food waste and increases participant satisfaction.
[0542] Example 1
[0543] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0544] In traditional banquets and parties, creating a meal plan that takes into account the dietary preferences and allergy information of the participants is time-consuming, and the meals served are often not fully optimized. There were also many cases where the appropriate amount of ingredients was not prepared, resulting in food waste. Furthermore, when meal plans needed to be revised, the process was cumbersome, making it difficult to respond in a timely manner.
[0545] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0546] In this invention, the server includes a means for receiving health information sent from a user terminal, a means for sending the information to the generation AI, and a means for the server to send the optimized meal plan provided by the generation AI to the organizer terminal and the provider store system. This allows for the automatic generation of an optimal meal plan for a banquet or party that takes into account the dietary preferences and allergy information of each participant, reducing food waste and enabling quick and accurate meal plan revisions.
[0547] A "device that provides health information" is a device that allows a user to input and manage their own health information and send it to a server.
[0548] "Participant's dietary information" refers to all diet-related information related to each user, such as allergy information, dietary preferences, and past dietary history.
[0549] "Means for integrating and analyzing" refers to a system for compiling multiple pieces of collected dietary information into a single dataset and analyzing it.
[0550] The "means for optimizing the content and quantity of food served at a banquet" is a system that calculates the type and quantity of food appropriate for each participant based on the analysis results.
[0551] "Means for providing optimized meal plans to the banquet organizer terminal and the restaurant system" refers to a mechanism for transmitting the optimal meal plan obtained from the generation AI to the organizer terminal and the restaurant system.
[0552] "Generative AI" is an artificial intelligence system that analyzes participants' dietary information and automatically generates the optimal cooking plan.
[0553] The "organizer's terminal" is a device used by the organizer to input banquet information and check and modify the menu plan.
[0554] The "store serving system" is a store system that prepares and serves food, and has the function of preparing food based on the optimized cooking plan provided by the generation AI.
[0555] "Data integrity" refers to the standards and methods by which a server handles data sent by a user while maintaining consistency and completeness.
[0556] "Modifying the meal plan" refers to the act of the organizer or the restaurant making necessary changes to the meal plan provided by the generation AI.
[0557] MODE FOR CARRYING OUT THE INVENTION
[0558] The present invention is a system that works in conjunction with a terminal that provides health information, reduces food waste at banquets and parties, and provides optimal meals to participants. Specific embodiments are described below.
[0559] Overall system configuration
[0560] The system consists of the following components:
[0561] 1. Device that provides health information (user device)
[0562] 2. Server
[0563] 3. Generation AI
[0564] 4. Manager terminal
[0565] 5. Store system
[0566] Terminal that provides health information (user terminal)
[0567] Users use the health support app to input their health information, such as their dietary history, allergy information, and food preferences. This information is used to provide the optimal dishes for the banquet the user is attending. When the user indicates their intention to attend the banquet, the device sends the information to the server.
[0568] server
[0569] The server receives and integrates health information and party participation information sent from user devices. The server checks the integrity of the received data, processes and organizes it, and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[0570] Generation AI
[0571] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, and preferences. The AI then sends the analysis results back to the server, providing the optimized meal plan to the organizer and the restaurant.
[0572] Organizer terminal
[0573] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[0574] Store system provided
[0575] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[0576] Specific examples
[0577] For example, suppose User A logs in to a health support app and registers his or her allergies (shrimp) and disliked foods (broccoli). User B, who is the organizer of a party that User A will be attending, enters party information on the organizer's terminal and sends invitations to participants. User A indicates his or her intention to attend the party through the app and sends this information to the server.
[0578] The server combines User A's health information with the banquet information entered by the organizer and sends it to the generation AI. The generation AI takes User A's allergies and disliked foods into consideration, generates an optimal meal plan that also includes information on other participants, and sends the results to the server.
[0579] The planner checks the meal plan created on the planner's terminal and makes any necessary changes. The final plan is then sent to the restaurant's system via the server.
[0580] The restaurant system prepares the food based on the final plan and provides the optimal dishes on the day of the banquet. For example, User A can be served a dish that does not contain shrimp or broccoli, and other guests can also enjoy meals that accommodate their individual preferences and allergies.
[0581] Prompt Sentence Examples
[0582] Below are some example prompts to input to a generative AI model:
[0583] Consider the health information and preferences of banquet attendees to generate an optimal meal plan that reduces food waste.
[0584] Participant list:
[0585] User A: Allergic to shrimp, hates broccoli
[0586] User B: Vegetarian
[0587] User C: Gluten intolerance
[0588] Banquet information:
[0589] Date: December 25, 2023
[0590] Venue: Restaurant in Tokyo
[0591] Number of participants: 10 people
[0592] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0593] Program processing flow
[0594] Step 1: Enter and submit user information
[0595] The user logs in to the health support app and enters their own health information.
[0596] Input: Individual health data such as dietary history, allergy information, and food preferences
[0597] Data processing: The entered health information is stored in a database and the intention to attend the banquet is registered.
[0598] Output: Organized health information data
[0599] When the user presses the "Join" button, the terminal sends this information to the server.
[0600] Specific behavior: When a user registers that they are allergic to shrimp and dislike broccoli, that information is sent to the server.
[0601] Step 2: Data reception and integration by the server
[0602] The server receives the health information and party participation information sent from the user terminal.
[0603] Input: Individual health data and participation intention information sent from the device
[0604] Data processing: Check data integrity and generate a unified dataset
[0605] Output: Integrated health and participation data set
[0606] The server will then format the data as needed and prepare it for transmission to the generating AI.
[0607] Specific actions: Integrate Tanaka's shrimp allergy information and banquet attendance information and organize the data.
[0608] Step 3: Sending data to the generative AI
[0609] The server sends the integrated data, which has been confirmed to be consistent, to the generation AI.
[0610] Input: Integrated health and participation data set
[0611] Data processing: Converting data formats into a format suitable for generative AI
[0612] Output: Data sent to the generative AI
[0613] The server generates the prompt sentences required for analysis and sends them along with the data.
[0614] Specific operation: Based on the integrated data, the AI is instructed to "generate the optimal meal plan taking into account the participants' allergy information."
[0615] Step 4: Data analysis and meal plan generation using generative AI
[0616] The generation AI analyzes the data received from the server and generates the optimal cooking plan.
[0617] Input: Integrated health information and analysis prompts
[0618] Data calculation: Calculate the optimal ingredient selection and dish composition based on each participant's allergy information and preferences
[0619] Output: The optimal cooking plan generated
[0620] The generation AI sends the generated cooking plan back to the server.
[0621] Specific action: Suggest shrimp-free dishes to Tanaka and vegetarian dishes to Suzuki.
[0622] Step 5: Send the generated plan to the server
[0623] The generation AI sends the generated cooking plan to the server.
[0624] Input: Optimal Meal Plan
[0625] Data processing: Preparation of the meal plan sent from the generative AI
[0626] Output: Meal plan sent to the organizing terminal and the restaurant system
[0627] The server receives the meal plan and prepares to provide it to the organizer terminal and the provider store system.
[0628] Specific operation: Prepare to send the meal plan received from the generation AI to the host terminal and the restaurant system
[0629] Step 6: Check and modify the plan on the master terminal
[0630] The organizer accesses the system from the organizer's terminal and checks the cooking plan sent by the generation AI.
[0631] Input: Generated Meal Plan
[0632] Data processing: Modifying plans based on user preferences and party details
[0633] Output: Revised final meal plan
[0634] The plan is amended as necessary, and the final plan is sent to the provider store system via the server.
[0635] Specific operation: The planner makes modifications such as adding desserts, and sends the final plan to the store's system.
[0636] Step 7: Prepare food using the restaurant's system
[0637] The restaurant system prepares and serves food based on the confirmed meal plan.
[0638] Input: Final meal plan
[0639] Data processing: Arranging ingredients and adjusting cooking arrangements based on the plan
[0640] Output: The best dishes to be served on the day of the banquet
[0641] The provider store system arranges the necessary ingredients and cooks the food based on the final plan.
[0642] Specific actions: On the day of the banquet, Tanaka will be served a dish that does not contain shrimp or broccoli, and the other participants will be served dishes that cater to their individual preferences and allergies.
[0643] (Application example 1)
[0644] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0645] At banquets and parties, providing optimal dishes that meet the health conditions and preferences of each guest is a difficult task. Furthermore, preparing food without considering the health and allergy information of guests is one of the causes of food waste. Furthermore, conventional methods require a lot of time and effort to create optimal meal plans, which makes it difficult to efficiently serve food in brick-and-mortar stores. The present invention aims to solve these problems.
[0646] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0647] In this invention, the server includes: means for linking with a terminal that provides health information and collecting meal information of participants; means for integrating the collected meal information and banquet information and sending it to a cloud server; means for integrating and analyzing the data on the cloud server and sending it to a generative AI model; means for optimizing the content and quantity of dishes to be served at the banquet based on the results of the analysis by the generative AI model; and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to efficiently generate meal plans optimized for the health conditions and preferences of participants, reducing food waste in physical restaurants and providing a high-quality dining experience.
[0648] A "terminal for providing health information" is a device that serves to input and provide health information such as a user's dietary history, allergy information, and dietary preferences.
[0649] "Participant" refers to an individual who attends a banquet or party and enters or provides their own health information.
[0650] The "organizer terminal" is a device used to manage banquet and party information and to confirm and modify the meal plans provided by the generation AI.
[0651] "Store system" refers to the store's computer system for preparing and serving food based on the optimized cooking plan.
[0652] The "server" is a central processing unit that receives data sent from user terminals and organizing terminals and sends it to the generation AI.
[0653] "Generative AI" is an artificial intelligence model used to analyze the integrated data received from the server and generate optimal cooking plans.
[0654] A "cloud server" is a distributed computing system for storing and analyzing data over the Internet.
[0655] A "meal plan" is a plan that indicates the content and quantity of meals optimized based on each participant's health information and preferences.
[0656] A system for realizing the present invention comprises the following components:
[0657] 1. Devices that provide health information
[0658] Users install a health support app on their smartphone and enter their health information, such as their dietary history, allergies, and food preferences, which is then sent to the server.
[0659] 2. Server
[0660] The server is built on the cloud and receives and integrates health and banquet information sent from user devices, using cloud services such as Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure.
[0661] 3. Generation AI
[0662] The generation AI analyzes the integrated data sent from the server and generates a cooking plan optimized for each participant. This AI model can be, for example, GPT-4. The analysis results are then sent back to the server.
[0663] 4. Manager terminal
[0664] The organizer checks and modifies the meal plan sent from the AI via the organizer's terminal. The modifications are sent to the restaurant's system via the server.
[0665] 5. Store system
[0666] The restaurant system prepares and serves the food based on the final meal plan. The system is operated by a computer installed in the restaurant, receives data from the cloud, and makes the necessary preparations.
[0667] Specific examples
[0668] For example, User A (let's call him Tanaka) logs in to a health support app and registers his allergy information (shrimp), disliked foods (broccoli), and favorite foods (salmon, avocado). The organizer of a party that Tanaka will be attending uses the organizer's terminal to enter party information (date, time, location, attendees, etc.) and send invitations to the participants. Tanaka receives the invitation and indicates his intention to attend on the app.
[0669] The server combines Tanaka's health information with the banquet information entered by the organizer and sends it to the AI generator, which then takes Tanaka's allergies and disliked foods into consideration to generate the optimal meal plan and sends the results to the server.
[0670] The organizer checks the meal plan created on the organizer's terminal and makes any necessary corrections. The final plan is then sent to the restaurant's system via the server.
[0671] The restaurant system will prepare and serve meals based on the final plan. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and other participants will be able to enjoy meals that accommodate their individual preferences and allergies.
[0672] Prompt Sentence Examples
[0673] An example of a prompt for the generative AI model is as follows:
[0674] User A (Mr. Tanaka) will be attending the party. Mr. Tanaka's health information is as follows:
[0675] Allergy: Shrimp
[0676] Disliked food: Broccoli
[0677] Favorite foods: salmon, avocado
[0678] Recent health checkup results: Cholesterol is slightly high
[0679] Include information from other participants to generate the best meal plan.
[0680] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0681] Step 1:
[0682] User enters health information
[0683] Input: The user opens a health support app installed on their smartphone and enters their dietary history, allergy information, dietary preferences, etc.
[0684] Data processing: The entered health information is converted into JSON format.
[0685] Output: The health information data generated by the health support app is sent to the server in JSON format.
[0686] Step 2:
[0687] The server receives and stores health information
[0688] Input: Health information data sent from the health support app (JSON format)
[0689] Data calculation: The server stores the received data in a database and classifies and organizes it for each participant.
[0690] Output: Organized health information data available for the next processing step.
[0691] Step 3:
[0692] The organizer enters the banquet information
[0693] Input: The organizer uses the organizer terminal to input information such as the date, location, and participant list of the banquet.
[0694] Data processing: The entered banquet information is converted into JSON format and linked to the health information of each participant.
[0695] Output: The linked banquet information data is sent to the server.
[0696] Step 4:
[0697] The server sends the integrated data to the generative AI model.
[0698] Input: Banquet information and associated attendee health information
[0699] Data calculation: The server integrates banquet information and health information to generate a prompt sentence suitable for the generative AI model.
[0700] Output: Send the generated prompt sentence to the generative AI model.
[0701] Step 5:
[0702] Generative AI model generates analysis and cooking plans
[0703] Input: Prompt text sent from the server
[0704] Data calculation: The generative AI model analyzes the prompts and generates an optimal meal plan, taking into account allergies and preferences and calculating the dish contents and quantities appropriate for each participant.
[0705] Output: The generated cooking plan is sent back to the server.
[0706] Step 6:
[0707] The organizer's terminal checks and modifies the meal plan
[0708] Input: Cooking plans sent from a generative AI model
[0709] Data calculation: The organizer terminal presents the displayed cooking plan to the organizer, who can make corrections as necessary.
[0710] Output: The final revised cooking plan is sent to the server.
[0711] Step 7:
[0712] The server sends the final meal plan to the restaurant system.
[0713] Input: Final recipe plan sent from the organizer's terminal
[0714] Data Calculation: The server converts the final meal plan into the appropriate format for sending to the restaurant system.
[0715] Output: The final meal plan is sent to the restaurant system.
[0716] Step 8:
[0717] The restaurant system prepares and serves the food
[0718] Input: The final meal plan sent by the server
[0719] Data calculation: Based on the final plan, the store system arranges the necessary ingredients and starts the cooking process.
[0720] Output: On the day of the banquet, each guest will be served an optimized meal.
[0721] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0722] The present invention is a system for providing optimal meal plans for banquets and parties in cooperation with a device that provides health information and emotions. This system collects dietary information and emotional information from participants and can optimize the content and quantity of dishes based on that information. Specific embodiments of the present invention are described below.
[0723] Overall system configuration
[0724] The system consists of the following components:
[0725] 1. Device that provides health information and emotions (user device)
[0726] 2. Server
[0727] 3. Generation AI
[0728] 4. Emotion Engine
[0729] 5. Manager terminal
[0730] 6. Store System
[0731] Terminal that provides health information and emotions (user terminal)
[0732] Using a health support app, users input health information such as their dietary history, allergies, and food preferences. The device is also equipped with an emotion engine that recognizes emotions from the user's facial expressions, tone of voice, text messages, and other factors. This information is used to provide optimal dishes for banquets that the user is attending. When the user indicates their intention to attend a banquet, the device sends that information to the server.
[0733] server
[0734] The server receives and integrates the health information, emotional information, and participation intention information sent from the user terminal. The server processes and organizes the received data and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[0735] Generation AI
[0736] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, preferences, and emotional information. The AI then sends the analysis results back to the server, providing an optimized meal plan to the organizer and the restaurants.
[0737] Emotion Engine
[0738] The emotion engine has the ability to analyze users' emotions from their facial expressions, tone of voice, text messages, etc. This allows participants' emotional states (e.g., stress, joy, sadness, etc.) to be grasped in real time and reflected in the cooking plan as needed.
[0739] Organizer terminal
[0740] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[0741] Store system provided
[0742] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[0743] Specific examples
[0744] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending, enters party information on the organizer's terminal and sends invitations to the participants. Mr. Tanaka indicates his intention to attend the party through the app and sends this information to the server.
[0745] The emotion engine analyzes Tanaka's facial expressions and tone of voice to determine his stress level and happiness, and obtains that information.
[0746] The server combines Tanaka's health and emotional information with the banquet information entered by Suzuki and sends it to the AI generator. The AI then generates an optimal meal plan that takes into account Tanaka's allergies, disliked foods, and even his emotions, and also integrates information about the other guests, and sends the results to the server.
[0747] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer terminal and makes any necessary changes. The final plan is then sent to the restaurant system via the server.
[0748] The restaurant system will prepare the food based on the final plan and provide the optimal dishes on the day of the banquet. At this time, ingredients and cooking methods that have a relaxing effect may be selected to reflect Tanaka's emotional state.
[0749] In this way, meals tailored to the individual needs of participants are provided based on health and emotional information, significantly reducing food waste and improving emotional satisfaction.
[0750] The processing flow will be explained below.
[0751] Step 1:
[0752] A user logs in to the health support app and enters health information such as their allergy information, dietary history, and food preferences. In addition, the emotion engine collects emotional information from the user's facial expressions, tone of voice, text messages, etc.
[0753] Step 2:
[0754] The user selects a party event they plan to attend using the app, indicates their intention to participate, and transmits party participation information, health information, and emotional information to the server.
[0755] Step 3:
[0756] The organizer logs in to the banquet information management system from the organizer's terminal and creates a new banquet event. The organizer enters the details of the banquet (date, time, location, and participant list) and sends them to the server.
[0757] Step 4:
[0758] The server receives the health information, emotional information, and participation intention information sent from the user terminal, and also receives detailed information about the party from the organizer terminal.
[0759] Step 5:
[0760] The server integrates the collected health information, emotional information, and banquet information, compares and adjusts them, and sends the data to the generation AI.
[0761] Step 6:
[0762] The generative AI analyzes the integrated data sent from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, preferences, and emotional information. The generative AI takes into account ingredients and cooking methods to optimize the meal plan.
[0763] Step 7:
[0764] The generation AI sends the optimized meal plan back to the server, which receives the plan and sends it to the host terminal and the restaurant system.
[0765] Step 8:
[0766] The organizer checks the generated meal plan on the organizer's terminal. If any corrections are needed, the organizer makes changes to the plan.
[0767] Step 9:
[0768] The organizer sends the finalized party plan to the server, which then sends this information to the provider's system.
[0769] Step 10:
[0770] Based on the final plan received from the server, the provider store system arranges for the necessary ingredients and prepares cooking.
[0771] Step 11:
[0772] The restaurant system will provide the food according to the final plan on the day of the banquet, allowing each participant to enjoy the food that is best suited to them.
[0773] Specific examples
[0774] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). When User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending via the app, expresses his intention to attend based on the party information managed on the organizer's device, the emotion engine analyzes Mr. Tanaka's facial expressions and tone of voice and sends this information to the server.
[0775] The server combines Tanaka's health and emotional information with the banquet information entered by Suzuki and sends it to the generation AI.
[0776] The AI generates an optimal cooking plan that takes into account Tanaka's allergies, disliked foods, and emotions, and also integrates information from other participants. For example, if Tanaka is feeling stressed, it generates a plan that incorporates herbs and ingredients with a relaxing effect. The AI then sends the results to the server.
[0777] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer's terminal and makes any necessary changes. The final plan is sent to the restaurant's system via the server.
[0778] The restaurant system will prepare the food based on the final plan and provide the most suitable dishes on the day of the banquet. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and will use herbs that have a relaxing effect.
[0779] In this way, meals tailored to the individual needs of participants are provided based on health and emotional information, significantly reducing food waste and improving emotional satisfaction.
[0780] Example 2
[0781] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0782] Currently, at many banquets and parties, it is difficult to consider the individual dietary restrictions, preferences, and emotions of each participant, resulting in food waste and reduced participant satisfaction. Providing a safe and satisfying meal is particularly difficult for participants with allergies or dietary restrictions. Furthermore, meal plans that take into account the emotional state of participants are rarely provided, which does not lead to improved overall satisfaction. To solve these issues, a system is needed that provides optimal meal plans based on participants' health and emotional information.
[0783] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting meal information and emotional information of participants in cooperation with the terminal that provides health information and emotional information, means for integrating and analyzing the collected meal information and emotional information, means for optimizing the content and quantity of dishes to be served at the banquet based on the analysis results, and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to provide an optimal meal plan that takes into account the health information and emotional state of each participant, thereby reducing food waste and improving participant satisfaction.
[0784] "Health information" is data related to the user's health condition, such as the user's dietary history, allergy information, and dietary preferences.
[0785] "Emotional information" is data about the user's emotional state, analyzed based on the user's facial expressions, tone of voice, text messages, etc.
[0786] A "terminal" is a device used by a user to input and transmit health information and emotional information, such as a smartphone or tablet.
[0787] The "server" is a central system that receives health and emotional information sent from user devices and processes, organizes, integrates, and transmits it.
[0788] "Generative AI" is an artificial intelligence that analyzes data received from the server and generates optimal cooking plans based on the individual health and emotional information of each participant.
[0789] The "organizer's terminal" is a device used by the organizer of a banquet or party to check and modify the generated menu plan.
[0790] The "store system" is a system for preparing and serving food based on a confirmed meal plan.
[0791] A "meal plan" is a plan that indicates the content and quantity of meals optimized based on the participant's health and emotional information.
[0792] "Synthesis" is the process of combining collected data into a coherent whole.
[0793] "Analysis" is the process of examining and examining collected data to derive meaningful information.
[0794] "Optimization" refers to adjusting to the most effective or efficient state based on specific conditions.
[0795] The present invention is a system for providing optimal meal plans for banquets and parties in cooperation with a terminal that provides health information and emotional information. Specific embodiments of the present invention will be described below.
[0796] Hardware and software used
[0797] 1. Devices that provide health and emotional information (user devices)
[0798] Users use a smartphone or tablet with a health support app installed.
[0799] Emotion analysis software (e.g., Microsoft Azure Emotion API) is built into the user's device to recognize emotions from the user's facial expressions, tone of voice, and text messages.
[0800] 2. Server
[0801] Use cloud-based integrated systems, e.g., AWS, Google Cloud.
[0802] The server receives health and emotional information sent from the user's device and processes, organizes, and integrates the data.
[0803] 3. Generation AI
[0804] As a generative AI model, e.g., OpenAI GPT-3 is used.
[0805] The data received from the server is analyzed and the optimal cooking plan is generated.
[0806] 4. Manager terminal
[0807] The organizer will use a smartphone or tablet with a banquet management app installed.
[0808] The organizer's terminal can check and modify the cooking plan sent from the generation AI.
[0809] 5. Store system
[0810] The store system uses computers or tablets with reservation and cooking management software installed.
[0811] Prepare and serve food based on the final meal plan.
[0812] System Operation
[0813] In this system, users use a health support app to input their own health information (e.g., dietary history, allergy information, food preferences) and emotional information. The terminal sends this information to a server. The server processes and organizes the received information and sends it to a generation AI. The generation AI generates an optimal meal plan based on the analysis results and sends it back to the server. The server provides the optimized meal plan to the host terminal and the restaurant system. The restaurant system prepares the food based on the final meal plan and serves it on the day of the banquet.
[0814] Specific examples
[0815] For example, User A (Mr. Tanaka) logs into a health support app and registers his or her allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Tanaka will be attending, enters party information on his or her organizer device and sends invitations to the participants. Tanaka indicates his or her intention to attend the party through the app and sends this information to the server. The emotion engine analyzes Tanaka's facial expressions and tone of voice to indicate his or her stress level and happiness, and acquires this information. The server combines Tanaka's health and emotional information with the party information entered by Suzuki and sends it to the generation AI. The generation AI generates an optimal meal plan that takes into account Tanaka's allergies, disliked foods, and emotions, as well as the information of other participants, and sends the result to the server. Organizer B (Mr. Suzuki) reviews the meal plan generated on his or her organizer device and makes changes as necessary. The final plan is then sent via the server to the restaurant system. The restaurant system prepares the food based on the final plan and serves the optimal dishes on the day of the party.
[0816] Prompt Sentence Examples
[0817] "Generate a stress-reducing meal plan that excludes shrimp based on the following participant information:
[0818] Participant: Tanaka-san
[0819] Allergy: Shrimp
[0820] Disliked food: Broccoli
[0821] Emotional information: High stress level
[0822] Please combine this information with other participants' information to come up with a plan that everyone can enjoy.
[0823] In this way, the system of the present invention can provide meals tailored to the individual needs of participants based on health and emotional information, significantly reducing food waste while improving emotional satisfaction.
[0824] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0825] Step 1:
[0826] A user enters their own health information (e.g., dietary history, allergy information, food preferences) and emotional information (e.g., facial expressions, tone of voice, text messages) into a health support app. The input information is entered into a form within the app and confirmed by pressing the submit button. The input data includes specific allergens and favorite dishes.
[0827] Input: User-entered health and emotional information
[0828] Output: Health and emotional information stored on the device
[0829] Step 2:
[0830] The device automatically transmits the entered health and emotional information to the server, where the data is encrypted and securely transferred to the server.
[0831] Input: Health and emotional information stored on the device
[0832] Output: Health and emotion information sent to the server
[0833] Step 3:
[0834] The server receives the health and emotional information sent from the device and processes and organizes the data, such as removing duplicate data and filling in missing data. The server then integrates each user's data and converts it into a consistent format.
[0835] Input: Health and emotional information sent from the device
[0836] Output: Formatted and processed health and emotional information
[0837] Step 4:
[0838] The server sends the formatted and processed data to the generation AI, which then formats the data into a format that the generation AI can understand, and generates and sends a prompt.
[0839] Input: Formatted and processed health and emotional information
[0840] Output: The aggregated data and prompt sent to the generative AI
[0841] Step 5:
[0842] The AI then analyzes the integrated data and generates an optimal meal plan, taking into account each participant's allergies, dietary preferences, and emotional state.
[0843] Input: Integrated data and prompt sent from the server
[0844] Output: The optimal cooking plan generated
[0845] Step 6:
[0846] The generation AI returns the generated meal plan to the server, which receives the plan and sends it to the organizer terminal and the restaurant system.
[0847] Input: Generated optimal cooking plan
[0848] Output: Meal plan sent to the manager terminal and the restaurant system
[0849] Step 7:
[0850] The organizer uses the organizer terminal to check the generated meal plan, make any necessary corrections, and finalize the meal plan. The organizer terminal can make changes through a simple user interface.
[0851] Input: Meal plan sent to the organizer's terminal
[0852] Output: Revised final meal plan
[0853] Step 8:
[0854] The organizer terminal transmits the final plan to the provider store system via the server, and the provider store system prepares the dishes based on the final plan.
[0855] Input: Revised final meal plan
[0856] Output: Final meal plan sent to the restaurant system
[0857] Step 9:
[0858] Based on the final plan, the restaurant system will arrange for the necessary ingredients and cooking arrangements, and provide the food on the day of the banquet. The kitchen staff will prepare the food according to the plan provided, providing the best possible food for each guest.
[0859] Input: Final meal plan sent to the restaurant system
[0860] Output: The best dishes to be served on the day of the banquet
[0861] (Application example 2)
[0862] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0863] Currently, there is no system for providing optimal meal plans at banquets and parties based on the individual health and emotional information of each participant. As a result, the food provided may not be suitable for the participant's health or mood, which increases food waste and reduces participant satisfaction.
[0864] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting meal information and emotional information of participants in cooperation with a terminal that provides health information and emotional information, means for integrating and analyzing the collected meal information and emotional information, means for optimizing the content and quantity of dishes to be served at the banquet based on the analysis results, means for notifying participants of the optimized meal plan using a smartphone application to support their ordering, and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to provide an optimal meal plan tailored to the health status and emotional state of participants, thereby reducing food waste and improving participant satisfaction.
[0865] "Health information" refers to data such as participants' allergy information, dietary preferences, and dietary history.
[0866] "Emotional information" refers to data that indicates a participant's emotional state, such as facial expressions, tone of voice, or text messages.
[0867] "Terminal" refers to devices used to collect health and emotional information, including smartphones and tablets.
[0868] "Means of collection" refers to the method of obtaining data using the device that provides health information and emotional information.
[0869] "Means of integration and analysis" refers to the process of organizing, integrating, and analyzing the collected health and emotional information.
[0870] "Optimization means" refers to methods for adjusting the content and quantity of food served based on the analysis results.
[0871] "Smartphone application" refers to software that runs on a smartphone and allows participants to input and collect health and emotional information and notify them of the optimal cooking plan.
[0872] "Means for notifying and supporting ordering" refers to a method of using a smartphone application to communicate the generated meal plan to participants and support their ordering.
[0873] "Organizer terminal" refers to a device used by the organizer of a banquet to review and modify the generated menu plan.
[0874] "Provider System" refers to the system used by restaurants and food delivery companies to prepare and serve food based on an optimized meal plan.
[0875] "Generative AI" refers to artificial intelligence used to analyze collected data and generate optimal cooking plans.
[0876] A "prompt" refers to the input text used to provide instructions to the generation AI, and is used to generate optimal cooking plans based on the user's health and emotional information.
[0877] This invention is a system for providing optimal food delivery menus based on participants' health and emotional information. This system consists of a user terminal, a server, a generation AI, an emotion engine, a manager terminal, and a provider store system. The following explains the details of each component and the overall flow.
[0878] User terminal
[0879] User devices are mainly smartphones and perform the following functions:
[0880] Entering health information: Users enter their allergy information, dietary preferences, and dietary history.
[0881] Emotional information collection: Uses the smartphone's camera, microphone, and text input to collect the user's emotional information (facial expressions, tone of voice, text messages, etc.).
[0882] Data transmission: The entered health and emotional information is transmitted to the server.
[0883] server
[0884] The server has the following roles:
[0885] Data integration: Integrate and organize health and emotional information received from user devices.
[0886] Prepare data for analysis: Send the combined data to the generative AI for analysis.
[0887] Information distribution: Receives the analysis results of the generating AI and sends them to the master terminal and the provider store system.
[0888] Generation AI
[0889] The generation AI plays the following roles:
[0890] Data analysis: Generates optimal food delivery menus based on health and emotional information sent from the server.
[0891] Return result: The generated menu is returned to the server.
[0892] Emotion Engine
[0893] The emotion engine analyzes the user's emotions and has the following roles:
[0894] Facial expression analysis: Analyzes the user's facial expressions from image data collected through the camera.
[0895] Voice analysis: Analyzes the tone of voice from audio data collected through a microphone.
[0896] Text analysis: Analyze text messages to infer the user's emotional state.
[0897] Organizer terminal
[0898] The organizer terminal is used by the organizer of the party and fulfills the following roles:
[0899] Review and modify the meal plan: Review the meal plan sent by the generation AI and modify it as necessary.
[0900] Sending the revised results: Send the revised final plan to the store system.
[0901] Store system provided
[0902] The provider store system will have the following roles:
[0903] Order Receipt: Receiving food delivery orders based on the optimized meal plan sent by the server.
[0904] Food preparation and serving: Prepare food based on the final plan and deliver it to the user.
[0905] Specific examples
[0906] For example, a user uses a health app to register their allergy information (wheat allergy) and input their emotion, such as "I want to relieve stress today." This information is sent to a server via their smartphone. The emotion engine analyzes the user's feelings from images taken with the camera and text messages they input, and determines that they are slightly tired. The server then sends this information to a generation AI, which then generates an optimal food delivery menu (e.g., gluten-free carbonara and herbal tea). This information is then sent via the server to the restaurant's system and delivered to the user.
[0907] Prompt Sentence Examples
[0908] "I feel like relaxing today."
[0909] In this way, the present invention provides optimal cooking plans tailored to the needs of each individual user, reducing food waste and increasing participant satisfaction.
[0910] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0911] Step 1:
[0912] The user terminal displays a health information input screen, and the user inputs their allergy information, dietary preferences, and dietary history. The input data is saved in the terminal and passed to the next processing step. The input data is the user's allergy information, dietary preferences, and dietary history, and is converted into an appropriate format.
[0913] Step 2:
[0914] The user device collects the user's emotional information using a camera, microphone, and text input. Specifically, the camera captures the user's facial expressions, the microphone records the tone of voice, and the user enters their mood through text input. The resulting data are facial expression images, audio files, and text data, which are then converted into a format that is easy to analyze by the emotion engine.
[0915] Step 3:
[0916] The user device sends the collected health and emotional information to the server. The input data is the health and emotional information stored in the device, and the server receives it. After receiving it, the data is checked for consistency and formatted if necessary.
[0917] Step 4:
[0918] The server integrates the received health and emotional information and sends it to the generation AI for analysis. The server converts these data into an appropriate format and performs data integration and pre-analysis. The input data is the collected health and emotional information, and the output data is the integrated health and emotional information.
[0919] Step 5:
[0920] The Generative AI analyzes the integrated data sent from the server and generates the optimal food delivery menu for each user. The input data is integrated health and emotional information, and the output data is an optimized food delivery menu. The Generative AI analyzes this data and proposes the optimal menu for each user.
[0921] Step 6:
[0922] The server sends the optimal menu received from the generation AI to the organizing terminal and the store system. The input data is the generated optimal menu, and the output data is the optimal menu sent to the organizing terminal and the store system. Here, the server converts the received data into an appropriate format and delivers the necessary information to the organizing terminal and the store system.
[0923] Step 7:
[0924] The organizer terminal checks the generated recipe plan and makes corrections as necessary. The input data is the generated recipe plan, which the organizer checks and corrects if necessary. The output data is the corrected final plan.
[0925] Step 8:
[0926] The organizer terminal sends the revised final plan to the provider store system via the server. The input data is the revised meal plan, and the output data is the final plan sent to the provider store system. The server receives this and sends it to the provider store system in the appropriate format.
[0927] Step 9:
[0928] The provider store system prepares food based on the final plan and serves it to the user. The input data is the final plan, and the output data is the prepared food. The provider store system arranges for the necessary ingredients based on the final plan, cooks the food, and delivers it to the user.
[0929] In this way, the present invention provides users with an optimal food delivery menu based on health information and emotional information, thereby reducing food waste and increasing participant satisfaction.
[0930] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0931] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0932] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0933] [Third embodiment]
[0934] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0935] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0936] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0937] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0938] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0939] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0940] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0941] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0942] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0943] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0944] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0945] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0946] The present invention is a system that works in conjunction with a terminal that provides health information to reduce food waste at banquets and parties and provide optimal meals for participants. This system collects dietary information from participants and is able to optimize the content and quantity of dishes based on that information. Specific embodiments of the present invention are described below.
[0947] Overall system configuration
[0948] The system consists of the following components:
[0949] 1. Device that provides health information (user device)
[0950] 2. Server
[0951] 3. Generation AI
[0952] 4. Manager terminal
[0953] 5. Store system
[0954] Terminal that provides health information (user terminal)
[0955] Users use the health support app to input their health information, such as their dietary history, allergy information, and food preferences. This information is used to provide the optimal dishes for the banquet the user is attending. When the user indicates their intention to attend the banquet, the device sends the information to the server.
[0956] server
[0957] The server receives and integrates health information and party participation information sent from user terminals. The server processes and organizes the received data and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[0958] Generation AI
[0959] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, and preferences. The AI then sends the analysis results back to the server, providing the optimized meal plan to the organizer and the restaurant.
[0960] Organizer terminal
[0961] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[0962] Store system provided
[0963] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[0964] Specific examples
[0965] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending, enters party information on the organizer's terminal and sends invitations to the participants. Mr. Tanaka indicates his intention to attend the party through the app and sends this information to the server.
[0966] The server combines Tanaka's health information with the banquet information entered by Suzuki and sends it to the AI generator. The AI then generates an optimal meal plan that takes into account Tanaka's allergies and disliked foods, as well as the information of the other guests, and sends the results to the server.
[0967] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer terminal and makes any necessary changes. The final plan is then sent to the restaurant system via the server.
[0968] The restaurant system will prepare the food based on the final plan and provide the optimal dishes on the day of the banquet. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and other guests can enjoy meals that accommodate their individual preferences and allergies.
[0969] In this way, the system provides meals tailored to the individual needs of participants and significantly reduces food waste.
[0970] The processing flow will be explained below.
[0971] Step 1:
[0972] The user logs into the health support app and enters data such as their allergy information, dietary history, and food preferences.
[0973] Step 2:
[0974] The user selects the party event they plan to attend using the app, indicates their intention to participate, and transmits party participation information to the server.
[0975] Step 3:
[0976] The organizer logs in to the banquet information management system from the organizer's terminal and creates a new banquet event. The organizer enters the details of the banquet (date, time, location, participant list) and sends them to the server.
[0977] Step 4:
[0978] The server receives the health information and participation intention information sent from the user terminal, and also receives detailed information about the party from the organizer terminal.
[0979] Step 5:
[0980] The server integrates the collected health information and banquet information, and compares and adjusts them, allowing for analysis of each participant's dietary history and preference trends.
[0981] Step 6:
[0982] The server sends the integrated data to the generation AI, which generates the optimal cooking plan based on each participant's data.
[0983] Step 7:
[0984] The generative AI analyzes the data sent and determines the contents and portions of meals tailored to each participant's individual needs, taking into account allergies and preferences for specific ingredients, for example.
[0985] Step 8:
[0986] The generation AI sends the optimized meal plan back to the server, which receives the plan and sends it to the host terminal and the restaurant system.
[0987] Step 9:
[0988] The organizer checks the generated meal plan on the organizer's terminal. If any corrections are needed, the organizer makes changes to the plan.
[0989] Step 10:
[0990] The organizer sends the finalized party plan to the server, which then sends this information to the provider's system.
[0991] Step 11:
[0992] Based on the final plan received from the server, the provider store system arranges for the necessary ingredients and prepares cooking.
[0993] Step 12:
[0994] The restaurant system will provide the food according to the final plan on the day of the banquet, allowing each participant to enjoy the food that is best suited to them.
[0995] This reduces food waste and increases participant satisfaction.
[0996] Example 1
[0997] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0998] In traditional banquets and parties, creating a meal plan that takes into account the dietary preferences and allergy information of the participants is time-consuming, and the meals served are often not fully optimized. There were also many cases where the appropriate amount of ingredients was not prepared, resulting in food waste. Furthermore, when meal plans needed to be revised, the process was cumbersome, making it difficult to respond in a timely manner.
[0999] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1000] In this invention, the server includes a means for receiving health information sent from a user terminal, a means for sending the information to the generation AI, and a means for the server to send the optimized meal plan provided by the generation AI to the organizer terminal and the provider store system. This allows for the automatic generation of an optimal meal plan for a banquet or party that takes into account the dietary preferences and allergy information of each participant, reducing food waste and enabling quick and accurate meal plan revisions.
[1001] A "device that provides health information" is a device that allows a user to input and manage their own health information and send it to a server.
[1002] "Participant's dietary information" refers to all diet-related information related to each user, such as allergy information, dietary preferences, and past dietary history.
[1003] "Means for integrating and analyzing" refers to a system for compiling multiple pieces of collected dietary information into a single dataset and analyzing it.
[1004] The "means for optimizing the content and quantity of food served at a banquet" is a system that calculates the type and quantity of food appropriate for each participant based on the analysis results.
[1005] "Means for providing optimized meal plans to the banquet organizer terminal and the restaurant system" refers to a mechanism for transmitting the optimal meal plan obtained from the generation AI to the organizer terminal and the restaurant system.
[1006] "Generative AI" is an artificial intelligence system that analyzes participants' dietary information and automatically generates the optimal cooking plan.
[1007] The "organizer's terminal" is a device used by the organizer to input banquet information and check and modify the menu plan.
[1008] The "store serving system" is a store system that prepares and serves food, and has the function of preparing food based on the optimized cooking plan provided by the generation AI.
[1009] "Data integrity" refers to the standards and methods by which a server handles data sent by a user while maintaining consistency and completeness.
[1010] "Modifying the meal plan" refers to the act of the organizer or the restaurant making necessary changes to the meal plan provided by the generation AI.
[1011] MODE FOR CARRYING OUT THE INVENTION
[1012] The present invention is a system that works in conjunction with a terminal that provides health information, reduces food waste at banquets and parties, and provides optimal meals to participants. Specific embodiments are described below.
[1013] Overall system configuration
[1014] The system consists of the following components:
[1015] 1. Device that provides health information (user device)
[1016] 2. Server
[1017] 3. Generation AI
[1018] 4. Manager terminal
[1019] 5. Store system
[1020] Terminal that provides health information (user terminal)
[1021] Users use the health support app to input their health information, such as their dietary history, allergy information, and food preferences. This information is used to provide the optimal dishes for the banquet the user is attending. When the user indicates their intention to attend the banquet, the device sends the information to the server.
[1022] server
[1023] The server receives and integrates health information and party participation information sent from user devices. The server checks the integrity of the received data, processes and organizes it, and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[1024] Generation AI
[1025] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, and preferences. The AI then sends the analysis results back to the server, providing the optimized meal plan to the organizer and the restaurant.
[1026] Organizer terminal
[1027] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[1028] Store system provided
[1029] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[1030] Specific examples
[1031] For example, suppose User A logs in to a health support app and registers his or her allergies (shrimp) and disliked foods (broccoli). User B, who is the organizer of a party that User A will be attending, enters party information on the organizer's terminal and sends invitations to participants. User A indicates his or her intention to attend the party through the app and sends this information to the server.
[1032] The server combines User A's health information with the banquet information entered by the organizer and sends it to the generation AI. The generation AI takes User A's allergies and disliked foods into consideration, generates an optimal meal plan that also includes information on other participants, and sends the results to the server.
[1033] The planner checks the meal plan created on the planner's terminal and makes any necessary changes. The final plan is then sent to the restaurant's system via the server.
[1034] The restaurant system prepares the food based on the final plan and provides the optimal dishes on the day of the banquet. For example, User A can be served a dish that does not contain shrimp or broccoli, and other guests can also enjoy meals that accommodate their individual preferences and allergies.
[1035] Prompt Sentence Examples
[1036] Below are some example prompts to input to a generative AI model:
[1037] Consider the health information and preferences of banquet attendees to generate an optimal meal plan that reduces food waste.
[1038] Participant list:
[1039] User A: Allergic to shrimp, hates broccoli
[1040] User B: Vegetarian
[1041] User C: Gluten intolerance
[1042] Banquet information:
[1043] Date: December 25, 2023
[1044] Venue: Restaurant in Tokyo
[1045] Number of participants: 10 people
[1046] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1047] Program processing flow
[1048] Step 1: Enter and submit user information
[1049] The user logs in to the health support app and enters their own health information.
[1050] Input: Individual health data such as dietary history, allergy information, and food preferences
[1051] Data processing: The entered health information is stored in a database and the intention to attend the banquet is registered.
[1052] Output: Organized health information data
[1053] When the user presses the "Join" button, the terminal sends this information to the server.
[1054] Specific behavior: When a user registers that they are allergic to shrimp and dislike broccoli, that information is sent to the server.
[1055] Step 2: Data reception and integration by the server
[1056] The server receives the health information and party participation information sent from the user terminal.
[1057] Input: Individual health data and participation intention information sent from the device
[1058] Data processing: Check data integrity and generate a unified dataset
[1059] Output: Integrated health and participation data set
[1060] The server will then format the data as needed and prepare it for transmission to the generating AI.
[1061] Specific actions: Integrate Tanaka's shrimp allergy information and banquet attendance information and organize the data.
[1062] Step 3: Sending data to the generative AI
[1063] The server sends the integrated data, which has been confirmed to be consistent, to the generation AI.
[1064] Input: Integrated health and participation data set
[1065] Data processing: Converting data formats into a format suitable for generative AI
[1066] Output: Data sent to the generative AI
[1067] The server generates the prompt sentences required for analysis and sends them along with the data.
[1068] Specific operation: Based on the integrated data, the AI is instructed to "generate the optimal meal plan taking into account the participants' allergy information."
[1069] Step 4: Data analysis and meal plan generation using generative AI
[1070] The generation AI analyzes the data received from the server and generates the optimal cooking plan.
[1071] Input: Integrated health information and analysis prompts
[1072] Data calculation: Calculate the optimal ingredient selection and dish composition based on each participant's allergy information and preferences
[1073] Output: The optimal cooking plan generated
[1074] The generation AI sends the generated cooking plan back to the server.
[1075] Specific action: Suggest shrimp-free dishes to Tanaka and vegetarian dishes to Suzuki.
[1076] Step 5: Send the generated plan to the server
[1077] The generation AI sends the generated cooking plan to the server.
[1078] Input: Optimal Meal Plan
[1079] Data processing: Preparation of the meal plan sent from the generative AI
[1080] Output: Meal plan sent to the organizing terminal and the restaurant system
[1081] The server receives the meal plan and prepares to provide it to the organizer terminal and the provider store system.
[1082] Specific operation: Prepare to send the meal plan received from the generation AI to the host terminal and the restaurant system
[1083] Step 6: Check and modify the plan on the master terminal
[1084] The organizer accesses the system from the organizer's terminal and checks the cooking plan sent by the generation AI.
[1085] Input: Generated Meal Plan
[1086] Data processing: Modifying plans based on user preferences and party details
[1087] Output: Revised final meal plan
[1088] The plan is amended as necessary, and the final plan is sent to the provider store system via the server.
[1089] Specific operation: The planner makes modifications such as adding desserts, and sends the final plan to the store's system.
[1090] Step 7: Prepare food using the restaurant's system
[1091] The restaurant system prepares and serves food based on the confirmed meal plan.
[1092] Input: Final meal plan
[1093] Data processing: Arranging ingredients and adjusting cooking arrangements based on the plan
[1094] Output: The best dishes to be served on the day of the banquet
[1095] The provider store system arranges the necessary ingredients and cooks the food based on the final plan.
[1096] Specific actions: On the day of the banquet, Tanaka will be served a dish that does not contain shrimp or broccoli, and the other participants will be served dishes that cater to their individual preferences and allergies.
[1097] (Application example 1)
[1098] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1099] At banquets and parties, providing optimal dishes that meet the health conditions and preferences of each guest is a difficult task. Furthermore, preparing food without considering the health and allergy information of guests is one of the causes of food waste. Furthermore, conventional methods require a lot of time and effort to create optimal meal plans, which makes it difficult to efficiently serve food in brick-and-mortar stores. The present invention aims to solve these problems.
[1100] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1101] In this invention, the server includes: means for linking with a terminal that provides health information and collecting meal information of participants; means for integrating the collected meal information and banquet information and sending it to a cloud server; means for integrating and analyzing the data on the cloud server and sending it to a generative AI model; means for optimizing the content and quantity of dishes to be served at the banquet based on the results of the analysis by the generative AI model; and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to efficiently generate meal plans optimized for the health conditions and preferences of participants, reducing food waste in physical restaurants and providing a high-quality dining experience.
[1102] A "terminal for providing health information" is a device that serves to input and provide health information such as a user's dietary history, allergy information, and dietary preferences.
[1103] "Participant" refers to an individual who attends a banquet or party and enters or provides their own health information.
[1104] The "organizer terminal" is a device used to manage banquet and party information and to confirm and modify the meal plans provided by the generation AI.
[1105] "Store system" refers to the store's computer system for preparing and serving food based on the optimized cooking plan.
[1106] The "server" is a central processing unit that receives data sent from user terminals and organizing terminals and sends it to the generation AI.
[1107] "Generative AI" is an artificial intelligence model used to analyze the integrated data received from the server and generate optimal cooking plans.
[1108] A "cloud server" is a distributed computing system for storing and analyzing data over the Internet.
[1109] A "meal plan" is a plan that indicates the content and quantity of meals optimized based on each participant's health information and preferences.
[1110] A system for realizing the present invention comprises the following components:
[1111] 1. Devices that provide health information
[1112] Users install a health support app on their smartphone and enter their health information, such as their dietary history, allergies, and food preferences, which is then sent to the server.
[1113] 2. Server
[1114] The server is built on the cloud and receives and integrates health and banquet information sent from user devices, using cloud services such as Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure.
[1115] 3. Generation AI
[1116] The generation AI analyzes the integrated data sent from the server and generates a cooking plan optimized for each participant. This AI model can be, for example, GPT-4. The analysis results are then sent back to the server.
[1117] 4. Manager terminal
[1118] The organizer checks and modifies the meal plan sent from the AI via the organizer's terminal. The modifications are sent to the restaurant's system via the server.
[1119] 5. Store system
[1120] The restaurant system prepares and serves the food based on the final meal plan. The system is operated by a computer installed in the restaurant, receives data from the cloud, and makes the necessary preparations.
[1121] Specific examples
[1122] For example, User A (let's call him Tanaka) logs in to a health support app and registers his allergy information (shrimp), disliked foods (broccoli), and favorite foods (salmon, avocado). The organizer of a party that Tanaka will be attending uses the organizer's terminal to enter party information (date, time, location, attendees, etc.) and send invitations to the participants. Tanaka receives the invitation and indicates his intention to attend on the app.
[1123] The server combines Tanaka's health information with the banquet information entered by the organizer and sends it to the AI generator, which then takes Tanaka's allergies and disliked foods into consideration to generate the optimal meal plan and sends the results to the server.
[1124] The organizer checks the meal plan created on the organizer's terminal and makes any necessary corrections. The final plan is then sent to the restaurant's system via the server.
[1125] The restaurant system will prepare and serve meals based on the final plan. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and other participants will be able to enjoy meals that accommodate their individual preferences and allergies.
[1126] Prompt Sentence Examples
[1127] An example of a prompt for the generative AI model is as follows:
[1128] User A (Mr. Tanaka) will be attending the party. Mr. Tanaka's health information is as follows:
[1129] Allergy: Shrimp
[1130] Disliked food: Broccoli
[1131] Favorite foods: salmon, avocado
[1132] Recent health checkup results: Cholesterol is slightly high
[1133] Include information from other participants to generate the best meal plan.
[1134] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1135] Step 1:
[1136] User enters health information
[1137] Input: The user opens a health support app installed on their smartphone and enters their dietary history, allergy information, dietary preferences, etc.
[1138] Data processing: The entered health information is converted into JSON format.
[1139] Output: The health information data generated by the health support app is sent to the server in JSON format.
[1140] Step 2:
[1141] The server receives and stores health information
[1142] Input: Health information data sent from the health support app (JSON format)
[1143] Data calculation: The server stores the received data in a database and classifies and organizes it for each participant.
[1144] Output: Organized health information data available for the next processing step.
[1145] Step 3:
[1146] The organizer enters the banquet information
[1147] Input: The organizer uses the organizer terminal to input information such as the date, location, and participant list of the banquet.
[1148] Data processing: The entered banquet information is converted into JSON format and linked to the health information of each participant.
[1149] Output: The linked banquet information data is sent to the server.
[1150] Step 4:
[1151] The server sends the integrated data to the generative AI model.
[1152] Input: Banquet information and associated attendee health information
[1153] Data calculation: The server integrates banquet information and health information to generate a prompt sentence suitable for the generative AI model.
[1154] Output: Send the generated prompt sentence to the generative AI model.
[1155] Step 5:
[1156] Generative AI model generates analysis and cooking plans
[1157] Input: Prompt text sent from the server
[1158] Data calculation: The generative AI model analyzes the prompts and generates an optimal meal plan, taking into account allergies and preferences and calculating the dish contents and quantities appropriate for each participant.
[1159] Output: The generated cooking plan is sent back to the server.
[1160] Step 6:
[1161] The organizer's terminal checks and modifies the meal plan
[1162] Input: Cooking plans sent from a generative AI model
[1163] Data calculation: The organizer terminal presents the displayed cooking plan to the organizer, who can make corrections as necessary.
[1164] Output: The final revised cooking plan is sent to the server.
[1165] Step 7:
[1166] The server sends the final meal plan to the restaurant system.
[1167] Input: Final recipe plan sent from the organizer's terminal
[1168] Data Calculation: The server converts the final meal plan into the appropriate format for sending to the restaurant system.
[1169] Output: The final meal plan is sent to the restaurant system.
[1170] Step 8:
[1171] The restaurant system prepares and serves the food
[1172] Input: The final meal plan sent by the server
[1173] Data calculation: Based on the final plan, the store system arranges the necessary ingredients and starts the cooking process.
[1174] Output: On the day of the banquet, each guest will be served an optimized meal.
[1175] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1176] The present invention is a system for providing optimal meal plans for banquets and parties in cooperation with a device that provides health information and emotions. This system collects dietary information and emotional information from participants and can optimize the content and quantity of dishes based on that information. Specific embodiments of the present invention are described below.
[1177] Overall system configuration
[1178] The system consists of the following components:
[1179] 1. Device that provides health information and emotions (user device)
[1180] 2. Server
[1181] 3. Generation AI
[1182] 4. Emotion Engine
[1183] 5. Manager terminal
[1184] 6. Store System
[1185] Terminal that provides health information and emotions (user terminal)
[1186] Using a health support app, users input health information such as their dietary history, allergies, and food preferences. The device is also equipped with an emotion engine that recognizes emotions from the user's facial expressions, tone of voice, text messages, and other factors. This information is used to provide optimal dishes for banquets that the user is attending. When the user indicates their intention to attend a banquet, the device sends that information to the server.
[1187] server
[1188] The server receives and integrates the health information, emotional information, and participation intention information sent from the user terminal. The server processes and organizes the received data and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[1189] Generation AI
[1190] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, preferences, and emotional information. The AI then sends the analysis results back to the server, providing an optimized meal plan to the organizer and the restaurants.
[1191] Emotion Engine
[1192] The emotion engine has the ability to analyze users' emotions from their facial expressions, tone of voice, text messages, etc. This allows participants' emotional states (e.g., stress, joy, sadness, etc.) to be grasped in real time and reflected in the cooking plan as needed.
[1193] Organizer terminal
[1194] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[1195] Store system provided
[1196] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[1197] Specific examples
[1198] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending, enters party information on the organizer's terminal and sends invitations to the participants. Mr. Tanaka indicates his intention to attend the party through the app and sends this information to the server.
[1199] The emotion engine analyzes Tanaka's facial expressions and tone of voice to determine his stress level and happiness, and obtains that information.
[1200] The server combines Tanaka's health and emotional information with the banquet information entered by Suzuki and sends it to the AI generator. The AI then generates an optimal meal plan that takes into account Tanaka's allergies, disliked foods, and even his emotions, and also integrates information about the other guests, and sends the results to the server.
[1201] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer terminal and makes any necessary changes. The final plan is then sent to the restaurant system via the server.
[1202] The restaurant system will prepare the food based on the final plan and provide the optimal dishes on the day of the banquet. At this time, ingredients and cooking methods that have a relaxing effect may be selected to reflect Tanaka's emotional state.
[1203] In this way, meals tailored to the individual needs of participants are provided based on health and emotional information, significantly reducing food waste and improving emotional satisfaction.
[1204] The processing flow will be explained below.
[1205] Step 1:
[1206] A user logs in to the health support app and enters health information such as their allergy information, dietary history, and food preferences. In addition, the emotion engine collects emotional information from the user's facial expressions, tone of voice, text messages, etc.
[1207] Step 2:
[1208] The user selects a party event they plan to attend using the app, indicates their intention to participate, and transmits party participation information, health information, and emotional information to the server.
[1209] Step 3:
[1210] The organizer logs in to the banquet information management system from the organizer's terminal and creates a new banquet event. The organizer enters the details of the banquet (date, time, location, and participant list) and sends them to the server.
[1211] Step 4:
[1212] The server receives the health information, emotional information, and participation intention information sent from the user terminal, and also receives detailed information about the party from the organizer terminal.
[1213] Step 5:
[1214] The server integrates the collected health information, emotional information, and banquet information, compares and adjusts them, and sends the data to the generation AI.
[1215] Step 6:
[1216] The generative AI analyzes the integrated data sent from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, preferences, and emotional information. The generative AI takes into account ingredients and cooking methods to optimize the meal plan.
[1217] Step 7:
[1218] The generation AI sends the optimized meal plan back to the server, which receives the plan and sends it to the host terminal and the restaurant system.
[1219] Step 8:
[1220] The organizer checks the generated meal plan on the organizer's terminal. If any corrections are needed, the organizer makes changes to the plan.
[1221] Step 9:
[1222] The organizer sends the finalized party plan to the server, which then sends this information to the provider's system.
[1223] Step 10:
[1224] Based on the final plan received from the server, the provider store system arranges for the necessary ingredients and prepares cooking.
[1225] Step 11:
[1226] The restaurant system will provide the food according to the final plan on the day of the banquet, allowing each participant to enjoy the food that is best suited to them.
[1227] Specific examples
[1228] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). When User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending via the app, expresses his intention to attend based on the party information managed on the organizer's device, the emotion engine analyzes Mr. Tanaka's facial expressions and tone of voice and sends this information to the server.
[1229] The server combines Tanaka's health and emotional information with the banquet information entered by Suzuki and sends it to the generation AI.
[1230] The AI generates an optimal cooking plan that takes into account Tanaka's allergies, disliked foods, and emotions, and also integrates information from other participants. For example, if Tanaka is feeling stressed, it generates a plan that incorporates herbs and ingredients with a relaxing effect. The AI then sends the results to the server.
[1231] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer's terminal and makes any necessary changes. The final plan is sent to the restaurant's system via the server.
[1232] The restaurant system will prepare the food based on the final plan and provide the most suitable dishes on the day of the banquet. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and will use herbs that have a relaxing effect.
[1233] In this way, meals tailored to the individual needs of participants are provided based on health and emotional information, significantly reducing food waste and improving emotional satisfaction.
[1234] Example 2
[1235] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1236] Currently, at many banquets and parties, it is difficult to consider the individual dietary restrictions, preferences, and emotions of each participant, resulting in food waste and reduced participant satisfaction. Providing a safe and satisfying meal is particularly difficult for participants with allergies or dietary restrictions. Furthermore, meal plans that take into account the emotional state of participants are rarely provided, which does not lead to improved overall satisfaction. To solve these issues, a system is needed that provides optimal meal plans based on participants' health and emotional information.
[1237] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting meal information and emotional information of participants in cooperation with the terminal that provides health information and emotional information, means for integrating and analyzing the collected meal information and emotional information, means for optimizing the content and quantity of dishes to be served at the banquet based on the analysis results, and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to provide an optimal meal plan that takes into account the health information and emotional state of each participant, thereby reducing food waste and improving participant satisfaction.
[1238] "Health information" is data related to the user's health condition, such as the user's dietary history, allergy information, and dietary preferences.
[1239] "Emotional information" is data about the user's emotional state, analyzed based on the user's facial expressions, tone of voice, text messages, etc.
[1240] A "terminal" is a device used by a user to input and transmit health information and emotional information, such as a smartphone or tablet.
[1241] The "server" is a central system that receives health and emotional information sent from user devices and processes, organizes, integrates, and transmits it.
[1242] "Generative AI" is an artificial intelligence that analyzes data received from the server and generates optimal cooking plans based on the individual health and emotional information of each participant.
[1243] The "organizer's terminal" is a device used by the organizer of a banquet or party to check and modify the generated menu plan.
[1244] The "store system" is a system for preparing and serving food based on a confirmed meal plan.
[1245] A "meal plan" is a plan that indicates the content and quantity of meals optimized based on the participant's health and emotional information.
[1246] "Synthesis" is the process of combining collected data into a coherent whole.
[1247] "Analysis" is the process of examining and examining collected data to derive meaningful information.
[1248] "Optimization" refers to adjusting to the most effective or efficient state based on specific conditions.
[1249] The present invention is a system for providing optimal meal plans for banquets and parties in cooperation with a terminal that provides health information and emotional information. Specific embodiments of the present invention will be described below.
[1250] Hardware and software used
[1251] 1. Devices that provide health and emotional information (user devices)
[1252] Users use a smartphone or tablet with a health support app installed.
[1253] Emotion analysis software (e.g., Microsoft Azure Emotion API) is built into the user's device to recognize emotions from the user's facial expressions, tone of voice, and text messages.
[1254] 2. Server
[1255] Use cloud-based integrated systems, e.g., AWS, Google Cloud.
[1256] The server receives health and emotional information sent from the user's device and processes, organizes, and integrates the data.
[1257] 3. Generation AI
[1258] As a generative AI model, e.g., OpenAI GPT-3 is used.
[1259] The data received from the server is analyzed and the optimal cooking plan is generated.
[1260] 4. Manager terminal
[1261] The organizer will use a smartphone or tablet with a banquet management app installed.
[1262] The organizer's terminal can check and modify the cooking plan sent from the generation AI.
[1263] 5. Store system
[1264] The store system uses computers or tablets with reservation and cooking management software installed.
[1265] Prepare and serve food based on the final meal plan.
[1266] System Operation
[1267] In this system, users use a health support app to input their own health information (e.g., dietary history, allergy information, food preferences) and emotional information. The terminal sends this information to a server. The server processes and organizes the received information and sends it to a generation AI. The generation AI generates an optimal meal plan based on the analysis results and sends it back to the server. The server provides the optimized meal plan to the host terminal and the restaurant system. The restaurant system prepares the food based on the final meal plan and serves it on the day of the banquet.
[1268] Specific examples
[1269] For example, User A (Mr. Tanaka) logs into a health support app and registers his or her allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Tanaka will be attending, enters party information on his or her organizer device and sends invitations to the participants. Tanaka indicates his or her intention to attend the party through the app and sends this information to the server. The emotion engine analyzes Tanaka's facial expressions and tone of voice to indicate his or her stress level and happiness, and acquires this information. The server combines Tanaka's health and emotional information with the party information entered by Suzuki and sends it to the generation AI. The generation AI generates an optimal meal plan that takes into account Tanaka's allergies, disliked foods, and emotions, as well as the information of other participants, and sends the result to the server. Organizer B (Mr. Suzuki) reviews the meal plan generated on his or her organizer device and makes changes as necessary. The final plan is then sent via the server to the restaurant system. The restaurant system prepares the food based on the final plan and serves the optimal dishes on the day of the party.
[1270] Prompt Sentence Examples
[1271] "Generate a stress-reducing meal plan that excludes shrimp based on the following participant information:
[1272] Participant: Tanaka-san
[1273] Allergy: Shrimp
[1274] Disliked food: Broccoli
[1275] Emotional information: High stress level
[1276] Please combine this information with other participants' information to come up with a plan that everyone can enjoy.
[1277] In this way, the system of the present invention can provide meals tailored to the individual needs of participants based on health and emotional information, significantly reducing food waste while improving emotional satisfaction.
[1278] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1279] Step 1:
[1280] A user enters their own health information (e.g., dietary history, allergy information, food preferences) and emotional information (e.g., facial expressions, tone of voice, text messages) into a health support app. The input information is entered into a form within the app and confirmed by pressing the submit button. The input data includes specific allergens and favorite dishes.
[1281] Input: User-entered health and emotional information
[1282] Output: Health and emotional information stored on the device
[1283] Step 2:
[1284] The device automatically transmits the entered health and emotional information to the server, where the data is encrypted and securely transferred to the server.
[1285] Input: Health and emotional information stored on the device
[1286] Output: Health and emotion information sent to the server
[1287] Step 3:
[1288] The server receives the health and emotional information sent from the device and processes and organizes the data, such as removing duplicate data and filling in missing data. The server then integrates each user's data and converts it into a consistent format.
[1289] Input: Health and emotional information sent from the device
[1290] Output: Formatted and processed health and emotional information
[1291] Step 4:
[1292] The server sends the formatted and processed data to the generation AI, which then formats the data into a format that the generation AI can understand, and generates and sends a prompt.
[1293] Input: Formatted and processed health and emotional information
[1294] Output: The aggregated data and prompt sent to the generative AI
[1295] Step 5:
[1296] The AI then analyzes the integrated data and generates an optimal meal plan, taking into account each participant's allergies, dietary preferences, and emotional state.
[1297] Input: Integrated data and prompt sent from the server
[1298] Output: The optimal cooking plan generated
[1299] Step 6:
[1300] The generation AI returns the generated meal plan to the server, which receives the plan and sends it to the organizer terminal and the restaurant system.
[1301] Input: Generated optimal cooking plan
[1302] Output: Meal plan sent to the manager terminal and the restaurant system
[1303] Step 7:
[1304] The organizer uses the organizer terminal to check the generated meal plan, make any necessary corrections, and finalize the meal plan. The organizer terminal can make changes through a simple user interface.
[1305] Input: Meal plan sent to the organizer's terminal
[1306] Output: Revised final meal plan
[1307] Step 8:
[1308] The organizer terminal transmits the final plan to the provider store system via the server, and the provider store system prepares the dishes based on the final plan.
[1309] Input: Revised final meal plan
[1310] Output: Final meal plan sent to the restaurant system
[1311] Step 9:
[1312] Based on the final plan, the restaurant system will arrange for the necessary ingredients and cooking arrangements, and provide the food on the day of the banquet. The kitchen staff will prepare the food according to the plan provided, providing the best possible food for each guest.
[1313] Input: Final meal plan sent to the restaurant system
[1314] Output: The best dishes to be served on the day of the banquet
[1315] (Application example 2)
[1316] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1317] Currently, there is no system for providing optimal meal plans at banquets and parties based on the individual health and emotional information of each participant. As a result, the food provided may not be suitable for the participant's health or mood, which increases food waste and reduces participant satisfaction.
[1318] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting meal information and emotional information of participants in cooperation with a terminal that provides health information and emotional information, means for integrating and analyzing the collected meal information and emotional information, means for optimizing the content and quantity of dishes to be served at the banquet based on the analysis results, means for notifying participants of the optimized meal plan using a smartphone application to support their ordering, and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to provide an optimal meal plan tailored to the health status and emotional state of participants, thereby reducing food waste and improving participant satisfaction.
[1319] "Health information" refers to data such as participants' allergy information, dietary preferences, and dietary history.
[1320] "Emotional information" refers to data that indicates a participant's emotional state, such as facial expressions, tone of voice, or text messages.
[1321] "Terminal" refers to devices used to collect health and emotional information, including smartphones and tablets.
[1322] "Means of collection" refers to the method of obtaining data using the device that provides health information and emotional information.
[1323] "Means of integration and analysis" refers to the process of organizing, integrating, and analyzing the collected health and emotional information.
[1324] "Optimization means" refers to methods for adjusting the content and quantity of food served based on the analysis results.
[1325] "Smartphone application" refers to software that runs on a smartphone and allows participants to input and collect health and emotional information and notify them of the optimal cooking plan.
[1326] "Means for notifying and supporting ordering" refers to a method of using a smartphone application to communicate the generated meal plan to participants and support their ordering.
[1327] "Organizer terminal" refers to a device used by the organizer of a banquet to review and modify the generated menu plan.
[1328] "Provider System" refers to the system used by restaurants and food delivery companies to prepare and serve food based on an optimized meal plan.
[1329] "Generative AI" refers to artificial intelligence used to analyze collected data and generate optimal cooking plans.
[1330] A "prompt" refers to the input text used to provide instructions to the generation AI, and is used to generate optimal cooking plans based on the user's health and emotional information.
[1331] This invention is a system for providing optimal food delivery menus based on participants' health and emotional information. This system consists of a user terminal, a server, a generation AI, an emotion engine, a manager terminal, and a provider store system. The following explains the details of each component and the overall flow.
[1332] User terminal
[1333] User devices are mainly smartphones and perform the following functions:
[1334] Entering health information: Users enter their allergy information, dietary preferences, and dietary history.
[1335] Emotional information collection: Uses the smartphone's camera, microphone, and text input to collect the user's emotional information (facial expressions, tone of voice, text messages, etc.).
[1336] Data transmission: The entered health and emotional information is transmitted to the server.
[1337] server
[1338] The server has the following roles:
[1339] Data integration: Integrate and organize health and emotional information received from user devices.
[1340] Prepare data for analysis: Send the combined data to the generative AI for analysis.
[1341] Information distribution: Receives the analysis results of the generating AI and sends them to the master terminal and the provider store system.
[1342] Generation AI
[1343] The generation AI plays the following roles:
[1344] Data analysis: Generates optimal food delivery menus based on health and emotional information sent from the server.
[1345] Return result: The generated menu is returned to the server.
[1346] Emotion Engine
[1347] The emotion engine analyzes the user's emotions and has the following roles:
[1348] Facial expression analysis: Analyzes the user's facial expressions from image data collected through the camera.
[1349] Voice analysis: Analyzes the tone of voice from audio data collected through a microphone.
[1350] Text analysis: Analyze text messages to infer the user's emotional state.
[1351] Organizer terminal
[1352] The organizer terminal is used by the organizer of the party and fulfills the following roles:
[1353] Review and modify the meal plan: Review the meal plan sent by the generation AI and modify it as necessary.
[1354] Sending the revised results: Send the revised final plan to the store system.
[1355] Store system provided
[1356] The provider store system will have the following roles:
[1357] Order Receipt: Receiving food delivery orders based on the optimized meal plan sent by the server.
[1358] Food preparation and serving: Prepare food based on the final plan and deliver it to the user.
[1359] Specific examples
[1360] For example, a user uses a health app to register their allergy information (wheat allergy) and input their emotion, such as "I want to relieve stress today." This information is sent to a server via their smartphone. The emotion engine analyzes the user's feelings from images taken with the camera and text messages they input, and determines that they are slightly tired. The server then sends this information to a generation AI, which then generates an optimal food delivery menu (e.g., gluten-free carbonara and herbal tea). This information is then sent via the server to the restaurant's system and delivered to the user.
[1361] Prompt Sentence Examples
[1362] "I feel like relaxing today."
[1363] In this way, the present invention provides optimal cooking plans tailored to the needs of each individual user, reducing food waste and increasing participant satisfaction.
[1364] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1365] Step 1:
[1366] The user terminal displays a health information input screen, and the user inputs their allergy information, dietary preferences, and dietary history. The input data is saved in the terminal and passed to the next processing step. The input data is the user's allergy information, dietary preferences, and dietary history, and is converted into an appropriate format.
[1367] Step 2:
[1368] The user device collects the user's emotional information using a camera, microphone, and text input. Specifically, the camera captures the user's facial expressions, the microphone records the tone of voice, and the user enters their mood through text input. The resulting data are facial expression images, audio files, and text data, which are then converted into a format that is easy to analyze by the emotion engine.
[1369] Step 3:
[1370] The user device sends the collected health and emotional information to the server. The input data is the health and emotional information stored in the device, and the server receives it. After receiving it, the data is checked for consistency and formatted if necessary.
[1371] Step 4:
[1372] The server integrates the received health and emotional information and sends it to the generation AI for analysis. The server converts these data into an appropriate format and performs data integration and pre-analysis. The input data is the collected health and emotional information, and the output data is the integrated health and emotional information.
[1373] Step 5:
[1374] The Generative AI analyzes the integrated data sent from the server and generates the optimal food delivery menu for each user. The input data is integrated health and emotional information, and the output data is an optimized food delivery menu. The Generative AI analyzes this data and proposes the optimal menu for each user.
[1375] Step 6:
[1376] The server sends the optimal menu received from the generation AI to the organizing terminal and the store system. The input data is the generated optimal menu, and the output data is the optimal menu sent to the organizing terminal and the store system. Here, the server converts the received data into an appropriate format and delivers the necessary information to the organizing terminal and the store system.
[1377] Step 7:
[1378] The organizer terminal checks the generated recipe plan and makes corrections as necessary. The input data is the generated recipe plan, which the organizer checks and corrects if necessary. The output data is the corrected final plan.
[1379] Step 8:
[1380] The organizer terminal sends the revised final plan to the provider store system via the server. The input data is the revised meal plan, and the output data is the final plan sent to the provider store system. The server receives this and sends it to the provider store system in the appropriate format.
[1381] Step 9:
[1382] The provider store system prepares food based on the final plan and serves it to the user. The input data is the final plan, and the output data is the prepared food. The provider store system arranges for the necessary ingredients based on the final plan, cooks the food, and delivers it to the user.
[1383] In this way, the present invention provides users with an optimal food delivery menu based on health information and emotional information, thereby reducing food waste and increasing participant satisfaction.
[1384] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1385] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1386] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1387] [Fourth embodiment]
[1388] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1389] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1390] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1391] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1392] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1393] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1394] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1395] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1396] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1397] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1398] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1399] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1400] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1401] The present invention is a system that works in conjunction with a terminal that provides health information to reduce food waste at banquets and parties and provide optimal meals for participants. This system collects dietary information from participants and is able to optimize the content and quantity of dishes based on that information. Specific embodiments of the present invention are described below.
[1402] Overall system configuration
[1403] The system consists of the following components:
[1404] 1. Device that provides health information (user device)
[1405] 2. Server
[1406] 3. Generation AI
[1407] 4. Manager terminal
[1408] 5. Store system
[1409] Terminal that provides health information (user terminal)
[1410] Users use the health support app to input their health information, such as their dietary history, allergy information, and food preferences. This information is used to provide the optimal dishes for the banquet the user is attending. When the user indicates their intention to attend the banquet, the device sends the information to the server.
[1411] server
[1412] The server receives and integrates health information and party participation information sent from user terminals. The server processes and organizes the received data and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[1413] Generation AI
[1414] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, and preferences. The AI then sends the analysis results back to the server, providing the optimized meal plan to the organizer and the restaurant.
[1415] Organizer terminal
[1416] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[1417] Store system provided
[1418] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[1419] Specific examples
[1420] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending, enters party information on the organizer's terminal and sends invitations to the participants. Mr. Tanaka indicates his intention to attend the party through the app and sends this information to the server.
[1421] The server combines Tanaka's health information with the banquet information entered by Suzuki and sends it to the AI generator. The AI then generates an optimal meal plan that takes into account Tanaka's allergies and disliked foods, as well as the information of the other guests, and sends the results to the server.
[1422] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer terminal and makes any necessary changes. The final plan is then sent to the restaurant system via the server.
[1423] The restaurant system will prepare the food based on the final plan and provide the optimal dishes on the day of the banquet. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and other guests can enjoy meals that accommodate their individual preferences and allergies.
[1424] In this way, the system provides meals tailored to the individual needs of participants and significantly reduces food waste.
[1425] The processing flow will be explained below.
[1426] Step 1:
[1427] The user logs into the health support app and enters data such as their allergy information, dietary history, and food preferences.
[1428] Step 2:
[1429] The user selects the party event they plan to attend using the app, indicates their intention to participate, and transmits party participation information to the server.
[1430] Step 3:
[1431] The organizer logs in to the banquet information management system from the organizer's terminal and creates a new banquet event. The organizer enters the details of the banquet (date, time, location, participant list) and sends them to the server.
[1432] Step 4:
[1433] The server receives the health information and participation intention information sent from the user terminal, and also receives detailed information about the party from the organizer terminal.
[1434] Step 5:
[1435] The server integrates the collected health information and banquet information, and compares and adjusts them, allowing for analysis of each participant's dietary history and preference trends.
[1436] Step 6:
[1437] The server sends the integrated data to the generation AI, which generates the optimal cooking plan based on each participant's data.
[1438] Step 7:
[1439] The generative AI analyzes the data sent and determines the contents and portions of meals tailored to each participant's individual needs, taking into account allergies and preferences for specific ingredients, for example.
[1440] Step 8:
[1441] The generation AI sends the optimized meal plan back to the server, which receives the plan and sends it to the host terminal and the restaurant system.
[1442] Step 9:
[1443] The organizer checks the generated meal plan on the organizer's terminal. If any corrections are needed, the organizer makes changes to the plan.
[1444] Step 10:
[1445] The organizer sends the finalized party plan to the server, which then sends this information to the provider's system.
[1446] Step 11:
[1447] Based on the final plan received from the server, the provider store system arranges for the necessary ingredients and prepares cooking.
[1448] Step 12:
[1449] The restaurant system will provide the food according to the final plan on the day of the banquet, allowing each participant to enjoy the food that is best suited to them.
[1450] This reduces food waste and increases participant satisfaction.
[1451] Example 1
[1452] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1453] In traditional banquets and parties, creating a meal plan that takes into account the dietary preferences and allergy information of the participants is time-consuming, and the meals served are often not fully optimized. There were also many cases where the appropriate amount of ingredients was not prepared, resulting in food waste. Furthermore, when meal plans needed to be revised, the process was cumbersome, making it difficult to respond in a timely manner.
[1454] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1455] In this invention, the server includes a means for receiving health information sent from a user terminal, a means for sending the information to the generation AI, and a means for the server to send the optimized meal plan provided by the generation AI to the organizer terminal and the provider store system. This allows for the automatic generation of an optimal meal plan for a banquet or party that takes into account the dietary preferences and allergy information of each participant, reducing food waste and enabling quick and accurate meal plan revisions.
[1456] A "device that provides health information" is a device that allows a user to input and manage their own health information and send it to a server.
[1457] "Participant's dietary information" refers to all diet-related information related to each user, such as allergy information, dietary preferences, and past dietary history.
[1458] "Means for integrating and analyzing" refers to a system for compiling multiple pieces of collected dietary information into a single dataset and analyzing it.
[1459] The "means for optimizing the content and quantity of food served at a banquet" is a system that calculates the type and quantity of food appropriate for each participant based on the analysis results.
[1460] "Means for providing optimized meal plans to the banquet organizer terminal and the restaurant system" refers to a mechanism for transmitting the optimal meal plan obtained from the generation AI to the organizer terminal and the restaurant system.
[1461] "Generative AI" is an artificial intelligence system that analyzes participants' dietary information and automatically generates the optimal cooking plan.
[1462] The "organizer's terminal" is a device used by the organizer to input banquet information and check and modify the menu plan.
[1463] The "store serving system" is a store system that prepares and serves food, and has the function of preparing food based on the optimized cooking plan provided by the generation AI.
[1464] "Data integrity" refers to the standards and methods by which a server handles data sent by a user while maintaining consistency and completeness.
[1465] "Modifying the meal plan" refers to the act of the organizer or the restaurant making necessary changes to the meal plan provided by the generation AI.
[1466] MODE FOR CARRYING OUT THE INVENTION
[1467] The present invention is a system that works in conjunction with a terminal that provides health information, reduces food waste at banquets and parties, and provides optimal meals to participants. Specific embodiments are described below.
[1468] Overall system configuration
[1469] The system consists of the following components:
[1470] 1. Device that provides health information (user device)
[1471] 2. Server
[1472] 3. Generation AI
[1473] 4. Manager terminal
[1474] 5. Store system
[1475] Terminal that provides health information (user terminal)
[1476] Users use the health support app to input their health information, such as their dietary history, allergy information, and food preferences. This information is used to provide the optimal dishes for the banquet the user is attending. When the user indicates their intention to attend the banquet, the device sends the information to the server.
[1477] server
[1478] The server receives and integrates health information and party participation information sent from user devices. The server checks the integrity of the received data, processes and organizes it, and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[1479] Generation AI
[1480] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, and preferences. The AI then sends the analysis results back to the server, providing the optimized meal plan to the organizer and the restaurant.
[1481] Organizer terminal
[1482] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[1483] Store system provided
[1484] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[1485] Specific examples
[1486] For example, suppose User A logs in to a health support app and registers his or her allergies (shrimp) and disliked foods (broccoli). User B, who is the organizer of a party that User A will be attending, enters party information on the organizer's terminal and sends invitations to participants. User A indicates his or her intention to attend the party through the app and sends this information to the server.
[1487] The server combines User A's health information with the banquet information entered by the organizer and sends it to the generation AI. The generation AI takes User A's allergies and disliked foods into consideration, generates an optimal meal plan that also includes information on other participants, and sends the results to the server.
[1488] The planner checks the meal plan created on the planner's terminal and makes any necessary changes. The final plan is then sent to the restaurant's system via the server.
[1489] The restaurant system prepares the food based on the final plan and provides the optimal dishes on the day of the banquet. For example, User A can be served a dish that does not contain shrimp or broccoli, and other guests can also enjoy meals that accommodate their individual preferences and allergies.
[1490] Prompt Sentence Examples
[1491] Below are some example prompts to input to a generative AI model:
[1492] Consider the health information and preferences of banquet attendees to generate an optimal meal plan that reduces food waste.
[1493] Participant list:
[1494] User A: Allergic to shrimp, hates broccoli
[1495] User B: Vegetarian
[1496] User C: Gluten intolerance
[1497] Banquet information:
[1498] Date: December 25, 2023
[1499] Venue: Restaurant in Tokyo
[1500] Number of participants: 10 people
[1501] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1502] Program processing flow
[1503] Step 1: Enter and submit user information
[1504] The user logs in to the health support app and enters their own health information.
[1505] Input: Individual health data such as dietary history, allergy information, and food preferences
[1506] Data processing: The entered health information is stored in a database and the intention to attend the banquet is registered.
[1507] Output: Organized health information data
[1508] When the user presses the "Join" button, the terminal sends this information to the server.
[1509] Specific behavior: When a user registers that they are allergic to shrimp and dislike broccoli, that information is sent to the server.
[1510] Step 2: Data reception and integration by the server
[1511] The server receives the health information and party participation information sent from the user terminal.
[1512] Input: Individual health data and participation intention information sent from the device
[1513] Data processing: Check data integrity and generate a unified dataset
[1514] Output: Integrated health and participation data set
[1515] The server will then format the data as needed and prepare it for transmission to the generating AI.
[1516] Specific actions: Integrate Tanaka's shrimp allergy information and banquet attendance information and organize the data.
[1517] Step 3: Sending data to the generative AI
[1518] The server sends the integrated data, which has been confirmed to be consistent, to the generation AI.
[1519] Input: Integrated health and participation data set
[1520] Data processing: Converting data formats into a format suitable for generative AI
[1521] Output: Data sent to the generative AI
[1522] The server generates the prompt sentences required for analysis and sends them along with the data.
[1523] Specific operation: Based on the integrated data, the AI is instructed to "generate the optimal meal plan taking into account the participants' allergy information."
[1524] Step 4: Data analysis and meal plan generation using generative AI
[1525] The generation AI analyzes the data received from the server and generates the optimal cooking plan.
[1526] Input: Integrated health information and analysis prompts
[1527] Data calculation: Calculate the optimal ingredient selection and dish composition based on each participant's allergy information and preferences
[1528] Output: The optimal cooking plan generated
[1529] The generation AI sends the generated cooking plan back to the server.
[1530] Specific action: Suggest shrimp-free dishes to Tanaka and vegetarian dishes to Suzuki.
[1531] Step 5: Send the generated plan to the server
[1532] The generation AI sends the generated cooking plan to the server.
[1533] Input: Optimal Meal Plan
[1534] Data processing: Preparation of the meal plan sent from the generative AI
[1535] Output: Meal plan sent to the organizing terminal and the restaurant system
[1536] The server receives the meal plan and prepares to provide it to the organizer terminal and the provider store system.
[1537] Specific operation: Prepare to send the meal plan received from the generation AI to the host terminal and the restaurant system
[1538] Step 6: Check and modify the plan on the master terminal
[1539] The organizer accesses the system from the organizer's terminal and checks the cooking plan sent by the generation AI.
[1540] Input: Generated Meal Plan
[1541] Data processing: Modifying plans based on user preferences and party details
[1542] Output: Revised final meal plan
[1543] The plan is amended as necessary, and the final plan is sent to the provider store system via the server.
[1544] Specific operation: The planner makes modifications such as adding desserts, and sends the final plan to the store's system.
[1545] Step 7: Prepare food using the restaurant's system
[1546] The restaurant system prepares and serves food based on the confirmed meal plan.
[1547] Input: Final meal plan
[1548] Data processing: Arranging ingredients and adjusting cooking arrangements based on the plan
[1549] Output: The best dishes to be served on the day of the banquet
[1550] The provider store system arranges the necessary ingredients and cooks the food based on the final plan.
[1551] Specific actions: On the day of the banquet, Tanaka will be served a dish that does not contain shrimp or broccoli, and the other participants will be served dishes that cater to their individual preferences and allergies.
[1552] (Application example 1)
[1553] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1554] At banquets and parties, providing optimal dishes that meet the health conditions and preferences of each guest is a difficult task. Furthermore, preparing food without considering the health and allergy information of guests is one of the causes of food waste. Furthermore, conventional methods require a lot of time and effort to create optimal meal plans, which makes it difficult to efficiently serve food in brick-and-mortar stores. The present invention aims to solve these problems.
[1555] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1556] In this invention, the server includes: means for linking with a terminal that provides health information and collecting meal information of participants; means for integrating the collected meal information and banquet information and sending it to a cloud server; means for integrating and analyzing the data on the cloud server and sending it to a generative AI model; means for optimizing the content and quantity of dishes to be served at the banquet based on the results of the analysis by the generative AI model; and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to efficiently generate meal plans optimized for the health conditions and preferences of participants, reducing food waste in physical restaurants and providing a high-quality dining experience.
[1557] A "terminal for providing health information" is a device that serves to input and provide health information such as a user's dietary history, allergy information, and dietary preferences.
[1558] "Participant" refers to an individual who attends a banquet or party and enters or provides their own health information.
[1559] The "organizer terminal" is a device used to manage banquet and party information and to confirm and modify the meal plans provided by the generation AI.
[1560] "Store system" refers to the store's computer system for preparing and serving food based on the optimized cooking plan.
[1561] The "server" is a central processing unit that receives data sent from user terminals and organizing terminals and sends it to the generation AI.
[1562] "Generative AI" is an artificial intelligence model used to analyze the integrated data received from the server and generate optimal cooking plans.
[1563] A "cloud server" is a distributed computing system for storing and analyzing data over the Internet.
[1564] A "meal plan" is a plan that indicates the content and quantity of meals optimized based on each participant's health information and preferences.
[1565] A system for realizing the present invention comprises the following components:
[1566] 1. Devices that provide health information
[1567] Users install a health support app on their smartphone and enter their health information, such as their dietary history, allergies, and food preferences, which is then sent to the server.
[1568] 2. Server
[1569] The server is built on the cloud and receives and integrates health and banquet information sent from user devices, using cloud services such as Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure.
[1570] 3. Generation AI
[1571] The generation AI analyzes the integrated data sent from the server and generates a cooking plan optimized for each participant. This AI model can be, for example, GPT-4. The analysis results are then sent back to the server.
[1572] 4. Manager terminal
[1573] The organizer checks and modifies the meal plan sent from the AI via the organizer's terminal. The modifications are sent to the restaurant's system via the server.
[1574] 5. Store system
[1575] The restaurant system prepares and serves the food based on the final meal plan. The system is operated by a computer installed in the restaurant, receives data from the cloud, and makes the necessary preparations.
[1576] Specific examples
[1577] For example, User A (let's call him Tanaka) logs in to a health support app and registers his allergy information (shrimp), disliked foods (broccoli), and favorite foods (salmon, avocado). The organizer of a party that Tanaka will be attending uses the organizer's terminal to enter party information (date, time, location, attendees, etc.) and sends invitations to the participants. Tanaka receives the invitation and indicates his intention to attend on the app.
[1578] The server combines Tanaka's health information with the banquet information entered by the organizer and sends it to the AI generator, which then takes Tanaka's allergies and disliked foods into consideration to generate the optimal meal plan and sends the results to the server.
[1579] The organizer checks the meal plan created on the organizer's terminal and makes any necessary corrections. The final plan is then sent to the restaurant's system via the server.
[1580] The restaurant system will prepare and serve meals based on the final plan. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and other participants will be able to enjoy meals that accommodate their individual preferences and allergies.
[1581] Prompt Sentence Examples
[1582] An example of a prompt for the generative AI model is as follows:
[1583] User A (Mr. Tanaka) will be attending the party. Mr. Tanaka's health information is as follows:
[1584] Allergy: Shrimp
[1585] Disliked food: Broccoli
[1586] Favorite foods: salmon, avocado
[1587] Recent health checkup results: Cholesterol is slightly high
[1588] Include information from other participants to generate the best meal plan.
[1589] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1590] Step 1:
[1591] User enters health information
[1592] Input: The user opens a health support app installed on their smartphone and enters their dietary history, allergy information, dietary preferences, etc.
[1593] Data processing: The entered health information is converted into JSON format.
[1594] Output: The health information data generated by the health support app is sent to the server in JSON format.
[1595] Step 2:
[1596] The server receives and stores health information
[1597] Input: Health information data sent from the health support app (JSON format)
[1598] Data calculation: The server stores the received data in a database and classifies and organizes it for each participant.
[1599] Output: Organized health information data available for the next processing step.
[1600] Step 3:
[1601] The organizer enters the banquet information
[1602] Input: The organizer uses the organizer terminal to input information such as the date, location, and participant list of the banquet.
[1603] Data processing: The entered banquet information is converted into JSON format and linked to the health information of each participant.
[1604] Output: The linked banquet information data is sent to the server.
[1605] Step 4:
[1606] The server sends the integrated data to the generative AI model.
[1607] Input: Banquet information and associated attendee health information
[1608] Data calculation: The server integrates banquet information and health information to generate a prompt sentence suitable for the generative AI model.
[1609] Output: Send the generated prompt sentence to the generative AI model.
[1610] Step 5:
[1611] Generative AI model generates analysis and cooking plans
[1612] Input: Prompt text sent from the server
[1613] Data calculation: The generative AI model analyzes the prompts and generates an optimal meal plan, taking into account allergies and preferences and calculating the dish contents and quantities appropriate for each participant.
[1614] Output: The generated cooking plan is sent back to the server.
[1615] Step 6:
[1616] The organizer's terminal checks and modifies the meal plan
[1617] Input: Cooking plans sent from a generative AI model
[1618] Data calculation: The organizer terminal presents the displayed cooking plan to the organizer, who can make corrections as necessary.
[1619] Output: The final revised cooking plan is sent to the server.
[1620] Step 7:
[1621] The server sends the final meal plan to the restaurant system.
[1622] Input: Final recipe plan sent from the organizer's terminal
[1623] Data Calculation: The server converts the final meal plan into the appropriate format for sending to the restaurant system.
[1624] Output: The final meal plan is sent to the restaurant system.
[1625] Step 8:
[1626] The restaurant system prepares and serves the food
[1627] Input: The final meal plan sent by the server
[1628] Data calculation: Based on the final plan, the store system arranges the necessary ingredients and starts the cooking process.
[1629] Output: On the day of the banquet, each guest will be served an optimized meal.
[1630] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1631] The present invention is a system for providing optimal meal plans for banquets and parties in cooperation with a device that provides health information and emotions. This system collects dietary information and emotional information from participants and can optimize the content and quantity of dishes based on that information. Specific embodiments of the present invention are described below.
[1632] Overall system configuration
[1633] The system consists of the following components:
[1634] 1. Device that provides health information and emotions (user device)
[1635] 2. Server
[1636] 3. Generation AI
[1637] 4. Emotion Engine
[1638] 5. Manager terminal
[1639] 6. Store System
[1640] Terminal that provides health information and emotions (user terminal)
[1641] Using a health support app, users input health information such as their dietary history, allergies, and food preferences. The device is also equipped with an emotion engine that recognizes emotions from the user's facial expressions, tone of voice, text messages, and other factors. This information is used to provide optimal dishes for banquets that the user is attending. When the user indicates their intention to attend a banquet, the device sends that information to the server.
[1642] server
[1643] The server receives and integrates the health information, emotional information, and participation intention information sent from the user terminal. The server processes and organizes the received data and sends it to the generation AI. The server then provides the analysis results from the generation AI to the organizer terminal and the provider store system.
[1644] Generation AI
[1645] The AI analyzes the integrated data received from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, preferences, and emotional information. The AI then sends the analysis results back to the server, providing an optimized meal plan to the organizer and the restaurants.
[1646] Emotion Engine
[1647] The emotion engine has the ability to analyze users' emotions from their facial expressions, tone of voice, text messages, etc. This allows participants' emotional states (e.g., stress, joy, sadness, etc.) to be grasped in real time and reflected in the cooking plan as needed.
[1648] Organizer terminal
[1649] The organizer accesses the system from their terminal and checks the meal plan sent from the generation AI. They can make corrections to the plan as needed. The final plan is sent from the organizer's terminal to the restaurant's system via the server.
[1650] Store system provided
[1651] The restaurant system prepares and serves the food based on the final meal plan. Based on the final plan sent from the server, the restaurant system arranges for the necessary ingredients and cooking, and serves the food on the day of the banquet.
[1652] Specific examples
[1653] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending, enters party information on the organizer's terminal and sends invitations to the participants. Mr. Tanaka indicates his intention to attend the party through the app and sends this information to the server.
[1654] The emotion engine analyzes Tanaka's facial expressions and tone of voice to determine his stress level and happiness, and obtains that information.
[1655] The server combines Tanaka's health and emotional information with the banquet information entered by Suzuki and sends it to the AI generator. The AI then generates an optimal meal plan that takes into account Tanaka's allergies, disliked foods, and even his emotions, and also integrates information about the other guests, and sends the results to the server.
[1656] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer terminal and makes any necessary changes. The final plan is then sent to the restaurant system via the server.
[1657] The restaurant system will prepare the food based on the final plan and provide the optimal dishes on the day of the banquet. At this time, ingredients and cooking methods that have a relaxing effect may be selected to reflect Tanaka's emotional state.
[1658] In this way, meals tailored to the individual needs of participants are provided based on health and emotional information, significantly reducing food waste and improving emotional satisfaction.
[1659] The processing flow will be explained below.
[1660] Step 1:
[1661] A user logs in to the health support app and enters health information such as their allergy information, dietary history, and food preferences. In addition, the emotion engine collects emotional information from the user's facial expressions, tone of voice, text messages, etc.
[1662] Step 2:
[1663] The user selects a party event they plan to attend using the app, indicates their intention to participate, and transmits party participation information, health information, and emotional information to the server.
[1664] Step 3:
[1665] The organizer logs in to the banquet information management system from the organizer's terminal and creates a new banquet event. The organizer enters the details of the banquet (date, time, location, participant list) and sends them to the server.
[1666] Step 4:
[1667] The server receives the health information, emotional information, and participation intention information sent from the user terminal, and also receives detailed information about the party from the organizer terminal.
[1668] Step 5:
[1669] The server integrates the collected health information, emotional information, and banquet information, compares and adjusts them, and sends the data to the generation AI.
[1670] Step 6:
[1671] The generative AI analyzes the integrated data sent from the server and generates an optimal meal plan based on each participant's dietary history, allergy information, preferences, and emotional information. The generative AI takes into account ingredients and cooking methods to optimize the meal plan.
[1672] Step 7:
[1673] The generation AI sends the optimized meal plan back to the server, which receives the plan and sends it to the host terminal and the restaurant system.
[1674] Step 8:
[1675] The organizer checks the generated meal plan on the organizer's terminal. If any corrections are needed, the organizer makes changes to the plan.
[1676] Step 9:
[1677] The organizer sends the finalized party plan to the server, which then sends this information to the provider's system.
[1678] Step 10:
[1679] Based on the final plan received from the server, the provider store system arranges for the necessary ingredients and prepares cooking.
[1680] Step 11:
[1681] The restaurant system will provide the food according to the final plan on the day of the banquet, allowing each participant to enjoy the food that is best suited to them.
[1682] Specific examples
[1683] For example, suppose User A (Mr. Tanaka) logs in to a health support app and registers his allergies (shrimp) and disliked foods (broccoli). When User B (Mr. Suzuki), who is the organizer of a party that Mr. Tanaka will be attending via the app, expresses his intention to attend based on the party information managed on the organizer's device, the emotion engine analyzes Mr. Tanaka's facial expressions and tone of voice and sends this information to the server.
[1684] The server combines Tanaka's health and emotional information with the banquet information entered by Suzuki and sends it to the generation AI.
[1685] The AI generates an optimal cooking plan that takes into account Tanaka's allergies, disliked foods, and emotions, and also integrates information from other participants. For example, if Tanaka is feeling stressed, it generates a plan that incorporates herbs and ingredients with a relaxing effect. The AI then sends the results to the server.
[1686] Organizer B (Mr. Suzuki) checks the meal plan created on the organizer's terminal and makes any necessary changes. The final plan is sent to the restaurant's system via the server.
[1687] The restaurant system will prepare the food based on the final plan and provide the most suitable dishes on the day of the banquet. For example, Tanaka will be served a dish that does not contain shrimp or broccoli, and will use herbs that have a relaxing effect.
[1688] In this way, meals tailored to the individual needs of participants are provided based on health and emotional information, significantly reducing food waste and improving emotional satisfaction.
[1689] Example 2
[1690] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1691] Currently, at many banquets and parties, it is difficult to consider the individual dietary restrictions, preferences, and emotions of each participant, resulting in food waste and reduced participant satisfaction. Providing a safe and satisfying meal is particularly difficult for participants with allergies or dietary restrictions. Furthermore, meal plans that take into account the emotional state of participants are rarely provided, which does not lead to improved overall satisfaction. To solve these issues, a system is needed that provides optimal meal plans based on participants' health and emotional information.
[1692] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting meal information and emotional information of participants in cooperation with the terminal that provides health information and emotional information, means for integrating and analyzing the collected meal information and emotional information, means for optimizing the content and quantity of dishes to be served at the banquet based on the analysis results, and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to provide an optimal meal plan that takes into account the health information and emotional state of each participant, thereby reducing food waste and improving participant satisfaction.
[1693] "Health information" is data related to the user's health condition, such as the user's dietary history, allergy information, and dietary preferences.
[1694] "Emotional information" is data about the user's emotional state, analyzed based on the user's facial expressions, tone of voice, text messages, etc.
[1695] A "terminal" is a device used by a user to input and transmit health information and emotional information, such as a smartphone or tablet.
[1696] The "server" is a central system that receives health and emotional information sent from user devices and processes, organizes, integrates, and transmits it.
[1697] "Generative AI" is an artificial intelligence that analyzes data received from the server and generates optimal cooking plans based on the individual health and emotional information of each participant.
[1698] The "organizer's terminal" is a device used by the organizer of a banquet or party to check and modify the generated menu plan.
[1699] The "store system" is a system for preparing and serving food based on a confirmed meal plan.
[1700] A "meal plan" is a plan that indicates the content and quantity of meals optimized based on the participant's health and emotional information.
[1701] "Synthesis" is the process of combining collected data into a coherent whole.
[1702] "Analysis" is the process of examining and examining collected data to derive meaningful information.
[1703] "Optimization" refers to adjusting to the most effective or efficient state based on specific conditions.
[1704] The present invention is a system for providing optimal meal plans for banquets and parties in cooperation with a terminal that provides health information and emotional information. Specific embodiments of the present invention will be described below.
[1705] Hardware and software used
[1706] 1. Devices that provide health and emotional information (user devices)
[1707] Users use a smartphone or tablet with a health support app installed.
[1708] Emotion analysis software (e.g., Microsoft Azure Emotion API) is built into the user's device to recognize emotions from the user's facial expressions, tone of voice, and text messages.
[1709] 2. Server
[1710] Use cloud-based integrated systems, e.g., AWS, Google Cloud.
[1711] The server receives health and emotional information sent from the user's device and processes, organizes, and integrates the data.
[1712] 3. Generation AI
[1713] As a generative AI model, e.g., OpenAI GPT-3 is used.
[1714] The data received from the server is analyzed and the optimal cooking plan is generated.
[1715] 4. Manager terminal
[1716] The organizer will use a smartphone or tablet with a banquet management app installed.
[1717] The organizer's terminal can check and modify the cooking plan sent from the generation AI.
[1718] 5. Store system
[1719] The store system uses computers or tablets with reservation and cooking management software installed.
[1720] Prepare and serve food based on the final meal plan.
[1721] System Operation
[1722] In this system, users use a health support app to input their own health information (e.g., dietary history, allergy information, food preferences) and emotional information. The terminal sends this information to a server. The server processes and organizes the received information and sends it to a generation AI. The generation AI generates an optimal meal plan based on the analysis results and sends it back to the server. The server provides the optimized meal plan to the host terminal and the restaurant system. The restaurant system prepares the food based on the final meal plan and serves it on the day of the banquet.
[1723] Specific examples
[1724] For example, User A (Mr. Tanaka) logs into a health support app and registers his or her allergies (shrimp) and disliked foods (broccoli). User B (Mr. Suzuki), who is the organizer of a party that Tanaka will be attending, enters party information on his or her organizer device and sends invitations to the participants. Tanaka indicates his or her intention to attend the party through the app and sends this information to the server. The emotion engine analyzes Tanaka's facial expressions and tone of voice to indicate his or her stress level and happiness, and acquires this information. The server combines Tanaka's health and emotional information with the party information entered by Suzuki and sends it to the generation AI. The generation AI generates an optimal meal plan that takes into account Tanaka's allergies, disliked foods, and emotions, as well as the information of other participants, and sends the result to the server. Organizer B (Mr. Suzuki) reviews the meal plan generated on his or her organizer device and makes changes as necessary. The final plan is then sent via the server to the restaurant system. The restaurant system prepares the food based on the final plan and serves the optimal dishes on the day of the party.
[1725] Prompt Sentence Examples
[1726] "Generate a stress-reducing meal plan that excludes shrimp based on the following participant information:
[1727] Participant: Tanaka-san
[1728] Allergy: Shrimp
[1729] Disliked food: Broccoli
[1730] Emotional information: High stress level
[1731] Please combine this information with other participants' information to come up with a plan that everyone can enjoy.
[1732] In this way, the system of the present invention can provide meals tailored to the individual needs of participants based on health and emotional information, significantly reducing food waste while improving emotional satisfaction.
[1733] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1734] Step 1:
[1735] A user enters their own health information (e.g., dietary history, allergy information, food preferences) and emotional information (e.g., facial expressions, tone of voice, text messages) into a health support app. The input information is entered into a form within the app and confirmed by pressing the submit button. The input data includes specific allergens and favorite dishes.
[1736] Input: User-entered health and emotional information
[1737] Output: Health and emotional information stored on the device
[1738] Step 2:
[1739] The device automatically transmits the entered health and emotional information to the server, where the data is encrypted and securely transferred to the server.
[1740] Input: Health and emotional information stored on the device
[1741] Output: Health and emotion information sent to the server
[1742] Step 3:
[1743] The server receives the health and emotional information sent from the device and processes and organizes the data, such as removing duplicate data and filling in missing data. The server then integrates each user's data and converts it into a consistent format.
[1744] Input: Health and emotional information sent from the device
[1745] Output: Formatted and processed health and emotional information
[1746] Step 4:
[1747] The server sends the formatted and processed data to the generation AI, which then formats the data into a format that the generation AI can understand, and generates and sends a prompt.
[1748] Input: Formatted and processed health and emotional information
[1749] Output: The aggregated data and prompt sent to the generative AI
[1750] Step 5:
[1751] The AI then analyzes the integrated data and generates an optimal meal plan, taking into account each participant's allergies, dietary preferences, and emotional state.
[1752] Input: Integrated data and prompt sent from the server
[1753] Output: The optimal cooking plan generated
[1754] Step 6:
[1755] The generation AI returns the generated meal plan to the server, which receives the plan and sends it to the organizer terminal and the restaurant system.
[1756] Input: Generated optimal cooking plan
[1757] Output: Meal plan sent to the manager terminal and the restaurant system
[1758] Step 7:
[1759] The organizer uses the organizer terminal to check the generated meal plan, make any necessary corrections, and finalize the meal plan. The organizer terminal can make changes through a simple user interface.
[1760] Input: Meal plan sent to the organizer's terminal
[1761] Output: Revised final meal plan
[1762] Step 8:
[1763] The organizer terminal transmits the final plan to the provider store system via the server, and the provider store system prepares the dishes based on the final plan.
[1764] Input: Revised final meal plan
[1765] Output: Final meal plan sent to the restaurant system
[1766] Step 9:
[1767] Based on the final plan, the restaurant system will arrange for the necessary ingredients and cooking arrangements, and provide the food on the day of the banquet. The kitchen staff will prepare the food according to the plan provided, providing the best possible food for each guest.
[1768] Input: Final meal plan sent to the restaurant system
[1769] Output: The best dishes to be served on the day of the banquet
[1770] (Application example 2)
[1771] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1772] Currently, there is no system for providing optimal meal plans at banquets and parties based on the individual health and emotional information of each participant. As a result, the food provided may not be suitable for the participant's health or mood, which increases food waste and reduces participant satisfaction.
[1773] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting meal information and emotional information of participants in cooperation with a terminal that provides health information and emotional information, means for integrating and analyzing the collected meal information and emotional information, means for optimizing the content and quantity of dishes to be served at the banquet based on the analysis results, means for notifying participants of the optimized meal plan using a smartphone application to support their ordering, and means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system. This makes it possible to provide an optimal meal plan tailored to the health status and emotional state of participants, thereby reducing food waste and improving participant satisfaction.
[1774] "Health information" refers to data such as participants' allergy information, dietary preferences, and dietary history.
[1775] "Emotional information" refers to data that indicates a participant's emotional state, such as facial expressions, tone of voice, or text messages.
[1776] "Terminal" refers to devices used to collect health and emotional information, including smartphones and tablets.
[1777] "Means of collection" refers to the method of obtaining data using the device that provides health information and emotional information.
[1778] "Means of integration and analysis" refers to the process of organizing, integrating, and analyzing the collected health and emotional information.
[1779] "Optimization means" refers to methods for adjusting the content and quantity of food served based on the analysis results.
[1780] "Smartphone application" refers to software that runs on a smartphone and allows participants to input and collect health and emotional information and notify them of the optimal cooking plan.
[1781] "Means for notifying and supporting ordering" refers to a method of using a smartphone application to communicate the generated meal plan to participants and support their ordering.
[1782] "Organizer terminal" refers to a device used by the organizer of a banquet to review and modify the generated menu plan.
[1783] "Provider System" refers to the system used by restaurants and food delivery companies to prepare and serve food based on an optimized meal plan.
[1784] "Generative AI" refers to artificial intelligence used to analyze collected data and generate optimal cooking plans.
[1785] A "prompt" refers to the input text used to provide instructions to the generation AI, and is used to generate optimal cooking plans based on the user's health and emotional information.
[1786] This invention is a system for providing optimal food delivery menus based on participants' health and emotional information. This system consists of a user terminal, a server, a generation AI, an emotion engine, a manager terminal, and a provider store system. The following explains the details of each component and the overall flow.
[1787] User terminal
[1788] User devices are mainly smartphones and perform the following functions:
[1789] Entering health information: Users enter their allergy information, dietary preferences, and dietary history.
[1790] Emotional information collection: Uses the smartphone's camera, microphone, and text input to collect the user's emotional information (facial expressions, tone of voice, text messages, etc.).
[1791] Data transmission: The entered health and emotional information is transmitted to the server.
[1792] server
[1793] The server has the following roles:
[1794] Data integration: Integrate and organize health and emotional information received from user devices.
[1795] Prepare data for analysis: Send the combined data to the generative AI for analysis.
[1796] Information distribution: Receives the analysis results of the generating AI and sends them to the master terminal and the provider store system.
[1797] Generation AI
[1798] The generation AI plays the following roles:
[1799] Data analysis: Generates optimal food delivery menus based on health and emotional information sent from the server.
[1800] Return result: The generated menu is returned to the server.
[1801] Emotion Engine
[1802] The emotion engine analyzes the user's emotions and has the following roles:
[1803] Facial expression analysis: Analyzes the user's facial expressions from image data collected through the camera.
[1804] Voice analysis: Analyzes the tone of voice from audio data collected through a microphone.
[1805] Text analysis: Analyze text messages to infer the user's emotional state.
[1806] Organizer terminal
[1807] The organizer terminal is used by the organizer of the party and fulfills the following roles:
[1808] Review and modify the meal plan: Review the meal plan sent by the generation AI and modify it as necessary.
[1809] Sending the revised results: Send the revised final plan to the store system.
[1810] Store system provided
[1811] The provider store system will have the following roles:
[1812] Order Receipt: Receiving food delivery orders based on the optimized meal plan sent by the server.
[1813] Food preparation and serving: Prepare food based on the final plan and deliver it to the user.
[1814] Specific examples
[1815] For example, a user uses a health app to register their allergy information (wheat allergy) and input their emotion, such as "I want to relieve stress today." This information is sent to a server via their smartphone. The emotion engine analyzes the user's feelings from images taken with the camera and text messages they input, and determines that they are slightly tired. The server then sends this information to a generation AI, which then generates an optimal food delivery menu (e.g., gluten-free carbonara and herbal tea). This information is then sent via the server to the restaurant's system and delivered to the user.
[1816] Prompt Sentence Examples
[1817] "I feel like relaxing today."
[1818] In this way, the present invention provides optimal cooking plans tailored to the needs of each individual user, reducing food waste and increasing participant satisfaction.
[1819] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1820] Step 1:
[1821] The user terminal displays a health information input screen, and the user inputs their allergy information, dietary preferences, and dietary history. The input data is saved in the terminal and passed to the next processing step. The input data is the user's allergy information, dietary preferences, and dietary history, and is converted into an appropriate format.
[1822] Step 2:
[1823] The user device collects the user's emotional information using a camera, microphone, and text input. Specifically, the camera captures the user's facial expressions, the microphone records the tone of voice, and the user enters their mood through text input. The resulting data are facial expression images, audio files, and text data, which are then converted into a format that is easy to analyze by the emotion engine.
[1824] Step 3:
[1825] The user device sends the collected health and emotional information to the server. The input data is the health and emotional information stored in the device, and the server receives it. After receiving it, the data is checked for consistency and formatted if necessary.
[1826] Step 4:
[1827] The server integrates the received health and emotional information and sends it to the generation AI for analysis. The server converts these data into an appropriate format and performs data integration and pre-analysis. The input data is the collected health and emotional information, and the output data is the integrated health and emotional information.
[1828] Step 5:
[1829] The Generative AI analyzes the integrated data sent from the server and generates the optimal food delivery menu for each user. The input data is integrated health and emotional information, and the output data is an optimized food delivery menu. The Generative AI analyzes this data and proposes the optimal menu for each user.
[1830] Step 6:
[1831] The server sends the optimal menu received from the generation AI to the organizing terminal and the store system. The input data is the generated optimal menu, and the output data is the optimal menu sent to the organizing terminal and the store system. Here, the server converts the received data into an appropriate format and delivers the necessary information to the organizing terminal and the store system.
[1832] Step 7:
[1833] The organizer terminal checks the generated recipe plan and makes corrections as necessary. The input data is the generated recipe plan, which the organizer checks and corrects if necessary. The output data is the corrected final plan.
[1834] Step 8:
[1835] The organizer terminal sends the revised final plan to the provider store system via the server. The input data is the revised meal plan, and the output data is the final plan sent to the provider store system. The server receives this and sends it to the provider store system in the appropriate format.
[1836] Step 9:
[1837] The provider store system prepares food based on the final plan and serves it to the user. The input data is the final plan, and the output data is the prepared food. The provider store system arranges for the necessary ingredients based on the final plan, cooks the food, and delivers it to the user.
[1838] In this way, the present invention provides users with an optimal food delivery menu based on health information and emotional information, thereby reducing food waste and increasing participant satisfaction.
[1839] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1840] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1841] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1842] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1843] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1844] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1845] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1846] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1847] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1848] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1849] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1850] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1851] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1852] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1853] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1854] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1855] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1856] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1857] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1858] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1859] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1860] The following is further disclosed regarding the above embodiment.
[1861] (Claim 1)
[1862] A means of collecting participants' dietary information in conjunction with a terminal that provides health information;
[1863] A means for integrating and analyzing the collected dietary information;
[1864] A means for optimizing the content and quantity of food served at banquets based on the analysis results;
[1865] A means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system;
[1866] A system including:
[1867] (Claim 2)
[1868] a means of collecting dietary history, allergy information, and dietary preferences from participants' health apps;
[1869] A means for integrating health information and banquet information and transmitting them to the generating AI;
[1870] A means for generating a banquet meal plan based on the analysis results of the generation AI;
[1871] 10. The system of claim 1, comprising:
[1872] (Claim 3)
[1873] A means for the organizing terminal to check and modify the generated cooking plan;
[1874] a means for transmitting the final revised plan to the provider store system;
[1875] The store system prepares and serves food based on the final plan,
[1876] 10. The system of claim 1, comprising:
[1877] "Example 1"
[1878] (Claim 1)
[1879] A means of collecting participants' dietary information in conjunction with a terminal that provides health information;
[1880] A means for integrating and analyzing the collected dietary information;
[1881] A means for optimizing the content and quantity of food served at banquets based on the analysis results;
[1882] A means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system;
[1883] A means for receiving health information transmitted from a user terminal and transmitting the information to the generating AI;
[1884] A means for the server to transmit the optimized meal plan provided by the generation AI to the host terminal and the provider store system;
[1885] A system including:
[1886] (Claim 2)
[1887] a means of collecting dietary history, allergy information, and dietary preferences from participants' health apps;
[1888] A means for integrating health information and banquet information and transmitting them to the generating AI;
[1889] A means for generating a banquet meal plan based on the analysis results of the generation AI;
[1890] an interface means for prompting data input from a user terminal;
[1891] A means of preparing the data format to be sent to the generating AI,
[1892] 10. The system of claim 1, comprising:
[1893] (Claim 3)
[1894] A means for the organizing terminal to check and modify the generated cooking plan;
[1895] a means for transmitting the final revised plan to the provider store system;
[1896] The store system will prepare and serve the food based on the final plan,
[1897] means for aligning data received by the server;
[1898] a means for the master terminal to access the system;
[1899] 10. The system of claim 1, comprising:
[1900] "Application Example 1"
[1901] (Claim 1)
[1902] A means of collecting participants' dietary information in conjunction with a terminal that provides health information;
[1903] a means for integrating the collected meal information and banquet information and transmitting the information to a cloud server;
[1904] A means to integrate and analyze data on a cloud server and send it to the generative AI model;
[1905] A means to optimize the content and quantity of food served at a banquet based on the results of the analysis by the generative AI model; and
[1906] A means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system;
[1907] A system including:
[1908] (Claim 2)
[1909] a means of collecting dietary history, allergy information, and dietary preferences from participants' health apps;
[1910] A means for transmitting health information and banquet information to a generative AI model to generate an optimal meal plan;
[1911] a means for providing the generated recipe plan to an organizer terminal and allowing the organizer terminal to modify the plan;
[1912] 10. The system of claim 1, comprising:
[1913] (Claim 3)
[1914] A means for the organizing terminal to check and modify the generated cooking plan;
[1915] A means for transmitting the final revised plan to the restaurant system, and for the restaurant system to prepare and serve food based on the final plan;
[1916] 10. The system of claim 1, comprising:
[1917] "Example 2: Combining Emotion Engines"
[1918] (Claim 1)
[1919] a means for collecting dietary information and emotional information of participants in cooperation with a terminal that provides health information and emotional information;
[1920] A means for integrating and analyzing the collected dietary information and emotional information;
[1921] A means for optimizing the content and quantity of food served at banquets based on the analysis results;
[1922] A means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system;
[1923] A system including:
[1924] (Claim 2)
[1925] a means of collecting dietary history, allergy information, food preferences, and emotional information from participants' health apps;
[1926] A means for integrating health information, emotional information, and party information and transmitting the information to the generating AI;
[1927] A means for generating a banquet meal plan based on the analysis results of the generation AI;
[1928] 10. The system of claim 1, comprising:
[1929] (Claim 3)
[1930] A means for the organizing terminal to check and modify the generated cooking plan;
[1931] a means for transmitting the final revised plan to the provider store system;
[1932] The store system will prepare and serve the food based on the final plan,
[1933] 10. The system of claim 1, comprising:
[1934] "Application example 2 when combining emotion engines"
[1935] (Claim 1)
[1936] a means for collecting dietary information and emotional information of participants in cooperation with a terminal that provides health information and emotional information;
[1937] A means for integrating and analyzing the collected dietary information and emotional information;
[1938] A means for optimizing the content and quantity of food served at banquets based on the analysis results;
[1939] A means of notifying participants of the optimized meal plan using a smartphone application and assisting them in ordering;
[1940] A means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system;
[1941] A system including:
[1942] (Claim 2)
[1943] a means of collecting dietary history, allergy information, and dietary preferences from participants' health apps;
[1944] A means for integrating the health information, emotion information, and banquet information and transmitting the information to the generating AI;
[1945] A means for generating a banquet meal plan based on the analysis results of the generation AI;
[1946] means for sending the results of the optimized meal plan back to the server and providing them to the organizing terminal and the restaurant system;
[1947] 10. The system of claim 1, comprising:
[1948] (Claim 3)
[1949] A means for the organizing terminal to check and modify the generated cooking plan;
[1950] a means for transmitting the final revised plan to the provider store system;
[1951] The store system will prepare and serve the food based on the final plan,
[1952] A method for inputting prompt sentences into a generative AI model to suggest optimal food delivery menus based on the user's health and emotional information; and
[1953] 10. The system of claim 1, comprising: [Explanation of symbols]
[1954] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. A means of collecting participants' dietary information in conjunction with a terminal that provides health information; A means for integrating and analyzing the collected dietary information; A means for optimizing the content and quantity of food served at banquets based on the analysis results; A means for providing the optimized meal plan to the banquet organizer terminal and the restaurant system; A system including:
2. a means of collecting dietary history, allergy information, and dietary preferences from participants' health apps; A means for integrating health information and banquet information and transmitting them to the generating AI; A means for generating a banquet meal plan based on the analysis results of the generation AI; The system of claim 1 , comprising:
3. A means for the organizing terminal to check and modify the generated cooking plan; a means for transmitting the final revised plan to the provider store system; The store system prepares and serves food based on the final plan, The system of claim 1 , comprising:
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A