System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving user input; means for analyzing the user input; means for sending a request to a generative AI model based on the analysis; means for receiving a date plan from the generative AI model; means for displaying the received date plan to a user; means for accepting user confirmation and fine-tuning; and means for booking an activity included in the date plan to a booking system.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] With traditional methods for planning dates, it's difficult for couples to find common hobbies and preferences, and date ideas often become monotonous. Furthermore, because it's not possible to provide a special date experience, there are few opportunities for couples to deepen their relationship. Furthermore, it's difficult to find time to come up with an attractive date plan given their busy lives. [Means for solving the problem]

[0005] The present invention provides a means for receiving user input and analyzing the input content, and a means for sending a request to a generative AI model based on the analyzed data. The generative AI model includes a means for generating a date plan tailored to the user's preferences, budget, and date purpose, and for receiving the plan. It also provides a means for displaying the generated date plan to the user, allowing the user to confirm and fine-tune it. It also includes a means for booking activities included in the date plan with a reservation system. In this way, a system is realized that allows users to easily create date plans that can provide an ideal and special experience.

[0006] "Means for receiving user input" refers to the function that allows a user to use a terminal to input information such as preferences, budget, and purpose of the date, and then aggregates and transmits the input data to the system.

[0007] "Means for analyzing user input" refers to the function of processing received user input data and extracting and organizing necessary information.

[0008] "Means for sending a request to the generative AI model" refers to the function of sending a request to the generative AI model to generate a date plan based on the analyzed data.

[0009] "Means for receiving date plans" refers to the function of receiving date plans generated from a generative AI model.

[0010] "Means for displaying received date plans to the user" refers to the function of displaying the details of the date plan on the device in a way that the user can check.

[0011] "Means for user confirmation and fine-tuning" refers to a function that allows the user to review the displayed date plan and make any necessary corrections or adjustments.

[0012] "Means for making reservations for activities included in a date plan through a reservation system" refers to a function that automatically performs reservation procedures for activities included in a date plan.

[0013] "User inputs including preferences, budget, and date objectives" refers to information provided by a user regarding personal preferences, available financial resources, and primary purpose of the date when generating a date plan.

[0014] "The generated date plan includes at least the date, time, location, activities, and total cost" means that the generated date plan includes at least the date of the event, the location, the content of the activities to be performed, and the total cost involved. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] This invention is a system that automatically generates an ideal date plan based on a user's preferences and budget. The system receives user input, analyzes it, and then requests a generative AI model to generate a date plan. The system then displays the generated date plan to the user and has the ability to make a reservation if necessary.

[0037] Overall system configuration

[0038] The system consists of the following main components:

[0039] 1. A means of receiving user input

[0040] 2. A way to analyze user input

[0041] 3. A means of sending requests to the generative AI model

[0042] 4. How to receive date plans

[0043] 5. How to display received date plans to users

[0044] 6. Means of accepting user confirmation and fine-tuning

[0045] 7. A means to reserve activities included in the date plan through the reservation system

[0046] Program processing procedure

[0047] The device receives data input by the user and sends it to the server. The server analyzes the data and sends the analysis results to the generative AI model. The generative AI model generates a date plan and sends the results back to the server. The server sends the received date plan to the device, which displays the plan contents to the user. The user confirms the plan and makes any necessary adjustments. Finally, the server notifies the reservation system of the confirmed plan and completes the necessary reservation procedures.

[0048] Program processing details

[0049] User input

[0050] The user (hereafter referred to as "Tanaka") starts up the device and operates the application to enter data into the input form. For example, enter the following information.

[0051] Preferences: Relaxation, gourmet food

[0052] Budget: 10,000 yen

[0053] Date purpose: A special date

[0054] Data transmission and analysis

[0055] The terminal sends input data to the server, which receives the data in JSON format and begins parsing it.

[0056] {

[0057] "preferences": ["Relax", "Gourmet"],

[0058] "budget": 10000,

[0059] "purpose": "special date"

[0060] }

[0061] The server converts the data into an internal format and makes requests to the generative AI model.

[0062] Generating date plans using generative AI models

[0063] A generative AI model receives the request and generates the best date plan based on the user's preferences and budget.

[0064] {

[0065] "date": "This Saturday",

[0066] "activities": [

[0067] {"time": "13:00", "activity": "Relax at a luxury spa"},

[0068] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[0069] ],

[0070] "total_cost": 9800

[0071] }

[0072] Display date plan

[0073] The server sends the generated date plan to the terminal, which displays the date plan to the user.

[0074] Date plan:

[0075] 1 PM: Relax at a luxury spa

[0076] 6:30 PM: Dinner at a popular French restaurant

[0077] Cost: 9,800 yen

[0078] User verification and fine-tuning

[0079] Tanaka checks the displayed date plan and adjusts the time and location as necessary, for example, changing the dinner time to 7 p.m.

[0080] Tanaka presses the "Confirm" button.

[0081] Confirmation of reservation

[0082] The server transmits the confirmed plan details to the reservation system and performs reservation procedures for the luxury spa and French restaurant.

[0083] {

[0084] "reservations": [

[0085] {"activity": "luxury spa", "time": "13:00"},

[0086] {"activity": "French restaurant", "time": "18:30"}

[0087] ]

[0088] }

[0089] A notification of the confirmed reservation is sent to the terminal and displayed to Tanaka.

[0090] In this way, the system of the present invention automatically generates an ideal date plan based on the user's preferences and budget, allowing the user to easily enjoy a special date experience. Furthermore, by automating the reservation procedure, the burden on the user can be reduced.

[0091] The processing flow will be explained below.

[0092] Step 1:

[0093] The user (Tanaka) starts up the device and opens the date planner app. Tanaka enters his preferences, budget, and purpose of the date into the input form. At this time, he enters the following information:

[0094] Preferences: Relaxation, gourmet food

[0095] Budget: 10,000 yen

[0096] Date purpose: A special date

[0097] Step 2:

[0098] The terminal converts the input data into JSON format and sends the data to the server. An example of the data to be sent is as follows:

[0099] {

[0100] "preferences": ["Relax", "Gourmet"],

[0101] "budget": 10000,

[0102] "purpose": "special date"

[0103] }

[0104] Step 3:

[0105] The server parses the JSON data received from the device. The parsed data is converted into an internal data structure, as shown below.

[0106] preferences = ["Relaxed", "Gourmet"]

[0107] budget = 10000

[0108] purpose = "special date"

[0109] Step 4:

[0110] The server creates data to request the AI ​​model to generate a date plan. An example of the created request data is as follows:

[0111] ai_request = {

[0112] "user_preferences": preferences,

[0113] "user_budget": budget,

[0114] "user_purpose": purpose

[0115] }

[0116] The server sends this request to the generative AI model.

[0117] Step 5:

[0118] The generative AI model receives a request from the server and generates a date plan using its internal algorithm. The generated date plan includes the following information:

[0119] {

[0120] "date": "This Saturday",

[0121] "activities": [

[0122] {"time": "13:00", "activity": "Relax at a luxury spa"},

[0123] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[0124] ],

[0125] "total_cost": 9800

[0126] }

[0127] Step 6:

[0128] The generative AI model sends the generated date plan back to the server, which receives the date plan.

[0129] Step 7:

[0130] The server sends the received date plan to the terminal. The terminal displays the date plan on the screen and presents the following to Tanaka:

[0131] Date plan:

[0132] 1 PM: Relax at a luxury spa

[0133] 6:30 PM: Dinner at a popular French restaurant

[0134] Cost: 9,800 yen

[0135] Step 8:

[0136] Tanaka checks the displayed date plan and makes any necessary adjustments. For example, he changes the dinner time to 7 p.m. Once he has completed the changes, he presses the "Confirm" button.

[0137] Step 9:

[0138] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[0139] {

[0140] "reservations": [

[0141] {"activity": "luxury spa", "time": "13:00"},

[0142] {"activity": "French restaurant", "time": "19:00"}

[0143] ]

[0144] }

[0145] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[0146] Your reservation is confirmed:

[0147] Luxury Spa: 1 PM

[0148] French Restaurant: 7 p.m.

[0149] In this way, the system of the present invention allows users to easily create, confirm, and reserve their ideal date plan.

[0150] Example 1

[0151] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0152] In today's busy lifestyles, efficiently planning and executing special date plans is difficult. It takes time and effort to independently create an ideal date plan that takes into account the user's preferences and budget, and then book activities based on that plan. Furthermore, the time and complexity of the booking process can be burdensome, making it difficult for users to easily enjoy a special date experience. To address these challenges, a system is needed that can automatically generate date plans based on user input and streamline the entire process, including the booking process.

[0153] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0154] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting confirmation and fine-tuning from the user, means for booking activities included in the date plan with a reservation system, means for creating a prompt sentence to be used in the date plan generation request, and means for formatting the date plan details. This allows users to easily receive a date plan optimized for their preferences and budget, and by automating the reservation procedure, they can efficiently realize a special date experience.

[0155] The "means for receiving user input" is an interface that allows the user to input information such as preferences, budget, and purpose of the date into the system.

[0156] "Means for analyzing user input" refers to a program or algorithm that analyzes received user input data and extracts and converts information such as preferences, budget, and purpose.

[0157] "Means for sending requests to the generative AI model based on the analyzed data" means means for sending requests in an appropriate format to the generative AI model using the analyzed data.

[0158] A "means for receiving a date plan from a generative AI model" is an interface or mechanism for accepting date plan data generated by a generative AI model.

[0159] The "means for displaying the received date plan to the user" refers to an interface and a program for visually displaying the received date plan to the user.

[0160] The "means for accepting user confirmation and fine adjustment" is a means for accepting operations by the user for confirming and modifying the displayed date plan.

[0161] The "means for reserving activities included in a date plan in a reservation system" refers to a system and program for automatically reserving various activities based on a confirmed date plan.

[0162] The "means for creating a prompt sentence to be used when requesting the generation of a date plan" is a program or algorithm for automatically creating a prompt sentence to be used when requesting the generation of a date plan from a generative AI model.

[0163] A "means for formatting date plan details" is a program or mechanism for converting date plan details received from a generative AI model into a format appropriate for display to a user.

[0164] This invention is a system that automatically generates an ideal date plan based on a user's preferences and budget. The system receives user input, analyzes it, and then requests a generative AI model to generate a date plan. The system then displays the generated date plan to the user and has the ability to make a reservation if necessary.

[0165] Overall system configuration

[0166] The system consists of the following main components:

[0167] 1. A means of receiving user input

[0168] The user enters information such as preferences, budget, and purpose of the date into an input form. For example, the input can be done using a smartphone or PC application.

[0169] 2. A way to analyze user input

[0170] The input data is analyzed, and the necessary information is extracted and converted. The analysis is performed using Python's Pandas library, etc.

[0171] 3. A means of sending requests to the generative AI model based on the analyzed data

[0172] A prompt is created based on the analyzed data and sent to a generative AI model (such as GPT-3 or GPT-4). An example of a prompt is as follows:

[0173] A user likes relaxation and gourmet food and is planning a special date. The budget is 10,000 yen, and they want to go on this Saturday. Generate the optimal date plan based on this.

[0174] 4. A way to receive date plans from a generative AI model

[0175] The date plan generated by the generative AI model is received on the server side. The received data is in JSON format.

[0176] 5. How to display received date plans to users

[0177] The received date plan is converted into an appropriate format, sent to the device, and displayed to the user. Web frameworks such as React and Angular are used for display.

[0178] 6. Means of accepting user confirmation and fine-tuning

[0179] It provides an interface for users to review their date plans and make adjustments to the time and location as needed, for example, changing the time or adding or removing activities.

[0180] 7. A means to reserve activities included in the date plan through the reservation system

[0181] The confirmed date plan details are sent to the reservation system, and each activity is automatically booked. Reservation management uses server-side frameworks such as Node.js and Django.

[0182] In this way, the system of the present invention automatically generates an ideal date plan based on the user's preferences and budget, allowing the user to easily enjoy a special date experience. Also, by automating the reservation process, the burden on the user can be reduced.

[0183] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0184] Step 1:

[0185] The user starts up the device, operates the application, and enters information such as preferences, budget, and purpose of the date into the input form.

[0186] Input: Information about your preferences, budget, and dating goals

[0187] Output: Data entered in the input form

[0188] Specific operation: The user opens the app on their smartphone or PC, enters the information as shown below, and taps the "Send" button.

[0189] Preferences: Relaxation, gourmet food

[0190] Budget: 10,000 yen

[0191] Date purpose: A special date

[0192] Step 2:

[0193] The terminal sends the input data to the server.

[0194] Input: Data entered into an input form

[0195] Output: JSON format data sent to the server

[0196] Specific operation: Tanaka's smartphone sends the input data to the server in real time. The data will be in the following format.

[0197] json

[0198] {

[0199] "preferences": ["Relax", "Gourmet"],

[0200] "budget": 10000,

[0201] "purpose": "special date"

[0202] }

[0203] Step 3:

[0204] The server parses the received data.

[0205] Input: JSON format data

[0206] Output: Parsed internal data format

[0207] Specific operation: The server parses the received JSON data and extracts information such as "preferences," "budget," and "purpose of the date." For example, it can be parsed using the Python Pandas library as follows:

[0208] python

[0209] data = {

[0210] "preferences": ["Relax", "Gourmet"],

[0211] "budget": 10000,

[0212] "purpose": "special date"

[0213] }

[0214] preferences = data["preferences"]

[0215] budget = data["budget"]

[0216] purpose = data["purpose"]

[0217] Step 4:

[0218] The server sends a request to the generative AI model based on the analysis results.

[0219] Input: Parsed internal data format

[0220] Output: The prompt sent to the generative AI model

[0221] Specific operation: The server creates a prompt for the generative AI model and sends it to the model in the following text format:

[0222] A user likes relaxation and gourmet food and is planning a special date. The budget is 10,000 yen, and they want to go on this Saturday. Generate the optimal date plan based on this.

[0223] Step 5:

[0224] A generative AI model receives the request and generates a date plan.

[0225] Input: Prompt text sent from the server

[0226] Output: Generated date plan (JSON format)

[0227] What it does: The generative AI model processes the request and generates the following details of the date plan:

[0228] json

[0229] {

[0230] "date": "This Saturday",

[0231] "activities": [

[0232] {"time": "13:00", "activity": "Relax at a luxury spa"},

[0233] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[0234] ],

[0235] "total_cost": 9800

[0236] }

[0237] Step 6:

[0238] The server receives the generated date plan.

[0239] Input: Date plan from the generative AI model (JSON format)

[0240] Output: Date plan saved in server storage

[0241] Specific operation: The server stores the date plan received from the generative AI model in an internal database and converts the format as necessary.

[0242] Step 7:

[0243] The server sends the date plan to the terminal, which displays it to the user.

[0244] Input: Date plan saved on the server

[0245] Output: Date plan displayed on user's device

[0246] Specific operation: The app displays the details of the date plan on Tanaka's smartphone. The displayed content is as follows:

[0247] Date plan:

[0248] 1 PM: Relax at a luxury spa

[0249] 6:30 PM: Dinner at a popular French restaurant

[0250] Cost: 9,800 yen

[0251] Step 8:

[0252] The user checks the plan and adjusts the time and location as needed.

[0253] Input: Date plan displayed to user

[0254] Output: Adjusted date plan

[0255] Specific operation: The user checks the date plan and changes the dinner time to, for example, 7 PM. Once the changes are complete, the user presses the "Confirm" button.

[0256] Step 9:

[0257] The server transmits the confirmed plan details to the reservation system and makes reservations for each activity.

[0258] Input: Adjusted date plan

[0259] Output: Request and booking confirmation sent to the reservation system

[0260] Specific operation: The server sends the following request to the reservation system to confirm the reservation of each activity.

[0261] json

[0262] {

[0263] "reservations": [

[0264] {"activity": "luxury spa", "time": "13:00"},

[0265] {"activity": "French restaurant", "time": "19:00"}

[0266] ]

[0267] }

[0268] Once the reservation is complete, the server sends a confirmation notice to the user's terminal and displays it to the user.

[0269] (Application example 1)

[0270] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0271] Current food delivery services lack a system that can automatically suggest optimal meal plans that fit multiple users' preferences, budgets, and specific delivery times. This requires users to search for restaurants and decide what to order themselves, which is time-consuming. Furthermore, when ordering multiple dishes from different locations at different times, the ordering process for each dish becomes complicated. Furthermore, it is difficult to suggest meal plans that fit specific delivery times, making it difficult to improve the user experience.

[0272] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0273] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a meal plan from the generative AI model, means for displaying the received meal plan to the user, means for accepting user confirmation and fine-tuning, and means for ordering and delivering meals. This allows users to easily receive a meal plan that is optimal for their preferences, budget, and specific delivery time, eliminating the complexity of ordering and delivery procedures.

[0274] The "means for receiving user input" is an interface for obtaining information such as preferences, budget, and delivery time from the user.

[0275] The "means for analyzing user input" is a processing function for analyzing received user input data and converting it into an appropriate format.

[0276] "Means for sending a request to the generative AI model based on the analyzed data" refers to a communication means for passing the analyzed data to the generative AI model and requesting the generation of an optimal meal plan.

[0277] "Means for receiving a meal plan from a generative AI model" refers to a receiving function for receiving a meal plan created by a generative AI model.

[0278] The "means for displaying the received meal plan to the user" is an interface for displaying the generated meal plan to the user in a format that is easy to understand.

[0279] The "means for accepting user confirmation and fine-tuning" is an interface that allows the user to review the generated plan and adjust it as necessary.

[0280] "Means for ordering and delivering meals" refers to a system for placing orders with restaurants based on a confirmed meal plan and delivering meals at the specified delivery time.

[0281] "Preferences" refers to information such as the type of food or style of restaurant the user prefers.

[0282] A "budget" is a range of amounts that a user specifies for spending on food.

[0283] "Delivery time" is information indicating the date and time when the user would like to receive the meal.

[0284] A "meal plan" is a plan that includes recommended meal menus and ordering details, generated based on user input.

[0285] This invention is a system that automatically generates an ideal meal plan based on a user's preferences and budget, and then handles ordering and delivery. The system uses a smartphone as the user interface, processes data on a cloud server, and generates meal plans using a generative AI model. It also uses a delivery API to automate meal ordering and delivery.

[0286] Hardware and software used

[0287] 1. Smartphone: This is the device where the user provides input data and checks the meal plan.

[0288] 2. Cloud server: Uses Amazon Web Services (AWS) Lambda and other services to perform scalable data processing and backend operations.

[0289] 3. Generative AI model: Using OpenAI GPT-4 and other models, it generates optimal meal plans based on user input data.

[0290] 4. Delivery API: Use APIs such as UberEats to automatically order and deliver meals.

[0291] System Operation Overview

[0292] 1. Receiving user input:

[0293] The user operates their smartphone and enters their preferences, budget, and delivery time into the application's input form. For example, the following input data is obtained:

[0294] Preferences: Italian

[0295] Budget: 5,000 yen

[0296] Delivery time: 19:00

[0297] 2. Data transmission and analysis:

[0298] The smartphone sends this input data to the cloud server, which receives and analyzes it. The analysis results will be in the following format:

[0299] {

[0300] "preferences": ["Italian"],

[0301] "budget": 5000,

[0302] "delivery_time": "19:00"

[0303] }

[0304] 3. Request to the generative AI model:

[0305] The cloud server sends a request to the generative AI model based on the analyzed data. An example of a prompt for the generative AI model is as follows:

[0306] Generate the perfect meal plan based on your preferences and budget. Use the following information to help you:

[0307] Preferences: Italian

[0308] Budget: 5,000 yen

[0309] Delivery time: 19:00

[0310] 4. Receive and view the generated meal plan:

[0311] The plan created by the generative AI model is sent to a smartphone via a cloud server, and the plan is displayed to the user as shown below.

[0312] Your food delivery plan:

[0313] - 18:50: Pizza Margherita

[0314] - 18:55: Carbonara

[0315] Cost: 4,800 yen

[0316] 5. User verification and fine-tuning:

[0317] Users can check the plan on their smartphone and make changes to the time and menu as needed. Once changes are complete, users press the "Confirm" button to finalize the plan.

[0318] 6. Ordering and Delivery Arrangements:

[0319] The cloud server sends an order request to the delivery API based on the confirmed plan. Orders are placed with each restaurant at the appropriate time, and the meals are delivered at the specified delivery time.

[0320] This system allows users to easily receive the optimal meal plan tailored to their preferences, budget, and specific delivery time, significantly reducing the hassle of ordering and delivery.

[0321] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0322] Step 1:

[0323] The user operates their smartphone and enters data into the application's input form. Specifically, the user enters "preferences," "budget," and "delivery time." This results in the following data being obtained as user input:

[0324] Input data:

[0325] Preferences: Italian

[0326] Budget: 5,000 yen

[0327] Delivery time: 19:00

[0328] Step 2:

[0329] The device sends this input data to the cloud server, which receives the data in JSON format and performs the following analysis:

[0330] input:

[0331] {

[0332] "preferences": ["Italian"],

[0333] "budget": 5000,

[0334] "delivery_time": "19:00"

[0335] }

[0336] The server parses this data and converts it into an internal format.

[0337] Step 3:

[0338] Based on the data analyzed by the server, a request is sent to the generative AI model. Specifically, the following prompt is generated:

[0339] Prompt statement:

[0340] Generate the perfect meal plan based on your preferences and budget. Use the following information to help you:

[0341] Preferences: Italian

[0342] Budget: 5,000 yen

[0343] Delivery time: 19:00

[0344] This allows the generative AI model to generate an optimal meal plan based on user input.

[0345] Step 4:

[0346] The generative AI model generates a meal plan and sends the results back to the server. The generated plan looks like this:

[0347] Generated plan:

[0348] {

[0349] "food_plan": [

[0350] {"time": "18:50", "food": "Pizza Margherita"},

[0351] {"time": "18:55", "food": "Carbonara"}

[0352] ],

[0353] "total_cost": 4800

[0354] }

[0355] Step 5:

[0356] The server receives the meal plan from the AI ​​model and sends it to the device (smartphone), which analyzes the data and displays the plan on the screen.

[0357] Display contents:

[0358] Your food delivery plan:

[0359] 18:50: Pizza Margherita

[0360] 18:55: Carbonara

[0361] Cost: 4,800 yen

[0362] Step 6:

[0363] The user can check the meal plan on the device and make any necessary adjustments, such as changing the delivery time. After making the adjustments, the user presses the "Confirm" button.

[0364] Step 7:

[0365] The server sends the confirmed meal plan to the delivery API and processes the order and delivery. Specifically, the following order request is sent.

[0366] Order Request:

[0367] {

[0368] "orders": [

[0369] {"restaurant": "Italian Restaurant A", "food": "Pizza Margherita", "time": "18:50"},

[0370] {"restaurant": "Italian Restaurant B", "food": "Carbonara", "time": "18:55"}

[0371] ]

[0372] }

[0373] Step 8:

[0374] When the delivery API successfully accepts the order, the server sends the result to the terminal and displays a notification of order confirmation to the user, allowing the user to confirm that the meal will be delivered at the specified time.

[0375] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0376] This invention is a system that automatically generates ideal date plans using a generative AI model based on user input and emotions, and provides them to users. This system has a means to recognize the user's emotions in addition to their preferences, budget, and date purpose to optimize the plans.

[0377] Overall system configuration

[0378] The system consists of the following main components:

[0379] 1. A means of receiving user input

[0380] 2. A way to analyze user input

[0381] 3. A means to recognize user emotions and adjust analytical data using an emotion engine

[0382] 4. A means of sending requests to the generative AI model

[0383] 5. How to receive date plans

[0384] 6. How to display received date plans to users

[0385] 7. Means of accepting user confirmation and fine-tuning

[0386] 8. A means to reserve activities included in the date plan through the reservation system

[0387] Program processing procedure

[0388] The device receives data input by the user and sends it to the server. Before analyzing the data, the server recognizes the user's emotions through an emotion engine. It adjusts the analyzed data based on the recognized emotions. It then sends a request to the generative AI model based on the adjusted data. The generative AI model generates a date plan and sends the result back to the server. The server sends the received date plan to the device, which displays the plan contents to the user. The user confirms the plan and makes any necessary adjustments. Finally, the server notifies the reservation system of the confirmed plan and completes the necessary reservation procedures.

[0389] Program processing details

[0390] User input

[0391] The user (hereafter referred to as "Tanaka") starts up the terminal and enters the following information into the input form via the application.

[0392] Preferences: Relaxation, gourmet food

[0393] Budget: 10,000 yen

[0394] Date purpose: A special date

[0395] Data transmission and analysis

[0396] The terminal sends input data in JSON format to the server, which receives the data and parses the JSON data.

[0397] {

[0398] "preferences": ["Relax", "Gourmet"],

[0399] "budget": 10000,

[0400] "purpose": "special date"

[0401] }

[0402] Emotion recognition by emotion engine

[0403] The server activates an emotion engine to recognize emotions from Tanaka's facial expressions, voice tone, and text input.

[0404] Emotion: Joy (85% probability)

[0405] Adjustment of analysis data

[0406] The server adjusts the analysis data based on the recognized emotion. For example, if Tanaka's emotion is "joy," it will enhance relaxation options.

[0407] Requests to generative AI models

[0408] The server sends a request to the generative AI model based on the adjusted data.

[0409] ai_request = {

[0410] "user_preferences": ["Relax", "Gourmet"],

[0411] "user_budget": 10000,

[0412] "user_purpose": "special date",

[0413] "user_emotion": "joy"

[0414] }

[0415] Generating date plans using generative AI models

[0416] The generative AI model generates a date plan, which looks like this:

[0417] {

[0418] "date": "This Saturday",

[0419] "activities": [

[0420] {"time": "13:00", "activity": "Relax at a luxury spa"},

[0421] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[0422] ],

[0423] "total_cost": 9800

[0424] }

[0425] Display date plan

[0426] The server sends the generated date plan to the device, which displays the plan to the user and presents the following to Tanaka:

[0427] Date plan:

[0428] 1 PM: Relax at a luxury spa

[0429] 6:30 PM: Dinner at a popular French restaurant

[0430] Cost: 9,800 yen

[0431] User verification and fine-tuning

[0432] Tanaka checks the displayed date plan and, for example, changes the dinner time to 7 p.m. Once the changes are complete, Tanaka presses the "Confirm" button.

[0433] Confirmation of reservation

[0434] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[0435] {

[0436] "reservations": [

[0437] {"activity": "luxury spa", "time": "13:00"},

[0438] {"activity": "French restaurant", "time": "19:00"}

[0439] ]

[0440] }

[0441] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[0442] Your reservation is confirmed:

[0443] Luxury Spa: 1 PM

[0444] French Restaurant: 7 p.m.

[0445] In this way, by combining the emotion engine, the system can better understand the user's emotional state and provide date plans tailored to individual needs, making the user's dating experience even richer and more special.

[0446] The processing flow will be explained below.

[0447] Step 1:

[0448] The user (Tanaka) starts up the device and opens the date planner app. Tanaka enters his preferences, budget, and purpose of the date into the input form. At this time, he enters the following information:

[0449] Preferences: Relaxation, gourmet food

[0450] Budget: 10,000 yen

[0451] Date purpose: A special date

[0452] Step 2:

[0453] The terminal converts the input data into JSON format and sends the data to the server. An example of the data to be sent is as follows:

[0454] {

[0455] "preferences": ["Relax", "Gourmet"],

[0456] "budget": 10000,

[0457] "purpose": "special date"

[0458] }

[0459] Step 3:

[0460] The server parses the JSON data received from the device. The parsed data is converted into an internal data structure, as shown below.

[0461] preferences = ["Relaxed", "Gourmet"]

[0462] budget = 10000

[0463] purpose = "special date"

[0464] Step 4:

[0465] The server activates the emotion engine and collects data to recognize emotions from Tanaka's facial expressions, voice tone, and text input. For example, facial expressions and voice are captured through the smartphone's camera and microphone.

[0466] Step 5:

[0467] The emotion engine analyzes the collected data and estimates Tanaka's emotional state. For example, it estimates "joy" from facial expression analysis and voice tone.

[0468] Emotion: Joy (85% probability)

[0469] Step 6:

[0470] The server adjusts the analysis data based on the recognized emotion. For example, if Tanaka's emotion is "joy," it will enhance relaxation options.

[0471] adjusted_preferences = ["Relaxed", "Gourmet"]

[0472] Step 7:

[0473] The server sends a request to the generative AI model based on the adjusted data. An example of the request data to be sent is as follows:

[0474] ai_request = {

[0475] "user_preferences": adjusted_preferences,

[0476] "user_budget": 10000,

[0477] "user_purpose": "special date",

[0478] "user_emotion": "joy"

[0479] }

[0480] Step 8:

[0481] The generative AI model receives a request from the server and generates a date plan using its internal algorithm. The generated date plan includes the following information:

[0482] {

[0483] "date": "This Saturday",

[0484] "activities": [

[0485] {"time": "13:00", "activity": "Relax at a luxury spa"},

[0486] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[0487] ],

[0488] "total_cost": 9800

[0489] }

[0490] Step 9:

[0491] The generative AI model sends the generated date plan back to the server, which receives the date plan.

[0492] Step 10:

[0493] The server sends the received date plan to the terminal. The terminal displays the date plan on the screen and presents the following to Tanaka:

[0494] Date plan:

[0495] 1 PM: Relax at a luxury spa

[0496] 6:30 PM: Dinner at a popular French restaurant

[0497] Cost: 9,800 yen

[0498] Step 11:

[0499] Tanaka checks the displayed date plan and makes any necessary adjustments. For example, he changes the dinner time to 7 p.m. Once he has completed the changes, he presses the "Confirm" button.

[0500] Step 12:

[0501] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[0502] {

[0503] "reservations": [

[0504] {"activity": "luxury spa", "time": "13:00"},

[0505] {"activity": "French restaurant", "time": "19:00"}

[0506] ]

[0507] }

[0508] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[0509] Your reservation is confirmed:

[0510] Luxury Spa: 1 PM

[0511] French Restaurant: 7 p.m.

[0512] In this way, the system of the present invention allows users to easily create, confirm, and book their ideal date plan, and by taking emotions into consideration, it can provide a more personalized experience.

[0513] Example 2

[0514] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0515] Conventional date plan generation systems generate plans based solely on user input data, making it impossible to take into account the user's emotions or momentary moods. This makes it difficult to provide a truly optimal plan for the user, resulting in low user satisfaction. Additionally, the process from the user confirming the plan details to finalizing the reservation is complicated, requiring a lot of time and effort.

[0516] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0517] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for recognizing the user's emotions using an emotion engine and adjusting the analysis data, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting user confirmation and fine-tuning, and means for booking activities included in the date plan with a reservation system. This makes it possible to provide a more optimal date plan that takes the user's emotions into consideration and significantly reduce the effort and time required for booking.

[0518] "User" refers to a person who uses this system to generate date plans.

[0519] "Means for receiving input" refers to an interface or device for obtaining data from a user.

[0520] "Means for analyzing" refers to software or algorithms used to structure and understand captured user input data.

[0521] A "generative AI model" refers to an artificial intelligence model that is trained to solve a specific task or problem.

[0522] "Date Plan" refers to a combination of activities and schedules suggested based on the user's requests and preferences.

[0523] "Means for displaying" refers to a screen or device for visually presenting the generated date plan to the user.

[0524] "Means for accepting confirmation and fine-tuning" refers to an interface that allows the user to make changes or confirmations to the proposed date plan.

[0525] "Reservation system" refers to a system for making reservations and confirming each activity included in a date plan.

[0526] An "emotion engine" refers to software or algorithms that analyze users' emotions and reflect them in plan generation.

[0527] "Means for adjusting analysis data" refers to a function for optimizing the analysis results and the content of the data generated based on the recognized emotions.

[0528] This invention is a system that automatically generates ideal date plans using a generative AI model based on user input and emotions, and provides them to users. This system has a means to recognize the user's emotions in addition to their preferences, budget, and date purpose to optimize the plans.

[0529] Overall system configuration

[0530] The system consists of the following main components:

[0531] 1. A means of receiving user input

[0532] 2. A way to analyze user input

[0533] 3. A means to recognize user emotions and adjust analytical data using an emotion engine

[0534] 4. A means of sending requests to the generative AI model

[0535] 5. How to receive date plans

[0536] 6. How to display received date plans to users

[0537] 7. Means of accepting user confirmation and fine-tuning

[0538] 8. A means to reserve activities included in the date plan through the reservation system

[0539] System Operation

[0540] User input

[0541] The user starts the device and enters the following information through the application:

[0542] Preferences: Relaxation, gourmet food

[0543] Budget: 10,000 yen

[0544] Date purpose: A special date

[0545] Sending input data

[0546] The device sends the user's input data in JSON format to the server.

[0547] json

[0548] {

[0549] "preferences": ["Relax", "Gourmet"],

[0550] "budget": 10000,

[0551] "purpose": "special date"

[0552] }

[0553] Data analysis and emotion recognition

[0554] The server analyzes the input data and activates the emotion engine.

[0555] The emotion engine recognizes emotions from the user's facial expressions, voice tone, and text input.

[0556] Emotion: Joy (85% probability)

[0557] Adjustment of analysis data

[0558] The server adjusts the analysis data based on the recognized emotion.

[0559] Sending requests to generative AI models

[0560] The server sends a request to the generative AI model based on the adjusted data.

[0561] json

[0562] {

[0563] "user_preferences": ["Relax", "Gourmet"],

[0564] "user_budget": 10000,

[0565] "user_purpose": "special date",

[0566] "user_emotion": "joy"

[0567] }

[0568] Receive the generated date plan

[0569] The generative AI model generates a date plan and sends it back to the server.

[0570] Date: This Saturday

[0571] activity:

[0572] 13:00: Relax at a luxury spa

[0573] 18:30: Dinner at a popular French restaurant

[0574] Total cost: 9,800 yen

[0575] Display date plan

[0576] The server transmits the generated date plan to the terminal, and the terminal displays the date plan to the user.

[0577] User verification and fine-tuning

[0578] The user reviews the displayed date plan and makes adjustments as necessary.

[0579] The user takes action to confirm the plan.

[0580] Confirmation of reservation

[0581] The server transmits the finalized date plan to the reservation system and makes reservations for each activity.

[0582] json

[0583] {

[0584] "reservations": [

[0585] {"activity": "luxury spa", "time": "13:00"},

[0586] {"activity": "French restaurant", "time": "19:00"}

[0587] ]

[0588] }

[0589] Sending confirmation of reservation

[0590] A confirmation of the reservation is sent to the device, which displays the following message to the user:

[0591] Your reservation is confirmed:

[0592] Luxury Spa: 1 PM

[0593] French Restaurant: 7 p.m.

[0594] Hardware and software used

[0595] Device: A device that receives user input and displays date plans, such as a smartphone, tablet, or PC.

[0596] Server: A central processing unit for data analysis, emotion recognition, communication with generative AI models, and reservation management.

[0597] Emotion Engine: Software for analyzing user emotions, combining speech recognition, image analysis, and text analysis technologies.

[0598] Generative AI model: An artificial intelligence model trained to automatically generate date plans.

[0599] By implementing the present invention, users can easily create optimal date plans tailored to their individual emotions and even make reservations, making their dating experience even more special and enriching.

[0600] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0601] Program processing flow

[0602] Step 1:

[0603] The user launches the application on their device and enters their preferences, budget, and date goals.

[0604] Example input:

[0605] Preferences: Relaxation, gourmet food

[0606] Budget: 10,000 yen

[0607] Date purpose: A special date

[0608] Input data is collected and converted to JSON format on the device.

[0609] Step 2:

[0610] The terminal sends the input data to the server in JSON format.

[0611] Input: User preferences, budget, and dating goals

[0612] Output: JSON format data

[0613] json

[0614] {

[0615] "preferences": ["Relax", "Gourmet"],

[0616] "budget": 10000,

[0617] "purpose": "special date"

[0618] }

[0619] Step 3:

[0620] The server receives the JSON data and parses the user input.

[0621] Input: JSON format data

[0622] Output: Analyzed user preferences, budget, and dating goals

[0623] Step 4:

[0624] The server activates the emotion engine to analyze the user's emotions, specifically recognizing emotions from facial expressions, voice tone, and text input data.

[0625] Input: User's facial expression data, voice data, text data

[0626] Output: User sentiment

[0627] Emotion: Joy (85% probability)

[0628] Step 5:

[0629] The server adjusts the analysis data based on the recognized emotion.

[0630] Input: User sentiment, preferences, budget, and dating goals

[0631] Output: Adjusted analysis data

[0632] Example of adjustment:

[0633] Adjusted data:

[0634] Preferences: Relaxation (strengthening), gourmet food

[0635] Budget: 10,000 yen

[0636] Date purpose: A special date

[0637] Step 6:

[0638] The server sends the adjusted data as a request to the generative AI model.

[0639] Input: Adjusted analysis data

[0640] Output: A request to the generative AI model

[0641] json

[0642] {

[0643] "user_preferences": ["Relax", "Gourmet"],

[0644] "user_budget": 10000,

[0645] "user_purpose": "special date",

[0646] "user_emotion": "joy"

[0647] }

[0648] Step 7:

[0649] The generative AI model generates a date plan and sends the results back to the server.

[0650] Input: A request to the generative AI model

[0651] Output: Generated date plan

[0652] json

[0653] {

[0654] "date": "This Saturday",

[0655] "activities": [

[0656] {"time": "13:00", "activity": "Relax at a luxury spa"},

[0657] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[0658] ],

[0659] "total_cost": 9800

[0660] }

[0661] Step 8:

[0662] The server transmits the date plan to the terminal, and the terminal displays the date plan to the user.

[0663] Input: Generated date plan

[0664] Output: Date plan displayed to the user

[0665] Date plan:

[0666] 1 PM: Relax at a luxury spa

[0667] 6:30 PM: Dinner at a popular French restaurant

[0668] Cost: 9,800 yen

[0669] Step 9:

[0670] The user can review the displayed date plan and make any necessary adjustments, such as changing the dinner time to 7 p.m.

[0671] Input: User's fine-tuning request

[0672] Output: A tweaked date plan

[0673] Dinner time changed to 7pm

[0674] Step 10:

[0675] The user confirms the plan, and the server sends the final confirmed date plan to the reservation system, which makes reservations for each activity.

[0676] Input: Confirmed date plans

[0677] Output: Request to the reservation system

[0678] json

[0679] {

[0680] "reservations": [

[0681] {"activity": "luxury spa", "time": "13:00"},

[0682] {"activity": "French restaurant", "time": "19:00"}

[0683] ]

[0684] }

[0685] Step 11:

[0686] A confirmation of the reservation is sent from the server to the terminal, and the terminal displays the reservation details to the user.

[0687] Input: Reservation system response

[0688] Output: A confirmation message displayed to the user

[0689] Your reservation is confirmed:

[0690] Luxury Spa: 1 PM

[0691] French Restaurant: 7 p.m.

[0692] (Application example 2)

[0693] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0694] This invention relates to a system that automatically generates and provides ideal date plans that will satisfy users based on their emotions, as well as their preferences, budget, and date goals. Conventional systems have had difficulty generating plans that reflect the user's emotions, and also lacked the ability to present and adjust plans using virtual reality. As a result, it has been difficult to provide a date experience that meets users' expectations.

[0695] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0696] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting user confirmation and fine-tuning, means for booking activities included in the date plan with a reservation system, means for recognizing user emotions using an emotion engine and adjusting the analyzed data, and means for displaying and fine-tuning the date plan in virtual reality. This makes it possible to provide a customized date plan that reflects the user's emotions and enable visual adjustments in real time, thereby improving the quality of the user experience.

[0697] "Means for receiving user input" refers to the part of the system through which a user inputs information such as preferences, budget, and date purpose via a smartphone or other device.

[0698] The "means for parsing user input" is the part of the system that analyzes received user input and converts it into a useful form of data.

[0699] The "means for sending a request to the generative AI model" refers to the part of the system that sends a request to the AI ​​model based on the analyzed data and generates a date plan.

[0700] The "means for receiving a date plan from a generative AI model" is the part of the system for receiving a date plan generated from the AI ​​model.

[0701] The "means for displaying the received date plan to the user" is the part of the system that visually presents the generated date plan to the user.

[0702] The "means for accepting user confirmation and fine-tuning" is the part of the system that allows the user to review the displayed itinerary and make adjustments as necessary.

[0703] The "means for reserving activities included in a date plan with a reservation system" is a part of the system for automatically reserving activities based on a confirmed date plan.

[0704] "Means for recognizing user emotions using an emotion engine and adjusting analyzed data" refers to the part of the system that analyzes the user's facial expressions, voice, etc. to recognize emotions and adjusts the data generated based on those emotions.

[0705] The "means for displaying and fine-tuning a date plan in virtual reality" is the part of the system that displays the generated date plan to the user in a virtual reality environment and allows for visual fine-tuning.

[0706] The present invention is a system that automatically generates an ideal date plan using a generative AI model based on user input and emotions, and provides it to the user. This system is equipped with a means for recognizing the user's emotions in addition to the user's preferences, budget, and date purpose to optimize the plan. Specific embodiments are described below.

[0707] System Components

[0708] The system consists of the following main components:

[0709] 1. A means of receiving user input: The user inputs information such as preferences, budget, and purpose of the date via a smartphone or other device. For example, the user might input "relaxation," "foodie," "budget of 10,000 yen," or "special date."

[0710] 2. A means of parsing user input: Parse the received user input and convert it into a useful format.

[0711] 3. Emotion engine: Recognizes emotions from the user's facial expressions and voice and adjusts the data accordingly. For example, if the user's emotion is recognized as "joy," the system will enhance relaxation options.

[0712] 4. Send a request to the generative AI model: Based on the adjusted data, send a request to the generative AI model to generate a date plan. An example of a prompt is as follows:

[0713] User preferences: Relaxation, gourmet

[0714] Budget: 10,000 yen

[0715] Purpose: A special date

[0716] Emotion: Joy

[0717] 5. Means for receiving date plans from the generative AI model: Receive the generated date plans and generate a plan such as the following, for example, a plan including "Relax at a luxury spa at 13:00" and "Dinner at a popular French restaurant at 18:30."

[0718] 6. Means for displaying received date plans to the user: The generated date plans are visually presented to the user.

[0719] 7. A way for users to confirm and adjust their plans: Users can confirm their plans and make adjustments if necessary, for example, changing the dinner time from 6:30 PM to 7:00 PM.

[0720] 8. Reservation system: Automatically book activities based on confirmed date plans.

[0721] 9. Display and fine-tuning in virtual reality: The generated date plan is displayed to the user in a virtual reality environment and can be visually fine-tuned, allowing the user to check and fine-tune the plan in a way that is close to the real experience.

[0722] The implementation of this system can improve the quality of the user experience by providing a customized date plan that reflects the user's emotions and enabling visual adjustments in real time.

[0723] Hardware and Software Configuration

[0724] Hardware:

[0725] Smartphone (iOS / Android)

[0726] Camera (for facial expression recognition)

[0727] software:

[0728] Emotion recognition engine (e.g. Microsoft Azure Emotion API)

[0729] Generative AI models (e.g., OpenAI GPT models)

[0730] Reservation system (dedicated API)

[0731] Specific examples

[0732] The user launches the smartphone app and enters the following information: "Relax," "Gourmet," "Budget 10,000 yen," and "Special date." The system analyzes this and sends a request to the generative AI model. At the same time, the emotion engine recognizes the user's emotion of joy and reinforces the relaxation option. The generated date plan is "Relax at a luxury spa at 1:00 PM" and "Dinner at a popular French restaurant at 6:30 PM." The user checks this plan in virtual reality and fine-tunes the dinner time to 7:00 PM. Finally, the system automatically books these activities and notifies the user.

[0733] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0734] Step 1:

[0735] Receive user input

[0736] The user launches the smartphone application and enters their preferences, budget, date goals, etc.

[0737] Example inputs: "Relax", "Gourmet", "Budget 10,000 yen", "Special date".

[0738] Input: User preferences, budget, and dating purpose

[0739] Output: Input data (JSON format)

[0740] Step 2:

[0741] Parsing input

[0742] The device sends the input data from the user in JSON format to the server, which receives and analyzes this data.

[0743] Input: User input data (JSON format)

[0744] Output: Analysis data

[0745] Specific actions: Parse and extract preferences, budget, and date purpose.

[0746] Step 3:

[0747] Emotion recognition by emotion engine

[0748] An emotion engine is launched on the server to recognize emotions from the user's facial expressions, voice, and text input.

[0749] Input: User facial expressions, voice, text

[0750] Output: Emotion data (e.g., "joy")

[0751] Specific operation: Using an emotion recognition algorithm, emotions are estimated from facial expressions and voice.

[0752] Step 4:

[0753] Adjustment of analysis data

[0754] The server adjusts the analysis data based on the recognized emotion, for example, enhancing relaxation options to reflect the emotion of "joy."

[0755] Input: Emotion data, analysis data

[0756] Output: Adjusted analysis data

[0757] Specific operation: Attach emotion data and update existing analysis data.

[0758] Step 5:

[0759] Sending requests to generative AI models

[0760] The server sends the adjusted analysis data as a request to the generative AI model.

[0761] Input: Adjusted analytical data (e.g., "Relax," "Gourmet," etc.)

[0762] Output: Prompt sentence to the generative AI model

[0763] Specific behavior: Generates a prompt in the following format:

[0764] User preferences: Relaxation, gourmet

[0765] Budget: 10,000 yen

[0766] Purpose: A special date

[0767] Emotion: Joy

[0768] Step 6:

[0769] Creating and receiving date plans

[0770] The generative AI model generates a date plan, and the server receives the results.

[0771] Input: prompt statement

[0772] Output: Date plan (e.g. "13:00 Relax at a luxury spa")

[0773] Specific operation: A plan is created using the generative AI model and sent back to the server.

[0774] Step 7:

[0775] Display date plan

[0776] The server transmits the generated date plan to the terminal, and the terminal displays the plan contents to the user.

[0777] Input: Date plan

[0778] Output: Display data

[0779] Specific operation: The device application visually displays the date plan.

[0780] Step 8:

[0781] User verification and fine-tuning

[0782] The user can review the displayed date plan and make adjustments to the time and activities as needed.

[0783] Input: Display data, user fine-tuning

[0784] Output: Confirmed date plan

[0785] Specific actions: Adjust the plan parameters through the user interface.

[0786] Step 9:

[0787] Confirmation of reservation

[0788] The server automatically reserves the activity for the reservation system based on the confirmed date plan.

[0789] Input: Confirmed date plan

[0790] Output: Reservation data

[0791] Specific operation: Call the reservation API, make the necessary reservations, and receive the results.

[0792] Step 10:

[0793] Confirmation Notice

[0794] The server transmits the confirmed reservation data to the terminal, and the terminal notifies the user.

[0795] Input: Reservation data

[0796] Output: Notification message

[0797] Specific actions: Notify the user through the notification system.

[0798] Overall summary based on the process flow:

[0799] The system receives and analyzes user input, adjusts it with emotional data, and then uses a generative AI model to create an optimal date plan. The user can then review and fine-tune the plan in virtual reality, and finally, the plan is automatically booked through the reservation system, providing users with a special experience.

[0800] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0801] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0802] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0803] [Second embodiment]

[0804] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0805] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0806] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0807] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0808] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0809] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0810] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0811] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0812] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0813] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0814] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0815] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0816] This invention is a system that automatically generates an ideal date plan based on a user's preferences and budget. The system receives user input, analyzes it, and then requests a generative AI model to generate a date plan. The system then displays the generated date plan to the user and has the ability to make a reservation if necessary.

[0817] Overall system configuration

[0818] The system consists of the following main components:

[0819] 1. A means of receiving user input

[0820] 2. A way to analyze user input

[0821] 3. A means of sending requests to the generative AI model

[0822] 4. How to receive date plans

[0823] 5. How to display received date plans to users

[0824] 6. Means of accepting user confirmation and fine-tuning

[0825] 7. A means to reserve activities included in the date plan through the reservation system

[0826] Program processing procedure

[0827] The device receives data input by the user and sends it to the server. The server analyzes the data and sends the analysis results to the generative AI model. The generative AI model generates a date plan and sends the results back to the server. The server sends the received date plan to the device, which displays the plan contents to the user. The user confirms the plan and makes any necessary adjustments. Finally, the server notifies the reservation system of the confirmed plan and completes the necessary reservation procedures.

[0828] Program processing details

[0829] User input

[0830] The user (hereafter referred to as "Tanaka") starts up the device and operates the application to enter data into the input form. For example, enter the following information.

[0831] Preferences: Relaxation, gourmet food

[0832] Budget: 10,000 yen

[0833] Date purpose: A special date

[0834] Data transmission and analysis

[0835] The terminal sends input data to the server, which receives the data in JSON format and begins parsing it.

[0836] {

[0837] "preferences": ["Relax", "Gourmet"],

[0838] "budget": 10000,

[0839] "purpose": "special date"

[0840] }

[0841] The server converts the data into an internal format and makes requests to the generative AI model.

[0842] Generating date plans using generative AI models

[0843] A generative AI model receives the request and generates the best date plan based on the user's preferences and budget.

[0844] {

[0845] "date": "This Saturday",

[0846] "activities": [

[0847] {"time": "13:00", "activity": "Relax at a luxury spa"},

[0848] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[0849] ],

[0850] "total_cost": 9800

[0851] }

[0852] Display date plan

[0853] The server sends the generated date plan to the terminal, which displays the date plan to the user.

[0854] Date plan:

[0855] 1 PM: Relax at a luxury spa

[0856] 6:30 PM: Dinner at a popular French restaurant

[0857] Cost: 9,800 yen

[0858] User verification and fine-tuning

[0859] Tanaka checks the displayed date plan and adjusts the time and location as necessary, for example, changing the dinner time to 7 p.m.

[0860] Tanaka presses the "Confirm" button.

[0861] Confirmation of reservation

[0862] The server transmits the confirmed plan details to the reservation system and performs reservation procedures for the luxury spa and French restaurant.

[0863] {

[0864] "reservations": [

[0865] {"activity": "luxury spa", "time": "13:00"},

[0866] {"activity": "French restaurant", "time": "18:30"}

[0867] ]

[0868] }

[0869] A notification of the confirmed reservation is sent to the terminal and displayed to Tanaka.

[0870] In this way, the system of the present invention automatically generates an ideal date plan based on the user's preferences and budget, allowing the user to easily enjoy a special date experience. Furthermore, by automating the reservation procedure, the burden on the user can be reduced.

[0871] The processing flow will be explained below.

[0872] Step 1:

[0873] The user (Tanaka) starts up the device and opens the date planner app. Tanaka enters his preferences, budget, and purpose of the date into the input form. At this time, he enters the following information:

[0874] Preferences: Relaxation, gourmet food

[0875] Budget: 10,000 yen

[0876] Date purpose: A special date

[0877] Step 2:

[0878] The terminal converts the input data into JSON format and sends the data to the server. An example of the data to be sent is as follows:

[0879] {

[0880] "preferences": ["Relax", "Gourmet"],

[0881] "budget": 10000,

[0882] "purpose": "special date"

[0883] }

[0884] Step 3:

[0885] The server parses the JSON data received from the device. The parsed data is converted into an internal data structure, as shown below.

[0886] preferences = ["Relaxed", "Gourmet"]

[0887] budget = 10000

[0888] purpose = "special date"

[0889] Step 4:

[0890] The server creates data to request the AI ​​model to generate a date plan. An example of the created request data is as follows:

[0891] ai_request = {

[0892] "user_preferences": preferences,

[0893] "user_budget": budget,

[0894] "user_purpose": purpose

[0895] }

[0896] The server sends this request to the generative AI model.

[0897] Step 5:

[0898] The generative AI model receives a request from the server and generates a date plan using its internal algorithm. The generated date plan includes the following information:

[0899] {

[0900] "date": "This Saturday",

[0901] "activities": [

[0902] {"time": "13:00", "activity": "Relax at a luxury spa"},

[0903] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[0904] ],

[0905] "total_cost": 9800

[0906] }

[0907] Step 6:

[0908] The generative AI model sends the generated date plan back to the server, which receives the date plan.

[0909] Step 7:

[0910] The server sends the received date plan to the terminal. The terminal displays the date plan on the screen and presents the following to Tanaka:

[0911] Date plan:

[0912] 1 PM: Relax at a luxury spa

[0913] 6:30 PM: Dinner at a popular French restaurant

[0914] Cost: 9,800 yen

[0915] Step 8:

[0916] Tanaka checks the displayed date plan and makes any necessary adjustments. For example, he changes the dinner time to 7 p.m. Once he has completed the changes, he presses the "Confirm" button.

[0917] Step 9:

[0918] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[0919] {

[0920] "reservations": [

[0921] {"activity": "luxury spa", "time": "13:00"},

[0922] {"activity": "French restaurant", "time": "19:00"}

[0923] ]

[0924] }

[0925] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[0926] Your reservation is confirmed:

[0927] Luxury Spa: 1 PM

[0928] French Restaurant: 7 p.m.

[0929] In this way, the system of the present invention allows users to easily create, confirm, and reserve their ideal date plan.

[0930] Example 1

[0931] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0932] In today's busy lifestyles, efficiently planning and executing special date plans is difficult. It takes time and effort to independently create an ideal date plan that takes into account the user's preferences and budget, and then book activities based on that plan. Furthermore, the time and complexity of the booking process can be burdensome, making it difficult for users to easily enjoy a special date experience. To address these challenges, a system is needed that can automatically generate date plans based on user input and streamline the entire process, including the booking process.

[0933] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0934] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting confirmation and fine-tuning from the user, means for booking activities included in the date plan with a reservation system, means for creating a prompt sentence to be used in the date plan generation request, and means for formatting the date plan details. This allows users to easily receive a date plan optimized for their preferences and budget, and by automating the reservation procedure, they can efficiently realize a special date experience.

[0935] The "means for receiving user input" is an interface that allows the user to input information such as preferences, budget, and purpose of the date into the system.

[0936] "Means for analyzing user input" refers to a program or algorithm that analyzes received user input data and extracts and converts information such as preferences, budget, and purpose.

[0937] "Means for sending requests to the generative AI model based on the analyzed data" means means for sending requests in an appropriate format to the generative AI model using the analyzed data.

[0938] A "means for receiving a date plan from a generative AI model" is an interface or mechanism for accepting date plan data generated by a generative AI model.

[0939] The "means for displaying the received date plan to the user" refers to an interface and a program for visually displaying the received date plan to the user.

[0940] The "means for accepting user confirmation and fine adjustment" is a means for accepting operations by the user for confirming and modifying the displayed date plan.

[0941] The "means for reserving activities included in a date plan in a reservation system" refers to a system and program for automatically reserving various activities based on a confirmed date plan.

[0942] The "means for creating a prompt sentence to be used when requesting the generation of a date plan" is a program or algorithm for automatically creating a prompt sentence to be used when requesting the generation of a date plan from a generative AI model.

[0943] A "means for formatting date plan details" is a program or mechanism for converting date plan details received from a generative AI model into a format appropriate for display to a user.

[0944] This invention is a system that automatically generates an ideal date plan based on a user's preferences and budget. The system receives user input, analyzes it, and then requests a generative AI model to generate a date plan. The system then displays the generated date plan to the user and has the ability to make a reservation if necessary.

[0945] Overall system configuration

[0946] The system consists of the following main components:

[0947] 1. A means of receiving user input

[0948] The user enters information such as preferences, budget, and purpose of the date into an input form. For example, the input can be done using a smartphone or PC application.

[0949] 2. A way to analyze user input

[0950] The input data is analyzed, and the necessary information is extracted and converted. The analysis is performed using Python's Pandas library, etc.

[0951] 3. A means of sending requests to the generative AI model based on the analyzed data

[0952] A prompt is created based on the analyzed data and sent to a generative AI model (such as GPT-3 or GPT-4). An example of a prompt is as follows:

[0953] A user likes relaxation and gourmet food and is planning a special date. The budget is 10,000 yen, and they want to go on this Saturday. Generate the optimal date plan based on this.

[0954] 4. A way to receive date plans from a generative AI model

[0955] The date plan generated by the generative AI model is received on the server side. The received data is in JSON format.

[0956] 5. How to display received date plans to users

[0957] The received date plan is converted into an appropriate format, sent to the device, and displayed to the user. Web frameworks such as React and Angular are used for display.

[0958] 6. Means of accepting user confirmation and fine-tuning

[0959] It provides an interface for users to review their date plans and make adjustments to the time and location as needed, for example, changing the time or adding or removing activities.

[0960] 7. A means to reserve activities included in the date plan through the reservation system

[0961] The confirmed date plan details are sent to the reservation system, and each activity is automatically booked. Reservation management uses server-side frameworks such as Node.js and Django.

[0962] In this way, the system of the present invention automatically generates an ideal date plan based on the user's preferences and budget, allowing the user to easily enjoy a special date experience. Also, by automating the reservation process, the burden on the user can be reduced.

[0963] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0964] Step 1:

[0965] The user starts up the device, operates the application, and enters information such as preferences, budget, and purpose of the date into the input form.

[0966] Input: Information about your preferences, budget, and dating goals

[0967] Output: Data entered in the input form

[0968] Specific operation: The user opens the app on their smartphone or PC, enters the information as shown below, and taps the "Send" button.

[0969] Preferences: Relaxation, gourmet food

[0970] Budget: 10,000 yen

[0971] Date purpose: A special date

[0972] Step 2:

[0973] The terminal sends the input data to the server.

[0974] Input: Data entered into an input form

[0975] Output: JSON format data sent to the server

[0976] Specific operation: Tanaka's smartphone sends the input data to the server in real time. The data will be in the following format.

[0977] json

[0978] {

[0979] "preferences": ["Relax", "Gourmet"],

[0980] "budget": 10000,

[0981] "purpose": "special date"

[0982] }

[0983] Step 3:

[0984] The server parses the received data.

[0985] Input: JSON format data

[0986] Output: Parsed internal data format

[0987] Specific operation: The server parses the received JSON data and extracts information such as "preferences," "budget," and "purpose of the date." For example, it can be parsed using the Python Pandas library as follows:

[0988] python

[0989] data = {

[0990] "preferences": ["Relax", "Gourmet"],

[0991] "budget": 10000,

[0992] "purpose": "special date"

[0993] }

[0994] preferences = data["preferences"]

[0995] budget = data["budget"]

[0996] purpose = data["purpose"]

[0997] Step 4:

[0998] The server sends a request to the generative AI model based on the analysis results.

[0999] Input: Parsed internal data format

[1000] Output: The prompt sent to the generative AI model

[1001] Specific operation: The server creates a prompt for the generative AI model and sends it to the model in the following text format:

[1002] A user likes relaxation and gourmet food and is planning a special date. The budget is 10,000 yen, and they want to go on this Saturday. Generate the optimal date plan based on this.

[1003] Step 5:

[1004] A generative AI model receives the request and generates a date plan.

[1005] Input: Prompt text sent from the server

[1006] Output: Generated date plan (JSON format)

[1007] What it does: The generative AI model processes the request and generates the following details of the date plan:

[1008] json

[1009] {

[1010] "date": "This Saturday",

[1011] "activities": [

[1012] {"time": "13:00", "activity": "Relax at a luxury spa"},

[1013] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[1014] ],

[1015] "total_cost": 9800

[1016] }

[1017] Step 6:

[1018] The server receives the generated date plan.

[1019] Input: Date plan from the generative AI model (JSON format)

[1020] Output: Date plan saved in server storage

[1021] Specific operation: The server stores the date plan received from the generative AI model in an internal database and converts the format as necessary.

[1022] Step 7:

[1023] The server sends the date plan to the terminal, which displays it to the user.

[1024] Input: Date plan saved on the server

[1025] Output: Date plan displayed on user's device

[1026] Specific operation: The app displays the details of the date plan on Tanaka's smartphone. The displayed content is as follows:

[1027] Date plan:

[1028] 1 PM: Relax at a luxury spa

[1029] 6:30 PM: Dinner at a popular French restaurant

[1030] Cost: 9,800 yen

[1031] Step 8:

[1032] The user checks the plan and adjusts the time and location as needed.

[1033] Input: Date plan displayed to user

[1034] Output: Adjusted date plan

[1035] Specific operation: The user checks the date plan and changes the dinner time to, for example, 7 PM. Once the changes are complete, the user presses the "Confirm" button.

[1036] Step 9:

[1037] The server transmits the confirmed plan details to the reservation system and makes reservations for each activity.

[1038] Input: Adjusted date plan

[1039] Output: Request and booking confirmation sent to the reservation system

[1040] Specific operation: The server sends the following request to the reservation system to confirm the reservation of each activity.

[1041] json

[1042] {

[1043] "reservations": [

[1044] {"activity": "luxury spa", "time": "13:00"},

[1045] {"activity": "French restaurant", "time": "19:00"}

[1046] ]

[1047] }

[1048] Once the reservation is complete, the server sends a confirmation notice to the user's terminal and displays it to the user.

[1049] (Application example 1)

[1050] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1051] Current food delivery services lack a system that can automatically suggest optimal meal plans that fit multiple users' preferences, budgets, and specific delivery times. This requires users to search for restaurants and decide what to order themselves, which is time-consuming. Furthermore, when ordering multiple dishes from different locations at different times, the ordering process for each dish becomes complicated. Furthermore, it is difficult to suggest meal plans that fit specific delivery times, making it difficult to improve the user experience.

[1052] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1053] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a meal plan from the generative AI model, means for displaying the received meal plan to the user, means for accepting user confirmation and fine-tuning, and means for ordering and delivering meals. This allows users to easily receive a meal plan that is optimal for their preferences, budget, and specific delivery time, eliminating the complexity of ordering and delivery procedures.

[1054] The "means for receiving user input" is an interface for obtaining information such as preferences, budget, and delivery time from the user.

[1055] The "means for analyzing user input" is a processing function for analyzing received user input data and converting it into an appropriate format.

[1056] "Means for sending a request to the generative AI model based on the analyzed data" refers to a communication means for passing the analyzed data to the generative AI model and requesting the generation of an optimal meal plan.

[1057] "Means for receiving a meal plan from a generative AI model" refers to a receiving function for receiving a meal plan created by a generative AI model.

[1058] The "means for displaying the received meal plan to the user" is an interface for displaying the generated meal plan to the user in a format that is easy to understand.

[1059] The "means for accepting user confirmation and fine-tuning" is an interface that allows the user to review the generated plan and adjust it as necessary.

[1060] "Means for ordering and delivering meals" refers to a system for placing orders with restaurants based on a confirmed meal plan and delivering meals at the specified delivery time.

[1061] "Preferences" refers to information such as the type of food or style of restaurant the user prefers.

[1062] A "budget" is a range of amounts that a user specifies for spending on food.

[1063] "Delivery time" is information indicating the date and time when the user would like to receive the meal.

[1064] A "meal plan" is a plan that includes recommended meal menus and ordering details, generated based on user input.

[1065] This invention is a system that automatically generates an ideal meal plan based on a user's preferences and budget, and then handles ordering and delivery. The system uses a smartphone as the user interface, processes data on a cloud server, and generates meal plans using a generative AI model. It also uses a delivery API to automate meal ordering and delivery.

[1066] Hardware and software used

[1067] 1. Smartphone: This is the device where the user provides input data and checks the meal plan.

[1068] 2. Cloud server: Uses Amazon Web Services (AWS) Lambda and other services to perform scalable data processing and backend operations.

[1069] 3. Generative AI model: Using OpenAI GPT-4 and other models, it generates optimal meal plans based on user input data.

[1070] 4. Delivery API: Use APIs such as UberEats to automatically order and deliver meals.

[1071] System Operation Overview

[1072] 1. Receiving user input:

[1073] The user operates their smartphone and enters their preferences, budget, and delivery time into the application's input form. For example, the following input data is obtained:

[1074] Preferences: Italian

[1075] Budget: 5,000 yen

[1076] Delivery time: 19:00

[1077] 2. Data transmission and analysis:

[1078] The smartphone sends this input data to the cloud server, which receives and analyzes it. The analysis results will be in the following format:

[1079] {

[1080] "preferences": ["Italian"],

[1081] "budget": 5000,

[1082] "delivery_time": "19:00"

[1083] }

[1084] 3. Request to the generative AI model:

[1085] The cloud server sends a request to the generative AI model based on the analyzed data. An example of a prompt for the generative AI model is as follows:

[1086] Generate the perfect meal plan based on your preferences and budget. Use the following information to help you:

[1087] Preferences: Italian

[1088] Budget: 5,000 yen

[1089] Delivery time: 19:00

[1090] 4. Receive and view the generated meal plan:

[1091] The plan created by the generative AI model is sent to a smartphone via a cloud server, and the plan is displayed to the user as shown below.

[1092] Your food delivery plan:

[1093] - 18:50: Pizza Margherita

[1094] - 18:55: Carbonara

[1095] Cost: 4,800 yen

[1096] 5. User verification and fine-tuning:

[1097] Users can check the plan on their smartphone and make changes to the time and menu as needed. Once changes are complete, users press the "Confirm" button to finalize the plan.

[1098] 6. Ordering and Delivery Arrangements:

[1099] The cloud server sends an order request to the delivery API based on the confirmed plan. Orders are placed with each restaurant at the appropriate time, and the meals are delivered at the specified delivery time.

[1100] This system allows users to easily receive the optimal meal plan tailored to their preferences, budget, and specific delivery time, significantly reducing the hassle of ordering and delivery.

[1101] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1102] Step 1:

[1103] The user operates their smartphone and enters data into the application's input form. Specifically, the user enters "preferences," "budget," and "delivery time." This results in the following data being obtained as user input:

[1104] Input data:

[1105] Preferences: Italian

[1106] Budget: 5,000 yen

[1107] Delivery time: 19:00

[1108] Step 2:

[1109] The device sends this input data to the cloud server, which receives the data in JSON format and performs the following analysis:

[1110] input:

[1111] {

[1112] "preferences": ["Italian"],

[1113] "budget": 5000,

[1114] "delivery_time": "19:00"

[1115] }

[1116] The server parses this data and converts it into an internal format.

[1117] Step 3:

[1118] Based on the data analyzed by the server, a request is sent to the generative AI model. Specifically, the following prompt is generated:

[1119] Prompt statement:

[1120] Generate the perfect meal plan based on your preferences and budget. Use the following information to help you:

[1121] Preferences: Italian

[1122] Budget: 5,000 yen

[1123] Delivery time: 19:00

[1124] This allows the generative AI model to generate an optimal meal plan based on user input.

[1125] Step 4:

[1126] The generative AI model generates a meal plan and sends the results back to the server. The generated plan looks like this:

[1127] Generated plan:

[1128] {

[1129] "food_plan": [

[1130] {"time": "18:50", "food": "Pizza Margherita"},

[1131] {"time": "18:55", "food": "Carbonara"}

[1132] ],

[1133] "total_cost": 4800

[1134] }

[1135] Step 5:

[1136] The server receives the meal plan from the AI ​​model and sends it to the device (smartphone), which analyzes the data and displays the plan on the screen.

[1137] Display contents:

[1138] Your food delivery plan:

[1139] 18:50: Pizza Margherita

[1140] 18:55: Carbonara

[1141] Cost: 4,800 yen

[1142] Step 6:

[1143] The user can check the meal plan on the device and make any necessary adjustments, such as changing the delivery time. After making the adjustments, the user presses the "Confirm" button.

[1144] Step 7:

[1145] The server sends the confirmed meal plan to the delivery API and processes the order and delivery. Specifically, the following order request is sent.

[1146] Order Request:

[1147] {

[1148] "orders": [

[1149] {"restaurant": "Italian Restaurant A", "food": "Pizza Margherita", "time": "18:50"},

[1150] {"restaurant": "Italian Restaurant B", "food": "Carbonara", "time": "18:55"}

[1151] ]

[1152] }

[1153] Step 8:

[1154] When the delivery API successfully accepts the order, the server sends the result to the terminal and displays a notification of order confirmation to the user, allowing the user to confirm that the meal will be delivered at the specified time.

[1155] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1156] This invention is a system that automatically generates ideal date plans using a generative AI model based on user input and emotions, and provides them to users. This system has a means to recognize the user's emotions in addition to their preferences, budget, and date purpose to optimize the plans.

[1157] Overall system configuration

[1158] The system consists of the following main components:

[1159] 1. A means of receiving user input

[1160] 2. A way to analyze user input

[1161] 3. A means to recognize user emotions and adjust analytical data using an emotion engine

[1162] 4. A means of sending requests to the generative AI model

[1163] 5. How to receive date plans

[1164] 6. How to display received date plans to users

[1165] 7. Means of accepting user confirmation and fine-tuning

[1166] 8. A means to reserve activities included in the date plan through the reservation system

[1167] Program processing procedure

[1168] The device receives data input by the user and sends it to the server. Before analyzing the data, the server recognizes the user's emotions through an emotion engine. It adjusts the analyzed data based on the recognized emotions. It then sends a request to the generative AI model based on the adjusted data. The generative AI model generates a date plan and sends the result back to the server. The server sends the received date plan to the device, which displays the plan contents to the user. The user confirms the plan and makes any necessary adjustments. Finally, the server notifies the reservation system of the confirmed plan and completes the necessary reservation procedures.

[1169] Program processing details

[1170] User input

[1171] The user (hereafter referred to as "Tanaka") starts up the terminal and enters the following information into the input form via the application.

[1172] Preferences: Relaxation, gourmet food

[1173] Budget: 10,000 yen

[1174] Date purpose: A special date

[1175] Data transmission and analysis

[1176] The terminal sends input data in JSON format to the server, which receives the data and parses the JSON data.

[1177] {

[1178] "preferences": ["Relax", "Gourmet"],

[1179] "budget": 10000,

[1180] "purpose": "special date"

[1181] }

[1182] Emotion recognition by emotion engine

[1183] The server activates an emotion engine to recognize emotions from Tanaka's facial expressions, voice tone, and text input.

[1184] Emotion: Joy (85% probability)

[1185] Adjustment of analysis data

[1186] The server adjusts the analysis data based on the recognized emotion. For example, if Tanaka's emotion is "joy," it will enhance relaxation options.

[1187] Requests to generative AI models

[1188] The server sends a request to the generative AI model based on the adjusted data.

[1189] ai_request = {

[1190] "user_preferences": ["Relax", "Gourmet"],

[1191] "user_budget": 10000,

[1192] "user_purpose": "special date",

[1193] "user_emotion": "joy"

[1194] }

[1195] Generating date plans using generative AI models

[1196] The generative AI model generates a date plan, which looks like this:

[1197] {

[1198] "date": "This Saturday",

[1199] "activities": [

[1200] {"time": "13:00", "activity": "Relax at a luxury spa"},

[1201] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[1202] ],

[1203] "total_cost": 9800

[1204] }

[1205] Display date plan

[1206] The server sends the generated date plan to the device, which displays the plan to the user and presents the following to Tanaka:

[1207] Date plan:

[1208] 1 PM: Relax at a luxury spa

[1209] 6:30 PM: Dinner at a popular French restaurant

[1210] Cost: 9,800 yen

[1211] User verification and fine-tuning

[1212] Tanaka checks the displayed date plan and, for example, changes the dinner time to 7 p.m. Once the changes are complete, Tanaka presses the "Confirm" button.

[1213] Confirmation of reservation

[1214] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[1215] {

[1216] "reservations": [

[1217] {"activity": "luxury spa", "time": "13:00"},

[1218] {"activity": "French restaurant", "time": "19:00"}

[1219] ]

[1220] }

[1221] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[1222] Your reservation is confirmed:

[1223] Luxury Spa: 1 PM

[1224] French Restaurant: 7 p.m.

[1225] In this way, by combining the emotion engine, the system can better understand the user's emotional state and provide date plans tailored to individual needs, making the user's dating experience even richer and more special.

[1226] The processing flow will be explained below.

[1227] Step 1:

[1228] The user (Tanaka) starts up the device and opens the date planner app. Tanaka enters his preferences, budget, and purpose of the date into the input form. At this time, he enters the following information:

[1229] Preferences: Relaxation, gourmet food

[1230] Budget: 10,000 yen

[1231] Date purpose: A special date

[1232] Step 2:

[1233] The terminal converts the input data into JSON format and sends the data to the server. An example of the data to be sent is as follows:

[1234] {

[1235] "preferences": ["Relax", "Gourmet"],

[1236] "budget": 10000,

[1237] "purpose": "special date"

[1238] }

[1239] Step 3:

[1240] The server parses the JSON data received from the device. The parsed data is converted into an internal data structure, as shown below.

[1241] preferences = ["Relaxed", "Gourmet"]

[1242] budget = 10000

[1243] purpose = "special date"

[1244] Step 4:

[1245] The server activates the emotion engine and collects data to recognize emotions from Tanaka's facial expressions, voice tone, and text input. For example, facial expressions and voice are captured through the smartphone's camera and microphone.

[1246] Step 5:

[1247] The emotion engine analyzes the collected data and estimates Tanaka's emotional state. For example, it estimates "joy" from facial expression analysis and voice tone.

[1248] Emotion: Joy (85% probability)

[1249] Step 6:

[1250] The server adjusts the analysis data based on the recognized emotion. For example, if Tanaka's emotion is "joy," it will enhance relaxation options.

[1251] adjusted_preferences = ["Relaxed", "Gourmet"]

[1252] Step 7:

[1253] The server sends a request to the generative AI model based on the adjusted data. An example of the request data to be sent is as follows:

[1254] ai_request = {

[1255] "user_preferences": adjusted_preferences,

[1256] "user_budget": 10000,

[1257] "user_purpose": "special date",

[1258] "user_emotion": "joy"

[1259] }

[1260] Step 8:

[1261] The generative AI model receives a request from the server and generates a date plan using its internal algorithm. The generated date plan includes the following information:

[1262] {

[1263] "date": "This Saturday",

[1264] "activities": [

[1265] {"time": "13:00", "activity": "Relax at a luxury spa"},

[1266] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[1267] ],

[1268] "total_cost": 9800

[1269] }

[1270] Step 9:

[1271] The generative AI model sends the generated date plan back to the server, which receives the date plan.

[1272] Step 10:

[1273] The server sends the received date plan to the terminal. The terminal displays the date plan on the screen and presents the following to Tanaka:

[1274] Date plan:

[1275] 1 PM: Relax at a luxury spa

[1276] 6:30 PM: Dinner at a popular French restaurant

[1277] Cost: 9,800 yen

[1278] Step 11:

[1279] Tanaka checks the displayed date plan and makes any necessary adjustments. For example, he changes the dinner time to 7 p.m. Once he has completed the changes, he presses the "Confirm" button.

[1280] Step 12:

[1281] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[1282] {

[1283] "reservations": [

[1284] {"activity": "luxury spa", "time": "13:00"},

[1285] {"activity": "French restaurant", "time": "19:00"}

[1286] ]

[1287] }

[1288] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[1289] Your reservation is confirmed:

[1290] Luxury Spa: 1 PM

[1291] French Restaurant: 7 p.m.

[1292] In this way, the system of the present invention allows users to easily create, confirm, and book their ideal date plan, and by taking emotions into consideration, it can provide a more personalized experience.

[1293] Example 2

[1294] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1295] Conventional date plan generation systems generate plans based solely on user input data, making it impossible to take into account the user's emotions or momentary moods. This makes it difficult to provide a truly optimal plan for the user, resulting in low user satisfaction. Additionally, the process from the user confirming the plan details to finalizing the reservation is complicated, requiring a lot of time and effort.

[1296] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1297] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for recognizing the user's emotions using an emotion engine and adjusting the analysis data, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting user confirmation and fine-tuning, and means for booking activities included in the date plan with a reservation system. This makes it possible to provide a more optimal date plan that takes the user's emotions into consideration and significantly reduce the effort and time required for booking.

[1298] "User" refers to a person who uses this system to generate date plans.

[1299] "Means for receiving input" refers to an interface or device for obtaining data from a user.

[1300] "Means for analyzing" refers to software or algorithms used to structure and understand captured user input data.

[1301] A "generative AI model" refers to an artificial intelligence model that is trained to solve a specific task or problem.

[1302] "Date Plan" refers to a combination of activities and schedules suggested based on the user's requests and preferences.

[1303] "Means for displaying" refers to a screen or device for visually presenting the generated date plan to the user.

[1304] "Means for accepting confirmation and fine-tuning" refers to an interface that allows the user to make changes or confirmations to the proposed date plan.

[1305] "Reservation system" refers to a system for making reservations and confirming each activity included in a date plan.

[1306] An "emotion engine" refers to software or algorithms that analyze users' emotions and reflect them in plan generation.

[1307] "Means for adjusting analysis data" refers to a function for optimizing the analysis results and the content of the data generated based on the recognized emotions.

[1308] This invention is a system that automatically generates ideal date plans using a generative AI model based on user input and emotions, and provides them to users. This system has a means to recognize the user's emotions in addition to their preferences, budget, and date purpose to optimize the plans.

[1309] Overall system configuration

[1310] The system consists of the following main components:

[1311] 1. A means of receiving user input

[1312] 2. A way to analyze user input

[1313] 3. A means to recognize user emotions and adjust analytical data using an emotion engine

[1314] 4. A means of sending requests to the generative AI model

[1315] 5. How to receive date plans

[1316] 6. How to display received date plans to users

[1317] 7. Means of accepting user confirmation and fine-tuning

[1318] 8. A means to reserve activities included in the date plan through the reservation system

[1319] System Operation

[1320] User input

[1321] The user starts the device and enters the following information through the application:

[1322] Preferences: Relaxation, gourmet food

[1323] Budget: 10,000 yen

[1324] Date purpose: A special date

[1325] Sending input data

[1326] The device sends the user's input data in JSON format to the server.

[1327] json

[1328] {

[1329] "preferences": ["Relax", "Gourmet"],

[1330] "budget": 10000,

[1331] "purpose": "special date"

[1332] }

[1333] Data analysis and emotion recognition

[1334] The server analyzes the input data and activates the emotion engine.

[1335] The emotion engine recognizes emotions from the user's facial expressions, voice tone, and text input.

[1336] Emotion: Joy (85% probability)

[1337] Adjustment of analysis data

[1338] The server adjusts the analysis data based on the recognized emotion.

[1339] Sending requests to generative AI models

[1340] The server sends a request to the generative AI model based on the adjusted data.

[1341] json

[1342] {

[1343] "user_preferences": ["Relax", "Gourmet"],

[1344] "user_budget": 10000,

[1345] "user_purpose": "special date",

[1346] "user_emotion": "joy"

[1347] }

[1348] Receive the generated date plan

[1349] The generative AI model generates a date plan and sends it back to the server.

[1350] Date: This Saturday

[1351] activity:

[1352] 13:00: Relax at a luxury spa

[1353] 18:30: Dinner at a popular French restaurant

[1354] Total cost: 9,800 yen

[1355] Display date plan

[1356] The server transmits the generated date plan to the terminal, and the terminal displays the date plan to the user.

[1357] User verification and fine-tuning

[1358] The user reviews the displayed date plan and makes adjustments as necessary.

[1359] The user takes action to confirm the plan.

[1360] Confirmation of reservation

[1361] The server transmits the finalized date plan to the reservation system and makes reservations for each activity.

[1362] json

[1363] {

[1364] "reservations": [

[1365] {"activity": "luxury spa", "time": "13:00"},

[1366] {"activity": "French restaurant", "time": "19:00"}

[1367] ]

[1368] }

[1369] Sending confirmation of reservation

[1370] A confirmation of the reservation is sent to the device, which displays the following message to the user:

[1371] Your reservation is confirmed:

[1372] Luxury Spa: 1 PM

[1373] French Restaurant: 7 p.m.

[1374] Hardware and software used

[1375] Device: A device that receives user input and displays date plans, such as a smartphone, tablet, or PC.

[1376] Server: A central processing unit for data analysis, emotion recognition, communication with generative AI models, and reservation management.

[1377] Emotion Engine: Software for analyzing user emotions, combining speech recognition, image analysis, and text analysis technologies.

[1378] Generative AI model: An artificial intelligence model trained to automatically generate date plans.

[1379] By implementing the present invention, users can easily create optimal date plans tailored to their individual emotions and even make reservations, making their dating experience even more special and enriching.

[1380] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1381] Program processing flow

[1382] Step 1:

[1383] The user launches the application on their device and enters their preferences, budget, and date goals.

[1384] Example input:

[1385] Preferences: Relaxation, gourmet food

[1386] Budget: 10,000 yen

[1387] Date purpose: A special date

[1388] Input data is collected and converted to JSON format on the device.

[1389] Step 2:

[1390] The terminal sends the input data to the server in JSON format.

[1391] Input: User preferences, budget, and dating goals

[1392] Output: JSON format data

[1393] json

[1394] {

[1395] "preferences": ["Relax", "Gourmet"],

[1396] "budget": 10000,

[1397] "purpose": "special date"

[1398] }

[1399] Step 3:

[1400] The server receives the JSON data and parses the user input.

[1401] Input: JSON format data

[1402] Output: Analyzed user preferences, budget, and dating goals

[1403] Step 4:

[1404] The server activates the emotion engine to analyze the user's emotions, specifically recognizing emotions from facial expressions, voice tone, and text input data.

[1405] Input: User's facial expression data, voice data, text data

[1406] Output: User sentiment

[1407] Emotion: Joy (85% probability)

[1408] Step 5:

[1409] The server adjusts the analysis data based on the recognized emotion.

[1410] Input: User sentiment, preferences, budget, and dating goals

[1411] Output: Adjusted analysis data

[1412] Example of adjustment:

[1413] Adjusted data:

[1414] Preferences: Relaxation (strengthening), gourmet food

[1415] Budget: 10,000 yen

[1416] Date purpose: A special date

[1417] Step 6:

[1418] The server sends the adjusted data as a request to the generative AI model.

[1419] Input: Adjusted analysis data

[1420] Output: A request to the generative AI model

[1421] json

[1422] {

[1423] "user_preferences": ["Relax", "Gourmet"],

[1424] "user_budget": 10000,

[1425] "user_purpose": "special date",

[1426] "user_emotion": "joy"

[1427] }

[1428] Step 7:

[1429] The generative AI model generates a date plan and sends the results back to the server.

[1430] Input: A request to the generative AI model

[1431] Output: Generated date plan

[1432] json

[1433] {

[1434] "date": "This Saturday",

[1435] "activities": [

[1436] {"time": "13:00", "activity": "Relax at a luxury spa"},

[1437] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[1438] ],

[1439] "total_cost": 9800

[1440] }

[1441] Step 8:

[1442] The server transmits the date plan to the terminal, and the terminal displays the date plan to the user.

[1443] Input: Generated date plan

[1444] Output: Date plan displayed to the user

[1445] Date plan:

[1446] 1 PM: Relax at a luxury spa

[1447] 6:30 PM: Dinner at a popular French restaurant

[1448] Cost: 9,800 yen

[1449] Step 9:

[1450] The user can review the displayed date plan and make any necessary adjustments, such as changing the dinner time to 7 p.m.

[1451] Input: User's fine-tuning request

[1452] Output: A tweaked date plan

[1453] Dinner time changed to 7pm

[1454] Step 10:

[1455] The user confirms the plan, and the server sends the final confirmed date plan to the reservation system, which makes reservations for each activity.

[1456] Input: Confirmed date plans

[1457] Output: Request to the reservation system

[1458] json

[1459] {

[1460] "reservations": [

[1461] {"activity": "luxury spa", "time": "13:00"},

[1462] {"activity": "French restaurant", "time": "19:00"}

[1463] ]

[1464] }

[1465] Step 11:

[1466] A confirmation of the reservation is sent from the server to the terminal, and the terminal displays the reservation details to the user.

[1467] Input: Reservation system response

[1468] Output: A confirmation message displayed to the user

[1469] Your reservation is confirmed:

[1470] Luxury Spa: 1 PM

[1471] French Restaurant: 7 p.m.

[1472] (Application example 2)

[1473] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1474] This invention relates to a system that automatically generates and provides ideal date plans that will satisfy users based on their emotions, as well as their preferences, budget, and date goals. Conventional systems have had difficulty generating plans that reflect the user's emotions, and also lacked the ability to present and adjust plans using virtual reality. As a result, it has been difficult to provide a date experience that meets users' expectations.

[1475] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1476] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting user confirmation and fine-tuning, means for booking activities included in the date plan with a reservation system, means for recognizing user emotions using an emotion engine and adjusting the analyzed data, and means for displaying and fine-tuning the date plan in virtual reality. This makes it possible to provide a customized date plan that reflects the user's emotions and enable visual adjustments in real time, thereby improving the quality of the user experience.

[1477] "Means for receiving user input" refers to the part of the system through which a user inputs information such as preferences, budget, and date purpose via a smartphone or other device.

[1478] The "means for parsing user input" is the part of the system that analyzes received user input and converts it into a useful form of data.

[1479] The "means for sending a request to the generative AI model" refers to the part of the system that sends a request to the AI ​​model based on the analyzed data and generates a date plan.

[1480] The "means for receiving a date plan from a generative AI model" is the part of the system for receiving a date plan generated from the AI ​​model.

[1481] The "means for displaying the received date plan to the user" is the part of the system that visually presents the generated date plan to the user.

[1482] The "means for accepting user confirmation and fine-tuning" is the part of the system that allows the user to review the displayed itinerary and make adjustments as necessary.

[1483] The "means for reserving activities included in a date plan with a reservation system" is a part of the system for automatically reserving activities based on a confirmed date plan.

[1484] "Means for recognizing user emotions using an emotion engine and adjusting analyzed data" refers to the part of the system that analyzes the user's facial expressions, voice, etc. to recognize emotions and adjusts the data generated based on those emotions.

[1485] The "means for displaying and fine-tuning a date plan in virtual reality" is the part of the system that displays the generated date plan to the user in a virtual reality environment and allows for visual fine-tuning.

[1486] The present invention is a system that automatically generates an ideal date plan using a generative AI model based on user input and emotions, and provides it to the user. This system is equipped with a means for recognizing the user's emotions in addition to the user's preferences, budget, and date purpose to optimize the plan. Specific embodiments are described below.

[1487] System Components

[1488] The system consists of the following main components:

[1489] 1. A means of receiving user input: The user inputs information such as preferences, budget, and purpose of the date via a smartphone or other device. For example, the user might input "relaxation," "foodie," "budget of 10,000 yen," or "special date."

[1490] 2. A means of parsing user input: Parse the received user input and convert it into a useful format.

[1491] 3. Emotion engine: Recognizes emotions from the user's facial expressions and voice and adjusts the data accordingly. For example, if the user's emotion is recognized as "joy," the system will enhance relaxation options.

[1492] 4. Send a request to the generative AI model: Based on the adjusted data, send a request to the generative AI model to generate a date plan. An example of a prompt is as follows:

[1493] User preferences: Relaxation, gourmet

[1494] Budget: 10,000 yen

[1495] Purpose: A special date

[1496] Emotion: Joy

[1497] 5. Means for receiving date plans from the generative AI model: Receive the generated date plans and generate a plan such as the following, for example, a plan including "Relax at a luxury spa at 13:00" and "Dinner at a popular French restaurant at 18:30."

[1498] 6. Means for displaying received date plans to the user: The generated date plans are visually presented to the user.

[1499] 7. A way for users to confirm and adjust their plans: Users can confirm their plans and make adjustments if necessary, for example, changing the dinner time from 6:30 PM to 7:00 PM.

[1500] 8. Reservation system: Automatically book activities based on confirmed date plans.

[1501] 9. Display and fine-tuning in virtual reality: The generated date plan is displayed to the user in a virtual reality environment and can be visually fine-tuned, allowing the user to check and fine-tune the plan in a way that is close to the real experience.

[1502] The implementation of this system can improve the quality of the user experience by providing a customized date plan that reflects the user's emotions and enabling visual adjustments in real time.

[1503] Hardware and Software Configuration

[1504] Hardware:

[1505] Smartphone (iOS / Android)

[1506] Camera (for facial expression recognition)

[1507] software:

[1508] Emotion recognition engine (e.g. Microsoft Azure Emotion API)

[1509] Generative AI models (e.g., OpenAI GPT models)

[1510] Reservation system (dedicated API)

[1511] Specific examples

[1512] The user launches the smartphone app and enters the following information: "Relax," "Gourmet," "Budget 10,000 yen," and "Special date." The system analyzes this and sends a request to the generative AI model. At the same time, the emotion engine recognizes the user's emotion of joy and reinforces the relaxation option. The generated date plan is "Relax at a luxury spa at 1:00 PM" and "Dinner at a popular French restaurant at 6:30 PM." The user checks this plan in virtual reality and fine-tunes the dinner time to 7:00 PM. Finally, the system automatically books these activities and notifies the user.

[1513] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1514] Step 1:

[1515] Receive user input

[1516] The user launches the smartphone application and enters their preferences, budget, date goals, etc.

[1517] Example inputs: "Relax", "Gourmet", "Budget 10,000 yen", "Special date".

[1518] Input: User preferences, budget, and dating purpose

[1519] Output: Input data (JSON format)

[1520] Step 2:

[1521] Parsing input

[1522] The device sends the input data from the user in JSON format to the server, which receives and analyzes this data.

[1523] Input: User input data (JSON format)

[1524] Output: Analysis data

[1525] Specific actions: Parse and extract preferences, budget, and date purpose.

[1526] Step 3:

[1527] Emotion recognition by emotion engine

[1528] An emotion engine is launched on the server to recognize emotions from the user's facial expressions, voice, and text input.

[1529] Input: User facial expressions, voice, text

[1530] Output: Emotion data (e.g., "joy")

[1531] Specific operation: Using an emotion recognition algorithm, emotions are estimated from facial expressions and voice.

[1532] Step 4:

[1533] Adjustment of analysis data

[1534] The server adjusts the analysis data based on the recognized emotion, for example, enhancing relaxation options to reflect the emotion of "joy."

[1535] Input: Emotion data, analysis data

[1536] Output: Adjusted analysis data

[1537] Specific operation: Attach emotion data and update existing analysis data.

[1538] Step 5:

[1539] Sending requests to generative AI models

[1540] The server sends the adjusted analysis data as a request to the generative AI model.

[1541] Input: Adjusted analytical data (e.g., "Relax," "Gourmet," etc.)

[1542] Output: Prompt sentence to the generative AI model

[1543] Specific behavior: Generates a prompt in the following format:

[1544] User preferences: Relaxation, gourmet

[1545] Budget: 10,000 yen

[1546] Purpose: A special date

[1547] Emotion: Joy

[1548] Step 6:

[1549] Creating and receiving date plans

[1550] The generative AI model generates a date plan, and the server receives the results.

[1551] Input: prompt statement

[1552] Output: Date plan (e.g. "13:00 Relax at a luxury spa")

[1553] Specific operation: A plan is created using the generative AI model and sent back to the server.

[1554] Step 7:

[1555] Display date plan

[1556] The server transmits the generated date plan to the terminal, and the terminal displays the plan contents to the user.

[1557] Input: Date plan

[1558] Output: Display data

[1559] Specific operation: The device application visually displays the date plan.

[1560] Step 8:

[1561] User verification and fine-tuning

[1562] The user can review the displayed date plan and make adjustments to the time and activities as needed.

[1563] Input: Display data, user fine-tuning

[1564] Output: Confirmed date plan

[1565] Specific actions: Adjust the plan parameters through the user interface.

[1566] Step 9:

[1567] Confirmation of reservation

[1568] The server automatically reserves the activity for the reservation system based on the confirmed date plan.

[1569] Input: Confirmed date plan

[1570] Output: Reservation data

[1571] Specific operation: Call the reservation API, make the necessary reservations, and receive the results.

[1572] Step 10:

[1573] Confirmation Notice

[1574] The server transmits the confirmed reservation data to the terminal, and the terminal notifies the user.

[1575] Input: Reservation data

[1576] Output: Notification message

[1577] Specific actions: Notify the user through the notification system.

[1578] Overall summary based on the process flow:

[1579] The system receives and analyzes user input, adjusts it with emotional data, and then uses a generative AI model to create an optimal date plan. The user can then review and fine-tune the plan in virtual reality, and finally, the plan is automatically booked through the reservation system, providing users with a special experience.

[1580] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1581] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1582] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1583] [Third embodiment]

[1584] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1585] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1586] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1587] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1588] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1589] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1590] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1591] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1592] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1593] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1594] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1595] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1596] This invention is a system that automatically generates an ideal date plan based on a user's preferences and budget. The system receives user input, analyzes it, and then requests a generative AI model to generate a date plan. The system then displays the generated date plan to the user and has the ability to make a reservation if necessary.

[1597] Overall system configuration

[1598] The system consists of the following main components:

[1599] 1. A means of receiving user input

[1600] 2. A way to analyze user input

[1601] 3. A means of sending requests to the generative AI model

[1602] 4. How to receive date plans

[1603] 5. How to display received date plans to users

[1604] 6. Means of accepting user confirmation and fine-tuning

[1605] 7. A means to reserve activities included in the date plan through the reservation system

[1606] Program processing procedure

[1607] The device receives data input by the user and sends it to the server. The server analyzes the data and sends the analysis results to the generative AI model. The generative AI model generates a date plan and sends the results back to the server. The server sends the received date plan to the device, which displays the plan contents to the user. The user confirms the plan and makes any necessary adjustments. Finally, the server notifies the reservation system of the confirmed plan and completes the necessary reservation procedures.

[1608] Program processing details

[1609] User input

[1610] The user (hereafter referred to as "Tanaka") starts up the device and operates the application to enter data into the input form. For example, enter the following information.

[1611] Preferences: Relaxation, gourmet food

[1612] Budget: 10,000 yen

[1613] Date purpose: A special date

[1614] Data transmission and analysis

[1615] The terminal sends input data to the server, which receives the data in JSON format and begins parsing it.

[1616] {

[1617] "preferences": ["Relax", "Gourmet"],

[1618] "budget": 10000,

[1619] "purpose": "special date"

[1620] }

[1621] The server converts the data into an internal format and makes requests to the generative AI model.

[1622] Generating date plans using generative AI models

[1623] A generative AI model receives the request and generates the best date plan based on the user's preferences and budget.

[1624] {

[1625] "date": "This Saturday",

[1626] "activities": [

[1627] {"time": "13:00", "activity": "Relax at a luxury spa"},

[1628] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[1629] ],

[1630] "total_cost": 9800

[1631] }

[1632] Display date plan

[1633] The server sends the generated date plan to the terminal, which displays the date plan to the user.

[1634] Date plan:

[1635] 1 PM: Relax at a luxury spa

[1636] 6:30 PM: Dinner at a popular French restaurant

[1637] Cost: 9,800 yen

[1638] User verification and fine-tuning

[1639] Tanaka checks the displayed date plan and adjusts the time and location as necessary, for example, changing the dinner time to 7 p.m.

[1640] Tanaka presses the "Confirm" button.

[1641] Confirmation of reservation

[1642] The server transmits the confirmed plan details to the reservation system and performs reservation procedures for the luxury spa and French restaurant.

[1643] {

[1644] "reservations": [

[1645] {"activity": "luxury spa", "time": "13:00"},

[1646] {"activity": "French restaurant", "time": "18:30"}

[1647] ]

[1648] }

[1649] A notification of the confirmed reservation is sent to the terminal and displayed to Tanaka.

[1650] In this way, the system of the present invention automatically generates an ideal date plan based on the user's preferences and budget, allowing the user to easily enjoy a special date experience. Furthermore, by automating the reservation procedure, the burden on the user can be reduced.

[1651] The processing flow will be explained below.

[1652] Step 1:

[1653] The user (Tanaka) starts up the device and opens the date planner app. Tanaka enters his preferences, budget, and purpose of the date into the input form. At this time, he enters the following information:

[1654] Preferences: Relaxation, gourmet food

[1655] Budget: 10,000 yen

[1656] Date purpose: A special date

[1657] Step 2:

[1658] The terminal converts the input data into JSON format and sends the data to the server. An example of the data to be sent is as follows:

[1659] {

[1660] "preferences": ["Relax", "Gourmet"],

[1661] "budget": 10000,

[1662] "purpose": "special date"

[1663] }

[1664] Step 3:

[1665] The server parses the JSON data received from the device. The parsed data is converted into an internal data structure, as shown below.

[1666] preferences = ["Relaxed", "Gourmet"]

[1667] budget = 10000

[1668] purpose = "special date"

[1669] Step 4:

[1670] The server creates data to request the AI ​​model to generate a date plan. An example of the created request data is as follows:

[1671] ai_request = {

[1672] "user_preferences": preferences,

[1673] "user_budget": budget,

[1674] "user_purpose": purpose

[1675] }

[1676] The server sends this request to the generative AI model.

[1677] Step 5:

[1678] The generative AI model receives a request from the server and generates a date plan using its internal algorithm. The generated date plan includes the following information:

[1679] {

[1680] "date": "This Saturday",

[1681] "activities": [

[1682] {"time": "13:00", "activity": "Relax at a luxury spa"},

[1683] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[1684] ],

[1685] "total_cost": 9800

[1686] }

[1687] Step 6:

[1688] The generative AI model sends the generated date plan back to the server, which receives the date plan.

[1689] Step 7:

[1690] The server sends the received date plan to the terminal. The terminal displays the date plan on the screen and presents the following to Tanaka:

[1691] Date plan:

[1692] 1 PM: Relax at a luxury spa

[1693] 6:30 PM: Dinner at a popular French restaurant

[1694] Cost: 9,800 yen

[1695] Step 8:

[1696] Tanaka checks the displayed date plan and makes any necessary adjustments. For example, he changes the dinner time to 7 p.m. Once he has completed the changes, he presses the "Confirm" button.

[1697] Step 9:

[1698] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[1699] {

[1700] "reservations": [

[1701] {"activity": "luxury spa", "time": "13:00"},

[1702] {"activity": "French restaurant", "time": "19:00"}

[1703] ]

[1704] }

[1705] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[1706] Your reservation is confirmed:

[1707] Luxury Spa: 1 PM

[1708] French Restaurant: 7 p.m.

[1709] In this way, the system of the present invention allows users to easily create, confirm, and reserve their ideal date plan.

[1710] Example 1

[1711] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1712] In today's busy lifestyles, efficiently planning and executing special date plans is difficult. It takes time and effort to independently create an ideal date plan that takes into account the user's preferences and budget, and then book activities based on that plan. Furthermore, the time and complexity of the booking process can be burdensome, making it difficult for users to easily enjoy a special date experience. To address these challenges, a system is needed that can automatically generate date plans based on user input and streamline the entire process, including the booking process.

[1713] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1714] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting confirmation and fine-tuning from the user, means for booking activities included in the date plan with a reservation system, means for creating a prompt sentence to be used in the date plan generation request, and means for formatting the date plan details. This allows users to easily receive a date plan optimized for their preferences and budget, and by automating the reservation procedure, they can efficiently realize a special date experience.

[1715] The "means for receiving user input" is an interface that allows the user to input information such as preferences, budget, and purpose of the date into the system.

[1716] "Means for analyzing user input" refers to a program or algorithm that analyzes received user input data and extracts and converts information such as preferences, budget, and purpose.

[1717] "Means for sending requests to the generative AI model based on the analyzed data" means means for sending requests in an appropriate format to the generative AI model using the analyzed data.

[1718] A "means for receiving a date plan from a generative AI model" is an interface or mechanism for accepting date plan data generated by a generative AI model.

[1719] The "means for displaying the received date plan to the user" refers to an interface and a program for visually displaying the received date plan to the user.

[1720] The "means for accepting user confirmation and fine adjustment" is a means for accepting operations by the user for confirming and modifying the displayed date plan.

[1721] The "means for reserving activities included in a date plan in a reservation system" refers to a system and program for automatically reserving various activities based on a confirmed date plan.

[1722] The "means for creating a prompt sentence to be used when requesting the generation of a date plan" is a program or algorithm for automatically creating a prompt sentence to be used when requesting the generation of a date plan from a generative AI model.

[1723] A "means for formatting date plan details" is a program or mechanism for converting date plan details received from a generative AI model into a format appropriate for display to a user.

[1724] This invention is a system that automatically generates an ideal date plan based on a user's preferences and budget. The system receives user input, analyzes it, and then requests a generative AI model to generate a date plan. The system then displays the generated date plan to the user and has the ability to make a reservation if necessary.

[1725] Overall system configuration

[1726] The system consists of the following main components:

[1727] 1. A means of receiving user input

[1728] The user enters information such as preferences, budget, and purpose of the date into an input form. For example, the input can be done using a smartphone or PC application.

[1729] 2. A way to analyze user input

[1730] The input data is analyzed, and the necessary information is extracted and converted. The analysis is performed using Python's Pandas library, etc.

[1731] 3. A means of sending requests to the generative AI model based on the analyzed data

[1732] A prompt is created based on the analyzed data and sent to a generative AI model (such as GPT-3 or GPT-4). An example of a prompt is as follows:

[1733] A user likes relaxation and gourmet food and is planning a special date. The budget is 10,000 yen, and they want to go on this Saturday. Generate the optimal date plan based on this.

[1734] 4. A way to receive date plans from a generative AI model

[1735] The date plan generated by the generative AI model is received on the server side. The received data is in JSON format.

[1736] 5. How to display received date plans to users

[1737] The received date plan is converted into an appropriate format, sent to the device, and displayed to the user. Web frameworks such as React and Angular are used for display.

[1738] 6. Means of accepting user confirmation and fine-tuning

[1739] It provides an interface for users to review their date plans and make adjustments to the time and location as needed, for example, changing the time or adding or removing activities.

[1740] 7. A means to reserve activities included in the date plan through the reservation system

[1741] The confirmed date plan details are sent to the reservation system, and each activity is automatically booked. Reservation management uses server-side frameworks such as Node.js and Django.

[1742] In this way, the system of the present invention automatically generates an ideal date plan based on the user's preferences and budget, allowing the user to easily enjoy a special date experience. Also, by automating the reservation process, the burden on the user can be reduced.

[1743] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1744] Step 1:

[1745] The user starts up the device, operates the application, and enters information such as preferences, budget, and purpose of the date into the input form.

[1746] Input: Information about your preferences, budget, and dating goals

[1747] Output: Data entered in the input form

[1748] Specific operation: The user opens the app on their smartphone or PC, enters the information as shown below, and taps the "Send" button.

[1749] Preferences: Relaxation, gourmet food

[1750] Budget: 10,000 yen

[1751] Date purpose: A special date

[1752] Step 2:

[1753] The terminal sends the input data to the server.

[1754] Input: Data entered into an input form

[1755] Output: JSON format data sent to the server

[1756] Specific operation: Tanaka's smartphone sends the input data to the server in real time. The data will be in the following format.

[1757] json

[1758] {

[1759] "preferences": ["Relax", "Gourmet"],

[1760] "budget": 10000,

[1761] "purpose": "special date"

[1762] }

[1763] Step 3:

[1764] The server parses the received data.

[1765] Input: JSON format data

[1766] Output: Parsed internal data format

[1767] Specific operation: The server parses the received JSON data and extracts information such as "preferences," "budget," and "purpose of the date." For example, it can be parsed using the Python Pandas library as follows:

[1768] python

[1769] data = {

[1770] "preferences": ["Relax", "Gourmet"],

[1771] "budget": 10000,

[1772] "purpose": "special date"

[1773] }

[1774] preferences = data["preferences"]

[1775] budget = data["budget"]

[1776] purpose = data["purpose"]

[1777] Step 4:

[1778] The server sends a request to the generative AI model based on the analysis results.

[1779] Input: Parsed internal data format

[1780] Output: The prompt sent to the generative AI model

[1781] Specific operation: The server creates a prompt for the generative AI model and sends it to the model in the following text format:

[1782] A user likes relaxation and gourmet food and is planning a special date. The budget is 10,000 yen, and they want to go on this Saturday. Generate the optimal date plan based on this.

[1783] Step 5:

[1784] A generative AI model receives the request and generates a date plan.

[1785] Input: Prompt text sent from the server

[1786] Output: Generated date plan (JSON format)

[1787] What it does: The generative AI model processes the request and generates the following details of the date plan:

[1788] json

[1789] {

[1790] "date": "This Saturday",

[1791] "activities": [

[1792] {"time": "13:00", "activity": "Relax at a luxury spa"},

[1793] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[1794] ],

[1795] "total_cost": 9800

[1796] }

[1797] Step 6:

[1798] The server receives the generated date plan.

[1799] Input: Date plan from the generative AI model (JSON format)

[1800] Output: Date plan saved in server storage

[1801] Specific operation: The server stores the date plan received from the generative AI model in an internal database and converts the format as necessary.

[1802] Step 7:

[1803] The server sends the date plan to the terminal, which displays it to the user.

[1804] Input: Date plan saved on the server

[1805] Output: Date plan displayed on user's device

[1806] Specific operation: The app displays the details of the date plan on Tanaka's smartphone. The displayed content is as follows:

[1807] Date plan:

[1808] 1 PM: Relax at a luxury spa

[1809] 6:30 PM: Dinner at a popular French restaurant

[1810] Cost: 9,800 yen

[1811] Step 8:

[1812] The user checks the plan and adjusts the time and location as needed.

[1813] Input: Date plan displayed to user

[1814] Output: Adjusted date plan

[1815] Specific operation: The user checks the date plan and changes the dinner time to, for example, 7 PM. Once the changes are complete, the user presses the "Confirm" button.

[1816] Step 9:

[1817] The server transmits the confirmed plan details to the reservation system and makes reservations for each activity.

[1818] Input: Adjusted date plan

[1819] Output: Request and booking confirmation sent to the reservation system

[1820] Specific operation: The server sends the following request to the reservation system to confirm the reservation of each activity.

[1821] json

[1822] {

[1823] "reservations": [

[1824] {"activity": "luxury spa", "time": "13:00"},

[1825] {"activity": "French restaurant", "time": "19:00"}

[1826] ]

[1827] }

[1828] Once the reservation is complete, the server sends a confirmation notice to the user's terminal and displays it to the user.

[1829] (Application example 1)

[1830] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1831] Current food delivery services lack a system that can automatically suggest optimal meal plans that fit multiple users' preferences, budgets, and specific delivery times. This requires users to search for restaurants and decide what to order themselves, which is time-consuming. Furthermore, when ordering multiple dishes from different locations at different times, the ordering process for each dish becomes complicated. Furthermore, it is difficult to suggest meal plans that fit specific delivery times, making it difficult to improve the user experience.

[1832] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1833] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a meal plan from the generative AI model, means for displaying the received meal plan to the user, means for accepting user confirmation and fine-tuning, and means for ordering and delivering meals. This allows users to easily receive a meal plan that is optimal for their preferences, budget, and specific delivery time, eliminating the complexity of ordering and delivery procedures.

[1834] The "means for receiving user input" is an interface for obtaining information such as preferences, budget, and delivery time from the user.

[1835] The "means for analyzing user input" is a processing function for analyzing received user input data and converting it into an appropriate format.

[1836] "Means for sending a request to the generative AI model based on the analyzed data" refers to a communication means for passing the analyzed data to the generative AI model and requesting the generation of an optimal meal plan.

[1837] "Means for receiving a meal plan from a generative AI model" refers to a receiving function for receiving a meal plan created by a generative AI model.

[1838] The "means for displaying the received meal plan to the user" is an interface for displaying the generated meal plan to the user in a format that is easy to understand.

[1839] The "means for accepting user confirmation and fine-tuning" is an interface that allows the user to review the generated plan and adjust it as necessary.

[1840] "Means for ordering and delivering meals" refers to a system for placing orders with restaurants based on a confirmed meal plan and delivering meals at the specified delivery time.

[1841] "Preferences" refers to information such as the type of food or style of restaurant the user prefers.

[1842] A "budget" is a range of amounts that a user specifies for spending on food.

[1843] "Delivery time" is information indicating the date and time when the user would like to receive the meal.

[1844] A "meal plan" is a plan that includes recommended meal menus and ordering details, generated based on user input.

[1845] This invention is a system that automatically generates an ideal meal plan based on a user's preferences and budget, and then handles ordering and delivery. The system uses a smartphone as the user interface, processes data on a cloud server, and generates meal plans using a generative AI model. It also uses a delivery API to automate meal ordering and delivery.

[1846] Hardware and software used

[1847] 1. Smartphone: This is the device where the user provides input data and checks the meal plan.

[1848] 2. Cloud server: Uses Amazon Web Services (AWS) Lambda and other services to perform scalable data processing and backend operations.

[1849] 3. Generative AI model: Using OpenAI GPT-4 and other models, it generates optimal meal plans based on user input data.

[1850] 4. Delivery API: Use APIs such as UberEats to automatically order and deliver meals.

[1851] System Operation Overview

[1852] 1. Receiving user input:

[1853] The user operates their smartphone and enters their preferences, budget, and delivery time into the application's input form. For example, the following input data is obtained:

[1854] Preferences: Italian

[1855] Budget: 5,000 yen

[1856] Delivery time: 19:00

[1857] 2. Data transmission and analysis:

[1858] The smartphone sends this input data to the cloud server, which receives and analyzes it. The analysis results will be in the following format:

[1859] {

[1860] "preferences": ["Italian"],

[1861] "budget": 5000,

[1862] "delivery_time": "19:00"

[1863] }

[1864] 3. Request to the generative AI model:

[1865] The cloud server sends a request to the generative AI model based on the analyzed data. An example of a prompt for the generative AI model is as follows:

[1866] Generate the perfect meal plan based on your preferences and budget. Use the following information to help you:

[1867] Preferences: Italian

[1868] Budget: 5,000 yen

[1869] Delivery time: 19:00

[1870] 4. Receive and view the generated meal plan:

[1871] The plan created by the generative AI model is sent to a smartphone via a cloud server, and the plan is displayed to the user as shown below.

[1872] Your food delivery plan:

[1873] - 18:50: Pizza Margherita

[1874] - 18:55: Carbonara

[1875] Cost: 4,800 yen

[1876] 5. User verification and fine-tuning:

[1877] Users can check the plan on their smartphone and make changes to the time and menu as needed. Once changes are complete, users press the "Confirm" button to finalize the plan.

[1878] 6. Ordering and Delivery Arrangements:

[1879] The cloud server sends an order request to the delivery API based on the confirmed plan. Orders are placed with each restaurant at the appropriate time, and the meals are delivered at the specified delivery time.

[1880] This system allows users to easily receive the optimal meal plan tailored to their preferences, budget, and specific delivery time, significantly reducing the hassle of ordering and delivery.

[1881] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1882] Step 1:

[1883] The user operates their smartphone and enters data into the application's input form. Specifically, the user enters "preferences," "budget," and "delivery time." This results in the following data being obtained as user input:

[1884] Input data:

[1885] Preferences: Italian

[1886] Budget: 5,000 yen

[1887] Delivery time: 19:00

[1888] Step 2:

[1889] The device sends this input data to the cloud server, which receives the data in JSON format and performs the following analysis:

[1890] input:

[1891] {

[1892] "preferences": ["Italian"],

[1893] "budget": 5000,

[1894] "delivery_time": "19:00"

[1895] }

[1896] The server parses this data and converts it into an internal format.

[1897] Step 3:

[1898] Based on the data analyzed by the server, a request is sent to the generative AI model. Specifically, the following prompt is generated:

[1899] Prompt statement:

[1900] Generate the perfect meal plan based on your preferences and budget. Use the following information to help you:

[1901] Preferences: Italian

[1902] Budget: 5,000 yen

[1903] Delivery time: 19:00

[1904] This allows the generative AI model to generate an optimal meal plan based on user input.

[1905] Step 4:

[1906] The generative AI model generates a meal plan and sends the results back to the server. The generated plan looks like this:

[1907] Generated plan:

[1908] {

[1909] "food_plan": [

[1910] {"time": "18:50", "food": "Pizza Margherita"},

[1911] {"time": "18:55", "food": "Carbonara"}

[1912] ],

[1913] "total_cost": 4800

[1914] }

[1915] Step 5:

[1916] The server receives the meal plan from the AI ​​model and sends it to the device (smartphone), which analyzes the data and displays the plan on the screen.

[1917] Display contents:

[1918] Your food delivery plan:

[1919] 18:50: Pizza Margherita

[1920] 18:55: Carbonara

[1921] Cost: 4,800 yen

[1922] Step 6:

[1923] The user can check the meal plan on the device and make any necessary adjustments, such as changing the delivery time. After making the adjustments, the user presses the "Confirm" button.

[1924] Step 7:

[1925] The server sends the confirmed meal plan to the delivery API and processes the order and delivery. Specifically, the following order request is sent.

[1926] Order Request:

[1927] {

[1928] "orders": [

[1929] {"restaurant": "Italian Restaurant A", "food": "Pizza Margherita", "time": "18:50"},

[1930] {"restaurant": "Italian Restaurant B", "food": "Carbonara", "time": "18:55"}

[1931] ]

[1932] }

[1933] Step 8:

[1934] When the delivery API successfully accepts the order, the server sends the result to the terminal and displays a notification of order confirmation to the user, allowing the user to confirm that the meal will be delivered at the specified time.

[1935] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1936] This invention is a system that automatically generates ideal date plans using a generative AI model based on user input and emotions, and provides them to users. This system has a means to recognize the user's emotions in addition to their preferences, budget, and date purpose to optimize the plans.

[1937] Overall system configuration

[1938] The system consists of the following main components:

[1939] 1. A means of receiving user input

[1940] 2. A way to analyze user input

[1941] 3. A means to recognize user emotions and adjust analytical data using an emotion engine

[1942] 4. A means of sending requests to the generative AI model

[1943] 5. How to receive date plans

[1944] 6. How to display received date plans to users

[1945] 7. Means of accepting user confirmation and fine-tuning

[1946] 8. A means to reserve activities included in the date plan through the reservation system

[1947] Program processing procedure

[1948] The device receives data input by the user and sends it to the server. Before analyzing the data, the server recognizes the user's emotions through an emotion engine. It adjusts the analyzed data based on the recognized emotions. It then sends a request to the generative AI model based on the adjusted data. The generative AI model generates a date plan and sends the result back to the server. The server sends the received date plan to the device, which displays the plan contents to the user. The user confirms the plan and makes any necessary adjustments. Finally, the server notifies the reservation system of the confirmed plan and completes the necessary reservation procedures.

[1949] Program processing details

[1950] User input

[1951] The user (hereafter referred to as "Tanaka") starts up the terminal and enters the following information into the input form via the application.

[1952] Preferences: Relaxation, gourmet food

[1953] Budget: 10,000 yen

[1954] Date purpose: A special date

[1955] Data transmission and analysis

[1956] The terminal sends input data in JSON format to the server, which receives the data and parses the JSON data.

[1957] {

[1958] "preferences": ["Relax", "Gourmet"],

[1959] "budget": 10000,

[1960] "purpose": "special date"

[1961] }

[1962] Emotion recognition by emotion engine

[1963] The server activates an emotion engine to recognize emotions from Tanaka's facial expressions, voice tone, and text input.

[1964] Emotion: Joy (85% probability)

[1965] Adjustment of analysis data

[1966] The server adjusts the analysis data based on the recognized emotion. For example, if Tanaka's emotion is "joy," it will enhance relaxation options.

[1967] Requests to generative AI models

[1968] The server sends a request to the generative AI model based on the adjusted data.

[1969] ai_request = {

[1970] "user_preferences": ["Relax", "Gourmet"],

[1971] "user_budget": 10000,

[1972] "user_purpose": "special date",

[1973] "user_emotion": "joy"

[1974] }

[1975] Generating date plans using generative AI models

[1976] The generative AI model generates a date plan, which looks like this:

[1977] {

[1978] "date": "This Saturday",

[1979] "activities": [

[1980] {"time": "13:00", "activity": "Relax at a luxury spa"},

[1981] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[1982] ],

[1983] "total_cost": 9800

[1984] }

[1985] Display date plan

[1986] The server sends the generated date plan to the device, which displays the plan to the user and presents the following to Tanaka:

[1987] Date plan:

[1988] 1 PM: Relax at a luxury spa

[1989] 6:30 PM: Dinner at a popular French restaurant

[1990] Cost: 9,800 yen

[1991] User verification and fine-tuning

[1992] Tanaka checks the displayed date plan and, for example, changes the dinner time to 7 p.m. Once the changes are complete, Tanaka presses the "Confirm" button.

[1993] Confirmation of reservation

[1994] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[1995] {

[1996] "reservations": [

[1997] {"activity": "luxury spa", "time": "13:00"},

[1998] {"activity": "French restaurant", "time": "19:00"}

[1999] ]

[2000] }

[2001] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[2002] Your reservation is confirmed:

[2003] Luxury Spa: 1 PM

[2004] French Restaurant: 7 p.m.

[2005] In this way, by combining the emotion engine, the system can better understand the user's emotional state and provide date plans tailored to individual needs, making the user's dating experience even richer and more special.

[2006] The processing flow will be explained below.

[2007] Step 1:

[2008] The user (Tanaka) starts up the device and opens the date planner app. Tanaka enters his preferences, budget, and purpose of the date into the input form. At this time, he enters the following information:

[2009] Preferences: Relaxation, gourmet food

[2010] Budget: 10,000 yen

[2011] Date purpose: A special date

[2012] Step 2:

[2013] The terminal converts the input data into JSON format and sends the data to the server. An example of the data to be sent is as follows:

[2014] {

[2015] "preferences": ["Relax", "Gourmet"],

[2016] "budget": 10000,

[2017] "purpose": "special date"

[2018] }

[2019] Step 3:

[2020] The server parses the JSON data received from the device. The parsed data is converted into an internal data structure, as shown below.

[2021] preferences = ["Relaxed", "Gourmet"]

[2022] budget = 10000

[2023] purpose = "special date"

[2024] Step 4:

[2025] The server activates the emotion engine and collects data to recognize emotions from Tanaka's facial expressions, voice tone, and text input. For example, facial expressions and voice are captured through the smartphone's camera and microphone.

[2026] Step 5:

[2027] The emotion engine analyzes the collected data and estimates Tanaka's emotional state. For example, it estimates "joy" from facial expression analysis and voice tone.

[2028] Emotion: Joy (85% probability)

[2029] Step 6:

[2030] The server adjusts the analysis data based on the recognized emotion. For example, if Tanaka's emotion is "joy," it will enhance relaxation options.

[2031] adjusted_preferences = ["Relaxed", "Gourmet"]

[2032] Step 7:

[2033] The server sends a request to the generative AI model based on the adjusted data. An example of the request data to be sent is as follows:

[2034] ai_request = {

[2035] "user_preferences": adjusted_preferences,

[2036] "user_budget": 10000,

[2037] "user_purpose": "special date",

[2038] "user_emotion": "joy"

[2039] }

[2040] Step 8:

[2041] The generative AI model receives a request from the server and generates a date plan using its internal algorithm. The generated date plan includes the following information:

[2042] {

[2043] "date": "This Saturday",

[2044] "activities": [

[2045] {"time": "13:00", "activity": "Relax at a luxury spa"},

[2046] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[2047] ],

[2048] "total_cost": 9800

[2049] }

[2050] Step 9:

[2051] The generative AI model sends the generated date plan back to the server, which receives the date plan.

[2052] Step 10:

[2053] The server sends the received date plan to the terminal. The terminal displays the date plan on the screen and presents the following to Tanaka:

[2054] Date plan:

[2055] 1 PM: Relax at a luxury spa

[2056] 6:30 PM: Dinner at a popular French restaurant

[2057] Cost: 9,800 yen

[2058] Step 11:

[2059] Tanaka checks the displayed date plan and makes any necessary adjustments. For example, he changes the dinner time to 7 p.m. Once he has completed the changes, he presses the "Confirm" button.

[2060] Step 12:

[2061] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[2062] {

[2063] "reservations": [

[2064] {"activity": "luxury spa", "time": "13:00"},

[2065] {"activity": "French restaurant", "time": "19:00"}

[2066] ]

[2067] }

[2068] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[2069] Your reservation is confirmed:

[2070] Luxury Spa: 1 PM

[2071] French Restaurant: 7 p.m.

[2072] In this way, the system of the present invention allows users to easily create, confirm, and book their ideal date plan, and by taking emotions into consideration, it can provide a more personalized experience.

[2073] Example 2

[2074] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2075] Conventional date plan generation systems generate plans based solely on user input data, making it impossible to take into account the user's emotions or momentary moods. This makes it difficult to provide a truly optimal plan for the user, resulting in low user satisfaction. Additionally, the process from the user confirming the plan details to finalizing the reservation is complicated, requiring a lot of time and effort.

[2076] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2077] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for recognizing the user's emotions using an emotion engine and adjusting the analysis data, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting user confirmation and fine-tuning, and means for booking activities included in the date plan with a reservation system. This makes it possible to provide a more optimal date plan that takes the user's emotions into consideration and significantly reduce the effort and time required for booking.

[2078] "User" refers to a person who uses this system to generate date plans.

[2079] "Means for receiving input" refers to an interface or device for obtaining data from a user.

[2080] "Means for analyzing" refers to software or algorithms used to structure and understand captured user input data.

[2081] A "generative AI model" refers to an artificial intelligence model that is trained to solve a specific task or problem.

[2082] "Date Plan" refers to a combination of activities and schedules suggested based on the user's requests and preferences.

[2083] "Means for displaying" refers to a screen or device for visually presenting the generated date plan to the user.

[2084] "Means for accepting confirmation and fine-tuning" refers to an interface that allows the user to make changes or confirmations to the proposed date plan.

[2085] "Reservation system" refers to a system for making reservations and confirming each activity included in a date plan.

[2086] An "emotion engine" refers to software or algorithms that analyze users' emotions and reflect them in plan generation.

[2087] "Means for adjusting analysis data" refers to a function for optimizing the analysis results and the content of the data generated based on the recognized emotions.

[2088] This invention is a system that automatically generates ideal date plans using a generative AI model based on user input and emotions, and provides them to users. This system has a means to recognize the user's emotions in addition to their preferences, budget, and date purpose to optimize the plans.

[2089] Overall system configuration

[2090] The system consists of the following main components:

[2091] 1. A means of receiving user input

[2092] 2. A way to analyze user input

[2093] 3. A means to recognize user emotions and adjust analytical data using an emotion engine

[2094] 4. A means of sending requests to the generative AI model

[2095] 5. How to receive date plans

[2096] 6. How to display received date plans to users

[2097] 7. Means of accepting user confirmation and fine-tuning

[2098] 8. A means to reserve activities included in the date plan through the reservation system

[2099] System Operation

[2100] User input

[2101] The user starts the device and enters the following information through the application:

[2102] Preferences: Relaxation, gourmet food

[2103] Budget: 10,000 yen

[2104] Date purpose: A special date

[2105] Sending input data

[2106] The device sends the user's input data in JSON format to the server.

[2107] json

[2108] {

[2109] "preferences": ["Relax", "Gourmet"],

[2110] "budget": 10000,

[2111] "purpose": "special date"

[2112] }

[2113] Data analysis and emotion recognition

[2114] The server analyzes the input data and activates the emotion engine.

[2115] The emotion engine recognizes emotions from the user's facial expressions, voice tone, and text input.

[2116] Emotion: Joy (85% probability)

[2117] Adjustment of analysis data

[2118] The server adjusts the analysis data based on the recognized emotion.

[2119] Sending requests to generative AI models

[2120] The server sends a request to the generative AI model based on the adjusted data.

[2121] json

[2122] {

[2123] "user_preferences": ["Relax", "Gourmet"],

[2124] "user_budget": 10000,

[2125] "user_purpose": "special date",

[2126] "user_emotion": "joy"

[2127] }

[2128] Receive the generated date plan

[2129] The generative AI model generates a date plan and sends it back to the server.

[2130] Date: This Saturday

[2131] activity:

[2132] 13:00: Relax at a luxury spa

[2133] 18:30: Dinner at a popular French restaurant

[2134] Total cost: 9,800 yen

[2135] Display date plan

[2136] The server transmits the generated date plan to the terminal, and the terminal displays the date plan to the user.

[2137] User verification and fine-tuning

[2138] The user reviews the displayed date plan and makes adjustments as necessary.

[2139] The user takes action to confirm the plan.

[2140] Confirmation of reservation

[2141] The server transmits the finalized date plan to the reservation system and makes reservations for each activity.

[2142] json

[2143] {

[2144] "reservations": [

[2145] {"activity": "luxury spa", "time": "13:00"},

[2146] {"activity": "French restaurant", "time": "19:00"}

[2147] ]

[2148] }

[2149] Sending confirmation of reservation

[2150] A confirmation of the reservation is sent to the device, which displays the following message to the user:

[2151] Your reservation is confirmed:

[2152] Luxury Spa: 1 PM

[2153] French Restaurant: 7 p.m.

[2154] Hardware and software used

[2155] Device: A device that receives user input and displays date plans, such as a smartphone, tablet, or PC.

[2156] Server: A central processing unit for data analysis, emotion recognition, communication with generative AI models, and reservation management.

[2157] Emotion Engine: Software for analyzing user emotions, combining speech recognition, image analysis, and text analysis technologies.

[2158] Generative AI model: An artificial intelligence model trained to automatically generate date plans.

[2159] By implementing the present invention, users can easily create optimal date plans tailored to their individual emotions and even make reservations, making their dating experience even more special and enriching.

[2160] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2161] Program processing flow

[2162] Step 1:

[2163] The user launches the application on their device and enters their preferences, budget, and date goals.

[2164] Example input:

[2165] Preferences: Relaxation, gourmet food

[2166] Budget: 10,000 yen

[2167] Date purpose: A special date

[2168] Input data is collected and converted to JSON format on the device.

[2169] Step 2:

[2170] The terminal sends the input data to the server in JSON format.

[2171] Input: User preferences, budget, and dating goals

[2172] Output: JSON format data

[2173] json

[2174] {

[2175] "preferences": ["Relax", "Gourmet"],

[2176] "budget": 10000,

[2177] "purpose": "special date"

[2178] }

[2179] Step 3:

[2180] The server receives the JSON data and parses the user input.

[2181] Input: JSON format data

[2182] Output: Analyzed user preferences, budget, and dating goals

[2183] Step 4:

[2184] The server activates the emotion engine to analyze the user's emotions, specifically recognizing emotions from facial expressions, voice tone, and text input data.

[2185] Input: User's facial expression data, voice data, text data

[2186] Output: User sentiment

[2187] Emotion: Joy (85% probability)

[2188] Step 5:

[2189] The server adjusts the analysis data based on the recognized emotion.

[2190] Input: User sentiment, preferences, budget, and dating goals

[2191] Output: Adjusted analysis data

[2192] Example of adjustment:

[2193] Adjusted data:

[2194] Preferences: Relaxation (strengthening), gourmet food

[2195] Budget: 10,000 yen

[2196] Date purpose: A special date

[2197] Step 6:

[2198] The server sends the adjusted data as a request to the generative AI model.

[2199] Input: Adjusted analysis data

[2200] Output: A request to the generative AI model

[2201] json

[2202] {

[2203] "user_preferences": ["Relax", "Gourmet"],

[2204] "user_budget": 10000,

[2205] "user_purpose": "special date",

[2206] "user_emotion": "joy"

[2207] }

[2208] Step 7:

[2209] The generative AI model generates a date plan and sends the results back to the server.

[2210] Input: A request to the generative AI model

[2211] Output: Generated date plan

[2212] json

[2213] {

[2214] "date": "This Saturday",

[2215] "activities": [

[2216] {"time": "13:00", "activity": "Relax at a luxury spa"},

[2217] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[2218] ],

[2219] "total_cost": 9800

[2220] }

[2221] Step 8:

[2222] The server transmits the date plan to the terminal, and the terminal displays the date plan to the user.

[2223] Input: Generated date plan

[2224] Output: Date plan displayed to the user

[2225] Date plan:

[2226] 1 PM: Relax at a luxury spa

[2227] 6:30 PM: Dinner at a popular French restaurant

[2228] Cost: 9,800 yen

[2229] Step 9:

[2230] The user can review the displayed date plan and make any necessary adjustments, such as changing the dinner time to 7 p.m.

[2231] Input: User's fine-tuning request

[2232] Output: A tweaked date plan

[2233] Dinner time changed to 7pm

[2234] Step 10:

[2235] The user confirms the plan, and the server sends the final confirmed date plan to the reservation system, which makes reservations for each activity.

[2236] Input: Confirmed date plans

[2237] Output: Request to the reservation system

[2238] json

[2239] {

[2240] "reservations": [

[2241] {"activity": "luxury spa", "time": "13:00"},

[2242] {"activity": "French restaurant", "time": "19:00"}

[2243] ]

[2244] }

[2245] Step 11:

[2246] A confirmation of the reservation is sent from the server to the terminal, and the terminal displays the reservation details to the user.

[2247] Input: Reservation system response

[2248] Output: A confirmation message displayed to the user

[2249] Your reservation is confirmed:

[2250] Luxury Spa: 1 PM

[2251] French Restaurant: 7 p.m.

[2252] (Application example 2)

[2253] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2254] This invention relates to a system that automatically generates and provides ideal date plans that will satisfy users based on their emotions, as well as their preferences, budget, and date goals. Conventional systems have had difficulty generating plans that reflect the user's emotions, and also lacked the ability to present and adjust plans using virtual reality. As a result, it has been difficult to provide a date experience that meets users' expectations.

[2255] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2256] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting user confirmation and fine-tuning, means for booking activities included in the date plan with a reservation system, means for recognizing user emotions using an emotion engine and adjusting the analyzed data, and means for displaying and fine-tuning the date plan in virtual reality. This makes it possible to provide a customized date plan that reflects the user's emotions and enable visual adjustments in real time, thereby improving the quality of the user experience.

[2257] "Means for receiving user input" refers to the part of the system through which a user inputs information such as preferences, budget, and date purpose via a smartphone or other device.

[2258] The "means for parsing user input" is the part of the system that analyzes received user input and converts it into a useful form of data.

[2259] The "means for sending a request to the generative AI model" refers to the part of the system that sends a request to the AI ​​model based on the analyzed data and generates a date plan.

[2260] The "means for receiving a date plan from a generative AI model" is the part of the system for receiving a date plan generated from the AI ​​model.

[2261] The "means for displaying the received date plan to the user" is the part of the system that visually presents the generated date plan to the user.

[2262] The "means for accepting user confirmation and fine-tuning" is the part of the system that allows the user to review the displayed itinerary and make adjustments as necessary.

[2263] The "means for reserving activities included in a date plan with a reservation system" is a part of the system for automatically reserving activities based on a confirmed date plan.

[2264] "Means for recognizing user emotions using an emotion engine and adjusting analyzed data" refers to the part of the system that analyzes the user's facial expressions, voice, etc. to recognize emotions and adjusts the data generated based on those emotions.

[2265] The "means for displaying and fine-tuning a date plan in virtual reality" is the part of the system that displays the generated date plan to the user in a virtual reality environment and allows for visual fine-tuning.

[2266] The present invention is a system that automatically generates an ideal date plan using a generative AI model based on user input and emotions, and provides it to the user. This system is equipped with a means for recognizing the user's emotions in addition to the user's preferences, budget, and date purpose to optimize the plan. Specific embodiments are described below.

[2267] System Components

[2268] The system consists of the following main components:

[2269] 1. A means of receiving user input: The user inputs information such as preferences, budget, and purpose of the date via a smartphone or other device. For example, the user might input "relaxation," "foodie," "budget of 10,000 yen," or "special date."

[2270] 2. A means of parsing user input: Parse the received user input and convert it into a useful format.

[2271] 3. Emotion engine: Recognizes emotions from the user's facial expressions and voice and adjusts the data accordingly. For example, if the user's emotion is recognized as "joy," the system will enhance relaxation options.

[2272] 4. Send a request to the generative AI model: Based on the adjusted data, send a request to the generative AI model to generate a date plan. An example of a prompt is as follows:

[2273] User preferences: Relaxation, gourmet

[2274] Budget: 10,000 yen

[2275] Purpose: A special date

[2276] Emotion: Joy

[2277] 5. Means for receiving date plans from the generative AI model: Receive the generated date plans and generate a plan such as the following, for example, a plan including "Relax at a luxury spa at 13:00" and "Dinner at a popular French restaurant at 18:30."

[2278] 6. Means for displaying received date plans to the user: The generated date plans are visually presented to the user.

[2279] 7. A way for users to confirm and adjust their plans: Users can confirm their plans and make adjustments if necessary, for example, changing the dinner time from 6:30 PM to 7:00 PM.

[2280] 8. Reservation system: Automatically book activities based on confirmed date plans.

[2281] 9. Display and fine-tuning in virtual reality: The generated date plan is displayed to the user in a virtual reality environment and can be visually fine-tuned, allowing the user to check and fine-tune the plan in a way that is close to the real experience.

[2282] The implementation of this system can improve the quality of the user experience by providing a customized date plan that reflects the user's emotions and enabling visual adjustments in real time.

[2283] Hardware and Software Configuration

[2284] Hardware:

[2285] Smartphone (iOS / Android)

[2286] Camera (for facial expression recognition)

[2287] software:

[2288] Emotion recognition engine (e.g. Microsoft Azure Emotion API)

[2289] Generative AI models (e.g., OpenAI GPT models)

[2290] Reservation system (dedicated API)

[2291] Specific examples

[2292] The user launches the smartphone app and enters the following information: "Relax," "Gourmet," "Budget 10,000 yen," and "Special date." The system analyzes this and sends a request to the generative AI model. At the same time, the emotion engine recognizes the user's emotion of joy and reinforces the relaxation option. The generated date plan is "Relax at a luxury spa at 1:00 PM" and "Dinner at a popular French restaurant at 6:30 PM." The user checks this plan in virtual reality and fine-tunes the dinner time to 7:00 PM. Finally, the system automatically books these activities and notifies the user.

[2293] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2294] Step 1:

[2295] Receive user input

[2296] The user launches the smartphone application and enters their preferences, budget, date goals, etc.

[2297] Example inputs: "Relax", "Gourmet", "Budget 10,000 yen", "Special date".

[2298] Input: User preferences, budget, and dating purpose

[2299] Output: Input data (JSON format)

[2300] Step 2:

[2301] Parsing input

[2302] The device sends the input data from the user in JSON format to the server, which receives and analyzes this data.

[2303] Input: User input data (JSON format)

[2304] Output: Analysis data

[2305] Specific actions: Parse and extract preferences, budget, and date purpose.

[2306] Step 3:

[2307] Emotion recognition by emotion engine

[2308] An emotion engine is launched on the server to recognize emotions from the user's facial expressions, voice, and text input.

[2309] Input: User facial expressions, voice, text

[2310] Output: Emotion data (e.g., "joy")

[2311] Specific operation: Using an emotion recognition algorithm, emotions are estimated from facial expressions and voice.

[2312] Step 4:

[2313] Adjustment of analysis data

[2314] The server adjusts the analysis data based on the recognized emotion, for example, enhancing relaxation options to reflect the emotion of "joy."

[2315] Input: Emotion data, analysis data

[2316] Output: Adjusted analysis data

[2317] Specific operation: Attach emotion data and update existing analysis data.

[2318] Step 5:

[2319] Sending requests to generative AI models

[2320] The server sends the adjusted analysis data as a request to the generative AI model.

[2321] Input: Adjusted analytical data (e.g., "Relax," "Gourmet," etc.)

[2322] Output: Prompt sentence to the generative AI model

[2323] Specific behavior: Generates a prompt in the following format:

[2324] User preferences: Relaxation, gourmet

[2325] Budget: 10,000 yen

[2326] Purpose: A special date

[2327] Emotion: Joy

[2328] Step 6:

[2329] Creating and receiving date plans

[2330] The generative AI model generates a date plan, and the server receives the results.

[2331] Input: prompt statement

[2332] Output: Date plan (e.g. "13:00 Relax at a luxury spa")

[2333] Specific operation: A plan is created using the generative AI model and sent back to the server.

[2334] Step 7:

[2335] Display date plan

[2336] The server transmits the generated date plan to the terminal, and the terminal displays the plan contents to the user.

[2337] Input: Date plan

[2338] Output: Display data

[2339] Specific operation: The device application visually displays the date plan.

[2340] Step 8:

[2341] User verification and fine-tuning

[2342] The user can review the displayed date plan and make adjustments to the time and activities as needed.

[2343] Input: Display data, user fine-tuning

[2344] Output: Confirmed date plan

[2345] Specific actions: Adjust the plan parameters through the user interface.

[2346] Step 9:

[2347] Confirmation of reservation

[2348] The server automatically reserves the activity for the reservation system based on the confirmed date plan.

[2349] Input: Confirmed date plan

[2350] Output: Reservation data

[2351] Specific operation: Call the reservation API, make the necessary reservations, and receive the results.

[2352] Step 10:

[2353] Confirmation Notice

[2354] The server transmits the confirmed reservation data to the terminal, and the terminal notifies the user.

[2355] Input: Reservation data

[2356] Output: Notification message

[2357] Specific actions: Notify the user through the notification system.

[2358] Overall summary based on the process flow:

[2359] The system receives and analyzes user input, adjusts it with emotional data, and then uses a generative AI model to create an optimal date plan. The user can then review and fine-tune the plan in virtual reality, and finally, the plan is automatically booked through the reservation system, providing users with a special experience.

[2360] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2361] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2362] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2363] [Fourth embodiment]

[2364] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2365] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2366] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2367] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2368] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2369] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2370] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2371] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2372] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2373] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2374] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2375] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2376] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2377] This invention is a system that automatically generates an ideal date plan based on a user's preferences and budget. The system receives user input, analyzes it, and then requests a generative AI model to generate a date plan. The system then displays the generated date plan to the user and has the ability to make a reservation if necessary.

[2378] Overall system configuration

[2379] The system consists of the following main components:

[2380] 1. A means of receiving user input

[2381] 2. A way to analyze user input

[2382] 3. A means of sending requests to the generative AI model

[2383] 4. How to receive date plans

[2384] 5. How to display received date plans to users

[2385] 6. Means of accepting user confirmation and fine-tuning

[2386] 7. A means to reserve activities included in the date plan through the reservation system

[2387] Program processing procedure

[2388] The device receives data input by the user and sends it to the server. The server analyzes the data and sends the analysis results to the generative AI model. The generative AI model generates a date plan and sends the results back to the server. The server sends the received date plan to the device, which displays the plan contents to the user. The user confirms the plan and makes any necessary adjustments. Finally, the server notifies the reservation system of the confirmed plan and completes the necessary reservation procedures.

[2389] Program processing details

[2390] User input

[2391] The user (hereafter referred to as "Tanaka") starts up the device and operates the application to enter data into the input form. For example, enter the following information.

[2392] Preferences: Relaxation, gourmet food

[2393] Budget: 10,000 yen

[2394] Date purpose: A special date

[2395] Data transmission and analysis

[2396] The terminal sends input data to the server, which receives the data in JSON format and begins parsing it.

[2397] {

[2398] "preferences": ["Relax", "Gourmet"],

[2399] "budget": 10000,

[2400] "purpose": "special date"

[2401] }

[2402] The server converts the data into an internal format and makes requests to the generative AI model.

[2403] Generating date plans using generative AI models

[2404] A generative AI model receives the request and generates the best date plan based on the user's preferences and budget.

[2405] {

[2406] "date": "This Saturday",

[2407] "activities": [

[2408] {"time": "13:00", "activity": "Relax at a luxury spa"},

[2409] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[2410] ],

[2411] "total_cost": 9800

[2412] }

[2413] Display date plan

[2414] The server sends the generated date plan to the terminal, which displays the date plan to the user.

[2415] Date plan:

[2416] 1 PM: Relax at a luxury spa

[2417] 6:30 PM: Dinner at a popular French restaurant

[2418] Cost: 9,800 yen

[2419] User verification and fine-tuning

[2420] Tanaka checks the displayed date plan and adjusts the time and location as necessary, for example, changing the dinner time to 7 p.m.

[2421] Tanaka presses the "Confirm" button.

[2422] Confirmation of reservation

[2423] The server transmits the confirmed plan details to the reservation system and performs reservation procedures for the luxury spa and French restaurant.

[2424] {

[2425] "reservations": [

[2426] {"activity": "luxury spa", "time": "13:00"},

[2427] {"activity": "French restaurant", "time": "18:30"}

[2428] ]

[2429] }

[2430] A notification of the confirmed reservation is sent to the terminal and displayed to Tanaka.

[2431] In this way, the system of the present invention automatically generates an ideal date plan based on the user's preferences and budget, allowing the user to easily enjoy a special date experience. Furthermore, by automating the reservation procedure, the burden on the user can be reduced.

[2432] The processing flow will be explained below.

[2433] Step 1:

[2434] The user (Tanaka) starts up the device and opens the date planner app. Tanaka enters his preferences, budget, and purpose of the date into the input form. At this time, he enters the following information:

[2435] Preferences: Relaxation, gourmet food

[2436] Budget: 10,000 yen

[2437] Date purpose: A special date

[2438] Step 2:

[2439] The terminal converts the input data into JSON format and sends the data to the server. An example of the data to be sent is as follows:

[2440] {

[2441] "preferences": ["Relax", "Gourmet"],

[2442] "budget": 10000,

[2443] "purpose": "special date"

[2444] }

[2445] Step 3:

[2446] The server parses the JSON data received from the device. The parsed data is converted into an internal data structure, as shown below.

[2447] preferences = ["Relaxed", "Gourmet"]

[2448] budget = 10000

[2449] purpose = "special date"

[2450] Step 4:

[2451] The server creates data to request the AI ​​model to generate a date plan. An example of the created request data is as follows:

[2452] ai_request = {

[2453] "user_preferences": preferences,

[2454] "user_budget": budget,

[2455] "user_purpose": purpose

[2456] }

[2457] The server sends this request to the generative AI model.

[2458] Step 5:

[2459] The generative AI model receives a request from the server and generates a date plan using its internal algorithm. The generated date plan includes the following information:

[2460] {

[2461] "date": "This Saturday",

[2462] "activities": [

[2463] {"time": "13:00", "activity": "Relax at a luxury spa"},

[2464] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[2465] ],

[2466] "total_cost": 9800

[2467] }

[2468] Step 6:

[2469] The generative AI model sends the generated date plan back to the server, which receives the date plan.

[2470] Step 7:

[2471] The server sends the received date plan to the terminal. The terminal displays the date plan on the screen and presents the following to Tanaka:

[2472] Date plan:

[2473] 1 PM: Relax at a luxury spa

[2474] 6:30 PM: Dinner at a popular French restaurant

[2475] Cost: 9,800 yen

[2476] Step 8:

[2477] Tanaka checks the displayed date plan and makes any necessary adjustments. For example, he changes the dinner time to 7 p.m. Once he has completed the changes, he presses the "Confirm" button.

[2478] Step 9:

[2479] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[2480] {

[2481] "reservations": [

[2482] {"activity": "luxury spa", "time": "13:00"},

[2483] {"activity": "French restaurant", "time": "19:00"}

[2484] ]

[2485] }

[2486] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[2487] Your reservation is confirmed:

[2488] Luxury Spa: 1 PM

[2489] French Restaurant: 7 p.m.

[2490] In this way, the system of the present invention allows users to easily create, confirm, and reserve their ideal date plan.

[2491] Example 1

[2492] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2493] In today's busy lifestyles, efficiently planning and executing special date plans is difficult. It takes time and effort to independently create an ideal date plan that takes into account the user's preferences and budget, and then book activities based on that plan. Furthermore, the time and complexity of the booking process can be burdensome, making it difficult for users to easily enjoy a special date experience. To address these challenges, a system is needed that can automatically generate date plans based on user input and streamline the entire process, including the booking process.

[2494] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2495] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting confirmation and fine-tuning from the user, means for booking activities included in the date plan with a reservation system, means for creating a prompt sentence to be used in the date plan generation request, and means for formatting the date plan details. This allows users to easily receive a date plan optimized for their preferences and budget, and by automating the reservation procedure, they can efficiently realize a special date experience.

[2496] The "means for receiving user input" is an interface that allows the user to input information such as preferences, budget, and purpose of the date into the system.

[2497] "Means for analyzing user input" refers to a program or algorithm that analyzes received user input data and extracts and converts information such as preferences, budget, and purpose.

[2498] "Means for sending requests to the generative AI model based on the analyzed data" means means for sending requests in an appropriate format to the generative AI model using the analyzed data.

[2499] A "means for receiving a date plan from a generative AI model" is an interface or mechanism for accepting date plan data generated by a generative AI model.

[2500] The "means for displaying the received date plan to the user" refers to an interface and a program for visually displaying the received date plan to the user.

[2501] The "means for accepting user confirmation and fine adjustment" is a means for accepting operations by the user for confirming and modifying the displayed date plan.

[2502] The "means for reserving activities included in a date plan in a reservation system" refers to a system and program for automatically reserving various activities based on a confirmed date plan.

[2503] The "means for creating a prompt sentence to be used when requesting the generation of a date plan" is a program or algorithm for automatically creating a prompt sentence to be used when requesting the generation of a date plan from a generative AI model.

[2504] A "means for formatting date plan details" is a program or mechanism for converting date plan details received from a generative AI model into a format appropriate for display to a user.

[2505] This invention is a system that automatically generates an ideal date plan based on a user's preferences and budget. The system receives user input, analyzes it, and then requests a generative AI model to generate a date plan. The system then displays the generated date plan to the user and has the ability to make a reservation if necessary.

[2506] Overall system configuration

[2507] The system consists of the following main components:

[2508] 1. A means of receiving user input

[2509] The user enters information such as preferences, budget, and purpose of the date into an input form. For example, the input can be done using a smartphone or PC application.

[2510] 2. A way to analyze user input

[2511] The input data is analyzed, and the necessary information is extracted and converted. The analysis is performed using Python's Pandas library, etc.

[2512] 3. A means of sending requests to the generative AI model based on the analyzed data

[2513] A prompt is created based on the analyzed data and sent to a generative AI model (such as GPT-3 or GPT-4). An example of a prompt is as follows:

[2514] A user likes relaxation and gourmet food and is planning a special date. The budget is 10,000 yen, and they want to go on this Saturday. Generate the optimal date plan based on this.

[2515] 4. A way to receive date plans from a generative AI model

[2516] The date plan generated by the generative AI model is received on the server side. The received data is in JSON format.

[2517] 5. How to display received date plans to users

[2518] The received date plan is converted into an appropriate format, sent to the device, and displayed to the user. Web frameworks such as React and Angular are used for display.

[2519] 6. Means of accepting user confirmation and fine-tuning

[2520] It provides an interface for users to review their date plans and make adjustments to the time and location as needed, for example, changing the time or adding or removing activities.

[2521] 7. A means to reserve activities included in the date plan through the reservation system

[2522] The confirmed date plan details are sent to the reservation system, and each activity is automatically booked. Reservation management uses server-side frameworks such as Node.js and Django.

[2523] In this way, the system of the present invention automatically generates an ideal date plan based on the user's preferences and budget, allowing the user to easily enjoy a special date experience. Also, by automating the reservation process, the burden on the user can be reduced.

[2524] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2525] Step 1:

[2526] The user starts up the device, operates the application, and enters information such as preferences, budget, and purpose of the date into the input form.

[2527] Input: Information about your preferences, budget, and dating goals

[2528] Output: Data entered in the input form

[2529] Specific operation: The user opens the app on their smartphone or PC, enters the information as shown below, and taps the "Send" button.

[2530] Preferences: Relaxation, gourmet food

[2531] Budget: 10,000 yen

[2532] Date purpose: A special date

[2533] Step 2:

[2534] The terminal sends the input data to the server.

[2535] Input: Data entered into an input form

[2536] Output: JSON format data sent to the server

[2537] Specific operation: Tanaka's smartphone sends the input data to the server in real time. The data will be in the following format.

[2538] json

[2539] {

[2540] "preferences": ["Relax", "Gourmet"],

[2541] "budget": 10000,

[2542] "purpose": "special date"

[2543] }

[2544] Step 3:

[2545] The server parses the received data.

[2546] Input: JSON format data

[2547] Output: Parsed internal data format

[2548] Specific operation: The server parses the received JSON data and extracts information such as "preferences," "budget," and "purpose of the date." For example, it can be parsed using the Python Pandas library as follows:

[2549] python

[2550] data = {

[2551] "preferences": ["Relax", "Gourmet"],

[2552] "budget": 10000,

[2553] "purpose": "special date"

[2554] }

[2555] preferences = data["preferences"]

[2556] budget = data["budget"]

[2557] purpose = data["purpose"]

[2558] Step 4:

[2559] The server sends a request to the generative AI model based on the analysis results.

[2560] Input: Parsed internal data format

[2561] Output: The prompt sent to the generative AI model

[2562] Specific operation: The server creates a prompt for the generative AI model and sends it to the model in the following text format:

[2563] A user likes relaxation and gourmet food and is planning a special date. The budget is 10,000 yen, and they want to go on this Saturday. Generate the optimal date plan based on this.

[2564] Step 5:

[2565] A generative AI model receives the request and generates a date plan.

[2566] Input: Prompt text sent from the server

[2567] Output: Generated date plan (JSON format)

[2568] What it does: The generative AI model processes the request and generates the following details of the date plan:

[2569] json

[2570] {

[2571] "date": "This Saturday",

[2572] "activities": [

[2573] {"time": "13:00", "activity": "Relax at a luxury spa"},

[2574] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[2575] ],

[2576] "total_cost": 9800

[2577] }

[2578] Step 6:

[2579] The server receives the generated date plan.

[2580] Input: Date plan from the generative AI model (JSON format)

[2581] Output: Date plan saved in server storage

[2582] Specific operation: The server stores the date plan received from the generative AI model in an internal database and converts the format as necessary.

[2583] Step 7:

[2584] The server sends the date plan to the terminal, which displays it to the user.

[2585] Input: Date plan saved on the server

[2586] Output: Date plan displayed on user's device

[2587] Specific operation: The app displays the details of the date plan on Tanaka's smartphone. The displayed content is as follows:

[2588] Date plan:

[2589] 1 PM: Relax at a luxury spa

[2590] 6:30 PM: Dinner at a popular French restaurant

[2591] Cost: 9,800 yen

[2592] Step 8:

[2593] The user checks the plan and adjusts the time and location as needed.

[2594] Input: Date plan displayed to user

[2595] Output: Adjusted date plan

[2596] Specific operation: The user checks the date plan and changes the dinner time to, for example, 7 PM. Once the changes are complete, the user presses the "Confirm" button.

[2597] Step 9:

[2598] The server transmits the confirmed plan details to the reservation system and makes reservations for each activity.

[2599] Input: Adjusted date plan

[2600] Output: Request and booking confirmation sent to the reservation system

[2601] Specific operation: The server sends the following request to the reservation system to confirm the reservation of each activity.

[2602] json

[2603] {

[2604] "reservations": [

[2605] {"activity": "luxury spa", "time": "13:00"},

[2606] {"activity": "French restaurant", "time": "19:00"}

[2607] ]

[2608] }

[2609] Once the reservation is complete, the server sends a confirmation notice to the user's terminal and displays it to the user.

[2610] (Application example 1)

[2611] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2612] Current food delivery services lack a system that can automatically suggest optimal meal plans that fit multiple users' preferences, budgets, and specific delivery times. This requires users to search for restaurants and decide what to order themselves, which is time-consuming. Furthermore, when ordering multiple dishes from different locations at different times, the ordering process for each dish becomes complicated. Furthermore, it is difficult to suggest meal plans that fit specific delivery times, making it difficult to improve the user experience.

[2613] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2614] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a meal plan from the generative AI model, means for displaying the received meal plan to the user, means for accepting user confirmation and fine-tuning, and means for ordering and delivering meals. This allows users to easily receive a meal plan that is optimal for their preferences, budget, and specific delivery time, eliminating the complexity of ordering and delivery procedures.

[2615] The "means for receiving user input" is an interface for obtaining information such as preferences, budget, and delivery time from the user.

[2616] The "means for analyzing user input" is a processing function for analyzing received user input data and converting it into an appropriate format.

[2617] "Means for sending a request to the generative AI model based on the analyzed data" refers to a communication means for passing the analyzed data to the generative AI model and requesting the generation of an optimal meal plan.

[2618] "Means for receiving a meal plan from a generative AI model" refers to a receiving function for receiving a meal plan created by a generative AI model.

[2619] The "means for displaying the received meal plan to the user" is an interface for displaying the generated meal plan to the user in a format that is easy to understand.

[2620] The "means for accepting user confirmation and fine-tuning" is an interface that allows the user to review the generated plan and adjust it as necessary.

[2621] "Means for ordering and delivering meals" refers to a system for placing orders with restaurants based on a confirmed meal plan and delivering meals at the specified delivery time.

[2622] "Preferences" refers to information such as the type of food or style of restaurant the user prefers.

[2623] A "budget" is a range of amounts that a user specifies for spending on food.

[2624] "Delivery time" is information indicating the date and time when the user would like to receive the meal.

[2625] A "meal plan" is a plan that includes recommended meal menus and ordering details, generated based on user input.

[2626] This invention is a system that automatically generates an ideal meal plan based on a user's preferences and budget, and then handles ordering and delivery. The system uses a smartphone as the user interface, processes data on a cloud server, and generates meal plans using a generative AI model. It also uses a delivery API to automate meal ordering and delivery.

[2627] Hardware and software used

[2628] 1. Smartphone: This is the device where the user provides input data and checks the meal plan.

[2629] 2. Cloud server: Uses Amazon Web Services (AWS) Lambda and other services to perform scalable data processing and backend operations.

[2630] 3. Generative AI model: Using OpenAI GPT-4 and other models, it generates optimal meal plans based on user input data.

[2631] 4. Delivery API: Use APIs such as UberEats to automatically order and deliver meals.

[2632] System Operation Overview

[2633] 1. Receiving user input:

[2634] The user operates their smartphone and enters their preferences, budget, and delivery time into the application's input form. For example, the following input data is obtained:

[2635] Preferences: Italian

[2636] Budget: 5,000 yen

[2637] Delivery time: 19:00

[2638] 2. Data transmission and analysis:

[2639] The smartphone sends this input data to the cloud server, which receives and analyzes it. The analysis results will be in the following format:

[2640] {

[2641] "preferences": ["Italian"],

[2642] "budget": 5000,

[2643] "delivery_time": "19:00"

[2644] }

[2645] 3. Request to the generative AI model:

[2646] The cloud server sends a request to the generative AI model based on the analyzed data. An example of a prompt for the generative AI model is as follows:

[2647] Generate the perfect meal plan based on your preferences and budget. Use the following information to help you:

[2648] Preferences: Italian

[2649] Budget: 5,000 yen

[2650] Delivery time: 19:00

[2651] 4. Receive and view the generated meal plan:

[2652] The plan created by the generative AI model is sent to a smartphone via a cloud server, and the plan is displayed to the user as shown below.

[2653] Your food delivery plan:

[2654] - 18:50: Pizza Margherita

[2655] - 18:55: Carbonara

[2656] Cost: 4,800 yen

[2657] 5. User verification and fine-tuning:

[2658] Users can check the plan on their smartphone and make changes to the time and menu as needed. Once changes are complete, users press the "Confirm" button to finalize the plan.

[2659] 6. Ordering and Delivery Arrangements:

[2660] The cloud server sends an order request to the delivery API based on the confirmed plan. Orders are placed with each restaurant at the appropriate time, and the meals are delivered at the specified delivery time.

[2661] This system allows users to easily receive the optimal meal plan tailored to their preferences, budget, and specific delivery time, significantly reducing the hassle of ordering and delivery.

[2662] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2663] Step 1:

[2664] The user operates their smartphone and enters data into the application's input form. Specifically, the user enters "preferences," "budget," and "delivery time." This results in the following data being obtained as user input:

[2665] Input data:

[2666] Preferences: Italian

[2667] Budget: 5,000 yen

[2668] Delivery time: 19:00

[2669] Step 2:

[2670] The device sends this input data to the cloud server, which receives the data in JSON format and performs the following analysis:

[2671] input:

[2672] {

[2673] "preferences": ["Italian"],

[2674] "budget": 5000,

[2675] "delivery_time": "19:00"

[2676] }

[2677] The server parses this data and converts it into an internal format.

[2678] Step 3:

[2679] Based on the data analyzed by the server, a request is sent to the generative AI model. Specifically, the following prompt is generated:

[2680] Prompt statement:

[2681] Generate the perfect meal plan based on your preferences and budget. Use the following information to help you:

[2682] Preferences: Italian

[2683] Budget: 5,000 yen

[2684] Delivery time: 19:00

[2685] This allows the generative AI model to generate an optimal meal plan based on user input.

[2686] Step 4:

[2687] The generative AI model generates a meal plan and sends the results back to the server. The generated plan looks like this:

[2688] Generated plan:

[2689] {

[2690] "food_plan": [

[2691] {"time": "18:50", "food": "Pizza Margherita"},

[2692] {"time": "18:55", "food": "Carbonara"}

[2693] ],

[2694] "total_cost": 4800

[2695] }

[2696] Step 5:

[2697] The server receives the meal plan from the AI ​​model and sends it to the device (smartphone), which analyzes the data and displays the plan on the screen.

[2698] Display contents:

[2699] Your food delivery plan:

[2700] 18:50: Pizza Margherita

[2701] 18:55: Carbonara

[2702] Cost: 4,800 yen

[2703] Step 6:

[2704] The user can check the meal plan on the device and make any necessary adjustments, such as changing the delivery time. After making the adjustments, the user presses the "Confirm" button.

[2705] Step 7:

[2706] The server sends the confirmed meal plan to the delivery API and processes the order and delivery. Specifically, the following order request is sent.

[2707] Order Request:

[2708] {

[2709] "orders": [

[2710] {"restaurant": "Italian Restaurant A", "food": "Pizza Margherita", "time": "18:50"},

[2711] {"restaurant": "Italian Restaurant B", "food": "Carbonara", "time": "18:55"}

[2712] ]

[2713] }

[2714] Step 8:

[2715] When the delivery API successfully accepts the order, the server sends the result to the terminal and displays a notification of order confirmation to the user, allowing the user to confirm that the meal will be delivered at the specified time.

[2716] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2717] This invention is a system that automatically generates ideal date plans using a generative AI model based on user input and emotions, and provides them to users. This system has a means to recognize the user's emotions in addition to their preferences, budget, and date purpose to optimize the plans.

[2718] Overall system configuration

[2719] The system consists of the following main components:

[2720] 1. A means of receiving user input

[2721] 2. A way to analyze user input

[2722] 3. A means to recognize user emotions and adjust analytical data using an emotion engine

[2723] 4. A means of sending requests to the generative AI model

[2724] 5. How to receive date plans

[2725] 6. How to display received date plans to users

[2726] 7. Means of accepting user confirmation and fine-tuning

[2727] 8. A means to reserve activities included in the date plan through the reservation system

[2728] Program processing procedure

[2729] The device receives data input by the user and sends it to the server. Before analyzing the data, the server recognizes the user's emotions through an emotion engine. It adjusts the analyzed data based on the recognized emotions. It then sends a request to the generative AI model based on the adjusted data. The generative AI model generates a date plan and sends the result back to the server. The server sends the received date plan to the device, which displays the plan contents to the user. The user confirms the plan and makes any necessary adjustments. Finally, the server notifies the reservation system of the confirmed plan and completes the necessary reservation procedures.

[2730] Program processing details

[2731] User input

[2732] The user (hereafter referred to as "Tanaka") starts up the terminal and enters the following information into the input form via the application.

[2733] Preferences: Relaxation, gourmet food

[2734] Budget: 10,000 yen

[2735] Date purpose: A special date

[2736] Data transmission and analysis

[2737] The terminal sends input data in JSON format to the server, which receives the data and parses the JSON data.

[2738] {

[2739] "preferences": ["Relax", "Gourmet"],

[2740] "budget": 10000,

[2741] "purpose": "special date"

[2742] }

[2743] Emotion recognition by emotion engine

[2744] The server activates an emotion engine to recognize emotions from Tanaka's facial expressions, voice tone, and text input.

[2745] Emotion: Joy (85% probability)

[2746] Adjustment of analysis data

[2747] The server adjusts the analysis data based on the recognized emotion. For example, if Tanaka's emotion is "joy," it will enhance relaxation options.

[2748] Requests to generative AI models

[2749] The server sends a request to the generative AI model based on the adjusted data.

[2750] ai_request = {

[2751] "user_preferences": ["Relax", "Gourmet"],

[2752] "user_budget": 10000,

[2753] "user_purpose": "special date",

[2754] "user_emotion": "joy"

[2755] }

[2756] Generating date plans using generative AI models

[2757] The generative AI model generates a date plan, which looks like this:

[2758] {

[2759] "date": "This Saturday",

[2760] "activities": [

[2761] {"time": "13:00", "activity": "Relax at a luxury spa"},

[2762] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[2763] ],

[2764] "total_cost": 9800

[2765] }

[2766] Display date plan

[2767] The server sends the generated date plan to the device, which displays the plan to the user and presents the following to Tanaka:

[2768] Date plan:

[2769] 1 PM: Relax at a luxury spa

[2770] 6:30 PM: Dinner at a popular French restaurant

[2771] Cost: 9,800 yen

[2772] User verification and fine-tuning

[2773] Tanaka checks the displayed date plan and, for example, changes the dinner time to 7 p.m. Once the changes are complete, Tanaka presses the "Confirm" button.

[2774] Confirmation of reservation

[2775] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[2776] {

[2777] "reservations": [

[2778] {"activity": "luxury spa", "time": "13:00"},

[2779] {"activity": "French restaurant", "time": "19:00"}

[2780] ]

[2781] }

[2782] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[2783] Your reservation is confirmed:

[2784] Luxury Spa: 1 PM

[2785] French Restaurant: 7 p.m.

[2786] In this way, by combining the emotion engine, the system can better understand the user's emotional state and provide date plans tailored to individual needs, making the user's dating experience even richer and more special.

[2787] The processing flow will be explained below.

[2788] Step 1:

[2789] The user (Tanaka) starts up the device and opens the date planner app. Tanaka enters his preferences, budget, and purpose of the date into the input form. At this time, he enters the following information:

[2790] Preferences: Relaxation, gourmet food

[2791] Budget: 10,000 yen

[2792] Date purpose: A special date

[2793] Step 2:

[2794] The terminal converts the input data into JSON format and sends the data to the server. An example of the data to be sent is as follows:

[2795] {

[2796] "preferences": ["Relax", "Gourmet"],

[2797] "budget": 10000,

[2798] "purpose": "special date"

[2799] }

[2800] Step 3:

[2801] The server parses the JSON data received from the device. The parsed data is converted into an internal data structure, as shown below.

[2802] preferences = ["Relaxed", "Gourmet"]

[2803] budget = 10000

[2804] purpose = "special date"

[2805] Step 4:

[2806] The server activates the emotion engine and collects data to recognize emotions from Tanaka's facial expressions, voice tone, and text input. For example, facial expressions and voice are captured through the smartphone's camera and microphone.

[2807] Step 5:

[2808] The emotion engine analyzes the collected data and estimates Tanaka's emotional state. For example, it estimates "joy" from facial expression analysis and voice tone.

[2809] Emotion: Joy (85% probability)

[2810] Step 6:

[2811] The server adjusts the analysis data based on the recognized emotion. For example, if Tanaka's emotion is "joy," it will enhance relaxation options.

[2812] adjusted_preferences = ["Relaxed", "Gourmet"]

[2813] Step 7:

[2814] The server sends a request to the generative AI model based on the adjusted data. An example of the request data to be sent is as follows:

[2815] ai_request = {

[2816] "user_preferences": adjusted_preferences,

[2817] "user_budget": 10000,

[2818] "user_purpose": "special date",

[2819] "user_emotion": "joy"

[2820] }

[2821] Step 8:

[2822] The generative AI model receives a request from the server and generates a date plan using its internal algorithm. The generated date plan includes the following information:

[2823] {

[2824] "date": "This Saturday",

[2825] "activities": [

[2826] {"time": "13:00", "activity": "Relax at a luxury spa"},

[2827] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[2828] ],

[2829] "total_cost": 9800

[2830] }

[2831] Step 9:

[2832] The generative AI model sends the generated date plan back to the server, which receives the date plan.

[2833] Step 10:

[2834] The server sends the received date plan to the terminal. The terminal displays the date plan on the screen and presents the following to Tanaka:

[2835] Date plan:

[2836] 1 PM: Relax at a luxury spa

[2837] 6:30 PM: Dinner at a popular French restaurant

[2838] Cost: 9,800 yen

[2839] Step 11:

[2840] Tanaka checks the displayed date plan and makes any necessary adjustments. For example, he changes the dinner time to 7 p.m. Once he has completed the changes, he presses the "Confirm" button.

[2841] Step 12:

[2842] The server automatically reserves the activity in the reservation system based on the confirmed date plan. An example of reservation data is as follows:

[2843] {

[2844] "reservations": [

[2845] {"activity": "luxury spa", "time": "13:00"},

[2846] {"activity": "French restaurant", "time": "19:00"}

[2847] ]

[2848] }

[2849] A confirmation of the reservation is sent to the terminal, and the terminal displays the following message to Tanaka.

[2850] Your reservation is confirmed:

[2851] Luxury Spa: 1 PM

[2852] French Restaurant: 7 p.m.

[2853] In this way, the system of the present invention allows users to easily create, confirm, and book their ideal date plan, and by taking emotions into consideration, it can provide a more personalized experience.

[2854] Example 2

[2855] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2856] Conventional date plan generation systems generate plans based solely on user input data, making it impossible to take into account the user's emotions or momentary moods. This makes it difficult to provide a truly optimal plan for the user, resulting in low user satisfaction. Additionally, the process from the user confirming the plan details to finalizing the reservation is complicated, requiring a lot of time and effort.

[2857] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2858] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for recognizing the user's emotions using an emotion engine and adjusting the analysis data, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting user confirmation and fine-tuning, and means for booking activities included in the date plan with a reservation system. This makes it possible to provide a more optimal date plan that takes the user's emotions into consideration and significantly reduce the effort and time required for booking.

[2859] "User" refers to a person who uses this system to generate date plans.

[2860] "Means for receiving input" refers to an interface or device for obtaining data from a user.

[2861] "Means for analyzing" refers to software or algorithms used to structure and understand captured user input data.

[2862] A "generative AI model" refers to an artificial intelligence model that is trained to solve a specific task or problem.

[2863] "Date Plan" refers to a combination of activities and schedules suggested based on the user's requests and preferences.

[2864] "Means for displaying" refers to a screen or device for visually presenting the generated date plan to the user.

[2865] "Means for accepting confirmation and fine-tuning" refers to an interface that allows the user to make changes or confirmations to the proposed date plan.

[2866] "Reservation system" refers to a system for making reservations and confirming each activity included in a date plan.

[2867] An "emotion engine" refers to software or algorithms that analyze users' emotions and reflect them in plan generation.

[2868] "Means for adjusting analysis data" refers to a function for optimizing the analysis results and the content of the data generated based on the recognized emotions.

[2869] This invention is a system that automatically generates ideal date plans using a generative AI model based on user input and emotions, and provides them to users. This system has a means to recognize the user's emotions in addition to their preferences, budget, and date purpose to optimize the plans.

[2870] Overall system configuration

[2871] The system consists of the following main components:

[2872] 1. A means of receiving user input

[2873] 2. A way to analyze user input

[2874] 3. A means to recognize user emotions and adjust analytical data using an emotion engine

[2875] 4. A means of sending requests to the generative AI model

[2876] 5. How to receive date plans

[2877] 6. How to display received date plans to users

[2878] 7. Means of accepting user confirmation and fine-tuning

[2879] 8. A means to reserve activities included in the date plan through the reservation system

[2880] System Operation

[2881] User input

[2882] The user starts the device and enters the following information through the application:

[2883] Preferences: Relaxation, gourmet food

[2884] Budget: 10,000 yen

[2885] Date purpose: A special date

[2886] Sending input data

[2887] The device sends the user's input data in JSON format to the server.

[2888] json

[2889] {

[2890] "preferences": ["Relax", "Gourmet"],

[2891] "budget": 10000,

[2892] "purpose": "special date"

[2893] }

[2894] Data analysis and emotion recognition

[2895] The server analyzes the input data and activates the emotion engine.

[2896] The emotion engine recognizes emotions from the user's facial expressions, voice tone, and text input.

[2897] Emotion: Joy (85% probability)

[2898] Adjustment of analysis data

[2899] The server adjusts the analysis data based on the recognized emotion.

[2900] Sending requests to generative AI models

[2901] The server sends a request to the generative AI model based on the adjusted data.

[2902] json

[2903] {

[2904] "user_preferences": ["Relax", "Gourmet"],

[2905] "user_budget": 10000,

[2906] "user_purpose": "special date",

[2907] "user_emotion": "joy"

[2908] }

[2909] Receive the generated date plan

[2910] The generative AI model generates a date plan and sends it back to the server.

[2911] Date: This Saturday

[2912] activity:

[2913] 13:00: Relax at a luxury spa

[2914] 18:30: Dinner at a popular French restaurant

[2915] Total cost: 9,800 yen

[2916] Display date plan

[2917] The server transmits the generated date plan to the terminal, and the terminal displays the date plan to the user.

[2918] User verification and fine-tuning

[2919] The user reviews the displayed date plan and makes adjustments as necessary.

[2920] The user takes action to confirm the plan.

[2921] Confirmation of reservation

[2922] The server transmits the finalized date plan to the reservation system and makes reservations for each activity.

[2923] json

[2924] {

[2925] "reservations": [

[2926] {"activity": "luxury spa", "time": "13:00"},

[2927] {"activity": "French restaurant", "time": "19:00"}

[2928] ]

[2929] }

[2930] Sending confirmation of reservation

[2931] A confirmation of the reservation is sent to the device, which displays the following message to the user:

[2932] Your reservation is confirmed:

[2933] Luxury Spa: 1 PM

[2934] French Restaurant: 7 p.m.

[2935] Hardware and software used

[2936] Device: A device that receives user input and displays date plans, such as a smartphone, tablet, or PC.

[2937] Server: A central processing unit for data analysis, emotion recognition, communication with generative AI models, and reservation management.

[2938] Emotion Engine: Software for analyzing user emotions, combining speech recognition, image analysis, and text analysis technologies.

[2939] Generative AI model: An artificial intelligence model trained to automatically generate date plans.

[2940] By implementing the present invention, users can easily create optimal date plans tailored to their individual emotions and even make reservations, making their dating experience even more special and enriching.

[2941] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2942] Program processing flow

[2943] Step 1:

[2944] The user launches the application on their device and enters their preferences, budget, and date goals.

[2945] Example input:

[2946] Preferences: Relaxation, gourmet food

[2947] Budget: 10,000 yen

[2948] Date purpose: A special date

[2949] Input data is collected and converted to JSON format on the device.

[2950] Step 2:

[2951] The terminal sends the input data to the server in JSON format.

[2952] Input: User preferences, budget, and dating goals

[2953] Output: JSON format data

[2954] json

[2955] {

[2956] "preferences": ["Relax", "Gourmet"],

[2957] "budget": 10000,

[2958] "purpose": "special date"

[2959] }

[2960] Step 3:

[2961] The server receives the JSON data and parses the user input.

[2962] Input: JSON format data

[2963] Output: Analyzed user preferences, budget, and dating goals

[2964] Step 4:

[2965] The server activates the emotion engine to analyze the user's emotions, specifically recognizing emotions from facial expressions, voice tone, and text input data.

[2966] Input: User's facial expression data, voice data, text data

[2967] Output: User sentiment

[2968] Emotion: Joy (85% probability)

[2969] Step 5:

[2970] The server adjusts the analysis data based on the recognized emotion.

[2971] Input: User sentiment, preferences, budget, and dating goals

[2972] Output: Adjusted analysis data

[2973] Example of adjustment:

[2974] Adjusted data:

[2975] Preferences: Relaxation (strengthening), gourmet food

[2976] Budget: 10,000 yen

[2977] Date purpose: A special date

[2978] Step 6:

[2979] The server sends the adjusted data as a request to the generative AI model.

[2980] Input: Adjusted analysis data

[2981] Output: A request to the generative AI model

[2982] json

[2983] {

[2984] "user_preferences": ["Relax", "Gourmet"],

[2985] "user_budget": 10000,

[2986] "user_purpose": "special date",

[2987] "user_emotion": "joy"

[2988] }

[2989] Step 7:

[2990] The generative AI model generates a date plan and sends the results back to the server.

[2991] Input: A request to the generative AI model

[2992] Output: Generated date plan

[2993] json

[2994] {

[2995] "date": "This Saturday",

[2996] "activities": [

[2997] {"time": "13:00", "activity": "Relax at a luxury spa"},

[2998] {"time": "18:30", "activity": "Dinner at a popular French restaurant"}

[2999] ],

[3000] "total_cost": 9800

[3001] }

[3002] Step 8:

[3003] The server transmits the date plan to the terminal, and the terminal displays the date plan to the user.

[3004] Input: Generated date plan

[3005] Output: Date plan displayed to the user

[3006] Date plan:

[3007] 1 PM: Relax at a luxury spa

[3008] 6:30 PM: Dinner at a popular French restaurant

[3009] Cost: 9,800 yen

[3010] Step 9:

[3011] The user can review the displayed date plan and make any necessary adjustments, such as changing the dinner time to 7 p.m.

[3012] Input: User's fine-tuning request

[3013] Output: A tweaked date plan

[3014] Dinner time changed to 7pm

[3015] Step 10:

[3016] The user confirms the plan, and the server sends the final confirmed date plan to the reservation system, which makes reservations for each activity.

[3017] Input: Confirmed date plans

[3018] Output: Request to the reservation system

[3019] json

[3020] {

[3021] "reservations": [

[3022] {"activity": "luxury spa", "time": "13:00"},

[3023] {"activity": "French restaurant", "time": "19:00"}

[3024] ]

[3025] }

[3026] Step 11:

[3027] A confirmation of the reservation is sent from the server to the terminal, and the terminal displays the reservation details to the user.

[3028] Input: Reservation system response

[3029] Output: A confirmation message displayed to the user

[3030] Your reservation is confirmed:

[3031] Luxury Spa: 1 PM

[3032] French Restaurant: 7 p.m.

[3033] (Application example 2)

[3034] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[3035] This invention relates to a system that automatically generates and provides ideal date plans that will satisfy users based on their emotions, as well as their preferences, budget, and date goals. Conventional systems have had difficulty generating plans that reflect the user's emotions, and also lacked the ability to present and adjust plans using virtual reality. As a result, it has been difficult to provide a date experience that meets users' expectations.

[3036] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[3037] In this invention, the server includes means for receiving user input, means for analyzing the user input, means for sending a request to the generative AI model based on the analyzed data, means for receiving a date plan from the generative AI model, means for displaying the received date plan to the user, means for accepting user confirmation and fine-tuning, means for booking activities included in the date plan with a reservation system, means for recognizing user emotions using an emotion engine and adjusting the analyzed data, and means for displaying and fine-tuning the date plan in virtual reality. This makes it possible to provide a customized date plan that reflects the user's emotions and enable visual adjustments in real time, thereby improving the quality of the user experience.

[3038] "Means for receiving user input" refers to the part of the system through which a user inputs information such as preferences, budget, and date purpose via a smartphone or other device.

[3039] The "means for parsing user input" is the part of the system that analyzes received user input and converts it into a useful form of data.

[3040] The "means for sending a request to the generative AI model" refers to the part of the system that sends a request to the AI ​​model based on the analyzed data and generates a date plan.

[3041] The "means for receiving a date plan from a generative AI model" is the part of the system for receiving a date plan generated from the AI ​​model.

[3042] The "means for displaying the received date plan to the user" is the part of the system that visually presents the generated date plan to the user.

[3043] The "means for accepting user confirmation and fine-tuning" is the part of the system that allows the user to review the displayed itinerary and make adjustments as necessary.

[3044] The "means for reserving activities included in a date plan with a reservation system" is a part of the system for automatically reserving activities based on a confirmed date plan.

[3045] "Means for recognizing user emotions using an emotion engine and adjusting analyzed data" refers to the part of the system that analyzes the user's facial expressions, voice, etc. to recognize emotions and adjusts the data generated based on those emotions.

[3046] The "means for displaying and fine-tuning a date plan in virtual reality" is the part of the system that displays the generated date plan to the user in a virtual reality environment and allows for visual fine-tuning.

[3047] The present invention is a system that automatically generates an ideal date plan using a generative AI model based on user input and emotions, and provides it to the user. This system is equipped with a means for recognizing the user's emotions in addition to the user's preferences, budget, and date purpose to optimize the plan. Specific embodiments are described below.

[3048] System Components

[3049] The system consists of the following main components:

[3050] 1. A means of receiving user input: The user inputs information such as preferences, budget, and purpose of the date via a smartphone or other device. For example, the user might input "relaxation," "foodie," "budget of 10,000 yen," or "special date."

[3051] 2. A means of parsing user input: Parse the received user input and convert it into a useful format.

[3052] 3. Emotion engine: Recognizes emotions from the user's facial expressions and voice and adjusts the data accordingly. For example, if the user's emotion is recognized as "joy," the system will enhance relaxation options.

[3053] 4. Send a request to the generative AI model: Based on the adjusted data, send a request to the generative AI model to generate a date plan. An example of a prompt is as follows:

[3054] User preferences: Relaxation, gourmet

[3055] Budget: 10,000 yen

[3056] Purpose: A special date

[3057] Emotion: Joy

[3058] 5. Means for receiving date plans from the generative AI model: Receive the generated date plans and generate a plan such as the following, for example, a plan including "Relax at a luxury spa at 13:00" and "Dinner at a popular French restaurant at 18:30."

[3059] 6. Means for displaying received date plans to the user: The generated date plans are visually presented to the user.

[3060] 7. A way for users to confirm and adjust their plans: Users can confirm their plans and make adjustments if necessary, for example, changing the dinner time from 6:30 PM to 7:00 PM.

[3061] 8. Reservation system: Automatically book activities based on confirmed date plans.

[3062] 9. Display and fine-tuning in virtual reality: The generated date plan is displayed to the user in a virtual reality environment and can be visually fine-tuned, allowing the user to check and fine-tune the plan in a way that is close to the real experience.

[3063] The implementation of this system can improve the quality of the user experience by providing a customized date plan that reflects the user's emotions and enabling visual adjustments in real time.

[3064] Hardware and Software Configuration

[3065] Hardware:

[3066] Smartphone (iOS / Android)

[3067] Camera (for facial expression recognition)

[3068] software:

[3069] Emotion recognition engine (e.g. Microsoft Azure Emotion API)

[3070] Generative AI models (e.g., OpenAI GPT models)

[3071] Reservation system (dedicated API)

[3072] Specific examples

[3073] The user launches the smartphone app and enters the following information: "Relax," "Gourmet," "Budget 10,000 yen," and "Special date." The system analyzes this and sends a request to the generative AI model. At the same time, the emotion engine recognizes the user's emotion of joy and reinforces the relaxation option. The generated date plan is "Relax at a luxury spa at 1:00 PM" and "Dinner at a popular French restaurant at 6:30 PM." The user checks this plan in virtual reality and fine-tunes the dinner time to 7:00 PM. Finally, the system automatically books these activities and notifies the user.

[3074] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[3075] Step 1:

[3076] Receive user input

[3077] The user launches the smartphone application and enters their preferences, budget, date goals, etc.

[3078] Example inputs: "Relax", "Gourmet", "Budget 10,000 yen", "Special date".

[3079] Input: User preferences, budget, and dating purpose

[3080] Output: Input data (JSON format)

[3081] Step 2:

[3082] Parsing input

[3083] The device sends the input data from the user in JSON format to the server, which receives and analyzes this data.

[3084] Input: User input data (JSON format)

[3085] Output: Analysis data

[3086] Specific actions: Parse and extract preferences, budget, and date purpose.

[3087] Step 3:

[3088] Emotion recognition by emotion engine

[3089] An emotion engine is launched on the server to recognize emotions from the user's facial expressions, voice, and text input.

[3090] Input: User facial expressions, voice, text

[3091] Output: Emotion data (e.g., "joy")

[3092] Specific operation: Using an emotion recognition algorithm, emotions are estimated from facial expressions and voice.

[3093] Step 4:

[3094] Adjustment of analysis data

[3095] The server adjusts the analysis data based on the recognized emotion, for example, enhancing relaxation options to reflect the emotion of "joy."

[3096] Input: Emotion data, analysis data

[3097] Output: Adjusted analysis data

[3098] Specific operation: Attach emotion data and update existing analysis data.

[3099] Step 5:

[3100] Sending requests to generative AI models

[3101] The server sends the adjusted analysis data as a request to the generative AI model.

[3102] Input: Adjusted analytical data (e.g., "Relax," "Gourmet," etc.)

[3103] Output: Prompt sentence to the generative AI model

[3104] Specific behavior: Generates a prompt in the following format:

[3105] User preferences: Relaxation, gourmet

[3106] Budget: 10,000 yen

[3107] Purpose: A special date

[3108] Emotion: Joy

[3109] Step 6:

[3110] Creating and receiving date plans

[3111] The generative AI model generates a date plan, and the server receives the results.

[3112] Input: prompt statement

[3113] Output: Date plan (e.g. "13:00 Relax at a luxury spa")

[3114] Specific operation: A plan is created using the generative AI model and sent back to the server.

[3115] Step 7:

[3116] Display date plan

[3117] The server transmits the generated date plan to the terminal, and the terminal displays the plan contents to the user.

[3118] Input: Date plan

[3119] Output: Display data

[3120] Specific operation: The device application visually displays the date plan.

[3121] Step 8:

[3122] User verification and fine-tuning

[3123] The user can review the displayed date plan and make adjustments to the time and activities as needed.

[3124] Input: Display data, user fine-tuning

[3125] Output: Confirmed date plan

[3126] Specific actions: Adjust the plan parameters through the user interface.

[3127] Step 9:

[3128] Confirmation of reservation

[3129] The server automatically reserves the activity for the reservation system based on the confirmed date plan.

[3130] Input: Confirmed date plan

[3131] Output: Reservation data

[3132] Specific operation: Call the reservation API, make the necessary reservations, and receive the results.

[3133] Step 10:

[3134] Confirmation Notice

[3135] The server transmits the confirmed reservation data to the terminal, and the terminal notifies the user.

[3136] Input: Reservation data

[3137] Output: Notification message

[3138] Specific actions: Notify the user through the notification system.

[3139] Overall summary based on the process flow:

[3140] The system receives and analyzes user input, adjusts it with emotional data, and then uses a generative AI model to create an optimal date plan. The user can then review and fine-tune the plan in virtual reality, and finally, the plan is automatically booked through the reservation system, providing users with a special experience.

[3141] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[3142] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[3143] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[3144] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[3145] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[3146] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[3147] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[3148] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[3149] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[3150] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[3151] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[3152] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[3153] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[3154] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[3155] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[3156] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[3157] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[3158] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[3159] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[3160] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[3161] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[3162] The following is further disclosed regarding the above embodiment.

[3163] (Claim 1)

[3164] means for receiving user input;

[3165] a means for parsing user input; and

[3166] a means for sending requests to a generative AI model based on the analyzed data;

[3167] a means for receiving a date plan from the generative AI model;

[3168] A means to display the received date plan to the user,

[3169] a means for accepting user confirmation and refinement;

[3170] A means for making a reservation for an activity included in a date plan to a reservation system;

[3171] A system including:

[3172] (Claim 2)

[3173] 10. The system of claim 1, wherein the system analyzes inputs including user preferences, budget, and date objectives.

[3174] (Claim 3)

[3175] 2. The system of claim 1, wherein the generated date plan includes at least a date, a location, an activity, and a total cost.

[3176] "Example 1"

[3177] (Claim 1)

[3178] means for receiving user input;

[3179] a means for parsing user input; and

[3180] a means for sending requests to a generative AI model based on the analyzed data;

[3181] a means for receiving a date plan from the generative AI model;

[3182] A means to display the received date plan to the user,

[3183] a means for accepting user confirmation and refinement;

[3184] A means for making a reservation for an activity included in a date plan to a reservation system;

[3185] A means for creating a prompt sentence to be used for requesting generation of a date plan;

[3186] A means of formatting the details of the date plan;

[3187] A system including:

[3188] (Claim 2)

[3189] 10. The system of claim 1, wherein the system analyzes inputs including user preferences, budget, and date objectives.

[3190] (Claim 3)

[3191] 2. The system of claim 1, wherein the generated date plan includes at least a date, a location, an activity, and a total cost.

[3192] "Application Example 1"

[3193] (Claim 1)

[3194] means for receiving user input;

[3195] a means for parsing user input; and

[3196] a means for sending requests to a generative AI model based on the analyzed data;

[3197] a means for receiving a meal plan from the generative AI model;

[3198] a means for displaying the received meal plan to the user;

[3199] a means for accepting user confirmation and refinement;

[3200] a means for ordering and delivering food;

[3201] A system including:

[3202] (Claim 2)

[3203] 10. The system of claim 1, wherein the system analyzes inputs including user preferences, budget, and delivery time.

[3204] (Claim 3)

[3205] 10. The system of claim 1, wherein the generated meal plan includes at least a date and time, meal type, order contents, and total cost.

[3206] "Example 2: Combining Emotion Engines"

[3207] (Claim 1)

[3208] means for receiving user input;

[3209] a means for parsing user input; and

[3210] a means for sending requests to a generative AI model based on the analyzed data;

[3211] a means for receiving a date plan from the generative AI model;

[3212] A means to display the received date plan to the user,

[3213] a means for accepting user confirmation and refinement;

[3214] A means for making a reservation for an activity included in a date plan to a reservation system;

[3215] a means for recognizing user emotions and adjusting the analysis data using an emotion engine;

[3216] A system including:

[3217] (Claim 2)

[3218] 10. The system of claim 1, wherein the system analyzes inputs including user preferences, budget, and date objectives.

[3219] (Claim 3)

[3220] 2. The system of claim 1, wherein the generated date plan includes at least a date, a location, an activity, and a total cost.

[3221] "Application example 2 when combining emotion engines"

[3222] (Claim 1)

[3223] means for receiving user input;

[3224] a means for parsing user input; and

[3225] a means for sending requests to a generative AI model based on the analyzed data;

[3226] a means for receiving a date plan from the generative AI model;

[3227] A means to display the received date plan to the user,

[3228] a means for accepting user confirmation and refinement;

[3229] A means for making a reservation for an activity included in a date plan to a reservation system;

[3230] A means for recognizing user emotions and adjusting analytical data by an emotion engine;

[3231] A means to view and fine-tune date plans in virtual reality;

[3232] A system including:

[3233] (Claim 2)

[3234] 10. The system of claim 1, wherein the system analyzes inputs including user preferences, budget, and date objectives.

[3235] (Claim 3)

[3236] 2. The system of claim 1, wherein the generated date plan includes at least a date, a location, an activity, and a total cost. [Explanation of symbols]

[3237] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for receiving user input; a means for parsing user input; and a means for sending requests to a generative AI model based on the analyzed data; a means for receiving a date plan from the generative AI model; A means to display the received date plan to the user, a means for accepting user confirmation and refinement; A means for making a reservation for an activity included in a date plan to a reservation system; A system including:

2. 10. The system of claim 1, wherein the system analyzes inputs including user preferences, budget, and date objectives.

3. The system of claim 1 , wherein the generated date plan includes at least a date, a location, an activity, and a total cost.

Images