System

Abstract

To provide a system for enabling a user to quickly and efficiently prepare an optimal travel plan, and to perform a reservation procedure without any labor.SOLUTION: The system includes an input unit configured to input a travel request of a user, an analysis / generation unit configured to analyze the travel request received from the input unit and generate a travel plan, a presentation unit configured to present the travel plan generated by the generation unit to the user, an evaluation / feedback reception unit configured to receive an evaluation or feedback of the user with respect to the travel plan presented by the presentation unit, a regeneration unit configured to adjust the travel plan based on the evaluation or feedback received by the evaluation / feedback reception unit, a reservation unit configured to execute a reservation of a transportation and an accommodation facility based on the travel plan adjusted by the regeneration unit, and a notification unit configured to notify the user whether the reservation is completed.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When today's busy users plan a trip, they face the challenge of complicated procedures such as determining specific destinations and routes, and making reservations. Creating a travel plan and making multiple reservations takes time and effort, making it difficult to put together a satisfactory travel plan. Furthermore, systems for sending reminders up until the day of travel or handling sudden changes are often not in place. This prevents users from enjoying a comfortable trip. [Means for solving the problem]

[0005] The present invention provides a system that includes an input means for inputting a user's travel requests, an analysis / generation means for analyzing the received travel requests and generating a travel plan, a presentation means for presenting the generated travel plan to the user, an evaluation / feedback receiving means for receiving the user's evaluation or feedback on the presented travel plan, a regeneration means for adjusting the travel plan based on the evaluation or feedback, a reservation means for making reservations for transportation and accommodation based on the adjusted travel plan, and a notification means for notifying the user whether the reservation has been completed. This allows users to quickly and efficiently create an optimal travel plan and complete the reservation procedure hassle-free. Furthermore, the system provides reminders based on the travel itinerary and notifies users of proposed changes in the event of weather or transportation disruptions, making the user's travel experience more comfortable and safe.

[0006] "Input means" refers to an interface or device that allows a user to input travel requests.

[0007] The "analysis and generation means" refers to a system or algorithm that analyzes the travel requests received from the input means and generates a travel plan that meets the user's needs.

[0008] The "presentation means" refers to a device or method for visually or audibly presenting to the user the travel plan generated by the analysis and generation means.

[0009] The "evaluation and feedback receiving means" refers to an interface or system that allows users to evaluate and provide feedback on the travel plan presented by the presentation means.

[0010] The "regeneration means" refers to a system or algorithm that adjusts or regenerates a travel plan based on the user's ratings and feedback received by the rating and feedback receiving means.

[0011] "Reservation Facility" means a system or process for making transportation and accommodation reservations based on the travel plan adjusted by the Regeneration Facility.

[0012] "Notification means" refers to an interface or system that notifies the user of the results of a reservation made through the reservation means. It also includes functions for notifying reminders and proposed changes on the day of the trip. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0014] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0017] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0018] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0019] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0021] [First embodiment]

[0022] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0023] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0026] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0029] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0034] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the reservation process. This system is an AI-based travel plan creation support system, and is configured and operates as follows:

[0035] System configuration

[0036] This system is broadly composed of the following components:

[0037] 1. Input means (terminal)

[0038] 2. Analysis and generation means (server)

[0039] 3. Presentation Method (Terminal and Server)

[0040] 4. Evaluation and feedback receiving means (terminal and server)

[0041] 5. Regeneration means (server)

[0042] 6. Reservation Method (Server)

[0043] 7. Notification Methods (Server and Terminal)

[0044] Program processing

[0045] Input method (terminal)

[0046] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[0047] Analysis and generation means (server)

[0048] The server analyzes the user's travel request data received from the device. This analysis uses natural language processing technology to extract specific keywords from the user's request. For example, if the server receives requests such as "family trip," "place rich in nature," "September," and "3 nights, 4 days," it will generate multiple suitable travel plans based on this information.

[0049] Presentation method (terminal and server)

[0050] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[0051] Evaluation and feedback receiving means (terminal and server)

[0052] Users can evaluate the plans presented and enter their feedback into the terminal. This feedback is sent from the terminal to the server. For example, users can enter feedback such as, "I like the Okinawa plan, but I would like to reduce the budget."

[0053] Regeneration means (server)

[0054] The server then adjusts the travel plan based on the user's ratings and feedback. This adjustment includes selecting the optimal accommodation and transportation options within the user's budget. For example, it regenerates a budget-friendly Okinawa resort plan.

[0055] Reservation method (server)

[0056] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[0057] Notification method (server and terminal)

[0058] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[0059] Specific examples

[0060] 1. When a user plans a trip

[0061] The user uses a terminal to input requests such as "I want to travel with my family to a place rich in nature," "3 nights and 4 days in September," and "My budget is 200,000 yen." Based on this, the server generates and presents two plans: one to enjoy the great outdoors of Hokkaido, and another to relax at a resort in Okinawa. If the user selects the Okinawa plan and submits feedback that they would like to keep the budget a little lower, the server displays a revised plan that fits within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[0062] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[0063] The processing flow will be explained below.

[0064] Step 1:

[0065] Display of input screen (terminal)

[0066] The device displays a screen for the user to enter basic information about the trip, including fields for inputting information such as the purpose of the trip, budget, duration of the trip, number of people traveling with the user, and type of destination.

[0067] Step 2:

[0068] User information input (user)

[0069] The user inputs their travel requirements into the device, such as "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days."

[0070] Step 3:

[0071] Sending input data (terminal)

[0072] The terminal sends the entered user information to the server. The sent data includes information from all input fields.

[0073] Step 4:

[0074] Receiving user information (server)

[0075] The server receives the user information sent from the terminal and prepares to analyze the received data.

[0076] Step 5:

[0077] Data analysis (server)

[0078] The server analyzes the received user information using natural language processing technology, extracting keywords such as "family trip," "nature," "September," and "3 nights, 4 days" from the user's request.

[0079] Step 6:

[0080] Travel plan generation (server)

[0081] Based on the analyzed keywords, the server generates multiple travel plans that match the user's requests, such as "a plan to enjoy the great outdoors of Hokkaido" and "a plan to relax at a resort in Okinawa."

[0082] Step 7:

[0083] Sending and displaying plans (server and device)

[0084] The server sends the generated travel plan to the terminal, which then displays it to the user. The details of each plan are displayed, allowing the user to check each plan.

[0085] Step 8:

[0086] User evaluation and feedback on the plan

[0087] The user evaluates the presented plans and inputs feedback, such as "The Okinawa plan is good, but I would like to reduce the budget."

[0088] Step 9:

[0089] Send Feedback (Device)

[0090] The device sends user feedback to the server, including ratings and desired modifications.

[0091] Step 10:

[0092] Receiving Feedback (Server)

[0093] The server receives the feedback sent from the device, and based on the feedback, it prepares to adjust the plan again.

[0094] Step 11:

[0095] Re-adjust plan (server)

[0096] The server analyzes the user's feedback and adjusts the travel plan. Specifically, it selects alternative accommodations and transportation options that fit the user's budget. For example, it adjusts the plan to "an Okinawa resort plan that fits within the user's budget."

[0097] Step 12:

[0098] Sending and displaying realignment plans (server and terminal)

[0099] The re-adjusted plan is sent from the server to the terminal again and displayed to the user, who can then check the plan again.

[0100] Step 13:

[0101] Final plan selection (user)

[0102] The user checks the re-arranged plans, selects the desired plan, and confirms the reservation. For example, the user selects "Okinawa resort plan within budget."

[0103] Step 14:

[0104] Send reservation data (terminal)

[0105] The terminal sends the user's final selection to the server, which starts the reservation procedure.

[0106] Step 15:

[0107] Reservation execution (server)

[0108] The server executes the booking process, booking airline tickets, accommodations, rental cars, etc. through API integration, making all the necessary reservations in one place.

[0109] Step 16:

[0110] Notification of reservation completion (server)

[0111] After the reservation is completed, the server sends the result to the terminal.

[0112] Step 17:

[0113] Display of reservation completion (terminal)

[0114] The terminal receives a reservation completion notification from the server and displays it to the user. For example, it displays "Your flight, hotel, and rental car reservations have been completed."

[0115] Step 18:

[0116] Reminder notification settings (server)

[0117] The server sets reminder notifications based on the travel itinerary, specifically, setting the notification to be sent the day before departure.

[0118] Step 19:

[0119] Sending reminder notifications (server and device)

[0120] As the travel date approaches, the server sends the configured reminder notification to the device, which then displays it to the user. For example, it might say, "It's forecast to rain tomorrow. Please bring an umbrella."

[0121] Step 20:

[0122] Notification of changes (server and terminal)

[0123] In the event of weather or transportation disruptions, the server will provide the user with suggested changes based on the information it has acquired, which the device will then display to the user and provide them with countermeasures.

[0124] Example 1

[0125] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0126] The objective of this study is to provide a system that allows users to easily create travel plans that reflect their detailed requests when planning a trip, and that also allows them to efficiently complete reservation procedures based on those plans. Conventional systems require users to use multiple websites and services to gather information, create their own plans, and make reservations individually, which takes a lot of time and effort.

[0127] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0128] In this invention, the server includes information input means for inputting a user's travel requests, analysis and generation means for analyzing the travel requests received from the information input means and generating a travel plan, and display means for presenting the travel plan generated by the generation means to the user. This enables the user to easily generate a travel plan that reflects the user's requests in detail and quickly select the most suitable plan from the proposed plans.

[0129] "Information input means" refers to a device or software that provides an interface for users to input their travel requests and conditions.

[0130] The "analysis and generation means" refers to a processing device or software in the server that analyzes the user's travel requests received from the information input means and generates an appropriate travel plan.

[0131] The "display means" is a device or software for visually presenting the generated travel plan to the user.

[0132] "Evaluation and feedback receiving means" refers to a device or software that allows a user to input and receive evaluations and feedback on a presented travel plan.

[0133] The "regeneration means" refers to a processing device or software in the server for readjusting the travel plan based on the user's rating or feedback received by the rating / feedback receiving means.

[0134] The "reservation means" refers to a processing device or software in the server for making reservations for transportation and accommodation based on the travel plan re-adjusted by the regeneration means.

[0135] The "notification means" is a device or software for notifying the user that the reservation procedure has been completed.

[0136] This invention is a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the booking process. This system uses AI to create travel plans and can optimize them based on user feedback.

[0137] System configuration

[0138] This system is broadly composed of the following components:

[0139] 1. Information input means (terminal)

[0140] 2. Analysis and generation means (server)

[0141] 3. Display means (terminal and server)

[0142] 4. Evaluation and feedback receiving means (terminal and server)

[0143] 5. Regeneration means (server)

[0144] 6. Reservation Method (Server)

[0145] 7. Notification Methods (Server and Terminal)

[0146] System Operation

[0147] Information input means (terminal)

[0148] The user uses the terminal interface to enter basic information about the trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of destination, etc.) Once the user enters this information into the form and clicks the "Submit" button, the data is sent to the server.

[0149] Analysis and generation means (server)

[0150] The server analyzes the user's travel request data received from the device. This analysis uses natural language processing technology (e.g., Python's Natural Language Toolkit (NLTK) or Google Cloud Natural Language API) to extract specific keywords from the user's requests. Next, it generates multiple travel plans based on the extracted keywords using a generative AI model (e.g., OpenAI's GPT-3).

[0151] Display means (terminal and server)

[0152] The generated travel plan is sent from the server to the terminal and visually displayed to the user. The user can then check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[0153] Evaluation and feedback receiving means (terminal and server)

[0154] The user can evaluate the presented plans and input feedback into the terminal. This feedback is sent from the terminal to the server and received by the evaluation / feedback receiving means. For example, the user can input feedback such as "I like the Okinawa plan, but I would like to reduce the budget."

[0155] Regeneration means (server)

[0156] The server then adjusts the travel plan based on the received feedback. When regenerating the plan, it selects the optimal accommodation and transportation options within the user's budget based on the user's requests. For example, it regenerates a budget-friendly Okinawa resort plan.

[0157] Reservation method (server)

[0158] Once the adjusted travel plan is confirmed, the server processes the transportation and accommodation reservations, specifically using APIs of multiple providers (e.g., Expedia API and Booking.com API) to perform bulk reservations, including airline ticket reservations, hotel reservations, and rental car reservations.

[0159] Notification method (server and terminal)

[0160] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[0161] Specific examples

[0162] 1. When a user plans a trip

[0163] The user uses a terminal and enters the following prompt text:

[0164] Example prompt sentence:

[0165] "I want to travel with my family to a place rich in nature." "3 nights, 4 days in September." "Budget is 200,000 yen."

[0166] Based on this, the server generates and displays the following itinerary:

[0167] A 3-night, 4-day plan to enjoy Hokkaido's great outdoors

[0168] Relax at an Okinawa resort for 3 nights and 4 days

[0169] If a user selects a plan for Okinawa and submits feedback that "I would like to keep the budget a little lower," the server will generate and display a plan that is adjusted to fit within the budget (for example, by changing the accommodation to reduce costs).

[0170] Once the user has confirmed the plan and confirmed the reservation, the server will complete the bulk reservation of the flight, hotel, rental car, etc., and notify the user of the completion. In addition, a reminder will be sent the day before the trip, and if the weather is bad, information on "alternative plans" or "change of destination" will be provided.

[0171] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[0172] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0173] Step 1:

[0174] Entering information (terminal)

[0175] The user accesses the terminal interface and inputs their travel requests (purpose of travel, budget, travel period, number of accompanying persons, type of travel destination, etc.).

[0176] Input: Specific prompt example: "I want to travel to a place rich in nature with my family," "3 nights and 4 days in September," "Budget is 200,000 yen."

[0177] Output: The input data is saved in the device in JSON format or similar.

[0178] Specific operation: The user enters information into the form and clicks the "Submit" button. The device converts the data into structured data and prepares it for transmission to the server.

[0179] Step 2:

[0180] Sending data (from device to server)

[0181] The terminal transmits the user's input data to the server.

[0182] Input: Travel request data entered by the user

[0183] Output: Travel request data is sent to the server

[0184] Specific operation: The terminal generates an HTTP request and sends the request including the user's input data to the server.

[0185] Step 3:

[0186] Data analysis (server)

[0187] The server receives the user's travel request data and analyzes it using natural language processing technology.

[0188] Input: Travel request data sent from the terminal

[0189] Output: Keyword extraction results (e.g., family trip, nature, budget 200,000 yen, September, 3 nights, 4 days)

[0190] Specific operation: The server extracts keywords from text data using Python's NLTK or Google Cloud Natural Language API.

[0191] Step 4:

[0192] Travel plan generation (server)

[0193] The server generates multiple travel plans using a generative AI model based on the extracted keywords.

[0194] Input: Extracted keyword data

[0195] Output: A list of generated travel plans (e.g., a 3-night, 4-day plan to enjoy the natural beauty of Hokkaido, or a 3-night, 4-day plan to relax at a resort in Okinawa)

[0196] How it works: The server uses a generative AI model such as OpenAI's GPT-3 to generate a travel plan in text format that matches the user's requests.

[0197] Step 5:

[0198] Displaying travel plans (from server to device)

[0199] The server transmits the generated travel plan to the terminal, which presents it to the user.

[0200] Input: Generated itinerary

[0201] Output: The itinerary displayed to the user

[0202] Specific operation: The server sends the generated plan in JSON format to the terminal, and the terminal converts the received data into HTML or the app UI and displays it.

[0203] Step 6:

[0204] Receiving user ratings and feedback (from device to server)

[0205] The user inputs an evaluation and feedback on the presented plan.

[0206] Input: User's rating and feedback (e.g., "I liked the Okinawa plan, but I want to reduce the budget.")

[0207] Output: Feedback is sent from the device to the server.

[0208] Specific operation: The user enters a comment in the feedback form and clicks the "Submit" button. The device sends the feedback to the server.

[0209] Step 7:

[0210] Regenerate travel plan (server)

[0211] The server readjusts the travel plan based on the received feedback.

[0212] Input: Feedback data from users

[0213] Output: Regenerated travel plan (e.g., budget Okinawa resort plan)

[0214] Specific operation: The server runs the generative AI model again and regenerates a plan based on the new conditions.

[0215] Step 8:

[0216] Execution of reservation procedures (server)

[0217] The user confirms the final plan and confirms the reservation. The server processes the reservations for transportation and accommodation.

[0218] Input: Final travel plan approved by the user

[0219] Output: Reservation completion notification

[0220] Specific operation: The server uses the Expedia API and Booking.com API to complete the booking process for airline tickets and hotels in bulk.

[0221] Step 9:

[0222] Notification of reservation completion (from server to device)

[0223] The server notifies the user that the reservation is complete, and also provides reminders based on the travel itinerary and information on how to deal with weather and transportation disruptions on the day of the trip.

[0224] Input: reservation completion data, travel itinerary data

[0225] Output: User notification

[0226] Specific operation: The server uses email or SMS to send reservation completion notifications and reminder notifications to the user.

[0227] This allows users to efficiently create travel plans and automate the booking process.

[0228] (Application example 1)

[0229] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0230] Currently, users spend a lot of time and effort planning their trips and creating optimal travel plans. Furthermore, it is difficult to plan efficiently because reservations for transportation and accommodations must be made separately. Furthermore, planning requires appropriately combining transportation methods, which is no easy task. In particular, when using autonomous vehicles as a modern means of transportation, a system is needed that allows for smooth generation and booking of travel plans that include these vehicles.

[0231] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0232] In this invention, the server includes: an input means for inputting a user's travel requests; an analysis and generation means for analyzing the travel requests received from the input means and generating a travel plan; a presentation means for presenting the travel plan generated by the generation means to the user; an evaluation and feedback receiving means for receiving a user's rating or feedback on the travel plan presented by the presentation means; a regeneration means for adjusting the travel plan based on the rating or feedback received by the evaluation and feedback receiving means; a reservation means for reserving transportation and accommodation based on the travel plan adjusted by the regeneration means; a notification means for notifying the user whether the reservation is complete; an input means for inputting the user's requests by voice or touch to a display device in an autonomous vehicle; and a presentation means for presenting a travel plan that includes the autonomous vehicle as a means of transportation. This enables users to plan their trips efficiently and comfortably and enjoy a smooth journey using the autonomous vehicle.

[0233] "Input means" refers to a device or interface that allows a user to input travel requests.

[0234] "Analysis and generation means" refers to a system or algorithm that analyzes the user's travel requests and generates the optimal travel plan.

[0235] The "presentation means" refers to a device or interface for visually or audibly presenting the generated travel plan to the user.

[0236] "Evaluation and feedback receiving means" refers to a system or interface for receiving evaluations and feedback made by users regarding travel plans.

[0237] A "regenerator" is a system or algorithm that adjusts and regenerates a travel plan based on the ratings and feedback received.

[0238] "Reservation Channel" means a system or interface for booking transportation and accommodation based on a coordinated travel plan.

[0239] "Notification means" refers to a system or device that notifies the user whether the reservation has been completed or other important information.

[0240] A "display device" is a display or touch panel installed in an autonomous vehicle for users to input and confirm information.

[0241] "Voice input" refers to an interface or technology that allows users to input travel requests and other information by voice.

[0242] "Touch input" refers to the interface and technology that allows users to input travel requests and other information using a touchscreen.

[0243] An "autonomous vehicle" is a vehicle that operates autonomously and does not require human operation.

[0244] A "travel plan" is detailed information such as a travel schedule, route, accommodation, and transportation that is proposed based on the user's requests.

[0245] The present invention relates to a system for efficiently assisting users in planning their trips and for using autonomous vehicles as a means of transportation. Hereinafter, a program and a processing procedure of the system will be described as a specific embodiment.

[0246] System Program

[0247] The server includes an input means for inputting travel requests from users, an analysis and generation means for analyzing the received travel requests and generating a travel plan, a presentation means for presenting the generated travel plan to the user, an evaluation and feedback receiving means for receiving ratings and feedback from users, a regeneration means for readjusting the travel plan based on the received ratings and feedback, a reservation means for reserving transportation and accommodations based on the adjusted travel plan, and a notification means for notifying the user of the completion of the reservation. Furthermore, the display devices (touch panel and voice input device) inside the autonomous vehicle are used as user input means.

[0248] Hardware and Software

[0249] Hardware: Smart displays, touch panels, microphones in autonomous vehicles, and users' smartphones

[0250] Software: Natural language processing engines (e.g., Google Cloud Natural Language API), AI models (e.g., GPT-4), booking APIs (e.g., Amadeus API)

[0251] Processing Description

[0252] The server receives information about the user's travel requests via voice or touch input on a display device inside the autonomous vehicle. The received information is analyzed using natural language processing technology. A natural language processing engine such as Google Cloud Natural Language API is used for this analysis. Based on the analysis results, an AI model (e.g., GPT-4) is used to generate multiple travel plans.

[0253] The generated travel plans are visually presented on a display inside the autonomous vehicle. The user selects a suitable plan from the list and provides their rating and feedback. This feedback is sent back to the server, where the regeneration means adjusts the plan. Based on the adjusted plan, the reservation means operates and makes reservations for transportation and accommodation. This reservation is made using a reservation system such as the Amadeus API.

[0254] Once the reservation is complete, the notification means will be activated and the result will be notified to the user. This will provide pre-travel reminders and weather information for the day, allowing the user to carry out their travel plans with peace of mind.

[0255] Specific examples

[0256] For example, if a user in a self-driving car says, "I want to go on a trip with my family to a place rich in nature. My budget is under 200,000 yen. I want to go for three nights and four days in September," the system will analyze this and generate the optimal travel plan. If the user sends feedback from one of the generated plans saying, "I would like a different plan with a lower budget," the system will generate a new plan and present it again.

[0257] This will enable users to plan trips efficiently and comfortably, and ensure a smooth journey using autonomous vehicles.

[0258] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0259] Step 1: User Input

[0260] Users input their travel needs into the display device inside the self-driving car by voice or touch. For voice input, a microphone is used, and for touch input, a touch panel is used. The input information includes basic information such as the purpose of the trip, budget, duration, number of accompanying people, and type of travel destination.

[0261] Step 2: Receiving data

[0262] The server receives the input data sent from the autonomous vehicle and stores the input travel request data on the server side.

[0263] Step 3: Data analysis

[0264] The server analyzes the stored travel request data. This analysis uses a natural language processing engine (e.g., Google Cloud Natural Language API). Specifically, it extracts keywords and desired conditions from the user's input and structures this data.

[0265] Input: Travel request data

[0266] Output: Parsed keywords and conditions

[0267] Step 4: Create a travel plan

[0268] The server uses the analyzed keywords and conditions to generate multiple travel plans using an AI model (e.g., GPT-4), each of which includes different destinations, activities, and accommodations.

[0269] Input: Parsed keywords and conditions

[0270] Output: Multiple itineraries

[0271] Step 5: Submit your travel plan

[0272] The server sends the generated travel plan to the user's device, where it is visually presented on a display inside the autonomous vehicle. The user can then check the details of the presented plan.

[0273] Input: Generated itinerary

[0274] Output: Travel plan displayed on the user's device

[0275] Step 6: Receiving feedback

[0276] The user inputs their evaluation and feedback on the presented travel plan into the display device, and the input feedback data is sent to the server.

[0277] Input: User feedback

[0278] Output: Feedback data sent to the server

[0279] Step 7: Regenerate

[0280] The server analyzes the received feedback data and adjusts the travel plan through a regeneration means, which includes the process of regenerating an appropriate plan based on the user's new requests and feedback.

[0281] Input: Feedback data

[0282] Output: Reworked itinerary

[0283] Step 8: Resubmit

[0284] The server then transmits the regenerated travel plan to the user's terminal, where the user can check the re-presented plan on the display.

[0285] Input: rearranged travel plans

[0286] Output: Realignment plan displayed on the user's device

[0287] Step 9: Reservation execution

[0288] The server makes reservations for transportation and accommodation based on the user's final travel plan, using a booking API (e.g., Amadeus API).

[0289] Input: Finalized travel plans

[0290] Output: Reservation completion data

[0291] Step 10: Notification

[0292] The server notifies the user whether the reservation is successful or not, and may also provide itinerary reminders, weather forecasts for the day, and suggested changes in case of transportation disruptions.

[0293] Input: Booking completion data and travel information

[0294] Output: Notification information sent to the user's device

[0295] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0296] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the reservation process. This system is a travel plan creation support system that utilizes AI and an emotion engine, and is configured and operates as follows:

[0297] System configuration

[0298] This system is broadly composed of the following components:

[0299] 1. Input means (terminal)

[0300] 2. Analysis and generation means (server)

[0301] 3. Presentation Method (Terminal and Server)

[0302] 4. Evaluation and feedback receiving means (terminal and server)

[0303] 5. Regeneration means (server)

[0304] 6. Reservation Method (Server)

[0305] 7. Notification Methods (Server and Terminal)

[0306] 8. Emotion engine (server and terminal)

[0307] Program processing

[0308] Input method (terminal)

[0309] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[0310] Emotion engine (server and terminal)

[0311] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions, which are then used as key elements in analyzing and generating the user's travel requests.

[0312] Analysis and generation means (server)

[0313] The server analyzes the user's travel request data received from the device and the emotion data obtained from the emotion engine. It uses natural language processing technology for the analysis, comprehensively evaluating the user's requests and emotions to extract necessary keywords. For example, if a user inputs "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "three nights and four days" while showing a relaxed expression, the server will use this data to generate the optimal travel plan for the user.

[0314] Presentation method (terminal and server)

[0315] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[0316] Evaluation and feedback receiving means (terminal and server)

[0317] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to generate a new plan. For example, a user can enter feedback such as "I like the Okinawa plan, but I would like to reduce the budget" and the associated emotions.

[0318] Regeneration means (server)

[0319] The server then re-adjusts the travel plan based on the user's feedback and sentiment data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly Okinawa resort plan.

[0320] Reservation method (server)

[0321] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[0322] Notification method (server and terminal)

[0323] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[0324] Specific examples

[0325] 1. When a user plans a trip

[0326] The user uses a device to input requests such as "I want to travel with my family to a place rich in nature," "3 nights, 4 days in September," and "budget of 200,000 yen." At the same time, the emotion engine analyzes the user's facial expressions and tone of voice and recognizes that the user is in a relaxed state. Based on this, the server generates and presents plans to enjoy the great outdoors of Hokkaido and to relax at a resort in Okinawa. If the user selects the Okinawa plan and submits feedback that they would like to keep the budget a little lower, the server analyzes that feedback and the user's emotions and displays a revised plan within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[0327] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[0328] The processing flow will be explained below.

[0329] Step 1:

[0330] Display of input screen (terminal)

[0331] The device displays a screen for the user to enter basic information about the trip, including fields for inputting information such as the purpose of the trip, budget, duration of the trip, number of people traveling with the user, and type of destination.

[0332] Step 2:

[0333] User information input (user)

[0334] The user inputs their travel requirements into the device. For example, they input information such as "family trip," "budget 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days." At the same time, the user's facial expressions and tone of voice are analyzed by the emotion engine.

[0335] Step 3:

[0336] Sending input data and emotion data (terminal)

[0337] The terminal transmits the input user information and emotion data from the emotion engine to the server. The transmitted data includes information on all input fields and the emotional state.

[0338] Step 4:

[0339] Receiving user information and emotion data (server)

[0340] The server receives the user information and emotion data sent from the device and prepares to analyze the received data.

[0341] Step 5:

[0342] Data analysis (server)

[0343] The server uses natural language processing technology to analyze the received user information and emotional data, extracting keywords such as "family trip," "nature," "September," and "three nights and four days" from the user's request, and uses the emotional data to determine the user's psychological state (e.g., whether they are relaxed).

[0344] Step 6:

[0345] Travel plan generation (server)

[0346] The server generates multiple travel plans that match the user's needs based on the analyzed keywords and emotion data, such as "a plan to enjoy the great outdoors of Hokkaido" and "a plan to relax at a resort in Okinawa."

[0347] Step 7:

[0348] Sending and displaying plans (server and device)

[0349] The server sends the generated travel plan to the terminal, which visually displays the received plan to the user. Specific plan details are displayed, allowing the user to check each plan.

[0350] Step 8:

[0351] User evaluation and feedback on the plan

[0352] The user evaluates the presented plans and enters feedback. For example, they may enter a comment such as, "The Okinawa plan is good, but I would like to reduce the budget." In this case, the emotion engine also analyzes the user's facial expressions and tone of voice to collect emotional data in real time.

[0353] Step 9:

[0354] Sending feedback and emotional data (device)

[0355] The device transmits user feedback and emotion data to the server, including user ratings and desired modifications.

[0356] Step 10:

[0357] Receiving feedback and emotion data (server)

[0358] The server receives the feedback and emotion data sent from the device, and prepares to adjust the plan again based on the feedback.

[0359] Step 11:

[0360] Re-adjust plan (server)

[0361] The server analyzes the user's feedback and emotional data and adjusts the travel plan accordingly. Specifically, it selects alternative accommodations and transportation options that fit the user's budget. For example, it adjusts the plan to "an Okinawa resort plan within the user's budget."

[0362] Step 12:

[0363] Sending and displaying realignment plans (server and terminal)

[0364] The server sends the re-adjusted plan to the terminal, which visually displays the received plan to the user again, allowing the user to review the plan again.

[0365] Step 13:

[0366] Final plan selection (user)

[0367] The user checks the re-arranged plans, selects the desired plan, and confirms the reservation. For example, the user selects "Okinawa resort plan within budget."

[0368] Step 14:

[0369] Send reservation data (terminal)

[0370] The terminal sends the user's final selection to the server, which starts the reservation procedure.

[0371] Step 15:

[0372] Reservation execution (server)

[0373] The server executes the booking process, booking airline tickets, accommodations, rental cars, etc. through API integration, making all the necessary reservations in one place.

[0374] Step 16:

[0375] Notification of reservation completion (server)

[0376] After the reservation is completed, the server sends the result to the terminal.

[0377] Step 17:

[0378] Display of reservation completion (terminal)

[0379] The terminal receives a reservation completion notification from the server and displays it to the user. For example, it displays "Your flight, hotel, and rental car reservations have been completed."

[0380] Step 18:

[0381] Reminder notification settings (server)

[0382] The server sets reminder notifications based on the travel itinerary, specifically, setting the notification to be sent the day before departure.

[0383] Step 19:

[0384] Sending reminder notifications (server and device)

[0385] As the travel date approaches, the server sends the configured reminder notification to the device, which then displays it to the user. For example, it might say, "It's forecast to rain tomorrow. Please bring an umbrella."

[0386] Step 20:

[0387] Notification of changes (server and terminal)

[0388] In the event of weather or transportation disruptions, the server will provide the user with suggested changes based on the information it has acquired, which the device will then display to the user and provide them with countermeasures.

[0389] Example 2

[0390] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0391] Conventional travel plan creation systems generate travel plans based solely on information entered by the user, which means they cannot fully reflect the user's latent desires and emotions. It is also difficult to efficiently collect and incorporate feedback on proposed plans, which can result in low user satisfaction. Furthermore, because reservation procedures and change notifications are not centralized, users must perform multiple procedures individually, which is time-consuming and laborious.

[0392] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting a user's travel requests; an analysis and generation means for analyzing the travel requests received from the input means and generating a travel plan; a presentation means for presenting the travel plan generated by the generation means to the user; an emotion engine for analyzing the user's biometric information to acquire emotion data; an evaluation and feedback receiving means for receiving the user's evaluation or feedback on the travel plan presented by the presentation means; a regeneration means for adjusting the travel plan based on the evaluation or feedback and emotion data received by the evaluation and feedback receiving means; a reservation means for reserving transportation and accommodation facilities based on the travel plan adjusted by the regeneration means; and a notification means for notifying the user whether the reservation has been completed. This enables the generation of an optimal travel plan that reflects the user's potential requests and emotions, rapid plan readjustment based on feedback, and unified reservation procedures and change notification.

[0393] "Input means" refers to a device or software that provides an interface for a user to input travel requests.

[0394] The "analysis and generation means" is a means for analyzing the travel requests received from the input means and generating an appropriate travel plan.

[0395] The "presentation means" is a means for visually or audibly presenting the travel plan generated by the generation means to the user.

[0396] An "emotion engine" is a device or software that analyzes biometric information from a user (e.g., facial expressions and tone of voice) to obtain emotional data.

[0397] The "evaluation / feedback receiving means" is a means for collecting user evaluations or feedback on the travel plan presented by the presentation means.

[0398] The "regeneration means" is a means for adjusting the travel plan based on the evaluation or feedback and emotion data received by the evaluation / feedback receiving means.

[0399] The "reservation means" is a means for making reservations for transportation and accommodation facilities based on the travel plan adjusted by the regeneration means.

[0400] The "notification means" is a means for notifying the user whether the reservation has been completed or not, and for providing reminders or suggested changes as necessary.

[0401] "Natural language processing technology" is a computer technology for analyzing, understanding, and generating text data, and is used to analyze travel requests and emotional data.

[0402] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the booking process. This system is a travel plan creation support system that utilizes AI and an emotion engine, and is configured and operates as follows:

[0403] System configuration

[0404] This system is broadly composed of the following components:

[0405] 1. Input means (terminal)

[0406] 2. Analysis and generation means (server)

[0407] 3. Presentation Method (Terminal and Server)

[0408] 4. Evaluation and feedback receiving means (terminal and server)

[0409] 5. Regeneration means (server)

[0410] 6. Reservation Method (Server)

[0411] 7. Notification Methods (Server and Terminal)

[0412] 8. Emotion engine (server and terminal)

[0413] Program processing

[0414] Input method (terminal)

[0415] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[0416] Emotion engine (server and terminal)

[0417] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions. This information is used as an important factor in analyzing and generating the user's travel requests. For example, it can determine whether the user is in a relaxed state when entering information.

[0418] Analysis and generation means (server)

[0419] The server analyzes the user's travel request data received from the device and the emotion data obtained from the emotion engine. It uses natural language processing technology for the analysis, comprehensively evaluating the user's requests and emotions to extract necessary keywords. For example, if a user inputs "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "three nights and four days" while showing a relaxed expression, the server will use this data to generate the optimal travel plan for the user.

[0420] Presentation method (terminal and server)

[0421] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day plan for enjoying a family trip in a natural area" or a "3-night, 4-day plan for relaxing at a resort" may be displayed.

[0422] Evaluation and feedback receiving means (terminal and server)

[0423] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to generate a new plan. For example, a user can enter feedback such as "I like the Okinawa plan, but I would like to reduce the budget" and the associated emotions.

[0424] Regeneration means (server)

[0425] The server then re-adjusts the itinerary based on the user's feedback and sentiment data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly resort itinerary.

[0426] Reservation method (server)

[0427] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[0428] Notification method (server and terminal)

[0429] Once the reservation is complete, the server notifies the user of the results. It also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel. For example, a reminder may be sent the day before travel, suggesting countermeasures if bad weather is predicted for the day of travel.

[0430] Specific examples

[0431] When planning a trip, a user uses a device to input requests such as "I want to go on a family trip to a place rich in nature," "3 nights and 4 days in September," and "My budget is 200,000 yen." At the same time, the emotion engine analyzes the user's facial expressions and tone of voice to recognize that the user is in a relaxed state. Based on this, the server generates and presents plans for a family trip to a place rich in nature and a relaxing resort. If the user selects a resort plan and submits feedback that they would like to keep the budget a little lower, the server analyzes that feedback and the user's emotions and displays a revised plan within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[0432] Specific examples of prompts to input to generative AI models

[0433] "I'm planning a four-day, three-night trip with my family to a place rich in nature. My budget is 200,000 yen, and I plan to leave in September. What travel plans do you recommend?"

[0434] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0435] Step 1:

[0436] The user enters basic information about the trip

[0437] The user uses the device to input basic information such as the purpose of the trip, budget, travel period, number of accompanying people, and type of travel destination. The device receives this information through an input interface, converts it into the required data format on the front end, and then sends it to the server. For example, a user might input "I want to travel with my family to a place rich in nature," "3 nights, 4 days in September," and "budget is 200,000 yen." This information is converted into a data structure such as JSON format and sent to the server.

[0438] Input: User's basic information (purpose, budget, period, number of people, genre)

[0439] Output: JSON formatted travel request data sent to the server

[0440] Step 2:

[0441] The device analyzes the user's emotional data

[0442] While the user is entering information, the device's built-in emotion engine analyzes the user's facial expressions, tone of voice, and other biometric information in real time. The analysis results in emotional data about the user. This emotional data indicates whether the user is relaxed or excited, and is an important factor in generating travel plans.

[0443] Input: User's facial expression data, tone of voice

[0444] Output: Analyzed user emotion data (e.g., relaxation state)

[0445] Step 3:

[0446] The server analyzes the request and emotion data

[0447] The server analyzes the travel request data and emotion data received from the device. Using natural language processing technology, it extracts important keywords from the travel request data and combines them with the emotion data to identify the user's true desires. For example, information such as "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days" along with a relaxed emotion are extracted.

[0448] Input: Travel request data, emotion data

[0449] Output: Analyzed keywords and sentiment evaluation

[0450] Step 4:

[0451] The server generates the optimal travel plan

[0452] Based on the analysis results, the server generates the optimal travel plan that meets the user's expectations. During the generation process, a generative AI model is used to make suggestions that match the user's desires and emotions. For example, options such as the natural beauty of Hokkaido or resorts in Okinawa are generated.

[0453] Input: Analyzed keywords and emotion evaluation

[0454] Output: Multiple travel plans (e.g. Hokkaido's natural beauty, Okinawa's resorts)

[0455] Step 5:

[0456] The server presents the generated plan to the device.

[0457] The server sends the generated travel plans to the device and presents them visually to the user. The user can then check the details of these plans on the device and compare the pros and cons of each plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed on the device screen.

[0458] Input: Generated itinerary

[0459] Output: A list of itineraries presented to the user

[0460] Step 6:

[0461] The device collects user feedback

[0462] The user evaluates the presented travel plans and inputs feedback via the terminal. The emotion engine again analyzes the user's facial expressions and tone of voice, and sends the feedback to the server. For example, the user might input feedback such as, "I like the Okinawa plan, but I would like to reduce the budget."

[0463] Input: User feedback, reanalyzed emotion data

[0464] Output: Feedback data, emotion data sent to the server

[0465] Step 7:

[0466] The server regenerates the plan based on the feedback.

[0467] The server then re-adjusts the travel plan based on the user's feedback and emotional data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly Okinawa resort plan.

[0468] Input: Feedback data, emotion data

[0469] Output: Reworked itinerary

[0470] Step 8:

[0471] The server starts the reservation process

[0472] Once the coordinated travel plans are finalized, the server initiates the booking process for transportation, accommodation, and other activities, using APIs from multiple providers to make bulk bookings, e.g., booking flights, booking hotels, and booking rental cars.

[0473] Input: Confirmed travel plans

[0474] Output: Completed reservation data

[0475] Step 9:

[0476] The server notifies the reservation result

[0477] Once the reservation process is complete, the server sends the results to the device and notifies the user. Furthermore, reminders based on the travel itinerary and the latest information on the day of travel (notification of changes in weather and transportation) are also sent. For example, a reminder is sent the day before travel, and if bad weather is predicted for the day of travel, countermeasures are suggested.

[0478] Input: Completed reservation data

[0479] Output: Notification messages, reminders, and proposed changes to users

[0480] (Application example 2)

[0481] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0482] In today's society, planning specific events or everyday meals can be time-consuming and tedious. There is a lack of easy ways to provide optimal food delivery plans tailored to users' emotions and specific needs. As a result, inefficient procedures and inappropriate choices lead to low user satisfaction.

[0483] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0484] In this invention, the server includes an input means for inputting a user's event or daily requests, an analysis and generation means for analyzing the requests received from the input means and generating a food delivery plan, a presentation means for presenting the food delivery plan generated by the generation means to the user, an evaluation and feedback receiving means for receiving the user's evaluation or feedback on the food delivery plan presented by the presentation means, a regeneration means for adjusting the food delivery plan based on the evaluation or feedback received by the evaluation and feedback receiving means, a reservation means for executing a food order based on the food delivery plan adjusted by the regeneration means, a notification means for notifying the user whether the reservation has been completed, and an emotion engine for analyzing the user's emotional state. This allows the user to easily create an optimal food delivery plan and achieve high satisfaction with events and daily meals.

[0485] "User" refers to an individual or organization that uses this system to provide specific services or information.

[0486] An "event" is a planned activity or event that takes place on a specific date or for a specific purpose.

[0487] "Daily needs" refer to the specific needs and demands that users have in their daily lives.

[0488] "Input means" refers to an interface through which a user provides information to a system.

[0489] "Analysis and generation means" refers to the functionality for processing information obtained from the user and generating specific plans and solutions.

[0490] "Presentation means" refers to an interface for visually displaying the plans and information generated by the system to the user.

[0491] "Means for receiving evaluations and feedback" refers to the function for collecting evaluations and opinions from users.

[0492] "Regeneration means" refers to functionality for readjusting the generated plan based on feedback from the user.

[0493] "Reservation means" refers to a function for making reservations and ordering services based on the generated plan.

[0494] "Notification means" refers to a function for notifying users of important information and updated content.

[0495] "Emotion engine" refers to technology for analyzing a user's emotional state.

[0496] "Food delivery plan" refers to the optimal food delivery plan based on the user's requests.

[0497] This invention relates to a system that collects user requests when they input their meal plans for a specific event or daily meal, generates and presents optimal food delivery plans, and automatically completes the reservation process. This system is configured and operates as follows:

[0498] System configuration

[0499] This system is broadly composed of the following components:

[0500] 1. Input means (terminal)

[0501] 2. Analysis and generation means (server)

[0502] 3. Presentation Method (Terminal and Server)

[0503] 4. Evaluation and feedback receiving means (terminal and server)

[0504] 5. Regeneration means (server)

[0505] 6. Reservation Method (Server)

[0506] 7. Notification Methods (Server and Terminal)

[0507] 8. Emotion engine (server and terminal)

[0508] Specific system behavior

[0509] An input method for inputting user events and daily requests

[0510] The terminal provides an interface for users to input basic information about a particular event or everyday meal (type of event, budget, number of guests, type of cuisine, etc.) The user enters this information into a form, and once completed, the information is sent to the server.

[0511] Emotion engine that analyzes the user's emotional state

[0512] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions. This information is used as an important element in analyzing and generating user requests. Specifically, it uses facial recognition and voice analysis technologies to understand the user's psychological state.

[0513] Analysis and generation means to analyze requests and generate food delivery plans

[0514] The server analyzes the user's events and daily request data received from the device, as well as the emotion data obtained from the emotion engine. The analysis uses natural language processing technology to comprehensively evaluate the user's requests and emotions and extract necessary keywords. For example, if a user inputs "weekend party with friends," "budget 8,000 yen," "Italian," "preferring vegetarian options," and shows a relaxed expression, the server will generate the optimal food delivery plan based on this data.

[0515] A means for presenting the generated food delivery plan to the user.

[0516] The generated food delivery plan is sent from the server to the device and visually displayed to the user, where the user can check the details of the proposed plan. For example, a "Refreshing and Healthy Italian Meal Plan" is displayed.

[0517] A means of receiving user ratings or feedback on the plan

[0518] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to determine how the plans are regenerated.

[0519] Regenerative measures to adjust food delivery plans

[0520] The server re-adjusts the food delivery plan based on user feedback and sentiment data, including selecting the best meals within the user's budget, for example, re-generating a healthy Italian meal plan on a budget.

[0521] Reservation method to process the reservation

[0522] Once the adjusted food delivery plan is confirmed, the server initiates the food ordering process. This reservation process is performed in bulk using the APIs of multiple service providers, for example, placing an order with partner food delivery services.

[0523] Notification method for notifying completion of reservation

[0524] Once the reservation is complete, the server notifies the user of the result, and also provides reminders on the delivery status and notifies the user of proposed changes to accommodate weather, transportation disruptions, etc.

[0525] Specific examples

[0526] Scenario: Weekend party with friends

[0527] 1. User input

[0528] Event: Weekend party with friends

[0529] Budget: 8,000 yen

[0530] Number of guests: 4

[0531] Cuisine:Italian

[0532] Other: Vegetarian option desired

[0533] 2. Emotional Data

[0534] Smiling and relaxed

[0535] 3. Prompt sentence for generative AI model

[0536] It was a weekend party with friends, with four guests and a budget of ¥8,000. They wanted Italian food, including vegetarian options. Since she had a relaxed, smiling face, I suggested a fun, casual menu.

[0537] In this scenario, users can easily create optimal food delivery plans, achieving high levels of satisfaction for events and everyday meals.

[0538] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0539] Step 1:

[0540] Enter user events and daily requests

[0541] Input: A user uses a device to input basic information about a particular event or daily meal.

[0542] Data processing: The terminal formats the input information and sends it to the server.

[0543] Output: The requested data to be sent to the server.

[0544] Step 2:

[0545] Emotional analysis of users using an emotion engine

[0546] Input: Biometric information such as facial expressions and tone of voice while the user is inputting information into the device.

[0547] Data calculation: The emotion engine uses facial recognition and voice analysis technologies to identify the user's emotions from the input data.

[0548] Output: User emotion data.

[0549] Step 3:

[0550] Analysis of user requests and emotion data and plan generation

[0551] Input: Desire data and emotion data sent to the server.

[0552] Data calculation: The server uses natural language processing technology (e.g., a generative AI model) to comprehensively analyze the user's requests and emotions, extract necessary keywords, generate prompt sentences, and input them into the generative AI model.

[0553] Output: Optimal food delivery plan.

[0554] Step 4:

[0555] Presenting the generated food delivery plan

[0556] Input: Server-generated food delivery plan.

[0557] Data processing: The server converts the plan into a visual format and sends it to the terminal.

[0558] Output: Food delivery plan details displayed on the terminal.

[0559] Step 5:

[0560] Collecting user ratings and feedback

[0561] Input: Ratings and feedback for the food delivery plans viewed by the user on their device.

[0562] Data processing: The device formats the ratings and feedback and sends them to the server.

[0563] Output: Rating and feedback data sent to the server.

[0564] Step 6:

[0565] Adjusting the plan by regeneration means

[0566] Input: Rating and feedback data, sentiment data sent to the server.

[0567] Data Computation: The server analyzes new request and emotion data and readjusts the plan as needed. It uses a generative AI model to generate new prompts.

[0568] Output: A reworked food delivery plan.

[0569] Step 7:

[0570] Presenting a re-adjusted food delivery plan

[0571] Input: Food delivery plan rearranged by server.

[0572] Data processing: The server converts the re-adjusted plan into a visual format and sends it to the terminal.

[0573] Output: The re-adjusted food delivery plan details displayed on the terminal.

[0574] Step 8:

[0575] Executing food ordering procedures

[0576] Input: The food delivery plan that the user finally selected.

[0577] Data processing: The server uses the API of the partner food delivery service to process the order.

[0578] Output: Order completed.

[0579] Step 9:

[0580] Reservation and delivery status notifications

[0581] Input: The result of the order process executed by the server.

[0582] Data Processing: The server monitors order confirmations and delivery status, sending reminders and status updates to the user as needed.

[0583] Output: Notification to user and delivery status update.

[0584] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0585] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0586] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0587] [Second embodiment]

[0588] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0589] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0590] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0591] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0592] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0593] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0594] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0595] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0596] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0597] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0598] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0599] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0600] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the reservation process. This system is an AI-based travel plan creation support system, and is configured and operates as follows:

[0601] System configuration

[0602] This system is broadly composed of the following components:

[0603] 1. Input means (terminal)

[0604] 2. Analysis and generation means (server)

[0605] 3. Presentation Method (Terminal and Server)

[0606] 4. Evaluation and feedback receiving means (terminal and server)

[0607] 5. Regeneration means (server)

[0608] 6. Reservation Method (Server)

[0609] 7. Notification Methods (Server and Terminal)

[0610] Program processing

[0611] Input method (terminal)

[0612] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[0613] Analysis and generation means (server)

[0614] The server analyzes the user's travel request data received from the device. This analysis uses natural language processing technology to extract specific keywords from the user's request. For example, if the server receives requests such as "family trip," "place rich in nature," "September," and "3 nights, 4 days," it will generate multiple suitable travel plans based on this information.

[0615] Presentation method (terminal and server)

[0616] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[0617] Evaluation and feedback receiving means (terminal and server)

[0618] Users can evaluate the plans presented and enter their feedback into the terminal. This feedback is sent from the terminal to the server. For example, users can enter feedback such as, "I like the Okinawa plan, but I would like to reduce the budget."

[0619] Regeneration means (server)

[0620] The server then adjusts the travel plan based on the user's ratings and feedback. This adjustment includes selecting the optimal accommodation and transportation options within the user's budget. For example, it regenerates a budget-friendly Okinawa resort plan.

[0621] Reservation method (server)

[0622] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[0623] Notification method (server and terminal)

[0624] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[0625] Specific examples

[0626] 1. When a user plans a trip

[0627] The user uses a terminal to input requests such as "I want to travel with my family to a place rich in nature," "3 nights and 4 days in September," and "My budget is 200,000 yen." Based on this, the server generates and presents two plans: one to enjoy the great outdoors of Hokkaido, and another to relax at a resort in Okinawa. If the user selects the Okinawa plan and submits feedback that they would like to keep the budget a little lower, the server displays a revised plan that fits within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[0628] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[0629] The processing flow will be explained below.

[0630] Step 1:

[0631] Display of input screen (terminal)

[0632] The device displays a screen for the user to enter basic information about the trip, including fields for inputting information such as the purpose of the trip, budget, duration of the trip, number of people traveling with the user, and type of destination.

[0633] Step 2:

[0634] User information input (user)

[0635] The user inputs their travel requirements into the device, such as "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days."

[0636] Step 3:

[0637] Sending input data (terminal)

[0638] The terminal sends the entered user information to the server. The sent data includes information from all input fields.

[0639] Step 4:

[0640] Receiving user information (server)

[0641] The server receives the user information sent from the terminal and prepares to analyze the received data.

[0642] Step 5:

[0643] Data analysis (server)

[0644] The server analyzes the received user information using natural language processing technology, extracting keywords such as "family trip," "nature," "September," and "3 nights, 4 days" from the user's request.

[0645] Step 6:

[0646] Travel plan generation (server)

[0647] Based on the analyzed keywords, the server generates multiple travel plans that match the user's requests, such as "a plan to enjoy the great outdoors of Hokkaido" and "a plan to relax at a resort in Okinawa."

[0648] Step 7:

[0649] Sending and displaying plans (server and device)

[0650] The server sends the generated travel plan to the terminal, which then displays it to the user. The details of each plan are displayed, allowing the user to check each plan.

[0651] Step 8:

[0652] User evaluation and feedback on the plan

[0653] The user evaluates the presented plans and inputs feedback, such as "The Okinawa plan is good, but I would like to reduce the budget."

[0654] Step 9:

[0655] Send Feedback (Device)

[0656] The device sends user feedback to the server, including ratings and desired modifications.

[0657] Step 10:

[0658] Receiving Feedback (Server)

[0659] The server receives the feedback sent from the device, and based on the feedback, it prepares to adjust the plan again.

[0660] Step 11:

[0661] Re-adjust plan (server)

[0662] The server analyzes the user's feedback and adjusts the travel plan. Specifically, it selects alternative accommodations and transportation options that fit the user's budget. For example, it adjusts the plan to "an Okinawa resort plan that fits within the user's budget."

[0663] Step 12:

[0664] Sending and displaying realignment plans (server and terminal)

[0665] The re-adjusted plan is sent from the server to the terminal again and displayed to the user, who can then check the plan again.

[0666] Step 13:

[0667] Final plan selection (user)

[0668] The user checks the re-arranged plans, selects the desired plan, and confirms the reservation. For example, the user selects "Okinawa resort plan within budget."

[0669] Step 14:

[0670] Send reservation data (terminal)

[0671] The terminal sends the user's final selection to the server, which starts the reservation procedure.

[0672] Step 15:

[0673] Reservation execution (server)

[0674] The server executes the booking process, booking airline tickets, accommodations, rental cars, etc. through API integration, making all the necessary reservations in one place.

[0675] Step 16:

[0676] Notification of reservation completion (server)

[0677] After the reservation is completed, the server sends the result to the terminal.

[0678] Step 17:

[0679] Display of reservation completion (terminal)

[0680] The terminal receives a reservation completion notification from the server and displays it to the user. For example, it displays "Your flight, hotel, and rental car reservations have been completed."

[0681] Step 18:

[0682] Reminder notification settings (server)

[0683] The server sets reminder notifications based on the travel itinerary, specifically, setting the notification to be sent the day before departure.

[0684] Step 19:

[0685] Sending reminder notifications (server and device)

[0686] As the travel date approaches, the server sends the configured reminder notification to the device, which then displays it to the user. For example, it might say, "It's forecast to rain tomorrow. Please bring an umbrella."

[0687] Step 20:

[0688] Notification of changes (server and terminal)

[0689] In the event of weather or transportation disruptions, the server will provide the user with suggested changes based on the information it has acquired, which the device will then display to the user and provide them with countermeasures.

[0690] Example 1

[0691] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0692] The objective of this study is to provide a system that allows users to easily create travel plans that reflect their detailed requests when planning a trip, and that also allows them to efficiently complete reservation procedures based on those plans. Conventional systems require users to use multiple websites and services to gather information, create their own plans, and make reservations individually, which takes a lot of time and effort.

[0693] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0694] In this invention, the server includes information input means for inputting a user's travel requests, analysis and generation means for analyzing the travel requests received from the information input means and generating a travel plan, and display means for presenting the travel plan generated by the generation means to the user. This enables the user to easily generate a travel plan that reflects the user's requests in detail and quickly select the most suitable plan from the proposed plans.

[0695] "Information input means" refers to a device or software that provides an interface for users to input their travel requests and conditions.

[0696] The "analysis and generation means" refers to a processing device or software in the server that analyzes the user's travel requests received from the information input means and generates an appropriate travel plan.

[0697] The "display means" is a device or software for visually presenting the generated travel plan to the user.

[0698] "Evaluation and feedback receiving means" refers to a device or software that allows a user to input and receive evaluations and feedback on a presented travel plan.

[0699] The "regeneration means" refers to a processing device or software in the server for readjusting the travel plan based on the user's rating or feedback received by the rating / feedback receiving means.

[0700] The "reservation means" refers to a processing device or software in the server for making reservations for transportation and accommodation based on the travel plan re-adjusted by the regeneration means.

[0701] The "notification means" is a device or software for notifying the user that the reservation procedure has been completed.

[0702] This invention is a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the booking process. This system uses AI to create travel plans and can optimize them based on user feedback.

[0703] System configuration

[0704] This system is broadly composed of the following components:

[0705] 1. Information input means (terminal)

[0706] 2. Analysis and generation means (server)

[0707] 3. Display means (terminal and server)

[0708] 4. Evaluation and feedback receiving means (terminal and server)

[0709] 5. Regeneration means (server)

[0710] 6. Reservation Method (Server)

[0711] 7. Notification Methods (Server and Terminal)

[0712] System Operation

[0713] Information input means (terminal)

[0714] The user uses the terminal interface to enter basic information about the trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of destination, etc.) Once the user enters this information into the form and clicks the "Submit" button, the data is sent to the server.

[0715] Analysis and generation means (server)

[0716] The server analyzes the user's travel request data received from the device. This analysis uses natural language processing technology (e.g., Python's Natural Language Toolkit (NLTK) or Google Cloud Natural Language API) to extract specific keywords from the user's requests. Next, it generates multiple travel plans based on the extracted keywords using a generative AI model (e.g., OpenAI's GPT-3).

[0717] Display means (terminal and server)

[0718] The generated travel plan is sent from the server to the terminal and visually displayed to the user. The user can then check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[0719] Evaluation and feedback receiving means (terminal and server)

[0720] The user can evaluate the presented plans and input feedback into the terminal. This feedback is sent from the terminal to the server and received by the evaluation / feedback receiving means. For example, the user can input feedback such as "I like the Okinawa plan, but I would like to reduce the budget."

[0721] Regeneration means (server)

[0722] The server then adjusts the travel plan based on the received feedback. When regenerating the plan, it selects the optimal accommodation and transportation options within the user's budget based on the user's requests. For example, it regenerates a budget-friendly Okinawa resort plan.

[0723] Reservation method (server)

[0724] Once the adjusted travel plan is confirmed, the server processes the transportation and accommodation reservations, specifically using APIs of multiple providers (e.g., Expedia API and Booking.com API) to perform bulk reservations, including airline ticket reservations, hotel reservations, and rental car reservations.

[0725] Notification method (server and terminal)

[0726] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[0727] Specific examples

[0728] 1. When a user plans a trip

[0729] The user uses a terminal and enters the following prompt text:

[0730] Example prompt sentence:

[0731] "I want to travel with my family to a place rich in nature." "3 nights, 4 days in September." "Budget is 200,000 yen."

[0732] Based on this, the server generates and displays the following itinerary:

[0733] A 3-night, 4-day plan to enjoy Hokkaido's great outdoors

[0734] Relax at an Okinawa resort for 3 nights and 4 days

[0735] If a user selects a plan for Okinawa and submits feedback that "I would like to keep the budget a little lower," the server will generate and display a plan that is adjusted to fit within the budget (for example, by changing the accommodation to reduce costs).

[0736] Once the user has confirmed the plan and confirmed the reservation, the server will complete the bulk reservation of the flight, hotel, rental car, etc., and notify the user of the completion. In addition, a reminder will be sent the day before the trip, and if the weather is bad, information on "alternative plans" or "change of destination" will be provided.

[0737] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[0738] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0739] Step 1:

[0740] Entering information (terminal)

[0741] The user accesses the terminal interface and inputs their travel requests (purpose of travel, budget, travel period, number of accompanying persons, type of travel destination, etc.).

[0742] Input: Specific prompt example: "I want to travel to a place rich in nature with my family," "3 nights and 4 days in September," "Budget is 200,000 yen."

[0743] Output: The input data is saved in the device in JSON format or similar.

[0744] Specific operation: The user enters information into the form and clicks the "Submit" button. The device converts the data into structured data and prepares it for transmission to the server.

[0745] Step 2:

[0746] Sending data (from device to server)

[0747] The terminal transmits the user's input data to the server.

[0748] Input: Travel request data entered by the user

[0749] Output: Travel request data is sent to the server

[0750] Specific operation: The terminal generates an HTTP request and sends the request including the user's input data to the server.

[0751] Step 3:

[0752] Data analysis (server)

[0753] The server receives the user's travel request data and analyzes it using natural language processing technology.

[0754] Input: Travel request data sent from the terminal

[0755] Output: Keyword extraction results (e.g., family trip, nature, budget 200,000 yen, September, 3 nights, 4 days)

[0756] Specific operation: The server extracts keywords from text data using Python's NLTK or Google Cloud Natural Language API.

[0757] Step 4:

[0758] Travel plan generation (server)

[0759] The server generates multiple travel plans using a generative AI model based on the extracted keywords.

[0760] Input: Extracted keyword data

[0761] Output: A list of generated travel plans (e.g., a 3-night, 4-day plan to enjoy the natural beauty of Hokkaido, or a 3-night, 4-day plan to relax at a resort in Okinawa)

[0762] How it works: The server uses a generative AI model such as OpenAI's GPT-3 to generate a travel plan in text format that matches the user's requests.

[0763] Step 5:

[0764] Displaying travel plans (from server to device)

[0765] The server transmits the generated travel plan to the terminal, which presents it to the user.

[0766] Input: Generated itinerary

[0767] Output: The itinerary displayed to the user

[0768] Specific operation: The server sends the generated plan in JSON format to the terminal, and the terminal converts the received data into HTML or the app UI and displays it.

[0769] Step 6:

[0770] Receiving user ratings and feedback (from device to server)

[0771] The user inputs an evaluation and feedback on the presented plan.

[0772] Input: User's rating and feedback (e.g., "I liked the Okinawa plan, but I want to reduce the budget.")

[0773] Output: Feedback is sent from the device to the server.

[0774] Specific operation: The user enters a comment in the feedback form and clicks the "Submit" button. The device sends the feedback to the server.

[0775] Step 7:

[0776] Regenerate travel plan (server)

[0777] The server readjusts the travel plan based on the received feedback.

[0778] Input: Feedback data from users

[0779] Output: Regenerated travel plan (e.g., budget Okinawa resort plan)

[0780] Specific operation: The server runs the generative AI model again and regenerates a plan based on the new conditions.

[0781] Step 8:

[0782] Execution of reservation procedures (server)

[0783] The user confirms the final plan and confirms the reservation. The server processes the reservations for transportation and accommodation.

[0784] Input: Final travel plan approved by the user

[0785] Output: Reservation completion notification

[0786] Specific operation: The server uses the Expedia API and Booking.com API to complete the booking process for airline tickets and hotels in bulk.

[0787] Step 9:

[0788] Notification of reservation completion (from server to device)

[0789] The server notifies the user that the reservation is complete, and also provides reminders based on the travel itinerary and information on how to deal with weather and transportation disruptions on the day of the trip.

[0790] Input: reservation completion data, travel itinerary data

[0791] Output: User notification

[0792] Specific operation: The server uses email or SMS to send reservation completion notifications and reminder notifications to the user.

[0793] This allows users to efficiently create travel plans and automate the booking process.

[0794] (Application example 1)

[0795] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0796] Currently, users spend a lot of time and effort planning their trips and creating optimal travel plans. Furthermore, it is difficult to plan efficiently because reservations for transportation and accommodations must be made separately. Furthermore, planning requires appropriately combining transportation methods, which is no easy task. In particular, when using autonomous vehicles as a modern means of transportation, a system is needed that allows for smooth generation and booking of travel plans that include these vehicles.

[0797] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0798] In this invention, the server includes: an input means for inputting a user's travel requests; an analysis and generation means for analyzing the travel requests received from the input means and generating a travel plan; a presentation means for presenting the travel plan generated by the generation means to the user; an evaluation and feedback receiving means for receiving a user's rating or feedback on the travel plan presented by the presentation means; a regeneration means for adjusting the travel plan based on the rating or feedback received by the evaluation and feedback receiving means; a reservation means for reserving transportation and accommodation based on the travel plan adjusted by the regeneration means; a notification means for notifying the user whether the reservation is complete; an input means for inputting the user's requests by voice or touch to a display device in an autonomous vehicle; and a presentation means for presenting a travel plan that includes the autonomous vehicle as a means of transportation. This enables users to plan their trips efficiently and comfortably and enjoy a smooth journey using the autonomous vehicle.

[0799] "Input means" refers to a device or interface that allows a user to input travel requests.

[0800] "Analysis and generation means" refers to a system or algorithm that analyzes the user's travel requests and generates the optimal travel plan.

[0801] The "presentation means" refers to a device or interface for visually or audibly presenting the generated travel plan to the user.

[0802] "Evaluation and feedback receiving means" refers to a system or interface for receiving evaluations and feedback made by users regarding travel plans.

[0803] A "regenerator" is a system or algorithm that adjusts and regenerates a travel plan based on the ratings and feedback received.

[0804] "Reservation Channel" means a system or interface for booking transportation and accommodation based on a coordinated travel plan.

[0805] "Notification means" refers to a system or device that notifies the user whether the reservation has been completed or other important information.

[0806] A "display device" is a display or touch panel installed in an autonomous vehicle for users to input and confirm information.

[0807] "Voice input" refers to an interface or technology that allows users to input travel requests and other information by voice.

[0808] "Touch input" refers to the interface and technology that allows users to input travel requests and other information using a touchscreen.

[0809] An "autonomous vehicle" is a vehicle that operates autonomously and does not require human operation.

[0810] A "travel plan" is detailed information such as a travel schedule, route, accommodation, and transportation that is proposed based on the user's requests.

[0811] The present invention relates to a system for efficiently assisting users in planning their trips and for using autonomous vehicles as a means of transportation. Hereinafter, a program and a processing procedure of the system will be described as a specific embodiment.

[0812] System Program

[0813] The server includes an input means for inputting travel requests from users, an analysis and generation means for analyzing the received travel requests and generating a travel plan, a presentation means for presenting the generated travel plan to the user, an evaluation and feedback receiving means for receiving ratings and feedback from users, a regeneration means for readjusting the travel plan based on the received ratings and feedback, a reservation means for reserving transportation and accommodations based on the adjusted travel plan, and a notification means for notifying the user of the completion of the reservation. Furthermore, the display devices (touch panel and voice input device) inside the autonomous vehicle are used as user input means.

[0814] Hardware and Software

[0815] Hardware: Smart displays, touch panels, microphones in autonomous vehicles, and users' smartphones

[0816] Software: Natural language processing engines (e.g., Google Cloud Natural Language API), AI models (e.g., GPT-4), booking APIs (e.g., Amadeus API)

[0817] Processing Description

[0818] The server receives information about the user's travel requests via voice or touch input on a display device inside the autonomous vehicle. The received information is analyzed using natural language processing technology. A natural language processing engine such as Google Cloud Natural Language API is used for this analysis. Based on the analysis results, an AI model (e.g., GPT-4) is used to generate multiple travel plans.

[0819] The generated travel plans are visually presented on a display inside the autonomous vehicle. The user selects a suitable plan from the list and provides their rating and feedback. This feedback is sent back to the server, where the regeneration means adjusts the plan. Based on the adjusted plan, the reservation means operates and makes reservations for transportation and accommodation. This reservation is made using a reservation system such as the Amadeus API.

[0820] Once the reservation is complete, the notification means will be activated and the result will be notified to the user. This will provide pre-travel reminders and weather information for the day, allowing the user to carry out their travel plans with peace of mind.

[0821] Specific examples

[0822] For example, if a user in a self-driving car says, "I want to go on a trip with my family to a place rich in nature. My budget is under 200,000 yen. I want to go for three nights and four days in September," the system will analyze this and generate the optimal travel plan. If the user sends feedback from one of the generated plans saying, "I would like a different plan with a lower budget," the system will generate a new plan and present it again.

[0823] This will enable users to plan trips efficiently and comfortably, and ensure a smooth journey using autonomous vehicles.

[0824] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0825] Step 1: User Input

[0826] Users input their travel needs into the display device inside the self-driving car by voice or touch. For voice input, a microphone is used, and for touch input, a touch panel is used. The input information includes basic information such as the purpose of the trip, budget, duration, number of accompanying people, and type of travel destination.

[0827] Step 2: Receiving data

[0828] The server receives the input data sent from the autonomous vehicle and stores the input travel request data on the server side.

[0829] Step 3: Data analysis

[0830] The server analyzes the stored travel request data. This analysis uses a natural language processing engine (e.g., Google Cloud Natural Language API). Specifically, it extracts keywords and desired conditions from the user's input and structures this data.

[0831] Input: Travel request data

[0832] Output: Parsed keywords and conditions

[0833] Step 4: Create a travel plan

[0834] The server uses the analyzed keywords and conditions to generate multiple travel plans using an AI model (e.g., GPT-4), each of which includes different destinations, activities, and accommodations.

[0835] Input: Parsed keywords and conditions

[0836] Output: Multiple itineraries

[0837] Step 5: Submit your travel plan

[0838] The server sends the generated travel plan to the user's device, where it is visually presented on a display inside the autonomous vehicle. The user can then check the details of the presented plan.

[0839] Input: Generated itinerary

[0840] Output: Travel plan displayed on the user's device

[0841] Step 6: Receiving feedback

[0842] The user inputs their evaluation and feedback on the presented travel plan into the display device, and the input feedback data is sent to the server.

[0843] Input: User feedback

[0844] Output: Feedback data sent to the server

[0845] Step 7: Regenerate

[0846] The server analyzes the received feedback data and adjusts the travel plan through a regeneration means, which includes the process of regenerating an appropriate plan based on the user's new requests and feedback.

[0847] Input: Feedback data

[0848] Output: Reworked itinerary

[0849] Step 8: Resubmit

[0850] The server then transmits the regenerated travel plan to the user's terminal, where the user can check the re-presented plan on the display.

[0851] Input: rearranged travel plans

[0852] Output: Realignment plan displayed on the user's device

[0853] Step 9: Reservation execution

[0854] The server makes reservations for transportation and accommodation based on the user's final travel plan, using a booking API (e.g., Amadeus API).

[0855] Input: Finalized travel plans

[0856] Output: Reservation completion data

[0857] Step 10: Notification

[0858] The server notifies the user whether the reservation is successful or not, and may also provide itinerary reminders, weather forecasts for the day, and suggested changes in case of transportation disruptions.

[0859] Input: Booking completion data and travel information

[0860] Output: Notification information sent to the user's device

[0861] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0862] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the reservation process. This system is a travel plan creation support system that utilizes AI and an emotion engine, and is configured and operates as follows:

[0863] System configuration

[0864] This system is broadly composed of the following components:

[0865] 1. Input means (terminal)

[0866] 2. Analysis and generation means (server)

[0867] 3. Presentation Method (Terminal and Server)

[0868] 4. Evaluation and feedback receiving means (terminal and server)

[0869] 5. Regeneration means (server)

[0870] 6. Reservation Method (Server)

[0871] 7. Notification Methods (Server and Terminal)

[0872] 8. Emotion engine (server and terminal)

[0873] Program processing

[0874] Input method (terminal)

[0875] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[0876] Emotion engine (server and terminal)

[0877] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions, which are then used as key elements in analyzing and generating the user's travel requests.

[0878] Analysis and generation means (server)

[0879] The server analyzes the user's travel request data received from the device and the emotion data obtained from the emotion engine. It uses natural language processing technology for the analysis, comprehensively evaluating the user's requests and emotions to extract necessary keywords. For example, if a user inputs "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "three nights and four days" while showing a relaxed expression, the server will use this data to generate the optimal travel plan for the user.

[0880] Presentation method (terminal and server)

[0881] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[0882] Evaluation and feedback receiving means (terminal and server)

[0883] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to generate a new plan. For example, a user can enter feedback such as "I like the Okinawa plan, but I would like to reduce the budget" and the associated emotions.

[0884] Regeneration means (server)

[0885] The server then re-adjusts the travel plan based on the user's feedback and sentiment data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly Okinawa resort plan.

[0886] Reservation method (server)

[0887] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[0888] Notification method (server and terminal)

[0889] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[0890] Specific examples

[0891] 1. When a user plans a trip

[0892] The user uses a device to input requests such as "I want to travel with my family to a place rich in nature," "3 nights, 4 days in September," and "budget of 200,000 yen." At the same time, the emotion engine analyzes the user's facial expressions and tone of voice and recognizes that the user is in a relaxed state. Based on this, the server generates and presents plans to enjoy the great outdoors of Hokkaido and to relax at a resort in Okinawa. If the user selects the Okinawa plan and submits feedback that they would like to keep the budget a little lower, the server analyzes that feedback and the user's emotions and displays a revised plan within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[0893] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[0894] The processing flow will be explained below.

[0895] Step 1:

[0896] Display of input screen (terminal)

[0897] The device displays a screen for the user to enter basic information about the trip, including fields for inputting information such as the purpose of the trip, budget, duration of the trip, number of people traveling with the user, and type of destination.

[0898] Step 2:

[0899] User information input (user)

[0900] The user inputs their travel requirements into the device. For example, they input information such as "family trip," "budget 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days." At the same time, the user's facial expressions and tone of voice are analyzed by the emotion engine.

[0901] Step 3:

[0902] Sending input data and emotion data (terminal)

[0903] The terminal transmits the input user information and emotion data from the emotion engine to the server. The transmitted data includes information on all input fields and the emotional state.

[0904] Step 4:

[0905] Receiving user information and emotion data (server)

[0906] The server receives the user information and emotion data sent from the device and prepares to analyze the received data.

[0907] Step 5:

[0908] Data analysis (server)

[0909] The server uses natural language processing technology to analyze the received user information and emotional data, extracting keywords such as "family trip," "nature," "September," and "three nights and four days" from the user's request, and uses the emotional data to determine the user's psychological state (e.g., whether they are relaxed).

[0910] Step 6:

[0911] Travel plan generation (server)

[0912] The server generates multiple travel plans that match the user's needs based on the analyzed keywords and emotion data, such as "a plan to enjoy the great outdoors of Hokkaido" and "a plan to relax at a resort in Okinawa."

[0913] Step 7:

[0914] Sending and displaying plans (server and device)

[0915] The server sends the generated travel plan to the terminal, which visually displays the received plan to the user. Specific plan details are displayed, allowing the user to check each plan.

[0916] Step 8:

[0917] User evaluation and feedback on the plan

[0918] The user evaluates the presented plans and enters feedback. For example, they may enter a comment such as, "The Okinawa plan is good, but I would like to reduce the budget." In this case, the emotion engine also analyzes the user's facial expressions and tone of voice to collect emotional data in real time.

[0919] Step 9:

[0920] Sending feedback and emotional data (device)

[0921] The device transmits user feedback and emotion data to the server, including user ratings and desired modifications.

[0922] Step 10:

[0923] Receiving feedback and emotion data (server)

[0924] The server receives the feedback and emotion data sent from the device, and prepares to adjust the plan again based on the feedback.

[0925] Step 11:

[0926] Re-adjust plan (server)

[0927] The server analyzes the user's feedback and emotional data and adjusts the travel plan accordingly. Specifically, it selects alternative accommodations and transportation options that fit the user's budget. For example, it adjusts the plan to "an Okinawa resort plan within the user's budget."

[0928] Step 12:

[0929] Sending and displaying realignment plans (server and terminal)

[0930] The server sends the re-adjusted plan to the terminal, which visually displays the received plan to the user again, allowing the user to review the plan again.

[0931] Step 13:

[0932] Final plan selection (user)

[0933] The user checks the re-arranged plans, selects the desired plan, and confirms the reservation. For example, the user selects "Okinawa resort plan within budget."

[0934] Step 14:

[0935] Send reservation data (terminal)

[0936] The terminal sends the user's final selection to the server, which starts the reservation procedure.

[0937] Step 15:

[0938] Reservation execution (server)

[0939] The server executes the booking process, booking airline tickets, accommodations, rental cars, etc. through API integration, making all the necessary reservations in one place.

[0940] Step 16:

[0941] Notification of reservation completion (server)

[0942] After the reservation is completed, the server sends the result to the terminal.

[0943] Step 17:

[0944] Display of reservation completion (terminal)

[0945] The terminal receives a reservation completion notification from the server and displays it to the user. For example, it displays "Your flight, hotel, and rental car reservations have been completed."

[0946] Step 18:

[0947] Reminder notification settings (server)

[0948] The server sets reminder notifications based on the travel itinerary, specifically, setting the notification to be sent the day before departure.

[0949] Step 19:

[0950] Sending reminder notifications (server and device)

[0951] As the travel date approaches, the server sends the configured reminder notification to the device, which then displays it to the user. For example, it might say, "It's forecast to rain tomorrow. Please bring an umbrella."

[0952] Step 20:

[0953] Notification of changes (server and terminal)

[0954] In the event of weather or transportation disruptions, the server will provide the user with suggested changes based on the information it has acquired, which the device will then display to the user and provide them with countermeasures.

[0955] Example 2

[0956] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0957] Conventional travel plan creation systems generate travel plans based solely on information entered by the user, which means they cannot fully reflect the user's latent desires and emotions. It is also difficult to efficiently collect and incorporate feedback on proposed plans, which can result in low user satisfaction. Furthermore, because reservation procedures and change notifications are not centralized, users must perform multiple procedures individually, which is time-consuming and laborious.

[0958] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting a user's travel requests; an analysis and generation means for analyzing the travel requests received from the input means and generating a travel plan; a presentation means for presenting the travel plan generated by the generation means to the user; an emotion engine for analyzing the user's biometric information to acquire emotion data; an evaluation and feedback receiving means for receiving the user's evaluation or feedback on the travel plan presented by the presentation means; a regeneration means for adjusting the travel plan based on the evaluation or feedback and emotion data received by the evaluation and feedback receiving means; a reservation means for reserving transportation and accommodation facilities based on the travel plan adjusted by the regeneration means; and a notification means for notifying the user whether the reservation has been completed. This enables the generation of an optimal travel plan that reflects the user's potential requests and emotions, rapid plan readjustment based on feedback, and unified reservation procedures and change notification.

[0959] "Input means" refers to a device or software that provides an interface for a user to input travel requests.

[0960] The "analysis and generation means" is a means for analyzing the travel requests received from the input means and generating an appropriate travel plan.

[0961] The "presentation means" is a means for visually or audibly presenting the travel plan generated by the generation means to the user.

[0962] An "emotion engine" is a device or software that analyzes biometric information from a user (e.g., facial expressions and tone of voice) to obtain emotional data.

[0963] The "evaluation / feedback receiving means" is a means for collecting user evaluations or feedback on the travel plan presented by the presentation means.

[0964] The "regeneration means" is a means for adjusting the travel plan based on the evaluation or feedback and emotion data received by the evaluation / feedback receiving means.

[0965] The "reservation means" is a means for making reservations for transportation and accommodation facilities based on the travel plan adjusted by the regeneration means.

[0966] The "notification means" is a means for notifying the user whether the reservation has been completed or not, and for providing reminders or suggested changes as necessary.

[0967] "Natural language processing technology" is a computer technology for analyzing, understanding, and generating text data, and is used to analyze travel requests and emotional data.

[0968] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the booking process. This system is a travel plan creation support system that utilizes AI and an emotion engine, and is configured and operates as follows:

[0969] System configuration

[0970] This system is broadly composed of the following components:

[0971] 1. Input means (terminal)

[0972] 2. Analysis and generation means (server)

[0973] 3. Presentation Method (Terminal and Server)

[0974] 4. Evaluation and feedback receiving means (terminal and server)

[0975] 5. Regeneration means (server)

[0976] 6. Reservation Method (Server)

[0977] 7. Notification Methods (Server and Terminal)

[0978] 8. Emotion engine (server and terminal)

[0979] Program processing

[0980] Input method (terminal)

[0981] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[0982] Emotion engine (server and terminal)

[0983] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions. This information is used as an important factor in analyzing and generating the user's travel requests. For example, it can determine whether the user is in a relaxed state when entering information.

[0984] Analysis and generation means (server)

[0985] The server analyzes the user's travel request data received from the device and the emotion data obtained from the emotion engine. It uses natural language processing technology for the analysis, comprehensively evaluating the user's requests and emotions to extract necessary keywords. For example, if a user inputs "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "three nights and four days" while showing a relaxed expression, the server will use this data to generate the optimal travel plan for the user.

[0986] Presentation method (terminal and server)

[0987] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day plan for enjoying a family trip in a natural area" or a "3-night, 4-day plan for relaxing at a resort" may be displayed.

[0988] Evaluation and feedback receiving means (terminal and server)

[0989] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to generate a new plan. For example, a user can enter feedback such as "I like the Okinawa plan, but I would like to reduce the budget" and the associated emotions.

[0990] Regeneration means (server)

[0991] The server then re-adjusts the itinerary based on the user's feedback and sentiment data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly resort itinerary.

[0992] Reservation method (server)

[0993] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[0994] Notification method (server and terminal)

[0995] Once the reservation is complete, the server notifies the user of the results. It also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel. For example, a reminder may be sent the day before travel, suggesting countermeasures if bad weather is predicted for the day of travel.

[0996] Specific examples

[0997] When planning a trip, a user uses a device to input requests such as "I want to go on a family trip to a place rich in nature," "3 nights and 4 days in September," and "My budget is 200,000 yen." At the same time, the emotion engine analyzes the user's facial expressions and tone of voice to recognize that the user is in a relaxed state. Based on this, the server generates and presents plans for a family trip to a place rich in nature and a relaxing resort. If the user selects a resort plan and submits feedback that they would like to keep the budget a little lower, the server analyzes that feedback and the user's emotions and displays a revised plan within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[0998] Specific examples of prompts to input to generative AI models

[0999] "I'm planning a four-day, three-night trip with my family to a place rich in nature. My budget is 200,000 yen, and I plan to leave in September. What travel plans do you recommend?"

[1000] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1001] Step 1:

[1002] The user enters basic information about the trip

[1003] The user uses the device to input basic information such as the purpose of the trip, budget, travel period, number of accompanying people, and type of travel destination. The device receives this information through an input interface, converts it into the required data format on the front end, and then sends it to the server. For example, a user might input "I want to travel with my family to a place rich in nature," "3 nights, 4 days in September," and "budget is 200,000 yen." This information is converted into a data structure such as JSON format and sent to the server.

[1004] Input: User's basic information (purpose, budget, period, number of people, genre)

[1005] Output: JSON formatted travel request data sent to the server

[1006] Step 2:

[1007] The device analyzes the user's emotional data

[1008] While the user is entering information, the device's built-in emotion engine analyzes the user's facial expressions, tone of voice, and other biometric information in real time. The analysis results in emotional data about the user. This emotional data indicates whether the user is relaxed or excited, and is an important factor in generating travel plans.

[1009] Input: User's facial expression data, tone of voice

[1010] Output: Analyzed user emotion data (e.g., relaxation state)

[1011] Step 3:

[1012] The server analyzes the request and emotion data

[1013] The server analyzes the travel request data and emotion data received from the device. Using natural language processing technology, it extracts important keywords from the travel request data and combines them with the emotion data to identify the user's true desires. For example, information such as "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days" along with a relaxed emotion are extracted.

[1014] Input: Travel request data, emotion data

[1015] Output: Analyzed keywords and sentiment evaluation

[1016] Step 4:

[1017] The server generates the optimal travel plan

[1018] Based on the analysis results, the server generates the optimal travel plan that meets the user's expectations. During the generation process, a generative AI model is used to make suggestions that match the user's desires and emotions. For example, options such as the natural beauty of Hokkaido or resorts in Okinawa are generated.

[1019] Input: Analyzed keywords and emotion evaluation

[1020] Output: Multiple travel plans (e.g. Hokkaido's natural beauty, Okinawa's resorts)

[1021] Step 5:

[1022] The server presents the generated plan to the device.

[1023] The server sends the generated travel plans to the device and presents them visually to the user. The user can then check the details of these plans on the device and compare the pros and cons of each plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed on the device screen.

[1024] Input: Generated itinerary

[1025] Output: A list of itineraries presented to the user

[1026] Step 6:

[1027] The device collects user feedback

[1028] The user evaluates the presented travel plans and inputs feedback via the terminal. The emotion engine again analyzes the user's facial expressions and tone of voice, and sends the feedback to the server. For example, the user might input feedback such as, "I like the Okinawa plan, but I would like to reduce the budget."

[1029] Input: User feedback, reanalyzed emotion data

[1030] Output: Feedback data, emotion data sent to the server

[1031] Step 7:

[1032] The server regenerates the plan based on the feedback.

[1033] The server then re-adjusts the travel plan based on the user's feedback and emotional data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly Okinawa resort plan.

[1034] Input: Feedback data, emotion data

[1035] Output: Reworked itinerary

[1036] Step 8:

[1037] The server starts the reservation process

[1038] Once the coordinated travel plans are finalized, the server initiates the booking process for transportation, accommodation, and other activities, using APIs from multiple providers to make bulk bookings, e.g., booking flights, booking hotels, and booking rental cars.

[1039] Input: Confirmed travel plans

[1040] Output: Completed reservation data

[1041] Step 9:

[1042] The server notifies the reservation result

[1043] Once the reservation process is complete, the server sends the results to the device and notifies the user. Furthermore, reminders based on the travel itinerary and the latest information on the day of travel (notification of changes in weather and transportation) are also sent. For example, a reminder is sent the day before travel, and if bad weather is predicted for the day of travel, countermeasures are suggested.

[1044] Input: Completed reservation data

[1045] Output: Notification messages, reminders, and proposed changes to users

[1046] (Application example 2)

[1047] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1048] In today's society, planning specific events or everyday meals can be time-consuming and tedious. There is a lack of easy ways to provide optimal food delivery plans tailored to users' emotions and specific needs. As a result, inefficient procedures and inappropriate choices lead to low user satisfaction.

[1049] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1050] In this invention, the server includes an input means for inputting a user's event or daily requests, an analysis and generation means for analyzing the requests received from the input means and generating a food delivery plan, a presentation means for presenting the food delivery plan generated by the generation means to the user, an evaluation and feedback receiving means for receiving the user's evaluation or feedback on the food delivery plan presented by the presentation means, a regeneration means for adjusting the food delivery plan based on the evaluation or feedback received by the evaluation and feedback receiving means, a reservation means for executing a food order based on the food delivery plan adjusted by the regeneration means, a notification means for notifying the user whether the reservation has been completed, and an emotion engine for analyzing the user's emotional state. This allows the user to easily create an optimal food delivery plan and achieve high satisfaction with events and daily meals.

[1051] "User" refers to an individual or organization that uses this system to provide specific services or information.

[1052] An "event" is a planned activity or event that takes place on a specific date or for a specific purpose.

[1053] "Daily needs" refer to the specific needs and demands that users have in their daily lives.

[1054] "Input means" refers to an interface through which a user provides information to a system.

[1055] "Analysis and generation means" refers to the functionality for processing information obtained from the user and generating specific plans and solutions.

[1056] "Presentation means" refers to an interface for visually displaying the plans and information generated by the system to the user.

[1057] "Means for receiving evaluations and feedback" refers to the function for collecting evaluations and opinions from users.

[1058] "Regeneration means" refers to functionality for readjusting the generated plan based on feedback from the user.

[1059] "Reservation means" refers to a function for making reservations and ordering services based on the generated plan.

[1060] "Notification means" refers to a function for notifying users of important information and updated content.

[1061] "Emotion engine" refers to technology for analyzing a user's emotional state.

[1062] "Food delivery plan" refers to the optimal food delivery plan based on the user's requests.

[1063] This invention relates to a system that collects user requests when they input their meal plans for a specific event or daily meal, generates and presents optimal food delivery plans, and automatically completes the reservation process. This system is configured and operates as follows:

[1064] System configuration

[1065] This system is broadly composed of the following components:

[1066] 1. Input means (terminal)

[1067] 2. Analysis and generation means (server)

[1068] 3. Presentation Method (Terminal and Server)

[1069] 4. Evaluation and feedback receiving means (terminal and server)

[1070] 5. Regeneration means (server)

[1071] 6. Reservation Method (Server)

[1072] 7. Notification Methods (Server and Terminal)

[1073] 8. Emotion engine (server and terminal)

[1074] Specific system behavior

[1075] An input method for inputting user events and daily requests

[1076] The terminal provides an interface for users to input basic information about a particular event or everyday meal (type of event, budget, number of guests, type of cuisine, etc.) The user enters this information into a form, and once completed, the information is sent to the server.

[1077] Emotion engine that analyzes the user's emotional state

[1078] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions. This information is used as an important element in analyzing and generating user requests. Specifically, it uses facial recognition and voice analysis technologies to understand the user's psychological state.

[1079] Analysis and generation means to analyze requests and generate food delivery plans

[1080] The server analyzes the user's events and daily request data received from the device, as well as the emotion data obtained from the emotion engine. The analysis uses natural language processing technology to comprehensively evaluate the user's requests and emotions and extract necessary keywords. For example, if a user inputs "weekend party with friends," "budget 8,000 yen," "Italian," "preferring vegetarian options," and shows a relaxed expression, the server will generate the optimal food delivery plan based on this data.

[1081] A means for presenting the generated food delivery plan to the user.

[1082] The generated food delivery plan is sent from the server to the device and visually displayed to the user, where the user can check the details of the proposed plan. For example, a "Refreshing and Healthy Italian Meal Plan" is displayed.

[1083] A means of receiving user ratings or feedback on the plan

[1084] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to determine how the plans are regenerated.

[1085] Regenerative measures to adjust food delivery plans

[1086] The server re-adjusts the food delivery plan based on user feedback and sentiment data, including selecting the best meals within the user's budget, for example, re-generating a healthy Italian meal plan on a budget.

[1087] Reservation method to process the reservation

[1088] Once the adjusted food delivery plan is confirmed, the server initiates the food ordering process. This reservation process is performed in bulk using the APIs of multiple service providers, for example, placing an order with partner food delivery services.

[1089] Notification method for notifying completion of reservation

[1090] Once the reservation is complete, the server notifies the user of the result, and also provides reminders on the delivery status and notifies the user of proposed changes to accommodate weather, transportation disruptions, etc.

[1091] Specific examples

[1092] Scenario: Weekend party with friends

[1093] 1. User input

[1094] Event: Weekend party with friends

[1095] Budget: 8,000 yen

[1096] Number of guests: 4

[1097] Cuisine:Italian

[1098] Other: Vegetarian option desired

[1099] 2. Emotional Data

[1100] Smiling and relaxed

[1101] 3. Prompt sentence for generative AI model

[1102] It was a weekend party with friends, with four guests and a budget of ¥8,000. They wanted Italian food, including vegetarian options. Since she had a relaxed, smiling face, I suggested a fun, casual menu.

[1103] In this scenario, users can easily create optimal food delivery plans, achieving high levels of satisfaction for events and everyday meals.

[1104] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1105] Step 1:

[1106] Enter user events and daily requests

[1107] Input: A user uses a device to input basic information about a particular event or daily meal.

[1108] Data processing: The terminal formats the input information and sends it to the server.

[1109] Output: The requested data to be sent to the server.

[1110] Step 2:

[1111] Emotional analysis of users using an emotion engine

[1112] Input: Biometric information such as facial expressions and tone of voice while the user is inputting information into the device.

[1113] Data calculation: The emotion engine uses facial recognition and voice analysis technologies to identify the user's emotions from the input data.

[1114] Output: User emotion data.

[1115] Step 3:

[1116] Analysis of user requests and emotion data and plan generation

[1117] Input: Desire data and emotion data sent to the server.

[1118] Data calculation: The server uses natural language processing technology (e.g., a generative AI model) to comprehensively analyze the user's requests and emotions, extract necessary keywords, generate prompt sentences, and input them into the generative AI model.

[1119] Output: Optimal food delivery plan.

[1120] Step 4:

[1121] Presenting the generated food delivery plan

[1122] Input: Server-generated food delivery plan.

[1123] Data processing: The server converts the plan into a visual format and sends it to the terminal.

[1124] Output: Food delivery plan details displayed on the terminal.

[1125] Step 5:

[1126] Collecting user ratings and feedback

[1127] Input: Ratings and feedback for the food delivery plans viewed by the user on their device.

[1128] Data processing: The device formats the ratings and feedback and sends them to the server.

[1129] Output: Rating and feedback data sent to the server.

[1130] Step 6:

[1131] Adjusting the plan by regeneration means

[1132] Input: Rating and feedback data, sentiment data sent to the server.

[1133] Data Computation: The server analyzes new request and emotion data and readjusts the plan as needed. It uses a generative AI model to generate new prompts.

[1134] Output: A reworked food delivery plan.

[1135] Step 7:

[1136] Presenting a re-adjusted food delivery plan

[1137] Input: Food delivery plan rearranged by server.

[1138] Data processing: The server converts the re-adjusted plan into a visual format and sends it to the terminal.

[1139] Output: The re-adjusted food delivery plan details displayed on the terminal.

[1140] Step 8:

[1141] Executing food ordering procedures

[1142] Input: The food delivery plan that the user finally selected.

[1143] Data processing: The server uses the API of the partner food delivery service to process the order.

[1144] Output: Order completed.

[1145] Step 9:

[1146] Reservation and delivery status notifications

[1147] Input: The result of the order process executed by the server.

[1148] Data Processing: The server monitors order confirmations and delivery status, sending reminders and status updates to the user as needed.

[1149] Output: Notification to user and delivery status update.

[1150] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1151] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1152] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1153] [Third embodiment]

[1154] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1155] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1156] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1157] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1158] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1159] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1160] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1161] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1162] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1163] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1164] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1165] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1166] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the reservation process. This system is an AI-based travel plan creation support system, and is configured and operates as follows:

[1167] System configuration

[1168] This system is broadly composed of the following components:

[1169] 1. Input means (terminal)

[1170] 2. Analysis and generation means (server)

[1171] 3. Presentation Method (Terminal and Server)

[1172] 4. Evaluation and feedback receiving means (terminal and server)

[1173] 5. Regeneration means (server)

[1174] 6. Reservation Method (Server)

[1175] 7. Notification Methods (Server and Terminal)

[1176] Program processing

[1177] Input method (terminal)

[1178] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[1179] Analysis and generation means (server)

[1180] The server analyzes the user's travel request data received from the device. This analysis uses natural language processing technology to extract specific keywords from the user's request. For example, if the server receives requests such as "family trip," "place rich in nature," "September," and "3 nights, 4 days," it will generate multiple suitable travel plans based on this information.

[1181] Presentation method (terminal and server)

[1182] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[1183] Evaluation and feedback receiving means (terminal and server)

[1184] Users can evaluate the plans presented and enter their feedback into the terminal. This feedback is sent from the terminal to the server. For example, users can enter feedback such as, "I like the Okinawa plan, but I would like to reduce the budget."

[1185] Regeneration means (server)

[1186] The server then adjusts the travel plan based on the user's ratings and feedback. This adjustment includes selecting the optimal accommodation and transportation options within the user's budget. For example, it regenerates a budget-friendly Okinawa resort plan.

[1187] Reservation method (server)

[1188] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[1189] Notification method (server and terminal)

[1190] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[1191] Specific examples

[1192] 1. When a user plans a trip

[1193] The user uses a terminal to input requests such as "I want to travel with my family to a place rich in nature," "3 nights and 4 days in September," and "My budget is 200,000 yen." Based on this, the server generates and presents two plans: one to enjoy the great outdoors of Hokkaido, and another to relax at a resort in Okinawa. If the user selects the Okinawa plan and submits feedback that they would like to keep the budget a little lower, the server displays a revised plan that fits within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[1194] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[1195] The processing flow will be explained below.

[1196] Step 1:

[1197] Display of input screen (terminal)

[1198] The device displays a screen for the user to enter basic information about the trip, including fields for inputting information such as the purpose of the trip, budget, duration of the trip, number of people traveling with the user, and type of destination.

[1199] Step 2:

[1200] User information input (user)

[1201] The user inputs their travel requirements into the device, such as "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days."

[1202] Step 3:

[1203] Sending input data (terminal)

[1204] The terminal sends the entered user information to the server. The sent data includes information from all input fields.

[1205] Step 4:

[1206] Receiving user information (server)

[1207] The server receives the user information sent from the terminal and prepares to analyze the received data.

[1208] Step 5:

[1209] Data analysis (server)

[1210] The server analyzes the received user information using natural language processing technology, extracting keywords such as "family trip," "nature," "September," and "3 nights, 4 days" from the user's request.

[1211] Step 6:

[1212] Travel plan generation (server)

[1213] Based on the analyzed keywords, the server generates multiple travel plans that match the user's requests, such as "a plan to enjoy the great outdoors of Hokkaido" and "a plan to relax at a resort in Okinawa."

[1214] Step 7:

[1215] Sending and displaying plans (server and device)

[1216] The server sends the generated travel plan to the terminal, which then displays it to the user. The details of each plan are displayed, allowing the user to check each plan.

[1217] Step 8:

[1218] User evaluation and feedback on the plan

[1219] The user evaluates the presented plans and inputs feedback, such as "The Okinawa plan is good, but I would like to reduce the budget."

[1220] Step 9:

[1221] Send Feedback (Device)

[1222] The device sends user feedback to the server, including ratings and desired modifications.

[1223] Step 10:

[1224] Receiving Feedback (Server)

[1225] The server receives the feedback sent from the device, and based on the feedback, it prepares to adjust the plan again.

[1226] Step 11:

[1227] Re-adjust plan (server)

[1228] The server analyzes the user's feedback and adjusts the travel plan. Specifically, it selects alternative accommodations and transportation options that fit the user's budget. For example, it adjusts the plan to "an Okinawa resort plan that fits within the user's budget."

[1229] Step 12:

[1230] Sending and displaying realignment plans (server and terminal)

[1231] The re-adjusted plan is sent from the server to the terminal again and displayed to the user, who can then check the plan again.

[1232] Step 13:

[1233] Final plan selection (user)

[1234] The user checks the re-arranged plans, selects the desired plan, and confirms the reservation. For example, the user selects "Okinawa resort plan within budget."

[1235] Step 14:

[1236] Send reservation data (terminal)

[1237] The terminal sends the user's final selection to the server, which starts the reservation procedure.

[1238] Step 15:

[1239] Reservation execution (server)

[1240] The server executes the booking process, booking airline tickets, accommodations, rental cars, etc. through API integration, making all the necessary reservations in one place.

[1241] Step 16:

[1242] Notification of reservation completion (server)

[1243] After the reservation is completed, the server sends the result to the terminal.

[1244] Step 17:

[1245] Display of reservation completion (terminal)

[1246] The terminal receives a reservation completion notification from the server and displays it to the user. For example, it displays "Your flight, hotel, and rental car reservations have been completed."

[1247] Step 18:

[1248] Reminder notification settings (server)

[1249] The server sets reminder notifications based on the travel itinerary, specifically, setting the notification to be sent the day before departure.

[1250] Step 19:

[1251] Sending reminder notifications (server and device)

[1252] As the travel date approaches, the server sends the configured reminder notification to the device, which then displays it to the user. For example, it might say, "It's forecast to rain tomorrow. Please bring an umbrella."

[1253] Step 20:

[1254] Notification of changes (server and terminal)

[1255] In the event of weather or transportation disruptions, the server will provide the user with suggested changes based on the information it has acquired, which the device will then display to the user and provide them with countermeasures.

[1256] Example 1

[1257] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1258] The objective of this study is to provide a system that allows users to easily create travel plans that reflect their detailed requests when planning a trip, and that also allows them to efficiently complete reservation procedures based on those plans. Conventional systems require users to use multiple websites and services to gather information, create their own plans, and make reservations individually, which takes a lot of time and effort.

[1259] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1260] In this invention, the server includes information input means for inputting a user's travel requests, analysis and generation means for analyzing the travel requests received from the information input means and generating a travel plan, and display means for presenting the travel plan generated by the generation means to the user. This enables the user to easily generate a travel plan that reflects the user's requests in detail and quickly select the most suitable plan from the proposed plans.

[1261] "Information input means" refers to a device or software that provides an interface for users to input their travel requests and conditions.

[1262] The "analysis and generation means" refers to a processing device or software in the server that analyzes the user's travel requests received from the information input means and generates an appropriate travel plan.

[1263] The "display means" is a device or software for visually presenting the generated travel plan to the user.

[1264] "Evaluation and feedback receiving means" refers to a device or software that allows a user to input and receive evaluations and feedback on a presented travel plan.

[1265] The "regeneration means" refers to a processing device or software in the server for readjusting the travel plan based on the user's rating or feedback received by the rating / feedback receiving means.

[1266] The "reservation means" refers to a processing device or software in the server for making reservations for transportation and accommodation based on the travel plan re-adjusted by the regeneration means.

[1267] The "notification means" is a device or software for notifying the user that the reservation procedure has been completed.

[1268] This invention is a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the booking process. This system uses AI to create travel plans and can optimize them based on user feedback.

[1269] System configuration

[1270] This system is broadly composed of the following components:

[1271] 1. Information input means (terminal)

[1272] 2. Analysis and generation means (server)

[1273] 3. Display means (terminal and server)

[1274] 4. Evaluation and feedback receiving means (terminal and server)

[1275] 5. Regeneration means (server)

[1276] 6. Reservation Method (Server)

[1277] 7. Notification Methods (Server and Terminal)

[1278] System Operation

[1279] Information input means (terminal)

[1280] The user uses the terminal interface to enter basic information about the trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of destination, etc.) Once the user enters this information into the form and clicks the "Submit" button, the data is sent to the server.

[1281] Analysis and generation means (server)

[1282] The server analyzes the user's travel request data received from the device. This analysis uses natural language processing technology (e.g., Python's Natural Language Toolkit (NLTK) or Google Cloud Natural Language API) to extract specific keywords from the user's requests. Next, it generates multiple travel plans based on the extracted keywords using a generative AI model (e.g., OpenAI's GPT-3).

[1283] Display means (terminal and server)

[1284] The generated travel plan is sent from the server to the terminal and visually displayed to the user. The user can then check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[1285] Evaluation and feedback receiving means (terminal and server)

[1286] The user can evaluate the presented plans and input feedback into the terminal. This feedback is sent from the terminal to the server and received by the evaluation / feedback receiving means. For example, the user can input feedback such as "I like the Okinawa plan, but I would like to reduce the budget."

[1287] Regeneration means (server)

[1288] The server then adjusts the travel plan based on the received feedback. When regenerating the plan, it selects the optimal accommodation and transportation options within the user's budget based on the user's requests. For example, it regenerates a budget-friendly Okinawa resort plan.

[1289] Reservation method (server)

[1290] Once the adjusted travel plan is confirmed, the server processes the transportation and accommodation reservations, specifically using APIs of multiple providers (e.g., Expedia API and Booking.com API) to perform bulk reservations, including airline ticket reservations, hotel reservations, and rental car reservations.

[1291] Notification method (server and terminal)

[1292] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[1293] Specific examples

[1294] 1. When a user plans a trip

[1295] The user uses a terminal and enters the following prompt text:

[1296] Example prompt sentence:

[1297] "I want to travel with my family to a place rich in nature." "3 nights, 4 days in September." "Budget is 200,000 yen."

[1298] Based on this, the server generates and displays the following itinerary:

[1299] A 3-night, 4-day plan to enjoy Hokkaido's great outdoors

[1300] Relax at an Okinawa resort for 3 nights and 4 days

[1301] If a user selects a plan for Okinawa and submits feedback that "I would like to keep the budget a little lower," the server will generate and display a plan that is adjusted to fit within the budget (for example, by changing the accommodation to reduce costs).

[1302] Once the user has confirmed the plan and confirmed the reservation, the server will complete the bulk reservation of the flight, hotel, rental car, etc., and notify the user of the completion. In addition, a reminder will be sent the day before the trip, and if the weather is bad, information on "alternative plans" or "change of destination" will be provided.

[1303] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[1304] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1305] Step 1:

[1306] Entering information (terminal)

[1307] The user accesses the terminal interface and inputs their travel requests (purpose of travel, budget, travel period, number of accompanying persons, type of travel destination, etc.).

[1308] Input: Specific prompt example: "I want to travel to a place rich in nature with my family," "3 nights and 4 days in September," "Budget is 200,000 yen."

[1309] Output: The input data is saved in the device in JSON format or similar.

[1310] Specific operation: The user enters information into the form and clicks the "Submit" button. The device converts the data into structured data and prepares it for transmission to the server.

[1311] Step 2:

[1312] Sending data (from device to server)

[1313] The terminal transmits the user's input data to the server.

[1314] Input: Travel request data entered by the user

[1315] Output: Travel request data is sent to the server

[1316] Specific operation: The terminal generates an HTTP request and sends the request including the user's input data to the server.

[1317] Step 3:

[1318] Data analysis (server)

[1319] The server receives the user's travel request data and analyzes it using natural language processing technology.

[1320] Input: Travel request data sent from the terminal

[1321] Output: Keyword extraction results (e.g., family trip, nature, budget 200,000 yen, September, 3 nights, 4 days)

[1322] Specific operation: The server extracts keywords from text data using Python's NLTK or Google Cloud Natural Language API.

[1323] Step 4:

[1324] Travel plan generation (server)

[1325] The server generates multiple travel plans using a generative AI model based on the extracted keywords.

[1326] Input: Extracted keyword data

[1327] Output: A list of generated travel plans (e.g., a 3-night, 4-day plan to enjoy the natural beauty of Hokkaido, or a 3-night, 4-day plan to relax at a resort in Okinawa)

[1328] How it works: The server uses a generative AI model such as OpenAI's GPT-3 to generate a travel plan in text format that matches the user's requests.

[1329] Step 5:

[1330] Displaying travel plans (from server to device)

[1331] The server transmits the generated travel plan to the terminal, which presents it to the user.

[1332] Input: Generated itinerary

[1333] Output: The itinerary displayed to the user

[1334] Specific operation: The server sends the generated plan in JSON format to the terminal, and the terminal converts the received data into HTML or the app UI and displays it.

[1335] Step 6:

[1336] Receiving user ratings and feedback (from device to server)

[1337] The user inputs an evaluation and feedback on the presented plan.

[1338] Input: User's rating and feedback (e.g., "I liked the Okinawa plan, but I want to reduce the budget.")

[1339] Output: Feedback is sent from the device to the server.

[1340] Specific operation: The user enters a comment in the feedback form and clicks the "Submit" button. The device sends the feedback to the server.

[1341] Step 7:

[1342] Regenerate travel plan (server)

[1343] The server readjusts the travel plan based on the received feedback.

[1344] Input: Feedback data from users

[1345] Output: Regenerated travel plan (e.g., budget Okinawa resort plan)

[1346] Specific operation: The server runs the generative AI model again and regenerates a plan based on the new conditions.

[1347] Step 8:

[1348] Execution of reservation procedures (server)

[1349] The user confirms the final plan and confirms the reservation. The server processes the reservations for transportation and accommodation.

[1350] Input: Final travel plan approved by the user

[1351] Output: Reservation completion notification

[1352] Specific operation: The server uses the Expedia API and Booking.com API to complete the booking process for airline tickets and hotels in bulk.

[1353] Step 9:

[1354] Notification of reservation completion (from server to device)

[1355] The server notifies the user that the reservation is complete, and also provides reminders based on the travel itinerary and information on how to deal with weather and transportation disruptions on the day of the trip.

[1356] Input: reservation completion data, travel itinerary data

[1357] Output: User notification

[1358] Specific operation: The server uses email or SMS to send reservation completion notifications and reminder notifications to the user.

[1359] This allows users to efficiently create travel plans and automate the booking process.

[1360] (Application example 1)

[1361] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1362] Currently, users spend a lot of time and effort planning their trips and creating optimal travel plans. Furthermore, it is difficult to plan efficiently because reservations for transportation and accommodations must be made separately. Furthermore, planning requires appropriately combining transportation methods, which is no easy task. In particular, when using autonomous vehicles as a modern means of transportation, a system is needed that allows for smooth generation and booking of travel plans that include these vehicles.

[1363] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1364] In this invention, the server includes: an input means for inputting a user's travel requests; an analysis and generation means for analyzing the travel requests received from the input means and generating a travel plan; a presentation means for presenting the travel plan generated by the generation means to the user; an evaluation and feedback receiving means for receiving a user's rating or feedback on the travel plan presented by the presentation means; a regeneration means for adjusting the travel plan based on the rating or feedback received by the evaluation and feedback receiving means; a reservation means for reserving transportation and accommodation based on the travel plan adjusted by the regeneration means; a notification means for notifying the user whether the reservation is complete; an input means for inputting the user's requests by voice or touch to a display device in an autonomous vehicle; and a presentation means for presenting a travel plan that includes the autonomous vehicle as a means of transportation. This enables users to plan their trips efficiently and comfortably and enjoy a smooth journey using the autonomous vehicle.

[1365] "Input means" refers to a device or interface that allows a user to input travel requests.

[1366] "Analysis and generation means" refers to a system or algorithm that analyzes the user's travel requests and generates the optimal travel plan.

[1367] The "presentation means" refers to a device or interface for visually or audibly presenting the generated travel plan to the user.

[1368] "Evaluation and feedback receiving means" refers to a system or interface for receiving evaluations and feedback made by users regarding travel plans.

[1369] A "regenerator" is a system or algorithm that adjusts and regenerates a travel plan based on the ratings and feedback received.

[1370] "Reservation Channel" means a system or interface for booking transportation and accommodation based on a coordinated travel plan.

[1371] "Notification means" refers to a system or device that notifies the user whether the reservation has been completed or other important information.

[1372] A "display device" is a display or touch panel installed in an autonomous vehicle for users to input and confirm information.

[1373] "Voice input" refers to an interface or technology that allows users to input travel requests and other information by voice.

[1374] "Touch input" refers to the interface and technology that allows users to input travel requests and other information using a touchscreen.

[1375] An "autonomous vehicle" is a vehicle that operates autonomously and does not require human operation.

[1376] A "travel plan" is detailed information such as a travel schedule, route, accommodation, and transportation that is proposed based on the user's requests.

[1377] The present invention relates to a system for efficiently assisting users in planning their trips and for using autonomous vehicles as a means of transportation. Hereinafter, a program and a processing procedure of the system will be described as a specific embodiment.

[1378] System Program

[1379] The server includes an input means for inputting travel requests from users, an analysis and generation means for analyzing the received travel requests and generating a travel plan, a presentation means for presenting the generated travel plan to the user, an evaluation and feedback receiving means for receiving ratings and feedback from users, a regeneration means for readjusting the travel plan based on the received ratings and feedback, a reservation means for reserving transportation and accommodations based on the adjusted travel plan, and a notification means for notifying the user of the completion of the reservation. Furthermore, the display devices (touch panel and voice input device) inside the autonomous vehicle are used as user input means.

[1380] Hardware and Software

[1381] Hardware: Smart displays, touch panels, microphones in autonomous vehicles, and users' smartphones

[1382] Software: Natural language processing engines (e.g., Google Cloud Natural Language API), AI models (e.g., GPT-4), booking APIs (e.g., Amadeus API)

[1383] Processing Description

[1384] The server receives information about the user's travel requests via voice or touch input on a display device inside the autonomous vehicle. The received information is analyzed using natural language processing technology. A natural language processing engine such as Google Cloud Natural Language API is used for this analysis. Based on the analysis results, an AI model (e.g., GPT-4) is used to generate multiple travel plans.

[1385] The generated travel plans are visually presented on a display inside the autonomous vehicle. The user selects a suitable plan from the list and provides their rating and feedback. This feedback is sent back to the server, where the regeneration means adjusts the plan. Based on the adjusted plan, the reservation means operates and makes reservations for transportation and accommodation. This reservation is made using a reservation system such as the Amadeus API.

[1386] Once the reservation is complete, the notification means will be activated and the result will be notified to the user. This will provide pre-travel reminders and weather information for the day, allowing the user to carry out their travel plans with peace of mind.

[1387] Specific examples

[1388] For example, if a user in a self-driving car says, "I want to go on a trip with my family to a place rich in nature. My budget is under 200,000 yen. I want to go for three nights and four days in September," the system will analyze this and generate the optimal travel plan. If the user sends feedback from one of the generated plans saying, "I would like a different plan with a lower budget," the system will generate a new plan and present it again.

[1389] This will enable users to plan trips efficiently and comfortably, and ensure a smooth journey using autonomous vehicles.

[1390] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1391] Step 1: User Input

[1392] Users input their travel needs into the display device inside the self-driving car by voice or touch. For voice input, a microphone is used, and for touch input, a touch panel is used. The input information includes basic information such as the purpose of the trip, budget, duration, number of accompanying people, and type of travel destination.

[1393] Step 2: Receiving data

[1394] The server receives the input data sent from the autonomous vehicle and stores the input travel request data on the server side.

[1395] Step 3: Data analysis

[1396] The server analyzes the stored travel request data. This analysis uses a natural language processing engine (e.g., Google Cloud Natural Language API). Specifically, it extracts keywords and desired conditions from the user's input and structures this data.

[1397] Input: Travel request data

[1398] Output: Parsed keywords and conditions

[1399] Step 4: Create a travel plan

[1400] The server uses the analyzed keywords and conditions to generate multiple travel plans using an AI model (e.g., GPT-4), each of which includes different destinations, activities, and accommodations.

[1401] Input: Parsed keywords and conditions

[1402] Output: Multiple itineraries

[1403] Step 5: Submit your travel plan

[1404] The server sends the generated travel plan to the user's device, where it is visually presented on a display inside the autonomous vehicle. The user can then check the details of the presented plan.

[1405] Input: Generated itinerary

[1406] Output: Travel plan displayed on the user's device

[1407] Step 6: Receiving feedback

[1408] The user inputs their evaluation and feedback on the presented travel plan into the display device, and the input feedback data is sent to the server.

[1409] Input: User feedback

[1410] Output: Feedback data sent to the server

[1411] Step 7: Regenerate

[1412] The server analyzes the received feedback data and adjusts the travel plan through a regeneration means, which includes the process of regenerating an appropriate plan based on the user's new requests and feedback.

[1413] Input: Feedback data

[1414] Output: Reworked itinerary

[1415] Step 8: Resubmit

[1416] The server then transmits the regenerated travel plan to the user's terminal, where the user can check the re-presented plan on the display.

[1417] Input: rearranged travel plans

[1418] Output: Realignment plan displayed on the user's device

[1419] Step 9: Reservation execution

[1420] The server makes reservations for transportation and accommodation based on the user's final travel plan, using a booking API (e.g., Amadeus API).

[1421] Input: Finalized travel plans

[1422] Output: Reservation completion data

[1423] Step 10: Notification

[1424] The server notifies the user whether the reservation is successful or not, and may also provide itinerary reminders, weather forecasts for the day, and suggested changes in case of transportation disruptions.

[1425] Input: Booking completion data and travel information

[1426] Output: Notification information sent to the user's device

[1427] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1428] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the reservation process. This system is a travel plan creation support system that utilizes AI and an emotion engine, and is configured and operates as follows:

[1429] System configuration

[1430] This system is broadly composed of the following components:

[1431] 1. Input means (terminal)

[1432] 2. Analysis and generation means (server)

[1433] 3. Presentation Method (Terminal and Server)

[1434] 4. Evaluation and feedback receiving means (terminal and server)

[1435] 5. Regeneration means (server)

[1436] 6. Reservation Method (Server)

[1437] 7. Notification Methods (Server and Terminal)

[1438] 8. Emotion engine (server and terminal)

[1439] Program processing

[1440] Input method (terminal)

[1441] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[1442] Emotion engine (server and terminal)

[1443] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions, which are then used as key elements in analyzing and generating the user's travel requests.

[1444] Analysis and generation means (server)

[1445] The server analyzes the user's travel request data received from the device and the emotion data obtained from the emotion engine. It uses natural language processing technology for the analysis, comprehensively evaluating the user's requests and emotions to extract necessary keywords. For example, if a user inputs "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "three nights and four days" while showing a relaxed expression, the server will use this data to generate the optimal travel plan for the user.

[1446] Presentation method (terminal and server)

[1447] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[1448] Evaluation and feedback receiving means (terminal and server)

[1449] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to generate a new plan. For example, a user can enter feedback such as "I like the Okinawa plan, but I would like to reduce the budget" and the associated emotions.

[1450] Regeneration means (server)

[1451] The server then re-adjusts the travel plan based on the user's feedback and sentiment data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly Okinawa resort plan.

[1452] Reservation method (server)

[1453] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[1454] Notification method (server and terminal)

[1455] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[1456] Specific examples

[1457] 1. When a user plans a trip

[1458] The user uses a device to input requests such as "I want to travel with my family to a place rich in nature," "3 nights, 4 days in September," and "budget of 200,000 yen." At the same time, the emotion engine analyzes the user's facial expressions and tone of voice and recognizes that the user is in a relaxed state. Based on this, the server generates and presents plans to enjoy the great outdoors of Hokkaido and to relax at a resort in Okinawa. If the user selects the Okinawa plan and submits feedback that they would like to keep the budget a little lower, the server analyzes that feedback and the user's emotions and displays a revised plan within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[1459] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[1460] The processing flow will be explained below.

[1461] Step 1:

[1462] Display of input screen (terminal)

[1463] The device displays a screen for the user to enter basic information about the trip, including fields for inputting information such as the purpose of the trip, budget, duration of the trip, number of people traveling with the user, and type of destination.

[1464] Step 2:

[1465] User information input (user)

[1466] The user inputs their travel requirements into the device. For example, they input information such as "family trip," "budget 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days." At the same time, the user's facial expressions and tone of voice are analyzed by the emotion engine.

[1467] Step 3:

[1468] Sending input data and emotion data (terminal)

[1469] The terminal transmits the input user information and emotion data from the emotion engine to the server. The transmitted data includes information on all input fields and the emotional state.

[1470] Step 4:

[1471] Receiving user information and emotion data (server)

[1472] The server receives the user information and emotion data sent from the device and prepares to analyze the received data.

[1473] Step 5:

[1474] Data analysis (server)

[1475] The server uses natural language processing technology to analyze the received user information and emotional data, extracting keywords such as "family trip," "nature," "September," and "three nights and four days" from the user's request, and uses the emotional data to determine the user's psychological state (e.g., whether they are relaxed).

[1476] Step 6:

[1477] Travel plan generation (server)

[1478] The server generates multiple travel plans that match the user's needs based on the analyzed keywords and emotion data, such as "a plan to enjoy the great outdoors of Hokkaido" and "a plan to relax at a resort in Okinawa."

[1479] Step 7:

[1480] Sending and displaying plans (server and device)

[1481] The server sends the generated travel plan to the terminal, which visually displays the received plan to the user. Specific plan details are displayed, allowing the user to check each plan.

[1482] Step 8:

[1483] User evaluation and feedback on the plan

[1484] The user evaluates the presented plans and enters feedback. For example, they may enter a comment such as, "The Okinawa plan is good, but I would like to reduce the budget." In this case, the emotion engine also analyzes the user's facial expressions and tone of voice to collect emotional data in real time.

[1485] Step 9:

[1486] Sending feedback and emotional data (device)

[1487] The device transmits user feedback and emotion data to the server, including user ratings and desired modifications.

[1488] Step 10:

[1489] Receiving feedback and emotion data (server)

[1490] The server receives the feedback and emotion data sent from the device, and prepares to adjust the plan again based on the feedback.

[1491] Step 11:

[1492] Re-adjust plan (server)

[1493] The server analyzes the user's feedback and emotional data and adjusts the travel plan accordingly. Specifically, it selects alternative accommodations and transportation options that fit the user's budget. For example, it adjusts the plan to "an Okinawa resort plan within the user's budget."

[1494] Step 12:

[1495] Sending and displaying realignment plans (server and terminal)

[1496] The server sends the re-adjusted plan to the terminal, which visually displays the received plan to the user again, allowing the user to review the plan again.

[1497] Step 13:

[1498] Final plan selection (user)

[1499] The user checks the re-arranged plans, selects the desired plan, and confirms the reservation. For example, the user selects "Okinawa resort plan within budget."

[1500] Step 14:

[1501] Send reservation data (terminal)

[1502] The terminal sends the user's final selection to the server, which starts the reservation procedure.

[1503] Step 15:

[1504] Reservation execution (server)

[1505] The server executes the booking process, booking airline tickets, accommodations, rental cars, etc. through API integration, making all the necessary reservations in one place.

[1506] Step 16:

[1507] Notification of reservation completion (server)

[1508] After the reservation is completed, the server sends the result to the terminal.

[1509] Step 17:

[1510] Display of reservation completion (terminal)

[1511] The terminal receives a reservation completion notification from the server and displays it to the user. For example, it displays "Your flight, hotel, and rental car reservations have been completed."

[1512] Step 18:

[1513] Reminder notification settings (server)

[1514] The server sets reminder notifications based on the travel itinerary, specifically, setting the notification to be sent the day before departure.

[1515] Step 19:

[1516] Sending reminder notifications (server and device)

[1517] As the travel date approaches, the server sends the configured reminder notification to the device, which then displays it to the user. For example, it might say, "It's forecast to rain tomorrow. Please bring an umbrella."

[1518] Step 20:

[1519] Notification of changes (server and terminal)

[1520] In the event of weather or transportation disruptions, the server will provide the user with suggested changes based on the information it has acquired, which the device will then display to the user and provide them with countermeasures.

[1521] Example 2

[1522] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1523] Conventional travel plan creation systems generate travel plans based solely on information entered by the user, which means they cannot fully reflect the user's latent desires and emotions. It is also difficult to efficiently collect and incorporate feedback on proposed plans, which can result in low user satisfaction. Furthermore, because reservation procedures and change notifications are not centralized, users must perform multiple procedures individually, which is time-consuming and laborious.

[1524] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting a user's travel requests; an analysis and generation means for analyzing the travel requests received from the input means and generating a travel plan; a presentation means for presenting the travel plan generated by the generation means to the user; an emotion engine for analyzing the user's biometric information to acquire emotion data; an evaluation and feedback receiving means for receiving the user's evaluation or feedback on the travel plan presented by the presentation means; a regeneration means for adjusting the travel plan based on the evaluation or feedback and emotion data received by the evaluation and feedback receiving means; a reservation means for reserving transportation and accommodation facilities based on the travel plan adjusted by the regeneration means; and a notification means for notifying the user whether the reservation has been completed. This enables the generation of an optimal travel plan that reflects the user's potential requests and emotions, rapid plan readjustment based on feedback, and unified reservation procedures and change notification.

[1525] "Input means" refers to a device or software that provides an interface for a user to input travel requests.

[1526] The "analysis and generation means" is a means for analyzing the travel requests received from the input means and generating an appropriate travel plan.

[1527] The "presentation means" is a means for visually or audibly presenting the travel plan generated by the generation means to the user.

[1528] An "emotion engine" is a device or software that analyzes biometric information from a user (e.g., facial expressions and tone of voice) to obtain emotional data.

[1529] The "evaluation / feedback receiving means" is a means for collecting user evaluations or feedback on the travel plan presented by the presentation means.

[1530] The "regeneration means" is a means for adjusting the travel plan based on the evaluation or feedback and emotion data received by the evaluation / feedback receiving means.

[1531] The "reservation means" is a means for making reservations for transportation and accommodation facilities based on the travel plan adjusted by the regeneration means.

[1532] The "notification means" is a means for notifying the user whether the reservation has been completed or not, and for providing reminders or suggested changes as necessary.

[1533] "Natural language processing technology" is a computer technology for analyzing, understanding, and generating text data, and is used to analyze travel requests and emotional data.

[1534] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the booking process. This system is a travel plan creation support system that utilizes AI and an emotion engine, and is configured and operates as follows:

[1535] System configuration

[1536] This system is broadly composed of the following components:

[1537] 1. Input means (terminal)

[1538] 2. Analysis and generation means (server)

[1539] 3. Presentation Method (Terminal and Server)

[1540] 4. Evaluation and feedback receiving means (terminal and server)

[1541] 5. Regeneration means (server)

[1542] 6. Reservation Method (Server)

[1543] 7. Notification Methods (Server and Terminal)

[1544] 8. Emotion engine (server and terminal)

[1545] Program processing

[1546] Input method (terminal)

[1547] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[1548] Emotion engine (server and terminal)

[1549] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions. This information is used as an important factor in analyzing and generating the user's travel requests. For example, it can determine whether the user is in a relaxed state when entering information.

[1550] Analysis and generation means (server)

[1551] The server analyzes the user's travel request data received from the device and the emotion data obtained from the emotion engine. It uses natural language processing technology for the analysis, comprehensively evaluating the user's requests and emotions to extract necessary keywords. For example, if a user inputs "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "three nights and four days" while showing a relaxed expression, the server will use this data to generate the optimal travel plan for the user.

[1552] Presentation method (terminal and server)

[1553] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day plan for enjoying a family trip in a natural area" or a "3-night, 4-day plan for relaxing at a resort" may be displayed.

[1554] Evaluation and feedback receiving means (terminal and server)

[1555] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to generate a new plan. For example, a user can enter feedback such as "I like the Okinawa plan, but I would like to reduce the budget" and the associated emotions.

[1556] Regeneration means (server)

[1557] The server then re-adjusts the itinerary based on the user's feedback and sentiment data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly resort itinerary.

[1558] Reservation method (server)

[1559] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[1560] Notification method (server and terminal)

[1561] Once the reservation is complete, the server notifies the user of the results. It also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel. For example, a reminder may be sent the day before travel, suggesting countermeasures if bad weather is predicted for the day of travel.

[1562] Specific examples

[1563] When planning a trip, a user uses a device to input requests such as "I want to go on a family trip to a place rich in nature," "3 nights and 4 days in September," and "My budget is 200,000 yen." At the same time, the emotion engine analyzes the user's facial expressions and tone of voice to recognize that the user is in a relaxed state. Based on this, the server generates and presents plans for a family trip to a place rich in nature and a relaxing resort. If the user selects a resort plan and submits feedback that they would like to keep the budget a little lower, the server analyzes that feedback and the user's emotions and displays a revised plan within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[1564] Specific examples of prompts to input to generative AI models

[1565] "I'm planning a four-day, three-night trip with my family to a place rich in nature. My budget is 200,000 yen, and I plan to leave in September. What travel plans do you recommend?"

[1566] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1567] Step 1:

[1568] The user enters basic information about the trip

[1569] The user uses the device to input basic information such as the purpose of the trip, budget, travel period, number of accompanying people, and type of travel destination. The device receives this information through an input interface, converts it into the required data format on the front end, and then sends it to the server. For example, a user might input "I want to travel with my family to a place rich in nature," "3 nights, 4 days in September," and "budget is 200,000 yen." This information is converted into a data structure such as JSON format and sent to the server.

[1570] Input: User's basic information (purpose, budget, period, number of people, genre)

[1571] Output: JSON formatted travel request data sent to the server

[1572] Step 2:

[1573] The device analyzes the user's emotional data

[1574] While the user is entering information, the device's built-in emotion engine analyzes the user's facial expressions, tone of voice, and other biometric information in real time. The analysis results in emotional data about the user. This emotional data indicates whether the user is relaxed or excited, and is an important factor in generating travel plans.

[1575] Input: User's facial expression data, tone of voice

[1576] Output: Analyzed user emotion data (e.g., relaxation state)

[1577] Step 3:

[1578] The server analyzes the request and emotion data

[1579] The server analyzes the travel request data and emotion data received from the device. Using natural language processing technology, it extracts important keywords from the travel request data and combines them with the emotion data to identify the user's true desires. For example, information such as "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days" along with a relaxed emotion are extracted.

[1580] Input: Travel request data, emotion data

[1581] Output: Analyzed keywords and sentiment evaluation

[1582] Step 4:

[1583] The server generates the optimal travel plan

[1584] Based on the analysis results, the server generates the optimal travel plan that meets the user's expectations. During the generation process, a generative AI model is used to make suggestions that match the user's desires and emotions. For example, options such as the natural beauty of Hokkaido or resorts in Okinawa are generated.

[1585] Input: Analyzed keywords and emotion evaluation

[1586] Output: Multiple travel plans (e.g. Hokkaido's natural beauty, Okinawa's resorts)

[1587] Step 5:

[1588] The server presents the generated plan to the device.

[1589] The server sends the generated travel plans to the device and presents them visually to the user. The user can then check the details of these plans on the device and compare the pros and cons of each plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed on the device screen.

[1590] Input: Generated itinerary

[1591] Output: A list of itineraries presented to the user

[1592] Step 6:

[1593] The device collects user feedback

[1594] The user evaluates the presented travel plans and inputs feedback via the terminal. The emotion engine again analyzes the user's facial expressions and tone of voice, and sends the feedback to the server. For example, the user might input feedback such as, "I like the Okinawa plan, but I would like to reduce the budget."

[1595] Input: User feedback, reanalyzed emotion data

[1596] Output: Feedback data, emotion data sent to the server

[1597] Step 7:

[1598] The server regenerates the plan based on the feedback.

[1599] The server then re-adjusts the travel plan based on the user's feedback and emotional data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly Okinawa resort plan.

[1600] Input: Feedback data, emotion data

[1601] Output: Reworked itinerary

[1602] Step 8:

[1603] The server starts the reservation process

[1604] Once the coordinated travel plans are finalized, the server initiates the booking process for transportation, accommodation, and other activities, using APIs from multiple providers to make bulk bookings, e.g., booking flights, booking hotels, and booking rental cars.

[1605] Input: Confirmed travel plans

[1606] Output: Completed reservation data

[1607] Step 9:

[1608] The server notifies the reservation result

[1609] Once the reservation process is complete, the server sends the results to the device and notifies the user. Furthermore, reminders based on the travel itinerary and the latest information on the day of travel (notification of changes in weather and transportation) are also sent. For example, a reminder is sent the day before travel, and if bad weather is predicted for the day of travel, countermeasures are suggested.

[1610] Input: Completed reservation data

[1611] Output: Notification messages, reminders, and proposed changes to users

[1612] (Application example 2)

[1613] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1614] In today's society, planning specific events or everyday meals can be time-consuming and tedious. There is a lack of easy ways to provide optimal food delivery plans tailored to users' emotions and specific needs. As a result, inefficient procedures and inappropriate choices lead to low user satisfaction.

[1615] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1616] In this invention, the server includes an input means for inputting a user's event or daily requests, an analysis and generation means for analyzing the requests received from the input means and generating a food delivery plan, a presentation means for presenting the food delivery plan generated by the generation means to the user, an evaluation and feedback receiving means for receiving the user's evaluation or feedback on the food delivery plan presented by the presentation means, a regeneration means for adjusting the food delivery plan based on the evaluation or feedback received by the evaluation and feedback receiving means, a reservation means for executing a food order based on the food delivery plan adjusted by the regeneration means, a notification means for notifying the user whether the reservation has been completed, and an emotion engine for analyzing the user's emotional state. This allows the user to easily create an optimal food delivery plan and achieve high satisfaction with events and daily meals.

[1617] "User" refers to an individual or organization that uses this system to provide specific services or information.

[1618] An "event" is a planned activity or event that takes place on a specific date or for a specific purpose.

[1619] "Daily needs" refer to the specific needs and demands that users have in their daily lives.

[1620] "Input means" refers to an interface through which a user provides information to a system.

[1621] "Analysis and generation means" refers to the functionality for processing information obtained from the user and generating specific plans and solutions.

[1622] "Presentation means" refers to an interface for visually displaying the plans and information generated by the system to the user.

[1623] "Means for receiving evaluations and feedback" refers to the function for collecting evaluations and opinions from users.

[1624] "Regeneration means" refers to functionality for readjusting the generated plan based on feedback from the user.

[1625] "Reservation means" refers to a function for making reservations and ordering services based on the generated plan.

[1626] "Notification means" refers to a function for notifying users of important information and updated content.

[1627] "Emotion engine" refers to technology for analyzing a user's emotional state.

[1628] "Food delivery plan" refers to the optimal food delivery plan based on the user's requests.

[1629] This invention relates to a system that collects user requests when they input their meal plans for a specific event or daily meal, generates and presents optimal food delivery plans, and automatically completes the reservation process. This system is configured and operates as follows:

[1630] System configuration

[1631] This system is broadly composed of the following components:

[1632] 1. Input means (terminal)

[1633] 2. Analysis and generation means (server)

[1634] 3. Presentation Method (Terminal and Server)

[1635] 4. Evaluation and feedback receiving means (terminal and server)

[1636] 5. Regeneration means (server)

[1637] 6. Reservation Method (Server)

[1638] 7. Notification Methods (Server and Terminal)

[1639] 8. Emotion engine (server and terminal)

[1640] Specific system behavior

[1641] An input method for inputting user events and daily requests

[1642] The terminal provides an interface for users to input basic information about a particular event or everyday meal (type of event, budget, number of guests, type of cuisine, etc.) The user enters this information into a form, and once completed, the information is sent to the server.

[1643] Emotion engine that analyzes the user's emotional state

[1644] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions. This information is used as an important element in analyzing and generating user requests. Specifically, it uses facial recognition and voice analysis technologies to understand the user's psychological state.

[1645] Analysis and generation means to analyze requests and generate food delivery plans

[1646] The server analyzes the user's events and daily request data received from the device, as well as the emotion data obtained from the emotion engine. The analysis uses natural language processing technology to comprehensively evaluate the user's requests and emotions and extract necessary keywords. For example, if a user inputs "weekend party with friends," "budget 8,000 yen," "Italian," "preferring vegetarian options," and shows a relaxed expression, the server will generate the optimal food delivery plan based on this data.

[1647] A means for presenting the generated food delivery plan to the user.

[1648] The generated food delivery plan is sent from the server to the device and visually displayed to the user, where the user can check the details of the proposed plan. For example, a "Refreshing and Healthy Italian Meal Plan" is displayed.

[1649] A means of receiving user ratings or feedback on the plan

[1650] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to determine how the plans are regenerated.

[1651] Regenerative measures to adjust food delivery plans

[1652] The server re-adjusts the food delivery plan based on user feedback and sentiment data, including selecting the best meals within the user's budget, for example, re-generating a healthy Italian meal plan on a budget.

[1653] Reservation method to process the reservation

[1654] Once the adjusted food delivery plan is confirmed, the server initiates the food ordering process. This reservation process is performed in bulk using the APIs of multiple service providers, for example, placing an order with partner food delivery services.

[1655] Notification method for notifying completion of reservation

[1656] Once the reservation is complete, the server notifies the user of the result, and also provides reminders on the delivery status and notifies the user of proposed changes to accommodate weather, transportation disruptions, etc.

[1657] Specific examples

[1658] Scenario: Weekend party with friends

[1659] 1. User input

[1660] Event: Weekend party with friends

[1661] Budget: 8,000 yen

[1662] Number of guests: 4

[1663] Cuisine:Italian

[1664] Other: Vegetarian option desired

[1665] 2. Emotional Data

[1666] Smiling and relaxed

[1667] 3. Prompt sentence for generative AI model

[1668] It was a weekend party with friends, with four guests and a budget of ¥8,000. They wanted Italian food, including vegetarian options. Since she had a relaxed, smiling face, I suggested a fun, casual menu.

[1669] In this scenario, users can easily create optimal food delivery plans, achieving high levels of satisfaction for events and everyday meals.

[1670] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1671] Step 1:

[1672] Enter user events and daily requests

[1673] Input: A user uses a device to input basic information about a particular event or daily meal.

[1674] Data processing: The terminal formats the input information and sends it to the server.

[1675] Output: The requested data to be sent to the server.

[1676] Step 2:

[1677] Emotional analysis of users using an emotion engine

[1678] Input: Biometric information such as facial expressions and tone of voice while the user is inputting information into the device.

[1679] Data calculation: The emotion engine uses facial recognition and voice analysis technologies to identify the user's emotions from the input data.

[1680] Output: User emotion data.

[1681] Step 3:

[1682] Analysis of user requests and emotion data and plan generation

[1683] Input: Desire data and emotion data sent to the server.

[1684] Data calculation: The server uses natural language processing technology (e.g., a generative AI model) to comprehensively analyze the user's requests and emotions, extract necessary keywords, generate prompt sentences, and input them into the generative AI model.

[1685] Output: Optimal food delivery plan.

[1686] Step 4:

[1687] Presenting the generated food delivery plan

[1688] Input: Server-generated food delivery plan.

[1689] Data processing: The server converts the plan into a visual format and sends it to the terminal.

[1690] Output: Food delivery plan details displayed on the terminal.

[1691] Step 5:

[1692] Collecting user ratings and feedback

[1693] Input: Ratings and feedback for the food delivery plans viewed by the user on their device.

[1694] Data processing: The device formats the ratings and feedback and sends them to the server.

[1695] Output: Rating and feedback data sent to the server.

[1696] Step 6:

[1697] Adjusting the plan by regeneration means

[1698] Input: Rating and feedback data, sentiment data sent to the server.

[1699] Data Computation: The server analyzes new request and emotion data and readjusts the plan as needed. It uses a generative AI model to generate new prompts.

[1700] Output: A reworked food delivery plan.

[1701] Step 7:

[1702] Presenting a re-adjusted food delivery plan

[1703] Input: Food delivery plan rearranged by server.

[1704] Data processing: The server converts the re-adjusted plan into a visual format and sends it to the terminal.

[1705] Output: The re-adjusted food delivery plan details displayed on the terminal.

[1706] Step 8:

[1707] Executing food ordering procedures

[1708] Input: The food delivery plan that the user finally selected.

[1709] Data processing: The server uses the API of the partner food delivery service to process the order.

[1710] Output: Order completed.

[1711] Step 9:

[1712] Reservation and delivery status notifications

[1713] Input: The result of the order process executed by the server.

[1714] Data Processing: The server monitors order confirmations and delivery status, sending reminders and status updates to the user as needed.

[1715] Output: Notification to user and delivery status update.

[1716] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1717] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1718] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1719] [Fourth embodiment]

[1720] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1721] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1722] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1723] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1724] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1725] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1726] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1727] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1728] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1729] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1730] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1731] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1732] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1733] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the reservation process. This system is an AI-based travel plan creation support system, and is configured and operates as follows:

[1734] System configuration

[1735] This system is broadly composed of the following components:

[1736] 1. Input means (terminal)

[1737] 2. Analysis and generation means (server)

[1738] 3. Presentation Method (Terminal and Server)

[1739] 4. Evaluation and feedback receiving means (terminal and server)

[1740] 5. Regeneration means (server)

[1741] 6. Reservation Method (Server)

[1742] 7. Notification Methods (Server and Terminal)

[1743] Program processing

[1744] Input method (terminal)

[1745] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[1746] Analysis and generation means (server)

[1747] The server analyzes the user's travel request data received from the device. This analysis uses natural language processing technology to extract specific keywords from the user's request. For example, if the server receives requests such as "family trip," "place rich in nature," "September," and "3 nights, 4 days," it will generate multiple suitable travel plans based on this information.

[1748] Presentation method (terminal and server)

[1749] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[1750] Evaluation and feedback receiving means (terminal and server)

[1751] Users can evaluate the plans presented and enter their feedback into the terminal. This feedback is sent from the terminal to the server. For example, users can enter feedback such as, "I like the Okinawa plan, but I would like to reduce the budget."

[1752] Regeneration means (server)

[1753] The server then adjusts the travel plan based on the user's ratings and feedback. This adjustment includes selecting the optimal accommodation and transportation options within the user's budget. For example, it regenerates a budget-friendly Okinawa resort plan.

[1754] Reservation method (server)

[1755] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[1756] Notification method (server and terminal)

[1757] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[1758] Specific examples

[1759] 1. When a user plans a trip

[1760] The user uses a terminal to input requests such as "I want to travel with my family to a place rich in nature," "3 nights and 4 days in September," and "My budget is 200,000 yen." Based on this, the server generates and presents two plans: one to enjoy the great outdoors of Hokkaido, and another to relax at a resort in Okinawa. If the user selects the Okinawa plan and submits feedback that they would like to keep the budget a little lower, the server displays a revised plan that fits within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[1761] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[1762] The processing flow will be explained below.

[1763] Step 1:

[1764] Display of input screen (terminal)

[1765] The device displays a screen for the user to enter basic information about the trip, including fields for inputting information such as the purpose of the trip, budget, duration of the trip, number of people traveling with the user, and type of destination.

[1766] Step 2:

[1767] User information input (user)

[1768] The user inputs their travel requirements into the device, such as "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days."

[1769] Step 3:

[1770] Sending input data (terminal)

[1771] The terminal sends the entered user information to the server. The sent data includes information from all input fields.

[1772] Step 4:

[1773] Receiving user information (server)

[1774] The server receives the user information sent from the terminal and prepares to analyze the received data.

[1775] Step 5:

[1776] Data analysis (server)

[1777] The server analyzes the received user information using natural language processing technology, extracting keywords such as "family trip," "nature," "September," and "3 nights, 4 days" from the user's request.

[1778] Step 6:

[1779] Travel plan generation (server)

[1780] Based on the analyzed keywords, the server generates multiple travel plans that match the user's requests, such as "a plan to enjoy the great outdoors of Hokkaido" and "a plan to relax at a resort in Okinawa."

[1781] Step 7:

[1782] Sending and displaying plans (server and device)

[1783] The server sends the generated travel plan to the terminal, which then displays it to the user. The details of each plan are displayed, allowing the user to check each plan.

[1784] Step 8:

[1785] User evaluation and feedback on the plan

[1786] The user evaluates the presented plans and inputs feedback, such as "The Okinawa plan is good, but I would like to reduce the budget."

[1787] Step 9:

[1788] Send Feedback (Device)

[1789] The device sends user feedback to the server, including ratings and desired modifications.

[1790] Step 10:

[1791] Receiving Feedback (Server)

[1792] The server receives the feedback sent from the device, and based on the feedback, it prepares to adjust the plan again.

[1793] Step 11:

[1794] Re-adjust plan (server)

[1795] The server analyzes the user's feedback and adjusts the travel plan. Specifically, it selects alternative accommodations and transportation options that fit the user's budget. For example, it adjusts the plan to "an Okinawa resort plan that fits within the user's budget."

[1796] Step 12:

[1797] Sending and displaying realignment plans (server and terminal)

[1798] The re-adjusted plan is sent from the server to the terminal again and displayed to the user, who can then check the plan again.

[1799] Step 13:

[1800] Final plan selection (user)

[1801] The user checks the re-arranged plans, selects the desired plan, and confirms the reservation. For example, the user selects "Okinawa resort plan within budget."

[1802] Step 14:

[1803] Send reservation data (terminal)

[1804] The terminal sends the user's final selection to the server, which starts the reservation procedure.

[1805] Step 15:

[1806] Reservation execution (server)

[1807] The server executes the booking process, booking airline tickets, accommodations, rental cars, etc. through API integration, making all the necessary reservations in one place.

[1808] Step 16:

[1809] Notification of reservation completion (server)

[1810] After the reservation is completed, the server sends the result to the terminal.

[1811] Step 17:

[1812] Display of reservation completion (terminal)

[1813] The terminal receives a reservation completion notification from the server and displays it to the user. For example, it displays "Your flight, hotel, and rental car reservations have been completed."

[1814] Step 18:

[1815] Reminder notification settings (server)

[1816] The server sets reminder notifications based on the travel itinerary, specifically, setting the notification to be sent the day before departure.

[1817] Step 19:

[1818] Sending reminder notifications (server and device)

[1819] As the travel date approaches, the server sends the configured reminder notification to the device, which then displays it to the user. For example, it might say, "It's forecast to rain tomorrow. Please bring an umbrella."

[1820] Step 20:

[1821] Notification of changes (server and terminal)

[1822] In the event of weather or transportation disruptions, the server will provide the user with suggested changes based on the information it has acquired, which the device will then display to the user and provide them with countermeasures.

[1823] Example 1

[1824] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1825] The objective of this study is to provide a system that allows users to easily create travel plans that reflect their detailed requests when planning a trip, and that also allows them to efficiently complete reservation procedures based on those plans. Conventional systems require users to use multiple websites and services to gather information, create their own plans, and make reservations individually, which takes a lot of time and effort.

[1826] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1827] In this invention, the server includes information input means for inputting a user's travel requests, analysis and generation means for analyzing the travel requests received from the information input means and generating a travel plan, and display means for presenting the travel plan generated by the generation means to the user. This enables the user to easily generate a travel plan that reflects the user's requests in detail and quickly select the most suitable plan from the proposed plans.

[1828] "Information input means" refers to a device or software that provides an interface for users to input their travel requests and conditions.

[1829] The "analysis and generation means" refers to a processing device or software in the server that analyzes the user's travel requests received from the information input means and generates an appropriate travel plan.

[1830] The "display means" is a device or software for visually presenting the generated travel plan to the user.

[1831] "Evaluation and feedback receiving means" refers to a device or software that allows a user to input and receive evaluations and feedback on a presented travel plan.

[1832] The "regeneration means" refers to a processing device or software in the server for readjusting the travel plan based on the user's rating or feedback received by the rating / feedback receiving means.

[1833] The "reservation means" refers to a processing device or software in the server for making reservations for transportation and accommodation based on the travel plan re-adjusted by the regeneration means.

[1834] The "notification means" is a device or software for notifying the user that the reservation procedure has been completed.

[1835] This invention is a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the booking process. This system uses AI to create travel plans and can optimize them based on user feedback.

[1836] System configuration

[1837] This system is broadly composed of the following components:

[1838] 1. Information input means (terminal)

[1839] 2. Analysis and generation means (server)

[1840] 3. Display means (terminal and server)

[1841] 4. Evaluation and feedback receiving means (terminal and server)

[1842] 5. Regeneration means (server)

[1843] 6. Reservation Method (Server)

[1844] 7. Notification Methods (Server and Terminal)

[1845] System Operation

[1846] Information input means (terminal)

[1847] The user uses the terminal interface to enter basic information about the trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of destination, etc.) Once the user enters this information into the form and clicks the "Submit" button, the data is sent to the server.

[1848] Analysis and generation means (server)

[1849] The server analyzes the user's travel request data received from the device. This analysis uses natural language processing technology (e.g., Python's Natural Language Toolkit (NLTK) or Google Cloud Natural Language API) to extract specific keywords from the user's requests. Next, it generates multiple travel plans based on the extracted keywords using a generative AI model (e.g., OpenAI's GPT-3).

[1850] Display means (terminal and server)

[1851] The generated travel plan is sent from the server to the terminal and visually displayed to the user. The user can then check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[1852] Evaluation and feedback receiving means (terminal and server)

[1853] The user can evaluate the presented plans and input feedback into the terminal. This feedback is sent from the terminal to the server and received by the evaluation / feedback receiving means. For example, the user can input feedback such as "I like the Okinawa plan, but I would like to reduce the budget."

[1854] Regeneration means (server)

[1855] The server then adjusts the travel plan based on the received feedback. When regenerating the plan, it selects the optimal accommodation and transportation options within the user's budget based on the user's requests. For example, it regenerates a budget-friendly Okinawa resort plan.

[1856] Reservation method (server)

[1857] Once the adjusted travel plan is confirmed, the server processes the transportation and accommodation reservations, specifically using APIs of multiple providers (e.g., Expedia API and Booking.com API) to perform bulk reservations, including airline ticket reservations, hotel reservations, and rental car reservations.

[1858] Notification method (server and terminal)

[1859] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[1860] Specific examples

[1861] 1. When a user plans a trip

[1862] The user uses a terminal and enters the following prompt text:

[1863] Example prompt sentence:

[1864] "I want to travel with my family to a place rich in nature." "3 nights, 4 days in September." "Budget is 200,000 yen."

[1865] Based on this, the server generates and displays the following itinerary:

[1866] A 3-night, 4-day plan to enjoy Hokkaido's great outdoors

[1867] Relax at an Okinawa resort for 3 nights and 4 days

[1868] If a user selects a plan for Okinawa and submits feedback that "I would like to keep the budget a little lower," the server will generate and display a plan that is adjusted to fit within the budget (for example, by changing the accommodation to reduce costs).

[1869] Once the user has confirmed the plan and confirmed the reservation, the server will complete the bulk reservation of the flight, hotel, rental car, etc., and notify the user of the completion. In addition, a reminder will be sent the day before the trip, and if the weather is bad, information on "alternative plans" or "change of destination" will be provided.

[1870] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[1871] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1872] Step 1:

[1873] Entering information (terminal)

[1874] The user accesses the terminal interface and inputs their travel requests (purpose of travel, budget, travel period, number of accompanying persons, type of travel destination, etc.).

[1875] Input: Specific prompt example: "I want to travel to a place rich in nature with my family," "3 nights and 4 days in September," "Budget is 200,000 yen."

[1876] Output: The input data is saved in the device in JSON format or similar.

[1877] Specific operation: The user enters information into the form and clicks the "Submit" button. The device converts the data into structured data and prepares it for transmission to the server.

[1878] Step 2:

[1879] Sending data (from device to server)

[1880] The terminal transmits the user's input data to the server.

[1881] Input: Travel request data entered by the user

[1882] Output: Travel request data is sent to the server

[1883] Specific operation: The terminal generates an HTTP request and sends the request including the user's input data to the server.

[1884] Step 3:

[1885] Data analysis (server)

[1886] The server receives the user's travel request data and analyzes it using natural language processing technology.

[1887] Input: Travel request data sent from the terminal

[1888] Output: Keyword extraction results (e.g., family trip, nature, budget 200,000 yen, September, 3 nights, 4 days)

[1889] Specific operation: The server extracts keywords from text data using Python's NLTK or Google Cloud Natural Language API.

[1890] Step 4:

[1891] Travel plan generation (server)

[1892] The server generates multiple travel plans using a generative AI model based on the extracted keywords.

[1893] Input: Extracted keyword data

[1894] Output: A list of generated travel plans (e.g., a 3-night, 4-day plan to enjoy the natural beauty of Hokkaido, or a 3-night, 4-day plan to relax at a resort in Okinawa)

[1895] How it works: The server uses a generative AI model such as OpenAI's GPT-3 to generate a travel plan in text format that matches the user's requests.

[1896] Step 5:

[1897] Displaying travel plans (from server to device)

[1898] The server transmits the generated travel plan to the terminal, which presents it to the user.

[1899] Input: Generated itinerary

[1900] Output: The itinerary displayed to the user

[1901] Specific operation: The server sends the generated plan in JSON format to the terminal, and the terminal converts the received data into HTML or the app UI and displays it.

[1902] Step 6:

[1903] Receiving user ratings and feedback (from device to server)

[1904] The user inputs an evaluation and feedback on the presented plan.

[1905] Input: User's rating and feedback (e.g., "I liked the Okinawa plan, but I want to reduce the budget.")

[1906] Output: Feedback is sent from the device to the server.

[1907] Specific operation: The user enters a comment in the feedback form and clicks the "Submit" button. The device sends the feedback to the server.

[1908] Step 7:

[1909] Regenerate travel plan (server)

[1910] The server readjusts the travel plan based on the received feedback.

[1911] Input: Feedback data from users

[1912] Output: Regenerated travel plan (e.g., budget Okinawa resort plan)

[1913] Specific operation: The server runs the generative AI model again and regenerates a plan based on the new conditions.

[1914] Step 8:

[1915] Execution of reservation procedures (server)

[1916] The user confirms the final plan and confirms the reservation. The server processes the reservations for transportation and accommodation.

[1917] Input: Final travel plan approved by the user

[1918] Output: Reservation completion notification

[1919] Specific operation: The server uses the Expedia API and Booking.com API to complete the booking process for airline tickets and hotels in bulk.

[1920] Step 9:

[1921] Notification of reservation completion (from server to device)

[1922] The server notifies the user that the reservation is complete, and also provides reminders based on the travel itinerary and information on how to deal with weather and transportation disruptions on the day of the trip.

[1923] Input: reservation completion data, travel itinerary data

[1924] Output: User notification

[1925] Specific operation: The server uses email or SMS to send reservation completion notifications and reminder notifications to the user.

[1926] This allows users to efficiently create travel plans and automate the booking process.

[1927] (Application example 1)

[1928] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1929] Currently, users spend a lot of time and effort planning their trips and creating optimal travel plans. Furthermore, it is difficult to plan efficiently because reservations for transportation and accommodations must be made separately. Furthermore, planning requires appropriately combining transportation methods, which is no easy task. In particular, when using autonomous vehicles as a modern means of transportation, a system is needed that allows for smooth generation and booking of travel plans that include these vehicles.

[1930] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1931] In this invention, the server includes: an input means for inputting a user's travel requests; an analysis and generation means for analyzing the travel requests received from the input means and generating a travel plan; a presentation means for presenting the travel plan generated by the generation means to the user; an evaluation and feedback receiving means for receiving a user's rating or feedback on the travel plan presented by the presentation means; a regeneration means for adjusting the travel plan based on the rating or feedback received by the evaluation and feedback receiving means; a reservation means for reserving transportation and accommodation based on the travel plan adjusted by the regeneration means; a notification means for notifying the user whether the reservation is complete; an input means for inputting the user's requests by voice or touch to a display device in an autonomous vehicle; and a presentation means for presenting a travel plan that includes the autonomous vehicle as a means of transportation. This enables users to plan their trips efficiently and comfortably and enjoy a smooth journey using the autonomous vehicle.

[1932] "Input means" refers to a device or interface that allows a user to input travel requests.

[1933] "Analysis and generation means" refers to a system or algorithm that analyzes the user's travel requests and generates the optimal travel plan.

[1934] The "presentation means" refers to a device or interface for visually or audibly presenting the generated travel plan to the user.

[1935] "Evaluation and feedback receiving means" refers to a system or interface for receiving evaluations and feedback made by users regarding travel plans.

[1936] A "regenerator" is a system or algorithm that adjusts and regenerates a travel plan based on the ratings and feedback received.

[1937] "Reservation Channel" means a system or interface for booking transportation and accommodation based on a coordinated travel plan.

[1938] "Notification means" refers to a system or device that notifies the user whether the reservation has been completed or other important information.

[1939] A "display device" is a display or touch panel installed in an autonomous vehicle for users to input and confirm information.

[1940] "Voice input" refers to an interface or technology that allows users to input travel requests and other information by voice.

[1941] "Touch input" refers to the interface and technology that allows users to input travel requests and other information using a touchscreen.

[1942] An "autonomous vehicle" is a vehicle that operates autonomously and does not require human operation.

[1943] A "travel plan" is detailed information such as a travel schedule, route, accommodation, and transportation that is proposed based on the user's requests.

[1944] The present invention relates to a system for efficiently assisting users in planning their trips and for using autonomous vehicles as a means of transportation. Hereinafter, a program and a processing procedure of the system will be described as a specific embodiment.

[1945] System Program

[1946] The server includes an input means for inputting travel requests from users, an analysis and generation means for analyzing the received travel requests and generating a travel plan, a presentation means for presenting the generated travel plan to the user, an evaluation and feedback receiving means for receiving ratings and feedback from users, a regeneration means for readjusting the travel plan based on the received ratings and feedback, a reservation means for reserving transportation and accommodations based on the adjusted travel plan, and a notification means for notifying the user of the completion of the reservation. Furthermore, the display devices (touch panel and voice input device) inside the autonomous vehicle are used as user input means.

[1947] Hardware and Software

[1948] Hardware: Smart displays, touch panels, microphones in autonomous vehicles, and users' smartphones

[1949] Software: Natural language processing engines (e.g., Google Cloud Natural Language API), AI models (e.g., GPT-4), booking APIs (e.g., Amadeus API)

[1950] Processing Description

[1951] The server receives information about the user's travel requests via voice or touch input on a display device inside the autonomous vehicle. The received information is analyzed using natural language processing technology. A natural language processing engine such as Google Cloud Natural Language API is used for this analysis. Based on the analysis results, an AI model (e.g., GPT-4) is used to generate multiple travel plans.

[1952] The generated travel plans are visually presented on a display inside the autonomous vehicle. The user selects a suitable plan from the list and provides their rating and feedback. This feedback is sent back to the server, where the regeneration means adjusts the plan. Based on the adjusted plan, the reservation means operates and makes reservations for transportation and accommodation. This reservation is made using a reservation system such as the Amadeus API.

[1953] Once the reservation is complete, the notification means will be activated and the result will be notified to the user. This will provide pre-travel reminders and weather information for the day, allowing the user to carry out their travel plans with peace of mind.

[1954] Specific examples

[1955] For example, if a user in a self-driving car says, "I want to go on a trip with my family to a place rich in nature. My budget is under 200,000 yen. I want to go for three nights and four days in September," the system will analyze this and generate the optimal travel plan. If the user sends feedback from one of the generated plans saying, "I would like a different plan with a lower budget," the system will generate a new plan and present it again.

[1956] This will enable users to plan trips efficiently and comfortably, and ensure a smooth journey using autonomous vehicles.

[1957] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1958] Step 1: User Input

[1959] Users input their travel needs into the display device inside the self-driving car by voice or touch. For voice input, a microphone is used, and for touch input, a touch panel is used. The input information includes basic information such as the purpose of the trip, budget, duration, number of accompanying people, and type of travel destination.

[1960] Step 2: Receiving data

[1961] The server receives the input data sent from the autonomous vehicle and stores the input travel request data on the server side.

[1962] Step 3: Data analysis

[1963] The server analyzes the stored travel request data. This analysis uses a natural language processing engine (e.g., Google Cloud Natural Language API). Specifically, it extracts keywords and desired conditions from the user's input and structures this data.

[1964] Input: Travel request data

[1965] Output: Parsed keywords and conditions

[1966] Step 4: Create a travel plan

[1967] The server uses the analyzed keywords and conditions to generate multiple travel plans using an AI model (e.g., GPT-4), each of which includes different destinations, activities, and accommodations.

[1968] Input: Parsed keywords and conditions

[1969] Output: Multiple itineraries

[1970] Step 5: Submit your travel plan

[1971] The server sends the generated travel plan to the user's device, where it is visually presented on a display inside the autonomous vehicle. The user can then check the details of the presented plan.

[1972] Input: Generated itinerary

[1973] Output: Travel plan displayed on the user's device

[1974] Step 6: Receiving feedback

[1975] The user inputs their evaluation and feedback on the presented travel plan into the display device, and the input feedback data is sent to the server.

[1976] Input: User feedback

[1977] Output: Feedback data sent to the server

[1978] Step 7: Regenerate

[1979] The server analyzes the received feedback data and adjusts the travel plan through a regeneration means, which includes the process of regenerating an appropriate plan based on the user's new requests and feedback.

[1980] Input: Feedback data

[1981] Output: Reworked itinerary

[1982] Step 8: Resubmit

[1983] The server then transmits the regenerated travel plan to the user's terminal, where the user can check the re-presented plan on the display.

[1984] Input: rearranged travel plans

[1985] Output: Realignment plan displayed on the user's device

[1986] Step 9: Reservation execution

[1987] The server makes reservations for transportation and accommodation based on the user's final travel plan, using a booking API (e.g., Amadeus API).

[1988] Input: Finalized travel plans

[1989] Output: Reservation completion data

[1990] Step 10: Notification

[1991] The server notifies the user whether the reservation is successful or not, and may also provide itinerary reminders, weather forecasts for the day, and suggested changes in case of transportation disruptions.

[1992] Input: Booking completion data and travel information

[1993] Output: Notification information sent to the user's device

[1994] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1995] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the reservation process. This system is a travel plan creation support system that utilizes AI and an emotion engine, and is configured and operates as follows:

[1996] System configuration

[1997] This system is broadly composed of the following components:

[1998] 1. Input means (terminal)

[1999] 2. Analysis and generation means (server)

[2000] 3. Presentation Method (Terminal and Server)

[2001] 4. Evaluation and feedback receiving means (terminal and server)

[2002] 5. Regeneration means (server)

[2003] 6. Reservation Method (Server)

[2004] 7. Notification Methods (Server and Terminal)

[2005] 8. Emotion engine (server and terminal)

[2006] Program processing

[2007] Input method (terminal)

[2008] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[2009] Emotion engine (server and terminal)

[2010] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions, which are then used as key elements in analyzing and generating the user's travel requests.

[2011] Analysis and generation means (server)

[2012] The server analyzes the user's travel request data received from the device and the emotion data obtained from the emotion engine. It uses natural language processing technology for the analysis, comprehensively evaluating the user's requests and emotions to extract necessary keywords. For example, if a user inputs "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "three nights and four days" while showing a relaxed expression, the server will use this data to generate the optimal travel plan for the user.

[2013] Presentation method (terminal and server)

[2014] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed.

[2015] Evaluation and feedback receiving means (terminal and server)

[2016] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to generate a new plan. For example, a user can enter feedback such as "I like the Okinawa plan, but I would like to reduce the budget" and the associated emotions.

[2017] Regeneration means (server)

[2018] The server then re-adjusts the travel plan based on the user's feedback and sentiment data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly Okinawa resort plan.

[2019] Reservation method (server)

[2020] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[2021] Notification method (server and terminal)

[2022] Once the reservation is complete, the server notifies the user of the result, and also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel.

[2023] Specific examples

[2024] 1. When a user plans a trip

[2025] The user uses a device to input requests such as "I want to travel with my family to a place rich in nature," "3 nights, 4 days in September," and "budget of 200,000 yen." At the same time, the emotion engine analyzes the user's facial expressions and tone of voice and recognizes that the user is in a relaxed state. Based on this, the server generates and presents plans to enjoy the great outdoors of Hokkaido and to relax at a resort in Okinawa. If the user selects the Okinawa plan and submits feedback that they would like to keep the budget a little lower, the server analyzes that feedback and the user's emotions and displays a revised plan within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[2026] In this way, users can easily create optimal travel plans and enjoy their trip with peace of mind.

[2027] The processing flow will be explained below.

[2028] Step 1:

[2029] Display of input screen (terminal)

[2030] The device displays a screen for the user to enter basic information about the trip, including fields for inputting information such as the purpose of the trip, budget, duration of the trip, number of people traveling with the user, and type of destination.

[2031] Step 2:

[2032] User information input (user)

[2033] The user inputs their travel requirements into the device. For example, they input information such as "family trip," "budget 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days." At the same time, the user's facial expressions and tone of voice are analyzed by the emotion engine.

[2034] Step 3:

[2035] Sending input data and emotion data (terminal)

[2036] The terminal transmits the input user information and emotion data from the emotion engine to the server. The transmitted data includes information on all input fields and the emotional state.

[2037] Step 4:

[2038] Receiving user information and emotion data (server)

[2039] The server receives the user information and emotion data sent from the device and prepares to analyze the received data.

[2040] Step 5:

[2041] Data analysis (server)

[2042] The server uses natural language processing technology to analyze the received user information and emotional data, extracting keywords such as "family trip," "nature," "September," and "three nights and four days" from the user's request, and uses the emotional data to determine the user's psychological state (e.g., whether they are relaxed).

[2043] Step 6:

[2044] Travel plan generation (server)

[2045] The server generates multiple travel plans that match the user's needs based on the analyzed keywords and emotion data, such as "a plan to enjoy the great outdoors of Hokkaido" and "a plan to relax at a resort in Okinawa."

[2046] Step 7:

[2047] Sending and displaying plans (server and device)

[2048] The server sends the generated travel plan to the terminal, which visually displays the received plan to the user. Specific plan details are displayed, allowing the user to check each plan.

[2049] Step 8:

[2050] User evaluation and feedback on the plan

[2051] The user evaluates the presented plans and enters feedback. For example, they may enter a comment such as, "The Okinawa plan is good, but I would like to reduce the budget." In this case, the emotion engine also analyzes the user's facial expressions and tone of voice to collect emotional data in real time.

[2052] Step 9:

[2053] Sending feedback and emotional data (device)

[2054] The device transmits user feedback and emotion data to the server, including user ratings and desired modifications.

[2055] Step 10:

[2056] Receiving feedback and emotion data (server)

[2057] The server receives the feedback and emotion data sent from the device, and prepares to adjust the plan again based on the feedback.

[2058] Step 11:

[2059] Re-adjust plan (server)

[2060] The server analyzes the user's feedback and emotional data and adjusts the travel plan accordingly. Specifically, it selects alternative accommodations and transportation options that fit the user's budget. For example, it adjusts the plan to "an Okinawa resort plan within the user's budget."

[2061] Step 12:

[2062] Sending and displaying realignment plans (server and terminal)

[2063] The server sends the re-adjusted plan to the terminal, which visually displays the received plan to the user again, allowing the user to review the plan again.

[2064] Step 13:

[2065] Final plan selection (user)

[2066] The user checks the re-arranged plans, selects the desired plan, and confirms the reservation. For example, the user selects "Okinawa resort plan within budget."

[2067] Step 14:

[2068] Send reservation data (terminal)

[2069] The terminal sends the user's final selection to the server, which starts the reservation procedure.

[2070] Step 15:

[2071] Reservation execution (server)

[2072] The server executes the booking process, booking airline tickets, accommodations, rental cars, etc. through API integration, making all the necessary reservations in one place.

[2073] Step 16:

[2074] Notification of reservation completion (server)

[2075] After the reservation is completed, the server sends the result to the terminal.

[2076] Step 17:

[2077] Display of reservation completion (terminal)

[2078] The terminal receives a reservation completion notification from the server and displays it to the user. For example, it displays "Your flight, hotel, and rental car reservations have been completed."

[2079] Step 18:

[2080] Reminder notification settings (server)

[2081] The server sets reminder notifications based on the travel itinerary, specifically, setting the notification to be sent the day before departure.

[2082] Step 19:

[2083] Sending reminder notifications (server and device)

[2084] As the travel date approaches, the server sends the configured reminder notification to the device, which then displays it to the user. For example, it might say, "It's forecast to rain tomorrow. Please bring an umbrella."

[2085] Step 20:

[2086] Notification of changes (server and terminal)

[2087] In the event of weather or transportation disruptions, the server will provide the user with suggested changes based on the information it has acquired, which the device will then display to the user and provide them with countermeasures.

[2088] Example 2

[2089] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2090] Conventional travel plan creation systems generate travel plans based solely on information entered by the user, which means they cannot fully reflect the user's latent desires and emotions. It is also difficult to efficiently collect and incorporate feedback on proposed plans, which can result in low user satisfaction. Furthermore, because reservation procedures and change notifications are not centralized, users must perform multiple procedures individually, which is time-consuming and laborious.

[2091] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting a user's travel requests; an analysis and generation means for analyzing the travel requests received from the input means and generating a travel plan; a presentation means for presenting the travel plan generated by the generation means to the user; an emotion engine for analyzing the user's biometric information to acquire emotion data; an evaluation and feedback receiving means for receiving the user's evaluation or feedback on the travel plan presented by the presentation means; a regeneration means for adjusting the travel plan based on the evaluation or feedback and emotion data received by the evaluation and feedback receiving means; a reservation means for reserving transportation and accommodation facilities based on the travel plan adjusted by the regeneration means; and a notification means for notifying the user whether the reservation has been completed. This enables the generation of an optimal travel plan that reflects the user's potential requests and emotions, rapid plan readjustment based on feedback, and unified reservation procedures and change notification.

[2092] "Input means" refers to a device or software that provides an interface for a user to input travel requests.

[2093] The "analysis and generation means" is a means for analyzing the travel requests received from the input means and generating an appropriate travel plan.

[2094] The "presentation means" is a means for visually or audibly presenting the travel plan generated by the generation means to the user.

[2095] An "emotion engine" is a device or software that analyzes biometric information from a user (e.g., facial expressions and tone of voice) to obtain emotional data.

[2096] The "evaluation / feedback receiving means" is a means for collecting user evaluations or feedback on the travel plan presented by the presentation means.

[2097] The "regeneration means" is a means for adjusting the travel plan based on the evaluation or feedback and emotion data received by the evaluation / feedback receiving means.

[2098] The "reservation means" is a means for making reservations for transportation and accommodation facilities based on the travel plan adjusted by the regeneration means.

[2099] The "notification means" is a means for notifying the user whether the reservation has been completed or not, and for providing reminders or suggested changes as necessary.

[2100] "Natural language processing technology" is a computer technology for analyzing, understanding, and generating text data, and is used to analyze travel requests and emotional data.

[2101] This invention relates to a system that efficiently collects user requests when planning a trip, generates and presents appropriate travel plans, and automatically completes the booking process. This system is a travel plan creation support system that utilizes AI and an emotion engine, and is configured and operates as follows:

[2102] System configuration

[2103] This system is broadly composed of the following components:

[2104] 1. Input means (terminal)

[2105] 2. Analysis and generation means (server)

[2106] 3. Presentation Method (Terminal and Server)

[2107] 4. Evaluation and feedback receiving means (terminal and server)

[2108] 5. Regeneration means (server)

[2109] 6. Reservation Method (Server)

[2110] 7. Notification Methods (Server and Terminal)

[2111] 8. Emotion engine (server and terminal)

[2112] Program processing

[2113] Input method (terminal)

[2114] The terminal provides an interface for users to input basic information about their trip (purpose of the trip, budget, duration of the trip, number of accompanying people, type of travel destination, etc.) The user enters this information into a form, and once the input is complete, the information is sent to the server.

[2115] Emotion engine (server and terminal)

[2116] The emotion engine analyzes biometric information such as facial expressions and tone of voice while the user is typing to identify the user's emotions. This information is used as an important factor in analyzing and generating the user's travel requests. For example, it can determine whether the user is in a relaxed state when entering information.

[2117] Analysis and generation means (server)

[2118] The server analyzes the user's travel request data received from the device and the emotion data obtained from the emotion engine. It uses natural language processing technology for the analysis, comprehensively evaluating the user's requests and emotions to extract necessary keywords. For example, if a user inputs "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "three nights and four days" while showing a relaxed expression, the server will use this data to generate the optimal travel plan for the user.

[2119] Presentation method (terminal and server)

[2120] The generated travel plan is sent from the server to the terminal and visually displayed to the user. Here, the user can check the details of the proposed plan. For example, a "3-night, 4-day plan for enjoying a family trip in a natural area" or a "3-night, 4-day plan for relaxing at a resort" may be displayed.

[2121] Evaluation and feedback receiving means (terminal and server)

[2122] Users can rate the presented plans and enter their feedback. The emotion engine analyzes the user's facial expressions and tone of voice when receiving the evaluation and feedback, and uses this information to generate a new plan. For example, a user can enter feedback such as "I like the Okinawa plan, but I would like to reduce the budget" and the associated emotions.

[2123] Regeneration means (server)

[2124] The server then re-adjusts the itinerary based on the user's feedback and sentiment data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly resort itinerary.

[2125] Reservation method (server)

[2126] Once the coordinated itinerary is finalized, the server initiates the booking process for transportation, accommodation, and other activities, which is performed in batches using APIs from multiple providers, for example, booking flights, hotels, and car rentals.

[2127] Notification method (server and terminal)

[2128] Once the reservation is complete, the server notifies the user of the results. It also provides reminders based on the travel itinerary and suggests changes to accommodate weather or transportation disruptions on the day of travel. For example, a reminder may be sent the day before travel, suggesting countermeasures if bad weather is predicted for the day of travel.

[2129] Specific examples

[2130] When planning a trip, a user uses a device to input requests such as "I want to go on a family trip to a place rich in nature," "3 nights and 4 days in September," and "My budget is 200,000 yen." At the same time, the emotion engine analyzes the user's facial expressions and tone of voice to recognize that the user is in a relaxed state. Based on this, the server generates and presents plans for a family trip to a place rich in nature and a relaxing resort. If the user selects a resort plan and submits feedback that they would like to keep the budget a little lower, the server analyzes that feedback and the user's emotions and displays a revised plan within the budget. Once the user finally confirms the plan and confirms the reservation, the server executes the bulk reservation and notifies the user of its completion. A reminder notification is also sent the day before the trip, and countermeasures are provided if the weather is bad.

[2131] Specific examples of prompts to input to generative AI models

[2132] "I'm planning a four-day, three-night trip with my family to a place rich in nature. My budget is 200,000 yen, and I plan to leave in September. What travel plans do you recommend?"

[2133] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2134] Step 1:

[2135] The user enters basic information about the trip

[2136] The user uses the device to input basic information such as the purpose of the trip, budget, travel period, number of accompanying people, and type of travel destination. The device receives this information through an input interface, converts it into the required data format on the front end, and then sends it to the server. For example, a user might input "I want to travel with my family to a place rich in nature," "3 nights, 4 days in September," and "budget is 200,000 yen." This information is converted into a data structure such as JSON format and sent to the server.

[2137] Input: User's basic information (purpose, budget, period, number of people, genre)

[2138] Output: JSON formatted travel request data sent to the server

[2139] Step 2:

[2140] The device analyzes the user's emotional data

[2141] While the user is entering information, the device's built-in emotion engine analyzes the user's facial expressions, tone of voice, and other biometric information in real time. The analysis results in emotional data about the user. This emotional data indicates whether the user is relaxed or excited, and is an important factor in generating travel plans.

[2142] Input: User's facial expression data, tone of voice

[2143] Output: Analyzed user emotion data (e.g., relaxation state)

[2144] Step 3:

[2145] The server analyzes the request and emotion data

[2146] The server analyzes the travel request data and emotion data received from the device. Using natural language processing technology, it extracts important keywords from the travel request data and combines them with the emotion data to identify the user's true desires. For example, information such as "family trip," "budget of 200,000 yen," "September," "place rich in nature," and "3 nights, 4 days" along with a relaxed emotion are extracted.

[2147] Input: Travel request data, emotion data

[2148] Output: Analyzed keywords and sentiment evaluation

[2149] Step 4:

[2150] The server generates the optimal travel plan

[2151] Based on the analysis results, the server generates the optimal travel plan that meets the user's expectations. During the generation process, a generative AI model is used to make suggestions that match the user's desires and emotions. For example, options such as the natural beauty of Hokkaido or resorts in Okinawa are generated.

[2152] Input: Analyzed keywords and emotion evaluation

[2153] Output: Multiple travel plans (e.g. Hokkaido's natural beauty, Okinawa's resorts)

[2154] Step 5:

[2155] The server presents the generated plan to the device.

[2156] The server sends the generated travel plans to the device and presents them visually to the user. The user can then check the details of these plans on the device and compare the pros and cons of each plan. For example, a "3-night, 4-day travel plan to enjoy the great outdoors of Hokkaido" and a "3-night, 4-day plan to relax at a resort in Okinawa" are displayed on the device screen.

[2157] Input: Generated itinerary

[2158] Output: A list of itineraries presented to the user

[2159] Step 6:

[2160] The device collects user feedback

[2161] The user evaluates the presented travel plans and inputs feedback via the terminal. The emotion engine again analyzes the user's facial expressions and tone of voice, and sends the feedback to the server. For example, the user might input feedback such as, "I like the Okinawa plan, but I would like to reduce the budget."

[2162] Input: User feedback, reanalyzed emotion data

[2163] Output: Feedback data, emotion data sent to the server

[2164] Step 7:

[2165] The server regenerates the plan based on the feedback.

[2166] The server then re-adjusts the travel plan based on the user's feedback and emotional data, including selecting the optimal accommodation and transportation options within the user's budget. For example, it re-generates a budget-friendly Okinawa resort plan.

[2167] Input: Feedback data, emotion data

[2168] Output: Reworked itinerary

[2169] Step 8:

[2170] The server starts the reservation process

[2171] Once the coordinated travel plans are finalized, the server initiates the booking process for transportation, accommodation, and other activities, using APIs from multiple providers to make bulk bookings, e.g., booking flights, booking hotels, and booking rental cars.

[2172] Input: Confirmed travel plans

[2173] Output: Completed reservation data

[2174] Step 9:

[2175] The server notifies the reservation result

[2176] Once the reservation process is complete, the server sends the results to the device and notifies the user. Furthermore, reminders based on the travel itinerary and the latest information on the day of travel (notification of changes in weather and transportation) are also sent. For example, a reminder is sent the day before travel, and if bad weather is predicted for the day of travel, countermeasures are suggested.

[2177] Input: Completed reservation data

[2178] Output: Notification messages, reminders, and proposed changes to users

[2179] (Application example 2)

[2180] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2181] In today's society, planning spec...

Claims

1. an input means for inputting a user's travel requests; analysis and generation means for analyzing the travel requests received from the input means and generating a travel plan; a presentation means for presenting the travel plan generated by the generation means to a user; evaluation and feedback receiving means for receiving user evaluations or feedback on the travel plan presented by the presentation means; a regeneration means for adjusting the travel plan based on the evaluation or feedback received by the evaluation / feedback receiving means; a reservation means for making reservations for transportation and accommodation facilities based on the travel plan adjusted by the regeneration means; a notification means for notifying the user whether the reservation has been completed; A system including:

2. 2. The system according to claim 1, wherein the analysis and generation means uses natural language processing technology to identify the user's travel needs and generate an optimal travel plan.

3. The system according to claim 1, characterized in that the notification means has a function of setting reminder notifications based on the travel itinerary and notifying the user of proposed changes in the event of weather or transportation disruptions.

Images