System

Abstract

To provide a system.SOLUTION: A system includes: artificial intelligence means for customizing a travel through interaction with a user; means for generating the original travel brochure generated by the artificial intelligence means; means for making reservations associated with the travel; means for providing support as a voice concierge when the user moves; feeling engine means for analyzing a feeling of the user; and means for adjusting a user's travel plan based upon the analysis result of the feeling engine means.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including a description and related instruction sentence regarding the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-180282 A Summary of the Invention [Problem to be solved by the invention]

[0004] When making travel plans, it is difficult to customize them to fit each individual user's preferences and budget, and there is also the issue of the complexity of arranging transportation, reservations, and other matters during the trip. [Means for solving the problem]

[0005] Using AI to customize trips through dialogue with users, the service creates original travel itineraries based on information such as the user's preferences and budget. In addition, the service makes reservations for flights, hotels, activities, meals, etc. in one place, and provides support as a voice concierge during travel, reducing the burden of travel planning for users. [Brief description of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Diagram 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. FIG. [Diagram 3] FIG. 11 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Diagram 5] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 13 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a process flow of the data processing system in the first embodiment of the first form example. [Figure 12] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the application example 1 of the first embodiment. [Figure 13] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the second embodiment of the second embodiment. [Figure 14] FIG. 13 is a sequence diagram showing a process flow of the data processing system in application example 2 of embodiment 2. [Figure 15] FIG. 13 is a sequence diagram showing a process flow of a data processing system in a third embodiment of the present invention. [Figure 16]FIG. 13 is a sequence diagram showing a process flow of the data processing system in the third application example of the third embodiment. [Figure 17] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when combined with an emotion engine. [Figure 19] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system according to the embodiment 2 of the second embodiment in the case where an emotion engine is combined. [Figure 20] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when combined with an emotion engine. [Figure 21] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in the embodiment 3 of the form example 3 in the case where an emotion engine is combined. [Figure 22] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when combined with an emotion engine. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by the processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a code is an interface including a communication processor and an antenna. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (e.g., a pen or a finger) to receive user input by the touch of the pointer. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (e.g., voice and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs voice according to instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor or a Charge Coupled Device (CCD) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of main functions of the data processing device 12 and the smart device 14.

[0023] As shown in Fig. 2, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32. The specific process program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific process program 56 from the storage 32, and executes the read specific process program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific process program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores a reception output program 60. The reception output program 60 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads out the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] As an embodiment of the present invention, a system is provided that customizes a trip through dialogue with AI. Specifically, when a user inputs desired travel conditions (e.g. budget, destination, length of stay, preferred activities, etc.) to the AI, the AI ​​generates a travel plan based on this information. The generated travel plan is presented to the user as an "original travel itinerary," and the user can use this as a basis for preparing for the trip.

[0029] "Example 2"

[0030] Furthermore, as an embodiment of the present invention, a system is provided that centralizes reservations for airline tickets, hotels, activities, meals, etc. Specifically, the system automatically makes the necessary reservations based on a travel plan generated by AI. This allows users to save time and effort in the reservation process.

[0031] "Example 3"

[0032] In addition, as an embodiment of the present invention, a system is provided that provides support as a voice concierge while traveling. Specifically, when a user inquires by voice about information required while traveling (e.g., travel route, local information, etc.), the AI ​​responds and provides the information. This allows the user to easily obtain the information they need even while traveling.

[0033] The process flow of each embodiment will be described below.

[0034] "Example 1"

[0035] Step 1: The user inputs their travel preferences (e.g. budget, destination, length of stay, preferred activities, etc.) into the AI.

[0036] Step 2: The AI ​​generates a travel plan based on the information input by the user.

[0037] Step 3: Present the generated travel plan to the user as an "original travel itinerary."

[0038] "Example 2"

[0039] Step 1: Based on the travel plan generated by AI, all necessary reservations (flights, hotels, activities, meals, etc.) are made centrally.

[0040] Step 2: Notify the user of the reservation result.

[0041] "Example 3"

[0042] Step 1: The user makes a voice request for the information they need while traveling (e.g., travel route, local information, etc.).

[0043] Step 2: The AI ​​responds to the user's inquiry and provides information.

[0044] Example 1

[0045] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0046] In conventional travel planning systems, it was difficult for users to customize their travel plans based on their desired conditions, and the process of creating travel plans and making reservations was cumbersome. In addition, there was a lack of support during travel, making it difficult for users to quickly obtain local information. This limited the users' travel experience.

[0047] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0048] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original trip plan created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as voice guidance during travel, a means for transmitting desired conditions input by the user from a terminal to the server, a means for the server to generate a trip plan using a generation AI model, and a means for transmitting the generated trip plan to the terminal and displaying it to the user. This allows the user to easily create and obtain a customized trip plan based on the desired conditions, and allows them to prepare for the trip and receive support on-site.

[0049] "User" means an individual or entity that uses the System to customize a trip.

[0050] "Interaction" is the process in which a user inputs desired requirements to a system and the system responds accordingly.

[0051] "Travel customization" refers to creating individual travel plans based on the user's desired conditions.

[0052] "Artificial intelligence means" means the part of the system that contains algorithms and models for generating travel plans based on user input.

[0053] An "original travel plan" is a unique travel plan created by an artificial intelligence means based on the user's desired conditions.

[0054] "Reservations for airfare, accommodation, activities, meals, etc." refers to the process of securing various services necessary for travel in advance.

[0055] "Voice guidance" is a function that provides users with necessary information via voice while they are traveling.

[0056] A "terminal" is a device (e.g., a PC or smartphone) that allows a user to access the system and input desired conditions.

[0057] The "server" refers to a central processing unit that receives user input data, generates a travel plan using a generative AI model, and transmits it to the terminal.

[0058] A "generative AI model" is an artificial intelligence algorithm that analyzes a user's desired conditions and suggests the optimal travel plan.

[0059] A "prompt" is text containing the user's desired conditions that is input into a generative AI model.

[0060] A "Travel Plan" is a specific travel schedule and activity proposal created based on the User's desired conditions.

[0061] This invention is a system that generates a customized travel plan based on a user's desired travel conditions input. The system includes an artificial intelligence means for customizing the trip through dialogue with the user, a means for creating a generated original travel plan, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as voice guidance during travel, a means for transmitting the desired conditions input by the user from a terminal to a server, a means for the server to generate a travel plan using a generation AI model, and a means for transmitting the generated travel plan to the terminal and displaying it to the user.

[0062] A user accesses the system using a terminal (e.g., a PC or smartphone). The user inputs the desired travel conditions (e.g., budget, destination, length of stay, preferred activities, etc.). Specifically, the user inputs the following information into the system's input form:

[0063] Budget: 100,000 yen

[0064] Destination: Kyoto

[0065] Length of stay: 3 days

[0066] Favorite activities: Visiting temples, experiencing Japanese cuisine

[0067] The device sends the desired conditions entered by the user as data to the server. This data is sent to the server as an HTTP request. Specifically, the device inputs the following prompt sentence into the generative AI model:

[0068] "I would like to stay in Kyoto for three days on a budget of 100,000 yen and enjoy visiting temples and experiencing Japanese cuisine."

[0069] The server generates a travel plan based on the received data using a generative AI model (e.g. GPT-4 (registered trademark) by OpenAI (registered trademark). The generative AI model analyzes the user's desired conditions and performs data processing and calculations to propose the optimal travel plan. The generated travel plan is returned to the server in the following format:

[0070] Day 1: Arrive at Kyoto Station and visit Kiyomizu-dera Temple and Kinkaku-ji Temple. Enjoy a Japanese dinner in Gion.

[0071] Day 2: Walk through the bamboo forest in Arashiyama and visit Tenryu-ji Temple. Enjoy a Japanese meal in Sagano for lunch.

[0072] Day 3: Visit Fushimi Inari Taisha Shrine and return home from Kyoto Station in the afternoon.

[0073] The server sends the generated travel plan to the terminal. This data is sent to the terminal as an HTTP response. The terminal displays the travel plan received from the server to the user. Specifically, the terminal displays the travel plan on the screen in an easy-to-read format. The user can then proceed with specific travel preparations based on this travel plan.

[0074] The system allows users to easily create and obtain customized travel plans based on their desired conditions, and allows them to receive support during travel preparation and on-site.

[0075] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0076] Step 1:

[0077] The user inputs the desired travel conditions.

[0078] A user accesses the system using a terminal (e.g., a PC or smartphone) and inputs the desired travel conditions (e.g., budget, destination, length of stay, preferred activities, etc.). Specifically, the user enters the following information into the system's input form:

[0079] Budget: 100,000 yen

[0080] Destination: Kyoto

[0081] Length of stay: 3 days

[0082] Favorite activities: Visiting temples, experiencing Japanese cuisine

[0083] Input data: User's desired conditions

[0084] Output data: Desired conditions entered in the input form

[0085] Step 2:

[0086] The terminal transmits the input data to the server.

[0087] The terminal sends the desired conditions entered by the user as data to the server. This data is sent to the server as an HTTP request. Specifically, the terminal sends the following JSON-formatted data to the server:

[0088] json

[0089] {

[0090] "budget": "100,000 yen",

[0091] "destination": "Kyoto",

[0092] "duration": "3 days",

[0093] "activities": ["Temple tour", "Japanese food experience"]

[0094] }

[0095] Input data: User's desired conditions

[0096] Output data: Data of desired conditions sent to the server

[0097] Step 3:

[0098] The server generates a travel plan using the generative AI model.

[0099] The server generates a travel plan using a generative AI model (e.g., OpenAI's GPT-4) based on the received data. The server inputs the user's desired conditions into the generative AI model as a prompt sentence. Specifically, the server inputs the following prompt sentence into the generative AI model:

[0100] "I would like to stay in Kyoto for three days on a budget of 100,000 yen and enjoy visiting temples and experiencing Japanese cuisine."

[0101] The generative AI model generates a travel plan based on this prompt.

[0102] Input data: User's desired conditions, prompt text

[0103] Output data: Generated itinerary

[0104] Step 4:

[0105] The server transmits the generated travel plan to the terminal.

[0106] The server sends the generated itinerary to the terminal. This data is sent to the terminal as an HTTP response. Specifically, the server sends the following JSON format data to the terminal:

[0107] json

[0108] {

[0109] "day1": "After arriving at Kyoto Station, visit Kiyomizu-dera Temple and Kinkaku-ji Temple. In the evening, have a Japanese dinner in Gion.",

[0110] "day2": "Walk through the bamboo forest in Arashiyama and visit Tenryu-ji Temple. For lunch, experience Japanese cuisine in Sagano.",

[0111] "day3": "Visit Fushimi Inari Taisha Shrine and return home from Kyoto Station in the afternoon."

[0112] }

[0113] Input data: Generated itinerary

[0114] Output data: Travel plan sent to the terminal

[0115] Step 5:

[0116] The terminal displays the travel plan to the user.

[0117] The terminal displays the travel plan received from the server to the user. Specifically, the terminal displays the travel plan on the screen in an easy-to-read format. The user can proceed with specific travel preparations based on this travel plan.

[0118] Input data: Travel plan received from the server

[0119] Output data: The itinerary displayed to the user

[0120] (Application example 1)

[0121] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0122] Conventional travel customization systems were able to create travel plans based on users' desired conditions, but they lacked the customization of meals during the trip or the provision of optimal food delivery plans. As a result, users had to spend time and effort finding suitable meals during their trip, which could reduce their satisfaction with the trip.

[0123] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0124] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for generating an optimal food delivery plan based on the user's desired conditions, and a means for presenting the generated food delivery plan to the user. This allows the user to easily find the optimal meal based on their desired conditions even while traveling, improving the satisfaction of the trip.

[0125] "User" means an individual or entity that uses the System to customize travel or generate food delivery plans.

[0126] "Dialogue" is the process in which a user inputs desired conditions or questions to a system and the system responds accordingly.

[0127] "Customized travel" refers to individually tailoring and creating travel plans based on the user's desired conditions.

[0128] "AI means" refers to a part of a system that uses artificial intelligence to analyze users' desired conditions and generate optimal travel plans and food delivery plans.

[0129] An "original travel itinerary" is a document created by AI means that contains a unique travel plan based on the user's desired conditions.

[0130] A "means for fulfilling reservations" is a part of a system that has the functionality to make online reservations for flights, hotels, activities, meals, etc.

[0131] "Voice concierge" is a part of the system that has the ability to provide support to users via voice while on the move.

[0132] A "Food Delivery Plan" is a plan that generates the optimal meal delivery plan based on the user's desired conditions.

[0133] A "presentation means" is a part of the system that has the functionality to present the generated plan to the user visually or audibly.

[0134] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary created by the AI ​​means, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for generating an optimal food delivery plan based on the user's desired conditions, and means for presenting the generated food delivery plan to the user.

[0135] System Programming

[0136] The system executes the following programs:

[0137] 1. User interaction:

[0138] Users input their desired travel conditions (budget, destination, length of stay, preferred activities, etc.) through a smartphone app.

[0139] Similarly, enter your dining preferences (budget, type of food, delivery time, allergy information, etc.).

[0140] 2. Analysis by AI means:

[0141] The server generates a prompt sentence based on the input desired conditions.

[0142] Use the OpenAI API to send prompts to a generative AI model (e.g., GPT-3 (registered trademark)).

[0143] 3. Generate travel and food delivery plans:

[0144] The AI ​​model generates optimal travel plans and food delivery plans and returns them to the server.

[0145] 4. Present the plan:

[0146] The server provides the generated plan to the user visually or audibly.

[0147] Hardware and Software Used

[0148] Hardware:

[0149] Smartphone: A device that allows users to input their desired conditions.

[0150] Server: A device that runs the AI ​​model and generates plans.

[0151] software:

[0152] Python: A programming language used to implement the program.

[0153] OpenAI API: An API for using generative AI models (e.g. GPT-3).

[0154] Data processing and calculation

[0155] Data processing:

[0156] The desired conditions entered by the user are formatted as a prompt.

[0157] example:

[0158] Generate the best food delivery plan based on your user preferences.

[0159] Price: 2000 yen

[0160] Cuisine type: Italian

[0161] Delivery time: 19:00

[0162] Allergy Information: Nuts

[0163] Data Calculation:

[0164] Use the OpenAI API to send prompts to a generative AI model to generate an optimal plan.

[0165] The generated plan is formatted visually or audibly for presentation to the user.

[0166] Examples

[0167] The user enters the following conditions into the app:

[0168] Price: 2000 yen

[0169] Cuisine type: Italian

[0170] Delivery time: 19:00

[0171] Allergy Information: Nuts

[0172] The server generates prompts based on these conditions and uses the OpenAI API to generate an optimal food delivery plan, which is then presented to the user visually or audibly.

[0173] In this way, users can easily find the best meal based on their desired criteria while traveling, thereby improving their satisfaction with the trip.

[0174] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0175] Step 1:

[0176] A user uses a smartphone device to input desired travel conditions (budget, destination, length of stay, favorite activities, etc.) and desired meal conditions (budget, type of food, delivery time, allergy information, etc.). The input data is sent from the device to the server.

[0177] Step 2:

[0178] The server generates a prompt based on the received user's desired conditions. Specifically, it converts the user's input data into text format and creates a prompt suitable for the generative AI model. For example, the following prompt is generated:

[0179] Generate the best food delivery plan based on your user preferences.

[0180] Price: 2000 yen

[0181] Cuisine type: Italian

[0182] Delivery time: 19:00

[0183] Allergy Information: Nuts

[0184] Step 3:

[0185] The server sends the generated prompt to the generative AI model (e.g., GPT-3) using the OpenAI API. The API request includes the prompt along with any required parameters (e.g., max_tokens, temperature, etc.).

[0186] Step 4:

[0187] The generative AI model generates optimal travel and food delivery plans based on the received prompts, which are then returned to the server as an API response.

[0188] Step 5:

[0189] The server parses the plans returned by the generative AI model and formats them for presentation to the user, specifically converting the travel plans and food delivery plans into data for visual or audio display.

[0190] Step 6:

[0191] The server sends the formatted plan to the smartphone terminal. The terminal presents the received plan to the user visually or audibly. The user can check the presented plan and proceed with reservations or orders as necessary.

[0192] In this way, the user can easily find the most suitable meal based on their desired conditions even while traveling, thereby improving the satisfaction of the trip.

[0193] Example 2

[0194] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0195] Conventional travel reservation systems require users to make individual reservations for air tickets, accommodations, activities, meals, etc., which is time-consuming and laborious. In addition, when creating a travel plan, users must collect information and make plans themselves, which is inefficient. Furthermore, there is a lack of support during travel, which means that there is insufficient information and guidance on-site.

[0196] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0197] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for making reservations using the application programming interface of each reservation site based on the generated travel plan, and a means for providing support as a voice concierge during travel. This allows the user to plan and book a trip in a unified manner and receive support during travel, making for an efficient and comfortable trip.

[0198] "User" means any individual or entity that uses the System to plan and book travel.

[0199] "Dialogue" is the process by which a user and a system exchange information, and includes the act of conveying the user's wishes and conditions to the system.

[0200] "Trip customization" is the process of creating the optimal travel plan based on the user's preferences, budget, dates, and other criteria.

[0201] "Artificial intelligence means" refers to algorithms or programs used to customize trips through interaction with users.

[0202] A "travel guidebook" is a document or digital data that contains a travel schedule or detailed plans.

[0203] An "air ticket" is a ticket for travelling on an aircraft.

[0204] "Accommodation facilities" refer to facilities such as hotels, inns, and guesthouses where travelers can stay.

[0205] "Activities" refers to activities such as sightseeing, leisure, and experiences that you undertake while traveling.

[0206] "Meals" refers to services such as restaurants and cafes that provide food and drinks to be consumed during travel.

[0207] A "reservation" is the process of reserving services such as airfare, accommodations, activities, and meals in advance.

[0208] An "application programming interface" is an interface that allows different software systems to communicate with each other.

[0209] A "voice concierge" is a service that provides information and guidance to users via voice.

[0210] "Support" refers to providing information and assistance in resolving problems that users require during their travels.

[0211] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0212] The present invention relates to a system that allows a user to make a trip plan and a reservation in an integrated manner. A specific embodiment of this system will be described below.

[0213] System Configuration

[0214] In this system, users input their desired travel conditions using a terminal (PC, smartphone, tablet, etc.), and the server generates a travel plan based on those conditions and automatically makes the necessary reservations. The system includes the following main components:

[0215] 1. User terminal: This is the device through which the user enters their travel preferences. This includes PCs, smartphones, tablets, etc.

[0216] 2. Server: Receives input from the user, generates a travel plan using the generative AI model, and makes the reservation using the API of each booking site.

[0217] 3. Generative AI models: For example, using a generative AI model such as OpenAI's GPT-4, generate a travel plan based on the user's desired criteria.

[0218] 4. Booking site API: Use the API of each booking site (e.g. airline ticket booking site, hotel booking site, restaurant booking site, etc.) to automatically make the necessary reservations.

[0219] Program Processing

[0220] The server receives the desired travel conditions entered by the user from the terminal and converts them into a prompt. For example, if the user enters the desired conditions, "I am planning a five-day trip to Tokyo in December 2023. My budget is within 200,000 yen, and I would like to enjoy sightseeing and delicious food," the server generates the following prompt.

[0221] Example prompt:

[0222] "I am planning a 5-day trip to Tokyo in December 2023. My budget is within 200,000 yen and I would like to enjoy sightseeing and delicious food. Please suggest the best travel plan."

[0223] The generated prompt sentence is sent to the generative AI model, which generates a travel plan based on the prompt sentence, like this:

[0224] An example of a generated itinerary:

[0225] Day 1: Arrival in Tokyo, sightseeing in Asakusa, visiting Sensoji Temple, dinner at a local restaurant

[0226] Day 2: Visit Tokyo Tower, go shopping in Ginza, and have lunch at a sushi restaurant

[0227] Day 3: Visit Ueno Zoo, shopping at Ameyoko, yakiniku dinner

[0228] Day 4: Sightseeing in Odaiba, shopping at VenusFort, dinner at an Italian restaurant

[0229] Day 5: Visit to Tokyo Disneyland, return home

[0230] The server makes the necessary reservations using the API of each reservation site based on the generated travel plan. For example, to reserve an airline ticket, the API of an airline reservation site is used, to reserve a hotel, the API of a hotel reservation site is used, and to reserve a restaurant, the API of a restaurant reservation site is used.

[0231] After all reservations are completed, the server sends a notification to the user, including details of the reservation (reservation number, date, time, location, etc.). The user can view this notification on their device.

[0232] This system allows users to plan and book their trips all in one place, making travel more efficient and comfortable.

[0233] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0234] Step 1:

[0235] The user inputs the desired travel conditions.

[0236] A user uses a terminal (PC, smartphone, tablet, etc.) to input the desired conditions for the trip (destination, budget, schedule, activities of interest, etc.). For example, a user might input conditions such as "I am planning a five-day trip to Tokyo in December 2023. My budget is within 200,000 yen, and I would like to enjoy sightseeing and delicious meals."

[0237] Input: Your travel preferences (destination, budget, dates, activities you're interested in, etc.)

[0238] Output: The user's preferences are sent to the server.

[0239] Step 2:

[0240] The server converts the entered conditions into a prompt.

[0241] The server receives the desired conditions entered by the user and converts them into a prompt sentence suitable for the generative AI model. For example, it generates a prompt sentence like the following.

[0242] Example prompt:

[0243] "I am planning a 5-day trip to Tokyo in December 2023. My budget is within 200,000 yen and I would like to enjoy sightseeing and delicious food. Please suggest the best travel plan."

[0244] Input: User's desired conditions

[0245] Output: The generated prompt statement

[0246] Step 3:

[0247] The server sends a prompt to the generative AI model.

[0248] The server sends the generated prompt to a generative AI model (e.g., OpenAI's GPT-4). Since the generative AI model runs on the cloud, the server sends the request over the Internet.

[0249] Input: Generated prompt text

[0250] Output: The prompt sent to the generative AI model

[0251] Step 4:

[0252] The generative AI model generates a travel plan and returns it to the server.

[0253] The generative AI model generates a travel plan based on the prompt sentence. For example, it generates a plan like the one below.

[0254] An example of a generated itinerary:

[0255] Day 1: Arrival in Tokyo, sightseeing in Asakusa, visiting Sensoji Temple, dinner at a local restaurant

[0256] Day 2: Visit Tokyo Tower, go shopping in Ginza, and have lunch at a sushi restaurant

[0257] Day 3: Visit Ueno Zoo, shopping at Ameyoko, yakiniku dinner

[0258] Day 4: Sightseeing in Odaiba, shopping at VenusFort, dinner at an Italian restaurant

[0259] Day 5: Visit to Tokyo Disneyland, return home

[0260] Input: The prompt sent to the generative AI model

[0261] Output: The generated itinerary

[0262] Step 5:

[0263] The server makes reservations based on the travel plan using the API of each reservation site.

[0264] Based on the generated travel plan, the server makes the necessary reservations using the API of each reservation site (e.g., airline ticket reservation site, accommodation reservation site, restaurant reservation site, etc.). Specifically, it automatically makes airline ticket reservations, accommodation reservations, activity reservations, restaurant reservations, etc.

[0265] Input: Generated itinerary

[0266] Output: Booking requests sent to each booking site

[0267] Step 6:

[0268] The server sends a notification to the user that the reservation is complete.

[0269] The server confirms that all reservations are complete and sends a notification to the user, including details of the reservation (reservation number, date, time, location, etc.). The user can view the notification on their device.

[0270] Input: Reservation completion information from each reservation site

[0271] Output: Booking completion notification sent to user

[0272] (Application example 2)

[0273] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0274] Conventional travel reservation systems have the problem that users have to book flights, hotels, activities, meals, etc. individually, which is time-consuming. In addition, the generation and reservation of meal plans that take into account the user's dietary preferences and allergy information was not automated, so users had to make adjustments themselves. This could make trip planning and execution cumbersome and reduce user satisfaction.

[0275] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0276] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel guide created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for inputting the user's dietary preferences and allergy information and for the AI ​​to generate a meal plan based on the user's preferences, and a means for automatically reserving necessary ingredients and dishes based on the generated meal plan. This allows the user to centrally manage everything from planning to execution of the trip, and the generation and reservation of a meal plan that takes into account dietary preferences and allergy information is automated, significantly reducing the hassle of traveling and making it possible to improve user satisfaction.

[0277] Key Word Definitions

[0278] "User" means any individual or entity that uses the System to plan and book travel.

[0279] "Dialogue" is the process by which a user and a system exchange information and is the means by which the user communicates their preferences and requests to the system.

[0280] "Trip customization" is the process of creating an individually optimized travel plan based on a user's preferences, budget, destinations, and other information.

[0281] "AI means" refers to a component of the system that uses artificial intelligence technology to analyze information input by users and generate optimal travel and meal plans.

[0282] An "original travel itinerary" is a document created by AI means that details the user's travel plans.

[0283] A "means for making reservations" is a component of a system that automatically makes reservations for flights, hotels, activities, meals, etc.

[0284] A "voice concierge" is a component of a system that provides voice guidance and support to users while traveling.

[0285] "Dietary preferences" refers to information such as the user's preferred ingredients, types of cuisine, and seasonings.

[0286] "Allergy information" refers to information about ingredients or substances to which a user has an allergy.

[0287] "Meal Plan" means a weekly meal plan generated by the AI ​​Means based on the User's dietary preferences and allergy information.

[0288] The "means for automatically reserving ingredients and meals" is a component of the system that automatically reserves the necessary ingredients and meals based on the generated meal plan.

[0289] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0290] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary created by the AI ​​means, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for inputting the user's dietary preferences and allergy information and having the AI ​​generate a meal plan based on the user's preferences, and means for automatically reserving necessary ingredients and dishes based on the generated meal plan.

[0291] Program processing explanation

[0292] Hardware and software used

[0293] Hardware: Smartphones, servers

[0294] Software: Python, OpenAI API, HTTP request library (requests)

[0295] Data processing and calculation

[0296] 1. Input of user preference information: The user inputs his / her food preferences and allergy information into the application using a smartphone. This information is sent to the server.

[0297] 2. AI meal plan generation: The server uses the OpenAI API to generate a weekly meal plan based on the user's preferences. It sends prompts to the generative AI model to obtain the appropriate meal plan.

[0298] 3. Automated Reservation: Based on the generated meal plan, the necessary ingredients and dishes are automatically reserved using the HTTP request library. The reservation information is sent from the server to the relevant service provider.

[0299] Examples

[0300] When the user enters "I'm a vegetarian, I have no allergies, and I like Japanese food," the server sends the following prompt to the generative AI model:

[0301] User preferences: Vegetarian, no allergies, likes Japanese food

[0302] Generate a meal plan for the week.

[0303] Based on this prompt, the generative AI model generates a meal plan such as "Monday: vegetable sushi, Tuesday: tofu steak, ...". The server receives this meal plan and automatically reserves the necessary ingredients and dishes. For example, the ingredients for vegetable sushi are ordered from an online supermarket, and the tofu steak is reserved at a restaurant.

[0304] In this way, users can centrally manage everything from trip planning to execution, and the generation and booking of meal plans that take into account dietary preferences and allergy information is automated, significantly reducing the hassle of traveling and improving user satisfaction.

[0305] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0306] Program processing steps

[0307] Step 1:

[0308] A user uses a smartphone to input their food preferences and allergy information into the application. The input information is sent from the user's device to the server. The input data includes the user's food preferences (e.g., vegetarian, likes Japanese food) and allergy information (e.g., no allergies).

[0309] Step 2:

[0310] The server creates a prompt for the generative AI model based on the received user preference information. The prompt is written in a format that includes the user's preferences and allergy information. For example, a prompt might be generated that reads, "User preferences: vegetarian, no allergies, likes Japanese food. Please generate a meal plan for one week."

[0311] Step 3:

[0312] The server sends the generated prompt to the OpenAI API, which generates a meal plan based on the AI ​​model. The AI ​​model analyzes the prompt and generates a weekly meal plan that matches the user's preferences. The generated meal plan is returned to the server.

[0313] Step 4:

[0314] The server analyzes the received meal plan and creates a list of ingredients and dishes required, for example, "Monday: veggie sushi, Tuesday: tofu steak."

[0315] Step 5:

[0316] The server uses an HTTP request library to automatically reserve the necessary ingredients and dishes based on the generated meal plan. For example, ingredients for vegetable sushi are ordered from an online supermarket, and a reservation for tofu steak is made with a restaurant. The reservation information is then sent from the server to the relevant service provider.

[0317] Step 6:

[0318] The server sends information about the completed reservation to the user's device. The user can check the information about the reserved ingredients and dishes via their smartphone. For example, a notification such as "The ingredients for Monday's vegetable sushi have been ordered. Tuesday's tofu steak reservation has been completed" is displayed.

[0319] In this way, users can centrally manage everything from planning to execution of their trip, and the generation and booking of meal plans that take into account dietary preferences and allergy information is automated, significantly reducing the hassle of traveling and improving user satisfaction.

[0320] Example 3

[0321] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0322] In conventional travel support systems, it was difficult for users to quickly and accurately obtain the information they needed while traveling. In addition, even in information provision systems that use voice input, the process of generating appropriate information in response to a user's inquiry and providing it by voice was complicated, and there was a problem that it lacked real-time performance. As a result, users had to spend a lot of time and effort to obtain the information they needed while traveling.

[0323] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0324] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for receiving a user's voice input and converting the voice data into text data, a means for inputting a prompt sentence into a generative AI model and generating information, a means for converting the generated text data into voice data, and a means for transmitting the generated voice data to the user's terminal. This allows the user to quickly and accurately obtain necessary information by voice even while on the move.

[0325] "Artificial intelligence means" refers to technologies used to collect information through dialogue with users and customize trips based on the users' preferences and requests.

[0326] The "means for creating an original travel itinerary" refers to a technology for creating a travel itinerary specifically for a user based on information collected by an artificial intelligence means.

[0327] A "reservation facilitation means" is any technology that allows online reservations of flights, accommodations, activities, meals, etc.

[0328] "Means of providing support as a voice concierge" refers to technology that provides users with the information they need via voice while on the move.

[0329] "Means for receiving voice input and converting the voice data into text data" refers to technology for digitally capturing a user's voice input and converting it into text form.

[0330] "Means of inputting a prompt sentence into a generative AI model and generating information" refers to a technology for inputting text data into a generative AI model and generating appropriate information in response to a user's inquiry.

[0331] The "means for converting the generated text data into voice data" refers to a technique for converting the generated text data into voice format.

[0332] "Means for transmitting the generated voice data to the user's terminal" refers to technology for transmitting the generated voice data to the user's terminal via the Internet.

[0333] This invention is a system in which an AI responds to a user's voice inquiry about the information they need while on the move and provides that information. Specifically, the user makes an inquiry by voice using a device such as a smartphone or tablet, and the server processes the voice data and provides the appropriate information.

[0334] The server uses voice recognition software (e.g., voice recognition API) to convert the user's voice input into text data. It then uses a generative AI model (e.g., generative AI model) to generate appropriate information based on the user's inquiry. This information may include travel routes and local information. The generated text data is converted into voice data using voice synthesis software (e.g., voice synthesis API). The server sends this voice data to the user's device, and the user can receive the information by voice through the device.

[0335] As a concrete example, consider a case where a user makes a voice inquiry such as, "Tell me where the nearest cafe is." In this case, the server performs the following process.

[0336] 1. The user makes a voice inquiry on their smartphone saying, "Tell me where the nearest cafe is."

[0337] 2. The device transmits the voice data to the server, where it is digitally encoded and sent over the Internet to the server.

[0338] 3. The server uses a speech recognition API to convert the voice data into text data. For example, the voice data "Tell me where the nearest cafe is" is converted into text data "Tell me where the nearest cafe is."

[0339] 4. The server inputs the prompt "Tell me where the nearest cafe is" into the generative AI model and generates appropriate information. The generated information is text data such as "The nearest cafe is ____."

[0340] 5. The server uses a speech synthesis API to convert the generated text data into voice data. For example, the text data "The nearest cafe is ____" is converted into voice data.

[0341] 6. The server sends the voice data to the user's device, which then transmits the data over the Internet to the device.

[0342] 7. The user receives audio information through the device. A voice message such as "The nearest cafe is ____" is played from the device's speaker.

[0343] An example of a prompt sentence is, "The user wants to know the nearest cafe. Please provide information about the cafe closest to their current location."

[0344] In this way, the user can easily obtain necessary information even while on the move. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0345] Step 1:

[0346] The user makes a voice inquiry.

[0347] A user uses a device such as a smartphone or tablet to make a voice request for information. For example, say, "Tell me where the nearest cafe is." The input is the user's voice data, and the output is the voice data sent to the device.

[0348] Step 2:

[0349] The terminal transmits the voice data to the server.

[0350] The device captures the user's voice input with a microphone and transmits the voice data to a server, where it is digitally encoded and sent over the Internet to the server. The input is the user's voice data and the output is the digital voice data sent to the server.

[0351] Step 3:

[0352] The server converts the voice data into text data.

[0353] The server uses voice recognition software (e.g., a voice recognition API) to convert the received voice data into text data. For example, voice data such as "Tell me where the nearest cafe is" is converted into text data such as "Tell me where the nearest cafe is." The input is digital voice data, and the output is text data.

[0354] Step 4:

[0355] The server inputs a prompt sentence into the generative AI model and generates information.

[0356] The server inputs the converted text data to a generative AI model (e.g., generative AI model) as a prompt sentence. For example, a prompt sentence such as "Tell me where the nearest cafe is" is input, and the AI ​​model generates appropriate information. The generated information is text data such as "The nearest cafe is ____." The input is text data as the prompt sentence, and the output is the generated text data.

[0357] Step 5:

[0358] The server converts the generated text data into voice data.

[0359] The server converts the generated text data into voice data using speech synthesis software (e.g., speech synthesis API). For example, text data such as "The nearest cafe is ____" is converted into voice data. The input is the generated text data, and the output is voice data.

[0360] Step 6:

[0361] The server transmits the audio data to the terminal.

[0362] The server transmits the converted voice data to the user's terminal. The voice data is sent to the terminal through the Internet. The input is the voice data, and the output is the voice data transmitted to the terminal.

[0363] Step 7:

[0364] A user receives voice information through a terminal.

[0365] The user receives voice information through the terminal. A voice such as "The nearest cafe is ____" is played from the terminal's speaker. The input is the voice data sent to the terminal, and the output is the voice information received by the user.

[0366] (Application example 3)

[0367] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0368] Conventional travel customization systems have the problem that it is difficult for users to obtain the information they need in real time while traveling. In addition, there is a lack of systems that allow users to inquire about information by voice while traveling, which reduces user convenience. Furthermore, there is no voice concierge system in autonomous vehicles, so the provision of information while traveling is insufficient. To solve these problems, a system is needed that allows users to easily obtain the information they need while traveling.

[0369] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0370] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel plan created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, a means including a voice concierge system that operates in an autonomous vehicle, a means for converting a user's voice input into text, analyzing the text to generate an appropriate response, and a means for converting the generated response into voice and providing it to the user. This allows the user to obtain necessary information in real time even while on the move, improving convenience.

[0371] "User" means an individual or organization that uses the System to customize travel and receive information.

[0372] "Interaction" refers to the exchange of information between a user and an artificial intelligence means.

[0373] "Travel customization" refers to individually tailoring travel plans based on a user's preferences and budget.

[0374] "Artificial intelligence means" refers to intelligent algorithms or programs used to customize trips through interaction with users.

[0375] "Custom Journey Plan" means a travel schedule or itinerary created by artificial intelligence means specifically for a User.

[0376] "Air Ticket" refers to the boarding pass for the flight used by the User.

[0377] "Accommodation" refers to facilities such as hotels and inns where users stay during their trip.

[0378] "Activities" refers to sightseeing, leisure, and other events or activities in which a User participates during a Trip.

[0379] "Meals" refers to the meals and drinks consumed by the User during the Trip.

[0380] "Reservation facilitation means" refers to a system or program for making reservations for airfare, accommodations, activities, meals, etc.

[0381] "Means of providing support as a voice concierge while on the move" refers to a system or program that provides appropriate answers when a user inquires about information by voice while on the move.

[0382] A "voice concierge system operating within an autonomous vehicle" refers to a system that provides information to users via voice within an autonomous vehicle.

[0383] "Means for converting voice input to text" refers to a system or program for converting a user's voice into text data.

[0384] "Means for analyzing text and generating appropriate answers" refers to a system or program for analyzing text data and generating appropriate answers to user questions.

[0385] "Means for converting the generated answer into speech and providing it to the user" refers to a system or program for converting the generated text answer into speech data and providing it to the user.

[0386] A system for implementing this invention includes artificial intelligence means for customizing a trip through dialogue with a user, means for creating an original travel plan created by the artificial intelligence means, means for making reservations for airline tickets, accommodations, activities, meals, etc., means for providing support as a voice concierge during travel, a voice concierge system that operates within an autonomous vehicle, means for converting a user's voice input into text, analyzing the text to generate an appropriate response, and means for converting the generated response into voice and providing it to the user.

[0387] The server uses Google (registered trademark) Cloud's Dialogflow to convert the user's voice input into text, analyzes the text, and generates an appropriate answer. The generated answer is converted into speech using Google Cloud's Text-to-Speech service and provided to the user. Specifically, when a user asks "Where is the next tourist spot?" in an autonomous vehicle, the server converts this speech into text and analyzes it using Dialogflow. The answer "The next tourist spot is Tokyo Tower" is generated as the analysis result, and this answer is converted into speech using the Text-to-Speech service and provided to the user.

[0388] The hardware used is a microphone for voice input and a speaker for voice output. The software uses Google Cloud's Dialogflow and Text-to-Speech services.

[0389] As a concrete example, consider the case where a user asks, "What is the nearest restaurant?" When this question is sent to Dialogflow, the AI ​​responds, "The nearest restaurant is ____." This response is converted to audio by the Text-to-Speech service and provided to the user.

[0390] Example of a prompt to be input to a generative AI model:

[0391] When a user asks, "Where is the next tourist spot?", create a system where the AI ​​answers, "The next tourist spot is Tokyo Tower."

[0392] The flow of the specific process in the application example 3 will be described with reference to FIG.

[0393] Step 1:

[0394] The user provides voice input inside the self-driving vehicle.

[0395] Input: User speech (e.g. "What's the next tourist spot?")

[0396] Output: Audio data

[0397] Specific action: The user speaks a question into a microphone in the vehicle.

[0398] Step 2:

[0399] The device converts voice input into text.

[0400] Input: Audio data

[0401] Output: Text data (e.g. "Where is the next tourist spot?")

[0402] Specific operation: The device uses Google Cloud's Dialogflow to convert voice data into text data.

[0403] Step 3:

[0404] The server analyzes the text data and generates an appropriate answer.

[0405] Input: Text data (e.g. "Where is the next tourist spot?")

[0406] Output: Answer text (e.g. "The next tourist spot is Tokyo Tower")

[0407] Specific operation: The server uses Dialogflow to analyze the text data and generate appropriate answers to the user's questions.

[0408] Step 4:

[0409] The server converts the generated answer text into speech.

[0410] Input: Answer text (e.g. "The next tourist spot is Tokyo Tower")

[0411] Output: Audio data

[0412] Specific operation: The server converts the response text into audio data using Google Cloud's Text-to-Speech service.

[0413] Step 5:

[0414] The terminal provides the voice data to the user.

[0415] Input: Audio data

[0416] Output: Audio output to the user

[0417] Specific operation: The terminal plays the voice data through the speaker in the vehicle and provides the user with a response.

[0418] Furthermore, an emotion engine that estimates the emotion of the user may be combined. That is, the identification processing unit 290 may estimate the emotion of the user using the emotion identification model 59, and perform identification processing using the emotion of the user.

[0419] "Example 1"

[0420] As one embodiment of the present invention, an AI system including an emotion engine that recognizes the emotion of a user is provided. The emotion engine analyzes the emotion of the user from the user's voice, facial expression, text input, etc., and feeds back the result to the AI ​​system. For example, if the user is feeling stressed about planning a trip, the emotion engine detects the stress, and the AI ​​system responds according to the user's emotion, such as proposing a simpler travel plan to the user.

[0421] "Example 2"

[0422] The emotion engine also customizes trips based on the user's emotions. For example, if the user expresses happiness, the engine recognizes the emotion and customizes the trip plan based on the emotion, such as recommending activities and tourist spots that the user will find enjoyable.

[0423] "Example 3"

[0424] In addition, the emotion engine adjusts the voice concierge's response according to the user's emotions. For example, if the user expresses anxiety, the voice concierge will recognize the emotion and respond in a way that provides the user with a sense of security. This allows the user to feel reassured during their trip, resulting in a more comfortable travel experience.

[0425] The process flow of each embodiment will be described below.

[0426] "Example 1"

[0427] Step 1: The user asks the AI ​​system to plan a trip.

[0428] Step 2: The emotion engine analyzes emotions from the user's voice, facial expressions, text input, etc.

[0429] Step 3: The emotion engine feeds back the analysis results to the AI ​​system.

[0430] Step 4: The AI ​​system suggests travel plans based on the user's emotions.

[0431] "Example 2"

[0432] Step 1: The user asks the AI ​​system to plan a trip.

[0433] Step 2: The emotion engine analyzes the user's emotions.

[0434] Step 3: The emotion engine feeds back the analysis results to the AI ​​system.

[0435] Step 4: The AI ​​system customizes the travel plan based on the user's emotions.

[0436] "Example 3"

[0437] Step 1: The user asks the AI ​​system to plan a trip.

[0438] Step 2: The emotion engine analyzes the user's emotions.

[0439] Step 3: The emotion engine feeds back the analysis results to the AI ​​system.

[0440] Step 4: The AI ​​system adjusts the voice concierge's response based on the user's emotions.

[0441] Example 1

[0442] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0443] Conventional travel plan creation systems had problems in that they did not adequately customize the plan based on the user's desired conditions, and could not adjust the plan to take the user's feelings into account. Furthermore, support during the trip was limited, making it difficult to increase user satisfaction.

[0444] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0445] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, an emotion engine means for analyzing the user's emotions, and a means for adjusting a travel plan based on the analysis results of the emotion engine means. This makes it possible to customize a travel plan based on the user's desired conditions and adjust the plan according to the user's emotions.

[0446] "User" means an individual or organization that uses the System to customize a travel plan and prepare for a trip.

[0447] "Dialogue" refers to the exchange of information between a user and an artificial intelligence means, including in the form of text, voice, facial recognition, etc.

[0448] "Travel customization" is the process of individually tailoring and creating a travel plan based on a user's preferences.

[0449] "Artificial intelligence means" refers to software or hardware for analyzing information input by a user and generating an optimal travel plan.

[0450] "Custom Travel Itinerary" means a document or digital data detailing a travel plan based on the User's desired conditions, created by artificial intelligence means.

[0451] "Means for making reservations for airline tickets, accommodations, activities, meals, etc." refers to software or hardware for making reservations for various services necessary for travel.

[0452] A "voice concierge" is a system that provides users with voice support while traveling, including route guidance and local information.

[0453] The "emotion engine means" is software or hardware for analyzing emotions from a user's voice, facial expression, text input, and the like.

[0454] The "means for adjusting the travel plan based on the analysis results of the emotion engine means" refers to software or hardware for regenerating or adjusting the travel plan depending on the user's emotional state obtained from the emotion engine means.

[0455] The present invention is a system that allows users to input their desired travel conditions and customize a travel plan using artificial intelligence means. The system also has a function of analyzing the user's emotions and adjusting the travel plan based on the results.

[0456] The user uses the device to input the desired conditions for the trip. The input format is diverse, including text, voice, and facial expression recognition. For example, the user might input, "My budget is within 100,000 yen, I would like to stay in Tokyo for three days and visit art museums." This input data is sent from the device to the server.

[0457] The server uses natural language processing (NLP) technology to analyze the received data. Specifically, it uses software such as Google Cloud Natural Language API and IBM Watson Natural Language Understanding. As a result of the analysis, the user's desired conditions are obtained as structured data.

[0458] Next, the server generates a travel plan using a generative AI model (e.g., OpenAI's GPT-4). An example of a prompt sentence to input to the generative AI model is as follows:

[0459] User requirements:

[0460] Budget: Under 100,000 yen

[0461] Destination: Tokyo

[0462] Length of stay: 3 days

[0463] Favorite activity: Visiting museums

[0464] Based on this criteria, generate the best itinerary for you.

[0465] Based on this prompt, the generative AI model will output an optimal itinerary, such as "Day 1: Visit the museums in Ueno, Day 2: Visit the museums in Roppongi, Day 3: Visit the gallery in Ginza and then return home."

[0466] In addition, the server uses an emotion engine to analyze the user's emotions during user input, specifically using Microsoft® Azure®'s Emotion API and Affectiva's emotion recognition software, and the analysis results in the user's emotional state (e.g., stress, joy, excitement, etc.).

[0467] The server regenerates a travel plan based on the user's emotions based on the feedback from the emotion engine. For example, if the user is feeling stressed, it will suggest a simpler travel plan.

[0468] The final itinerary is sent from the server to the terminal. The terminal displays the received itinerary to the user. The user can then proceed with preparing for the trip based on this "original travel guide."

[0469] In this way, the present invention realizes customization of a travel plan based on a user's desired conditions and adjustment of the plan according to the user's emotions.

[0470] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0471] Step 1:

[0472] The user enters the travel requirements.

[0473] The user uses the device to input the desired travel conditions (budget, destination, length of stay, preferred activities, etc.). Input formats include text, voice, and facial expression recognition. For example, the user might input, "My budget is less than 100,000 yen, I would like to stay in Tokyo for three days and visit art museums." The input data is stored in text format on the device.

[0474] Step 2:

[0475] The terminal transmits the input data to the server.

[0476] The terminal converts the data entered by the user into JSON format and sends it to the server using the HTTPS protocol. The input data includes information such as budget, destination, length of stay, and preferred activities.

[0477] Step 3:

[0478] The server parses the input data.

[0479] The server uses natural language processing (NLP) technology to analyze the received JSON data. Specifically, it uses software such as Google Cloud Natural Language API and IBM Watson Natural Language Understanding. As a result of the analysis, the user's desired conditions are obtained as structured data. For example, conditions such as "budget: under 100,000 yen," "destination: Tokyo," "length of stay: 3 days," and "favorite activity: visiting museums" are extracted.

[0480] Step 4:

[0481] The server generates a travel plan using the generative AI model.

[0482] The server generates a travel plan using a generative AI model (e.g., OpenAI's GPT-4) based on the analysis results. Specifically, the server inputs the following prompt sentence into the generative AI model:

[0483] User requirements:

[0484] Budget: Under 100,000 yen

[0485] Destination: Tokyo

[0486] Length of stay: 3 days

[0487] Favorite activity: Visiting museums

[0488] Based on this criteria, generate the best itinerary for you.

[0489] Based on this prompt, the generative AI model will output an optimal itinerary, such as "Day 1: Visit the museums in Ueno, Day 2: Visit the museums in Roppongi, Day 3: Visit the gallery in Ginza and then return home."

[0490] Step 5:

[0491] The server uses an emotion engine to analyze the user's emotions.

[0492] The server uses an emotion engine to analyze the user's emotions while the user is typing. Specifically, it uses Microsoft Azure's Emotion API and Affectiva's emotion recognition software. The analysis results in the user's emotional state (e.g., stress, joy, excitement, etc.). For example, if the user is feeling stressed, that information is fed back to the server.

[0493] Step 6:

[0494] The server adjusts the travel plan according to the emotion.

[0495] The server regenerates a travel plan based on the user's emotions, based on feedback from the emotion engine. For example, if the user is feeling stressed, it will suggest a simpler travel plan. The regenerated plan might be something like "Day 1: Visit a relaxing cafe, Day 2: Visit hot springs, Day 3: Walk in nature."

[0496] Step 7:

[0497] The server sends the final itinerary to the terminal.

[0498] The server converts the final generated itinerary into JSON format and sends it to the terminal using the HTTPS protocol. The transmitted data includes the details of the itinerary.

[0499] Step 8:

[0500] The device displays the travel plan to the user.

[0501] The device will then display the travel plan to the user, who can then use this "original travel guide" to prepare for the trip. The plan includes specific dates and details of the places to be visited.

[0502] (Application example 1)

[0503] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0504] Conventional travel customization systems can generate travel plans based on the user's desired conditions, but they do not adequately handle meal arrangements during the trip or respond to the user's emotions. This can lead to users feeling stressed during the trip, which can reduce the satisfaction of the trip. Another issue is that arranging meals during a trip is complicated, and there is no environment in place for users to easily use food delivery services.

[0505] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0506] In this invention, the server includes an AI means for customizing the trip through dialogue with the user, a means for creating an original travel guide created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for generating an optimal food delivery plan based on the user's desired conditions, and a means for analyzing the user's emotions and responding appropriately based on the results. This makes it easier for the user to arrange meals during the trip, and furthermore, it is possible to respond according to the user's emotions, thereby improving the satisfaction of the trip.

[0507] "User" refers to an individual who uses the System to customize travel or arrange food delivery.

[0508] "Dialogue" refers to the process in which a user and an AI system exchange information through voice or text.

[0509] "Travel customization" refers to individually tailoring travel plans based on a user's preferences.

[0510] "AI means" refers to the function of using artificial intelligence technology to analyze information entered by users and generate optimal travel plans or food delivery plans.

[0511] An "original travel itinerary" refers to a document that contains a unique travel plan generated by an AI tool based on the user's desired conditions.

[0512] "Means of fulfilling reservations" refers to the ability to make online reservations for flights, hotels, activities, meals, etc.

[0513] "Voice concierge" refers to a feature that provides voice support to users while on the move.

[0514] "Food delivery plan" refers to generating the optimal food delivery plan based on the user's desired conditions.

[0515] "Means of emotion analysis" refers to the function of reading emotions from the user's voice or text and feeding the results back to the AI ​​system.

[0516] "Appropriate response" refers to the optimal support and suggestions that the AI ​​system provides based on the user's emotions.

[0517] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for generating an optimal food delivery plan based on the user's desired conditions, and means for analyzing the user's emotions and taking appropriate action based on the results.

[0518] System Configuration

[0519] The server uses the following hardware and software:

[0520] Hardware: A server with powerful processors, memory, and storage devices.

[0521] Software: Python, OpenAI API, Emotion Recognition API

[0522] Data processing and calculation

[0523] 1. User interaction:

[0524] Users use their smartphones to input their desired travel conditions (budget, destination, length of stay, preferred activities, etc.).

[0525] The server receives this information and analyzes it using AI means.

[0526] 2. Generate a travel plan:

[0527] The server uses a generative AI model to generate an optimal travel plan based on the user's desired conditions.

[0528] The generated travel plan is presented to the user as an original travel guide.

[0529] 3. Making a booking:

[0530] The server handles online reservations for flights, hotels, activities, meals, etc.

[0531] 4. Voice Concierge:

[0532] Users can use the voice concierge function on their smartphones while traveling.

[0533] The server provides voice guidance on travel routes and local information.

[0534] 5. Generate food delivery plan:

[0535] Users input their desired dining conditions during their trip (budget, type of cuisine, delivery time, allergy information, etc.).

[0536] Based on this information, the server uses a generative AI model to generate an optimal food delivery plan.

[0537] 6. Sentiment analysis and appropriate response:

[0538] The server analyzes the user's voice and text data using the Emotion Recognition API to identify the user's emotions.

[0539] Based on the results of emotion analysis, the server will respond appropriately to the user. For example, if the user is feeling stressed, it will suggest simpler travel plans or food delivery plans.

[0540] Examples

[0541] If a user requests Italian food to be delivered at 6:00 p.m. within a budget of 2,000 yen and has a nut allergy, and is feeling stressed, the server will suggest an "easy-to-order Italian set menu."

[0542] Examples of prompt statements

[0543] User's desired conditions: Budget: 2000 yen, Cuisine type: Italian, Delivery time: 18:00, Allergy information: Nuts. User's emotion: Stress. Please suggest the best food delivery plan.

[0544] In this way, a system can be realized that provides optimal travel plans and food delivery plans based on the user's desired conditions and emotions.

[0545] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0546] Step 1:

[0547] Users use their smartphones to input their desired travel conditions (budget, destination, length of stay, preferred activities, etc.).

[0548] Input: User's desired conditions (budget, destination, length of stay, preferred activities, etc.)

[0549] Output: The user's preferences are sent to the server.

[0550] Step 2:

[0551] The server uses a generative AI model to generate an optimal travel plan based on the user's desired conditions.

[0552] Input: User's desired conditions

[0553] Data processing: Input prompts into the generative AI model to generate a travel plan

[0554] Output: Generated itinerary

[0555] Step 3:

[0556] The server creates an original travel itinerary based on the generated travel plan.

[0557] Input: Generated itinerary

[0558] Data processing: Convert travel plans into bookmark format

[0559] Output: Original travel guide

[0560] Step 4:

[0561] The server handles online reservations for flights, hotels, activities, meals, etc.

[0562] Input: Original travel guide

[0563] Data processing: Send reservation information to each reservation system

[0564] Output: Reservation confirmation information

[0565] Step 5:

[0566] Users can use the voice concierge function on their smartphones while traveling.

[0567] Input: User's voice command

[0568] Data processing: Analyzes voice instructions and provides necessary information

[0569] Output: Voice guidance and information provided

[0570] Step 6:

[0571] The user inputs their travel meal preferences (budget, type of cuisine, delivery time, allergy information, etc.).

[0572] Input: User's meal preferences

[0573] Output: Meal preferences are sent to the server

[0574] Step 7:

[0575] The server uses a generative AI model to generate an optimal food delivery plan based on the received meal preferences.

[0576] Input: User's meal preferences

[0577] Data processing: Input prompts into the generative AI model to generate a food delivery plan

[0578] Output: Generated food delivery plan

[0579] Step 8:

[0580] The server analyzes the user's voice and text data using the Emotion Recognition API to identify the user's emotions.

[0581] Input: User's voice data, text data

[0582] Data processing: Emotion analysis using Emotion Recognition API

[0583] Output: The user's emotional state.

[0584] Step 9:

[0585] The server responds appropriately to the user based on the results of emotion analysis. For example, if the user is feeling stressed, it will suggest simpler travel plans or food delivery plans.

[0586] Input: User's emotional state, travel plans, food delivery plans

[0587] Data processing: Adjusting plans according to emotional states

[0588] Output: Adjusted travel and food delivery plans

[0589] In this way, a system can be realized that provides optimal travel plans and food delivery plans based on the user's desired conditions and emotions.

[0590] Example 2

[0591] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0592] Conventional travel reservation systems have the problem that users have to book flights, accommodations, activities, meals, etc. individually, which is time-consuming. In addition, it is difficult to increase user satisfaction because it is not possible to customize travel plans according to the user's emotions. Furthermore, support during the trip is insufficient, and users often have trouble when they are on the ground.

[0593] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0594] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for recognizing the user's emotions and customizing a travel plan based on the emotions, and a means for automatically making reservations based on the generated travel plan. This allows the user to plan and book a trip in a unified manner, enables customization according to emotions, and provides support during the trip, thereby increasing user satisfaction.

[0595] "User" means any individual or entity that uses the System to plan and book travel.

[0596] "Dialogue" is a communication process in which the user and the system exchange information.

[0597] "Travel customization" refers to individually tailoring travel plans based on a user's preferences and requirements.

[0598] "Artificial intelligence means" refers to intelligent algorithms and software used to generate and customize travel plans through interaction with users.

[0599] A "travel guidebook" is a document or digital data that contains detailed travel plans and schedules.

[0600] An "air ticket" is a ticket for travelling on an aircraft.

[0601] "Accommodation" means a hotel or other place of lodging for travelers.

[0602] "Activities" refers to sightseeing, leisure, entertainment and other activities undertaken during a trip.

[0603] "Meals" refers to food and drink consumed during the trip.

[0604] "Reservation facilitation mechanisms" refers to the systems and processes used to make online reservations, including but not limited to flights, accommodations, activities, meals, etc.

[0605] "Voice concierge" refers to a service that provides users with support and information while traveling via voice.

[0606] "Means of recognizing emotions" refers to software or algorithms used to analyze user emotions and obtain that data.

[0607] "Emotionally-customized travel plans" refers to systems or processes for adjusting travel plans based on a user's emotional data.

[0608] "Means for automatically making reservations based on the generated travel plan" refers to a system or process for automatically making the necessary reservations in accordance with the generated travel plan.

[0609] This invention is a system that allows a user to plan and book a trip in an integrated manner. The system includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for automatically making a reservation based on a generated travel plan, a means for recognizing a user's emotions and customizing the travel plan based on the emotions, and a means for providing support as a voice concierge during travel.

[0610] Hardware and Software Used

[0611] Hardware

[0612] Server: Use a server with high-performance computing power, which can run generative AI models and manage databases.

[0613] Terminal: A device used by a user, such as a smartphone or PC, that allows the user to access the system and input information.

[0614] software

[0615] Generative AI models: For example, using advanced natural language processing models such as OpenAI's GPT-4, which can generate itineraries based on user input.

[0616] Emotion recognition software: For example, using Microsoft Azure Emotion API, which allows you to analyze and capture user emotions.

[0617] Booking APIs: For example, use the Expedia API or Booking.com API, which allows you to automatically make reservations for flights, accommodation, activities, meals, etc.

[0618] Program Processing

[0619] Generate a travel plan

[0620] The user inputs the desired travel conditions (destination, schedule, budget, desired activities, etc.) into the terminal.

[0621] The terminal transmits the input information to the server.

[0622] The server generates a prompt sentence based on the received information and sends it to the generative AI model.

[0623] The server stores the travel plan received from the generative AI model in a database and notifies the user.

[0624] Automatic booking execution

[0625] The server analyzes the flight, accommodation, activity and meal reservation information based on the generated travel plan.

[0626] The server carries out the reservation process using the API of each reservation site.

[0627] The server notifies the user that the reservation has been completed.

[0628] Customization with Emotion Engine

[0629] The user inputs his / her feelings about the travel plan into the terminal (e.g., "I'm really looking forward to it!").

[0630] The device uses emotion recognition software to analyze the user's emotions and transmits the data to a server.

[0631] The server runs an emotion engine based on the received emotion data to customize the travel plan.

[0632] The server notifies the user of the customized travel plan.

[0633] Examples of concrete examples and prompts

[0634] Examples

[0635] The user inputs the following desired conditions: "I am planning a 3-night, 4-day trip to Tokyo. My budget is under 100,000 yen, and I would like to enjoy sightseeing and gourmet food."

[0636] The server sends the following prompt to the generative AI model: "Please create a plan for a 3-night, 4-day trip to Tokyo. The budget should be within 100,000 yen, and the plan should include sightseeing and gourmet food."

[0637] The server automatically makes reservations for flights, hotels, and restaurants based on the generated plan.

[0638] The user checks the travel plans and enters the emotion, "I'm really looking forward to it!"

[0639] The server uses an emotion engine to analyze the emotion of "fun" and recommends further enjoyable activities (e.g., tickets to Tokyo Disneyland).

[0640] Examples of prompt statements

[0641] "Please create a plan for a 3-night, 4-day trip to Tokyo. The budget should be under 100,000 yen, and the plan should include sightseeing and gourmet food."

[0642] “What activities or tourist destinations would you recommend if a user expressed the emotion of joy?”

[0643] In this way, users can easily plan and book their trips, and customize it according to their mood.

[0644] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0645] Step 1:

[0646] The user inputs the desired travel conditions (destination, schedule, budget, desired activities, etc.) into the terminal.

[0647] Input: destination, dates, budget, desired activities

[0648] Output: Data of the desired conditions entered

[0649] Specific operation: The user inputs information such as "Destination: Tokyo," "Schedule: 3 nights and 4 days," "Budget: 100,000 yen," and "Desired activities: sightseeing and gourmet" on the screen of a smartphone or PC. The device transmits the input information to the server in real time.

[0650] Step 2:

[0651] The server generates a prompt sentence based on the received desired conditions and sends it to the generative AI model.

[0652] Input: Data of desired conditions sent by the user

[0653] Output: The prompt to send to the generative AI model

[0654] Specific operation: The server generates a prompt saying, "Please create a 3-night, 4-day trip to Tokyo. The budget should be within 100,000 yen, and the trip should include sightseeing and gourmet food." The server sends this prompt to the generative AI model, and within a few seconds, the server receives a detailed trip plan.

[0655] Step 3:

[0656] The server stores the travel plan received from the generative AI model in a database and notifies the user.

[0657] Input: A travel plan received from a generative AI model

[0658] Output: Travel plan stored in database, notification to user

[0659] Specific operation: The server saves the travel plan received from the generative AI model in a database. The server then notifies the user of the summary of the saved travel plan via email or app notification.

[0660] Step 4:

[0661] The server analyzes the flight, accommodation, activity and meal reservation information based on the generated travel plan.

[0662] Input: A travel plan stored in the database

[0663] Output: Information required for the reservation process

[0664] Specific operation: The server analyzes the "airline ticket to Tokyo," "hotel for three nights," "admission tickets to tourist attractions," and "restaurant reservations" listed in the travel plan.

[0665] Step 5:

[0666] The server carries out the reservation process using the API of each reservation site.

[0667] Input: Information required for reservation procedure

[0668] Output: Reservation completion information

[0669] Specific operation: The server uses the Expedia API to book an airline ticket and the Booking.com API to book a hotel. The server notifies the user of the completion of the reservation by email or app notification.

[0670] Step 6:

[0671] The user inputs his / her feelings about the travel plan into the terminal (e.g., "I'm really looking forward to it!").

[0672] Input: User sentiment

[0673] Output: Input emotion data

[0674] Specific operation: The user checks the travel plan and inputs the emotion, "I'm really looking forward to it!" The device transmits the input emotion data to the server in real time.

[0675] Step 7:

[0676] The device uses emotion recognition software to analyze the user's emotions and transmits the data to a server.

[0677] Input: User emotion data

[0678] Output: Parsed emotion data

[0679] Specific operation: The device uses the Microsoft Azure Emotion API to analyze the emotion of "enjoyment" and sends the data to the server.

[0680] Step 8:

[0681] The server runs an emotion engine based on the received emotion data to customize the travel plan.

[0682] Input: Parsed emotion data

[0683] Output: A customized itinerary

[0684] Specific operation: The server receives the emotion data of "fun" and runs the emotion engine. The server adds an activity that the user can enjoy even more (e.g., a ticket to Tokyo Disneyland).

[0685] Step 9:

[0686] The server notifies the user of the customized travel plan.

[0687] Input: Customized Travel Plan

[0688] Output:Notification to the user

[0689] Specific operation: The server notifies the user of the customized travel plan via email or app notification.

[0690] (Application example 2)

[0691] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0692] Conventional travel reservation systems have the problem that users have to book flights, hotels, activities, meals, etc. individually, which is time-consuming. In addition, it is difficult to increase user satisfaction because it is not possible to customize travel plans according to the user's emotions. Furthermore, there was no system that allowed users to select and customize travel plans in virtual stores, which limited the user experience.

[0693] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0694] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, an emotion engine means for analyzing the user's emotions and customizing a travel plan based on the emotions, and a means for selecting a travel plan in a virtual store and providing a customized travel plan. This allows the user to make a trip reservation in a centralized manner, enables customization of a travel plan according to emotions, and also allows the selection and customization of a travel plan in a virtual store.

[0695] "User" means an individual or organization that uses the System to create and book travel plans.

[0696] "Dialogue" refers to communication between a user and a system in which information is exchanged.

[0697] "Travel customization" refers to individually tailoring travel plans based on a user's preferences and emotions.

[0698] "AI means" refers to technology that uses artificial intelligence to interact with users and create travel plans.

[0699] A "travel guidebook" is a document or digital data that summarizes a travel schedule and detailed information.

[0700] A "means for making reservations" is technology that automatically makes reservations for airline tickets, hotels, activities, meals, etc.

[0701] A "voice concierge" is a service that provides users with route guidance and local information via voice.

[0702] The "emotion engine means" is a technology that analyzes a user's emotions and customizes a travel plan based on those emotions.

[0703] "Virtual Store" means a virtual store space provided on the Internet where users can select and customize their travel plans.

[0704] "Travel Plan" means a plan that includes travel destinations, dates, accommodations, activities, etc.

[0705] A "customized itinerary" is a travel plan that is tailored based on a user's preferences and feelings.

[0706] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary created by the AI ​​means, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, emotion engine means for analyzing a user's emotions and customizing a travel plan based on the emotions, and means for selecting a travel plan in a virtual store and providing a customized travel plan.

[0707] System program processing

[0708] The server first customizes the trip through a dialogue with the user, including information such as the user's preferences, budget, and travel destinations. This information is then analyzed by AI means to create a custom itinerary.

[0709] The server then uses an emotion engine means to analyze the user's emotion. The emotion engine analyzes the text and voice data entered by the user to identify the user's emotional state. For example, if the user enters "I want to relax," the emotion engine recognizes the emotion "relax."

[0710] The server then customizes the travel plan based on the emotion. The AI ​​means selects and suggests to the user travel plans that suit the emotion identified by the emotion engine. For example, for the emotion "relaxation," hot spring trips and beach resorts are suggested.

[0711] When a user selects a suggested travel plan, the server automatically reserves air tickets, hotels, activities, meals, etc., allowing users to complete their travel reservations in a centralized manner.

[0712] In addition, a means to select and customize travel plans within the virtual store will be provided. Users can freely move around the virtual store using their smartphones to check and select travel plans. The selected plan will be automatically booked by AI.

[0713] Hardware and Software Used

[0714] This system mainly uses smartphones and servers. The smartphone is used for interacting with users and operating within the virtual store, while the server executes the AI ​​means, emotion engine means, and reservation means. The software uses Python, with the requests library for API communication and the json library for data processing.

[0715] Examples

[0716] For example, if a user types "I want to relax," the emotion engine will recognize the emotion and provide travel plans suitable for relaxation, such as hot spring trips and beach resorts.

[0717] Example prompt:

[0718] If a user types "I want to relax," the emotion engine will recognize the emotion and provide travel plans suitable for relaxation, such as hot spring trips and beach resorts.

[0719] In this way, users can easily select and book the best travel plan based on their emotions.

[0720] The flow of the identification process in the application example 2 will be described with reference to FIG.

[0721] Step 1:

[0722] The server initiates a dialogue with the user. The user uses a smartphone to input information such as travel destination, preferences, and budget. The server receives this information and stores it in a database. The input data includes travel preferences in text format. The server analyzes this data to determine the user's basic travel needs.

[0723] Step 2:

[0724] The server uses AI tools to analyze the information input by the user and create an original travel plan. Specifically, it generates an appropriate travel plan based on the user's preferences and budget. The input data is the user's travel preferences, and the output data is the generated travel plan. The server presents this plan to the user.

[0725] Step 3:

[0726] The user inputs his / her feelings about the presented travel plan. For example, he / she inputs feelings such as "I want to relax" in text format. The server receives this feeling data and analyzes it using the emotion engine means. The input data is the user's emotion information, and the output data is the analyzed emotion state.

[0727] Step 4:

[0728] The server customizes the travel plan based on the emotional state analyzed using the emotion engine means. For example, for the emotion "relaxation", a plan such as a trip to a hot spring or a beach resort is selected. The input data is the analyzed emotional state, and the output data is the customized travel plan. The server presents the customized plan to the user.

[0729] Step 5:

[0730] When the user selects a customized travel plan, the server automatically makes reservations for airfare, hotels, activities, meals, etc. The input data is the user's selected travel plan, and the output data is reservation confirmation information. The server notifies the user of the reservation confirmation information.

[0731] Step 6:

[0732] The user uses a smartphone to freely move around the virtual store and check and select a travel plan. The server monitors the user's operations in the virtual store and provides an appropriate travel plan. The input data is the user's operation information, and the output data is the provided travel plan.

[0733] Step 7:

[0734] The server acts as a voice concierge to provide support during travel. Specifically, it provides route guidance and local information. The input data is the user's current location and destination information, and the output data is voice guidance information. The server sends the voice guidance information to the user's smartphone.

[0735] Through the above steps, users can make travel reservations in a centralized manner, customize travel plans according to their emotions, and even select and customize travel plans in the virtual store.

[0736] Example 3

[0737] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0738] Conventional travel support systems have difficulty in quickly and appropriately providing users with the information they need while traveling, and they are unable to respond to the user's emotions, meaning that they are unable to provide a sufficient sense of security and comfort during the trip. In particular, there is a demand for a system that can recognize when a user feels anxious or stressed and respond appropriately.

[0739] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0740] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel guide created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for converting voice to text using a voice recognition engine, a means for analyzing text using a natural language processing engine, a means for analyzing the user's emotions using an emotion recognition engine, a means for converting text to voice using a voice synthesis engine, and a means for adjusting the voice concierge's response according to the user's emotions. This allows the user to easily obtain necessary information even while traveling, and further allows the user to enjoy a sense of security and comfort by receiving a response according to their emotions.

[0741] "User" refers to an individual who uses the system to customize their trip and receive information.

[0742] "Artificial intelligence means" refers to intelligent algorithms or programs used to customize trips through interaction with users.

[0743] "Travel itinerary" refers to documents or data that summarize travel plans and schedules created by artificial intelligence means.

[0744] "Accommodation" refers to facilities such as hotels and inns where users can stay during their trip.

[0745] "Activity" refers to the events and experiences that users participate in during their trip.

[0746] "Voice concierge" refers to the system's function of providing information and support to users via voice while on the move.

[0747] A "speech recognition engine" refers to software or algorithms that convert a user's speech into text.

[0748] A "natural language processing engine" refers to software and algorithms that analyze text and understand user intent.

[0749] An "emotion recognition engine" refers to software or algorithms used to analyze emotions from a user's voice or text.

[0750] "Speech synthesis engine" refers to software or algorithms for converting text into speech.

[0751] "Means to tailor responses" refers to the ability to change the content and tone of the voice concierge's responses depending on the user's emotions.

[0752] This invention is a system in which AI responds to and provides information when a user makes a voice inquiry about the information they need while on the move. In addition, it is equipped with an emotion engine, which adjusts the voice concierge's response according to the user's emotions, providing a sense of security and comfort to the user.

[0753] The server uses a server machine equipped with a high-performance processor and large-capacity memory. Specifically, the following hardware and software are used:

[0754] Hardware: A server machine equipped with a powerful processor and large memory capacity (e.g. 64GB RAM).

[0755] software:

[0756] Speech recognition engine: Uses common speech recognition APIs to convert speech to text.

[0757] Natural Language Processing (NLP) engine: Uses common natural language processing models to analyze text and understand user intent.

[0758] Emotion Recognition Engine: Uses common emotion recognition APIs to analyze emotions from the user's voice.

[0759] Speech synthesis engine: Uses common speech synthesis APIs to convert text to speech.

[0760] When a user makes a voice inquiry, the device captures the voice data and sends it to a server via the Internet. The server uses a voice recognition engine to convert the voice into text and analyzes the text with a natural language processing engine. It then analyzes the user's emotions with an emotion recognition engine and generates the required information. The generated information is converted into voice with a voice synthesis engine and sent to the device. The device plays back the voice data and provides the information to the user.

[0761] Examples:

[0762] Suppose a user makes a voice inquiry while traveling, saying, "Tell me where the nearest restaurant is." The device captures this voice and sends it to the server. The server uses a voice recognition engine to convert the voice into text, generating the text, "Tell me where the nearest restaurant is." The natural language processing engine then analyzes this text and understands that the user is looking for the nearest restaurant. The emotion recognition engine is used to analyze the user's emotions and detects feelings of anxiety. The server generates information about the nearest restaurant based on the user's current location information, and generates a message saying, "Don't worry, there's a great restaurant nearby." The server uses a speech synthesis engine to convert this message into speech, and sends the generated voice data to the device. The device plays the voice data and provides the information to the user. The user can listen to the information from the voice concierge and head to the nearest restaurant with peace of mind.

[0763] Example prompt:

[0764] "Explain how a voice concierge can help users when they're on the go looking for the nearest restaurant."

[0765] In this way, the server provides the user with necessary information during the user's movement and responds according to the user's emotions, thereby realizing a system that provides the user with a sense of security and comfort. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0766] Step 1:

[0767] The user makes a voice inquiry.

[0768] Specific operation: The user makes a voice inquiry into a device such as a smartphone or tablet saying, "Tell me where the nearest restaurant is."

[0769] Input: The user's voice data.

[0770] Output: The captured audio data on your device.

[0771] Step 2:

[0772] The terminal transmits the voice data to the server.

[0773] Specific operation: The device transmits the captured audio data to a server via the Internet.

[0774] Input: Audio data captured on the device.

[0775] Output: The audio data sent to the server.

[0776] Step 3:

[0777] The server converts the speech into text using a speech recognition engine.

[0778] Specific operation: The server uses a speech recognition engine to convert the received voice data into text, for example, "What is the nearest restaurant?"

[0779] Input: The audio data sent to the server.

[0780] Output: The text data generated by the speech recognition engine.

[0781] Step 4:

[0782] The server analyzes the text using a natural language processing (NLP) engine.

[0783] Specific operation: The server uses a natural language processing engine to analyze the text data and understand the user's intent. For example, the intent is analyzed as "looking for the nearest restaurant."

[0784] Input: The text data generated by the speech recognition engine.

[0785] Output: The intent data parsed by the natural language processing engine.

[0786] Step 5:

[0787] The server analyzes the user's emotions using an emotion recognition engine.

[0788] Specific operation: The server uses an emotion recognition engine to analyze the user's emotions from the voice data. For example, it is detected that the user is expressing an anxious emotion.

[0789] Input: The audio data sent to the server.

[0790] Output: Emotion data parsed by the emotion recognition engine.

[0791] Step 6:

[0792] The server generates the necessary information and adjusts the response according to the emotion.

[0793] Specific operation: The server generates information about the nearest restaurant based on the user's current location. It also generates a message that provides a sense of security to the user according to the user's emotions. For example, a message such as "Don't worry, there is a nice restaurant nearby" is generated.

[0794] Input: Intent data analyzed by a natural language processing engine, emotion data analyzed by an emotion recognition engine, and the user's current location.

[0795] Output: The informational messages generated.

[0796] Step 7:

[0797] The server converts the text to speech using a speech synthesis engine.

[0798] Specific operation: The server converts the generated text message into speech using a speech synthesis engine, for example generating speech data that says, "Don't worry, there's a great restaurant nearby."

[0799] Input: The generated informational message.

[0800] Output: The speech data generated by the speech synthesis engine.

[0801] Step 8:

[0802] The server transmits the generated voice data to the terminal.

[0803] Specific operations: The server transmits the generated voice data to the terminal.

[0804] Input: The speech data generated by the speech synthesis engine.

[0805] Output: The audio data sent to the device.

[0806] Step 9:

[0807] The terminal reproduces the audio data and provides information to the user.

[0808] Specific operation: The terminal plays the received voice data and provides information to the user. The user can listen to the information from the voice concierge and head to the nearest restaurant.

[0809] Input: The audio data sent to the device.

[0810] Output: The audio information provided to the user.

[0811] (Application example 3)

[0812] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0813] Conventional travel support systems make it difficult for users to easily obtain the information they need while traveling, and they are unable to respond to the user's emotions, resulting in a lack of security and comfort during the trip. In particular, for autonomous vehicles, it is important to provide information while traveling and respond to emotions, but there was no effective way to achieve this.

[0814] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0815] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for analyzing the user's emotions and adjusting the voice concierge's response according to the emotions, a means for calculating an optimal travel route based on the destination, and a means for providing information about the area around the destination. This allows the user to easily obtain necessary information even while traveling, and to feel reassured and comfortable by receiving responses according to their emotions.

[0816] "User interaction" is the process by which a user and a system exchange information through voice or text.

[0817] "Customized travel" means individually tailoring travel plans based on a user's preferences and budget.

[0818] "AI means" refers to means that use artificial intelligence technology to process information and make decisions in response to user requests.

[0819] An "original travel guide" is a unique travel guide created based on the user's travel plans.

[0820] A "means for making reservations" is a system for making online reservations for airline tickets, hotels, activities, meals, etc.

[0821] A "voice concierge" is a virtual assistant that provides information and support to users via voice.

[0822] "Means of emotion analysis" refers to technology that recognizes emotions from a user's voice or text and determines an appropriate response based on those emotions.

[0823] The "means for calculating a travel route" is an algorithm that calculates an optimal travel path based on the user's destination.

[0824] A "means of providing local information" is a system that provides users with information on tourist attractions, restaurants, etc. around the destination.

[0825] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for analyzing the user's emotions and adjusting the voice concierge's response in accordance with the emotions, means for calculating the optimal travel route based on the destination, and means for providing information about the area around the destination.

[0826] System Programming

[0827] Hardware

[0828] Microphone: Used to capture the user's voice input.

[0829] Speaker: Used to provide audio output.

[0830] Server: Used for data processing and information provision.

[0831] software

[0832] speech_recognition: Uses a speech recognition library to convert the user's speech into text.

[0833] pyttsx3: Use the speech synthesis library to convert text to speech.

[0834] emotion_recognition: Analyzes user emotions using an emotion recognition library.

[0835] route_planner: Uses a route planning library to calculate optimal travel routes.

[0836] local_info_provider: Uses the local information provider library to get information about the area around the destination.

[0837] Processing flow

[0838] 1. Speech Recognition: When the user speaks into the microphone, the voice is converted into text through the speech_recognition library.

[0839] 2. Sentiment Analysis: The captured text is analyzed through the emotion_recognition library to identify the user's emotions.

[0840] 3. Information provision: Based on the user request, the route_planner library calculates the optimal travel route and the local_info_provider library obtains information about the area around the destination.

[0841] 4. Speech synthesis: The acquired information is converted into speech through the pyttsx3 library and provided to the user through the speaker.

[0842] Examples

[0843] When a user says, "Tell me the route to Tokyo Station," the system calculates the optimal route and provides voice guidance saying, "The optimal route is XX."

[0844] When a user says, "Tell me about restaurants around Tokyo Station," the system provides information about nearby restaurants.

[0845] If the user says in an anxious voice, "I think I'm lost," the system responds, "Don't worry. You'll reach your destination soon."

[0846] Examples of prompt statements

[0847] "Tell me the route to Tokyo Station."

[0848] "Please tell me about restaurants around Tokyo Station."

[0849] "I think I'm lost."

[0850] In this way, users can easily obtain the information they need even while on the move, and can feel reassured and comfortable by receiving responses that correspond to their emotions.

[0851] The flow of the specific process in the application example 3 will be described with reference to FIG.

[0852] Step 1:

[0853] The user speaks into the microphone.

[0854] Input: User's voice.

[0855] Specific operation: The user says, "Tell me the route to Tokyo Station."

[0856] Output: Audio data.

[0857] Step 2:

[0858] The device uses a speech recognition library (speech_recognition) to convert the voice data into text.

[0859] Input: Audio data.

[0860] Specific operation: The speech recognition library analyzes the voice data and generates text such as "Please tell me the route to Tokyo Station."

[0861] Output: Text data.

[0862] Step 3:

[0863] The server uses an emotion recognition library (emotion_recognition) to analyze the user's emotions from the text data.

[0864] Input: Text data.

[0865] What happens: The emotion recognition library analyzes the text data and identifies the user's emotion as "neutral."

[0866] Output: emotion data.

[0867] Step 4:

[0868] The server uses a route planning library (route_planner) to calculate the optimal travel route based on the destination.

[0869] Input: Text data (destination information).

[0870] Specific operation: The route planning library calculates the optimal route based on the destination information "Tokyo Station."

[0871] Output: Route information.

[0872] Step 5:

[0873] The server uses the local information provider library (local_info_provider) to obtain information about the area around the destination.

[0874] Input: Text data (destination information).

[0875] Specific operation: The local information library obtains restaurant information around "Tokyo Station."

[0876] Output:Local information.

[0877] Step 6:

[0878] The server uses a speech synthesis library (pyttsx3) to convert the acquired information into speech.

[0879] Input: route information, local information.

[0880] Specific operation: The speech synthesis library converts the text "The best route is XX. Restaurant information around Tokyo Station is △△." into speech.

[0881] Output: Audio data.

[0882] Step 7:

[0883] The terminal provides voice data to the user through a speaker.

[0884] Input: Audio data.

[0885] Specific operation: The speaker will provide audio guidance saying, "The best route is XX. Restaurant information around Tokyo Station is △△."

[0886] Output: The user gets the information.

[0887] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0888] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0889] Another example of generative AI is Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0890] In the above embodiment, an example was given in which the specific process was performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0891] [Second embodiment]

[0892] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0893] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0894] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0895] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0896] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[0897] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[0898] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[0899] Fig. 4 shows an example of main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0900] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0901] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0902] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0903] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0904] "Example 1"

[0905] As an embodiment of the present invention, a system is provided that customizes a trip through dialogue with AI. Specifically, when a user inputs desired travel conditions (e.g. budget, destination, length of stay, preferred activities, etc.) to the AI, the AI ​​generates a travel plan based on this information. The generated travel plan is presented to the user as an "original travel itinerary," and the user can use this as a basis for preparing for the trip.

[0906] "Example 2"

[0907] Furthermore, as an embodiment of the present invention, a system is provided that centralizes reservations for airline tickets, hotels, activities, meals, etc. Specifically, the system automatically makes the necessary reservations based on a travel plan generated by AI. This allows users to save time and effort in the reservation process.

[0908] "Example 3"

[0909] In addition, as an embodiment of the present invention, a system is provided that provides support as a voice concierge while traveling. Specifically, when a user inquires by voice about information required while traveling (e.g., travel route, local information, etc.), the AI ​​responds and provides the information. This allows the user to easily obtain the information they need even while traveling.

[0910] The process flow of each embodiment will be described below.

[0911] "Example 1"

[0912] Step 1: The user inputs their travel preferences (e.g. budget, destination, length of stay, preferred activities, etc.) into the AI.

[0913] Step 2: The AI ​​generates a travel plan based on the information input by the user.

[0914] Step 3: Present the generated travel plan to the user as an "original travel itinerary."

[0915] "Example 2"

[0916] Step 1: Based on the travel plan generated by AI, all necessary reservations (flights, hotels, activities, meals, etc.) are made centrally.

[0917] Step 2: Notify the user of the reservation result.

[0918] "Example 3"

[0919] Step 1: The user makes a voice request for the information they need while traveling (e.g., travel route, local information, etc.).

[0920] Step 2: The AI ​​responds to the user's inquiry and provides information.

[0921] Example 1

[0922] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0923] In conventional travel planning systems, it was difficult for users to customize their travel plans based on their desired conditions, and the process of creating travel plans and making reservations was cumbersome. In addition, there was a lack of support during travel, making it difficult for users to quickly obtain local information. This limited the users' travel experience.

[0924] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0925] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original trip plan created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as voice guidance during travel, a means for transmitting desired conditions input by the user from a terminal to the server, a means for the server to generate a trip plan using a generation AI model, and a means for transmitting the generated trip plan to the terminal and displaying it to the user. This allows the user to easily create and obtain a customized trip plan based on the desired conditions, and allows them to prepare for the trip and receive support on-site.

[0926] "User" means an individual or entity that uses the System to customize a trip.

[0927] "Interaction" is the process in which a user inputs desired requirements to a system and the system responds accordingly.

[0928] "Travel customization" refers to creating individual travel plans based on the user's desired conditions.

[0929] "Artificial intelligence means" means the part of the system that contains algorithms and models for generating travel plans based on user input.

[0930] An "original travel plan" is a unique travel plan created by an artificial intelligence means based on the user's desired conditions.

[0931] "Reservations for airfare, accommodation, activities, meals, etc." refers to the process of securing various services necessary for travel in advance.

[0932] "Voice guidance" is a function that provides users with necessary information via voice while they are traveling.

[0933] A "terminal" is a device (e.g., a PC or smartphone) that allows a user to access the system and input desired conditions.

[0934] The "server" refers to a central processing unit that receives user input data, generates a travel plan using a generative AI model, and transmits it to the terminal.

[0935] A "generative AI model" is an artificial intelligence algorithm that analyzes a user's desired conditions and suggests the optimal travel plan.

[0936] A "prompt" is text containing the user's desired conditions that is input into a generative AI model.

[0937] A "Travel Plan" is a specific travel schedule and activity proposal created based on the User's desired conditions.

[0938] This invention is a system that generates a customized travel plan based on a user's desired travel conditions input. The system includes an artificial intelligence means for customizing the trip through dialogue with the user, a means for creating a generated original travel plan, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as voice guidance during travel, a means for transmitting the desired conditions input by the user from a terminal to a server, a means for the server to generate a travel plan using a generation AI model, and a means for transmitting the generated travel plan to the terminal and displaying it to the user.

[0939] A user accesses the system using a terminal (e.g., a PC or smartphone). The user inputs the desired travel conditions (e.g., budget, destination, length of stay, preferred activities, etc.). Specifically, the user inputs the following information into the system's input form:

[0940] Budget: 100,000 yen

[0941] Destination: Kyoto

[0942] Length of stay: 3 days

[0943] Favorite activities: Visiting temples, experiencing Japanese cuisine

[0944] The device sends the desired conditions entered by the user as data to the server. This data is sent to the server as an HTTP request. Specifically, the device inputs the following prompt sentence into the generative AI model:

[0945] "I would like to stay in Kyoto for three days on a budget of 100,000 yen and enjoy visiting temples and experiencing Japanese cuisine."

[0946] The server generates a travel plan based on the received data using a generative AI model (e.g., OpenAI's GPT-4). The generative AI model analyzes the user's desired conditions and performs data processing and calculations to propose the optimal travel plan. The generated travel plan is returned to the server in the following format:

[0947] Day 1: Arrive at Kyoto Station and visit Kiyomizu-dera Temple and Kinkaku-ji Temple. Enjoy a Japanese dinner in Gion.

[0948] Day 2: Walk through the bamboo forest in Arashiyama and visit Tenryu-ji Temple. Enjoy a Japanese meal in Sagano for lunch.

[0949] Day 3: Visit Fushimi Inari Taisha Shrine and return home from Kyoto Station in the afternoon.

[0950] The server sends the generated travel plan to the terminal. This data is sent to the terminal as an HTTP response. The terminal displays the travel plan received from the server to the user. Specifically, the terminal displays the travel plan on the screen in an easy-to-read format. The user can then proceed with specific travel preparations based on this travel plan.

[0951] The system allows users to easily create and obtain customized travel plans based on their desired conditions, and allows them to receive support during travel preparation and on-site.

[0952] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0953] Step 1:

[0954] The user inputs the desired travel conditions.

[0955] A user accesses the system using a terminal (e.g., a PC or smartphone) and inputs the desired travel conditions (e.g., budget, destination, length of stay, preferred activities, etc.). Specifically, the user enters the following information into the system's input form:

[0956] Budget: 100,000 yen

[0957] Destination: Kyoto

[0958] Length of stay: 3 days

[0959] Favorite activities: Visiting temples, experiencing Japanese cuisine

[0960] Input data: User's desired conditions

[0961] Output data: Desired conditions entered in the input form

[0962] Step 2:

[0963] The terminal transmits the input data to the server.

[0964] The terminal sends the desired conditions entered by the user as data to the server. This data is sent to the server as an HTTP request. Specifically, the terminal sends the following JSON-formatted data to the server:

[0965] json

[0966] {

[0967] "budget": "100,000 yen",

[0968] "destination": "Kyoto",

[0969] "duration": "3 days",

[0970] "activities": ["Temple tour", "Japanese food experience"]

[0971] }

[0972] Input data: User's desired conditions

[0973] Output data: Data of desired conditions sent to the server

[0974] Step 3:

[0975] The server generates a travel plan using the generative AI model.

[0976] The server generates a travel plan using a generative AI model (e.g., OpenAI's GPT-4) based on the received data. The server inputs the user's desired conditions into the generative AI model as a prompt sentence. Specifically, the server inputs the following prompt sentence into the generative AI model:

[0977] "I would like to stay in Kyoto for three days on a budget of 100,000 yen and enjoy visiting temples and experiencing Japanese cuisine."

[0978] The generative AI model generates a travel plan based on this prompt.

[0979] Input data: User's desired conditions, prompt text

[0980] Output data: Generated itinerary

[0981] Step 4:

[0982] The server transmits the generated travel plan to the terminal.

[0983] The server sends the generated itinerary to the terminal. This data is sent to the terminal as an HTTP response. Specifically, the server sends the following JSON format data to the terminal:

[0984] json

[0985] {

[0986] "day1": "After arriving at Kyoto Station, visit Kiyomizu-dera Temple and Kinkaku-ji Temple. In the evening, have a Japanese dinner in Gion.",

[0987] "day2": "Walk through the bamboo forest in Arashiyama and visit Tenryu-ji Temple. For lunch, experience Japanese cuisine in Sagano.",

[0988] "day3": "Visit Fushimi Inari Taisha Shrine and return home from Kyoto Station in the afternoon."

[0989] }

[0990] Input data: Generated itinerary

[0991] Output data: Travel plan sent to the terminal

[0992] Step 5:

[0993] The terminal displays the travel plan to the user.

[0994] The terminal displays the travel plan received from the server to the user. Specifically, the terminal displays the travel plan on the screen in an easy-to-read format. The user can proceed with specific travel preparations based on this travel plan.

[0995] Input data: Travel plan received from the server

[0996] Output data: The itinerary displayed to the user

[0997] (Application example 1)

[0998] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0999] Conventional travel customization systems were able to create travel plans based on users' desired conditions, but they lacked the customization of meals during the trip or the provision of optimal food delivery plans. As a result, users had to spend time and effort finding suitable meals during their trip, which could reduce their satisfaction with the trip.

[1000] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1001] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for generating an optimal food delivery plan based on the user's desired conditions, and a means for presenting the generated food delivery plan to the user. This allows the user to easily find the optimal meal based on their desired conditions even while traveling, improving the satisfaction of the trip.

[1002] "User" means an individual or entity that uses the System to customize travel or generate food delivery plans.

[1003] "Dialogue" is the process in which a user inputs desired conditions or questions to a system and the system responds accordingly.

[1004] "Customized travel" refers to individually tailoring and creating travel plans based on the user's desired conditions.

[1005] "AI means" refers to a part of a system that uses artificial intelligence to analyze users' desired conditions and generate optimal travel plans and food delivery plans.

[1006] An "original travel itinerary" is a document created by AI means that contains a unique travel plan based on the user's desired conditions.

[1007] A "means for fulfilling reservations" is a part of a system that has the functionality to make online reservations for flights, hotels, activities, meals, etc.

[1008] "Voice concierge" is a part of the system that has the ability to provide support to users via voice while on the move.

[1009] A "Food Delivery Plan" is a plan that generates the optimal food delivery plan based on the user's desired conditions.

[1010] A "presentation means" is a part of the system that has the functionality to present the generated plan to the user visually or audibly.

[1011] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary created by the AI ​​means, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for generating an optimal food delivery plan based on the user's desired conditions, and means for presenting the generated food delivery plan to the user.

[1012] System Programming

[1013] The system executes the following programs:

[1014] 1. User interaction:

[1015] Users input their desired travel conditions (budget, destination, length of stay, preferred activities, etc.) through a smartphone app.

[1016] Similarly, enter your dining preferences (budget, type of food, delivery time, allergy information, etc.).

[1017] 2. Analysis by AI means:

[1018] The server generates a prompt sentence based on the input desired conditions.

[1019] Use the OpenAI API to send prompts to a generative AI model (e.g. GPT-3).

[1020] 3. Generate travel and food delivery plans:

[1021] The AI ​​model generates optimal travel plans and food delivery plans and returns them to the server.

[1022] 4. Present the plan:

[1023] The server provides the generated plan to the user visually or audibly.

[1024] Hardware and Software Used

[1025] Hardware:

[1026] Smartphone: A device that allows users to input their desired conditions.

[1027] Server: A device that runs the AI ​​model and generates plans.

[1028] software:

[1029] Python: A programming language used to implement the program.

[1030] OpenAI API: An API for using generative AI models (e.g. GPT-3).

[1031] Data processing and calculation

[1032] Data processing:

[1033] The desired conditions entered by the user are formatted as a prompt.

[1034] example:

[1035] Generate the best food delivery plan based on your user preferences.

[1036] Price: 2000 yen

[1037] Cuisine type: Italian

[1038] Delivery time: 19:00

[1039] Allergy Information: Nuts

[1040] Data Calculation:

[1041] Use the OpenAI API to send prompts to a generative AI model to generate an optimal plan.

[1042] The generated plan is formatted visually or audibly for presentation to the user.

[1043] Examples

[1044] The user enters the following conditions into the app:

[1045] Price: 2000 yen

[1046] Cuisine type: Italian

[1047] Delivery time: 19:00

[1048] Allergy Information: Nuts

[1049] The server generates prompts based on these conditions and uses the OpenAI API to generate an optimal food delivery plan, which is then presented to the user visually or audibly.

[1050] In this way, users can easily find the best meal based on their desired criteria while traveling, thereby improving their satisfaction with the trip.

[1051] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1052] Step 1:

[1053] A user uses a smartphone device to input desired travel conditions (budget, destination, length of stay, favorite activities, etc.) and desired meal conditions (budget, type of food, delivery time, allergy information, etc.). The input data is sent from the device to the server.

[1054] Step 2:

[1055] The server generates a prompt based on the received user's desired conditions. Specifically, it converts the user's input data into text format and creates a prompt suitable for the generative AI model. For example, the following prompt is generated:

[1056] Generate the best food delivery plan based on your user preferences.

[1057] Price: 2000 yen

[1058] Cuisine type: Italian

[1059] Delivery time: 19:00

[1060] Allergy Information: Nuts

[1061] Step 3:

[1062] The server sends the generated prompt to the generative AI model (e.g., GPT-3) using the OpenAI API. The API request includes the prompt along with any required parameters (e.g., max_tokens, temperature, etc.).

[1063] Step 4:

[1064] The generative AI model generates optimal travel and food delivery plans based on the received prompts, which are then returned to the server as an API response.

[1065] Step 5:

[1066] The server parses the plans returned by the generative AI model and formats them for presentation to the user, specifically converting the travel plans and food delivery plans into data for visual or audio display.

[1067] Step 6:

[1068] The server sends the formatted plan to the smartphone terminal. The terminal presents the received plan to the user visually or audibly. The user can check the presented plan and proceed with reservations or orders as necessary.

[1069] In this way, the user can easily find the most suitable meal based on their desired conditions even while traveling, thereby improving the satisfaction of the trip.

[1070] Example 2

[1071] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[1072] Conventional travel reservation systems require users to make individual reservations for air tickets, accommodations, activities, meals, etc., which is time-consuming and laborious. In addition, when creating a travel plan, users must collect information and make plans themselves, which is inefficient. Furthermore, there is a lack of support during travel, which means that there is insufficient information and guidance on-site.

[1073] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1074] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for making reservations using the application programming interface of each reservation site based on the generated travel plan, and a means for providing support as a voice concierge during travel. This allows the user to plan and book a trip in a unified manner and receive support during travel, making for an efficient and comfortable trip.

[1075] "User" means any individual or entity that uses the System to plan and book travel.

[1076] "Dialogue" is the process by which a user and a system exchange information, and includes the act of conveying the user's wishes and conditions to the system.

[1077] "Trip customization" is the process of creating the optimal travel plan based on the user's preferences, budget, dates, and other criteria.

[1078] "Artificial intelligence means" refers to algorithms or programs used to customise trips through dialogue with users.

[1079] A "travel guidebook" is a document or digital data that contains a travel schedule or detailed plans.

[1080] An "air ticket" is a ticket for travelling on an aircraft.

[1081] "Accommodation facilities" refer to facilities such as hotels, inns, and guesthouses where travelers can stay.

[1082] "Activities" refers to activities such as sightseeing, leisure, and experiences that you undertake while traveling.

[1083] "Meals" refers to services such as restaurants and cafes that provide food and drinks to be consumed during travel.

[1084] A "reservation" is the process of reserving services such as airfare, accommodations, activities, and meals in advance.

[1085] An "application programming interface" is an interface that allows different software systems to communicate with each other.

[1086] A "voice concierge" is a service that provides information and guidance to users via voice.

[1087] "Support" refers to providing information and assistance in resolving problems that users require during their travels.

[1088] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[1089] The present invention relates to a system that allows a user to make a trip plan and a reservation in an integrated manner. A specific embodiment of this system will be described below.

[1090] System Configuration

[1091] In this system, users input their desired travel conditions using a terminal (PC, smartphone, tablet, etc.), and the server generates a travel plan based on those conditions and automatically makes the necessary reservations. The system includes the following main components:

[1092] 1. User terminal: This is the device through which the user enters their travel preferences. This includes PCs, smartphones, tablets, etc.

[1093] 2. Server: Receives input from the user, generates a travel plan using the generative AI model, and makes the reservation using the API of each booking site.

[1094] 3. Generative AI models: For example, using a generative AI model such as OpenAI's GPT-4, generate a travel plan based on the user's desired criteria.

[1095] 4. Booking site API: Use the API of each booking site (e.g. airline ticket booking site, hotel booking site, restaurant booking site, etc.) to automatically make the necessary reservations.

[1096] Program Processing

[1097] The server receives the desired travel conditions entered by the user from the terminal and converts them into a prompt. For example, if the user enters the desired conditions, "I am planning a five-day trip to Tokyo in December 2023. My budget is within 200,000 yen, and I would like to enjoy sightseeing and delicious food," the server generates the following prompt.

[1098] Example prompt:

[1099] "I am planning a 5-day trip to Tokyo in December 2023. My budget is within 200,000 yen and I would like to enjoy sightseeing and delicious food. Please suggest the best travel plan."

[1100] The generated prompt sentence is sent to the generative AI model, which generates a travel plan based on the prompt sentence, like this:

[1101] An example of a generated itinerary:

[1102] Day 1: Arrival in Tokyo, sightseeing in Asakusa, visiting Sensoji Temple, dinner at a local restaurant

[1103] Day 2: Visit Tokyo Tower, go shopping in Ginza, and have lunch at a sushi restaurant

[1104] Day 3: Visit Ueno Zoo, shopping at Ameyoko, yakiniku dinner

[1105] Day 4: Sightseeing in Odaiba, shopping at VenusFort, dinner at an Italian restaurant

[1106] Day 5: Visit to Tokyo Disneyland, return home

[1107] The server makes the necessary reservations using the API of each reservation site based on the generated travel plan. For example, to reserve an airline ticket, the API of an airline reservation site is used, to reserve a hotel, the API of a hotel reservation site is used, and to reserve a restaurant, the API of a restaurant reservation site is used.

[1108] After all reservations are completed, the server sends a notification to the user, including details of the reservation (reservation number, date, time, location, etc.). The user can view this notification on their device.

[1109] This system allows users to plan and book their trips all in one place, making travel more efficient and comfortable.

[1110] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1111] Step 1:

[1112] The user inputs the desired travel conditions.

[1113] A user uses a terminal (PC, smartphone, tablet, etc.) to input the desired conditions for the trip (destination, budget, schedule, activities of interest, etc.). For example, a user might input conditions such as "I am planning a five-day trip to Tokyo in December 2023. My budget is within 200,000 yen, and I would like to enjoy sightseeing and delicious meals."

[1114] Input: Your travel preferences (destination, budget, dates, activities you're interested in, etc.)

[1115] Output: The user's preferences are sent to the server.

[1116] Step 2:

[1117] The server converts the entered conditions into a prompt.

[1118] The server receives the desired conditions entered by the user and converts them into a prompt sentence suitable for the generative AI model. For example, it generates a prompt sentence like the following.

[1119] Example prompt:

[1120] "I am planning a 5-day trip to Tokyo in December 2023. My budget is within 200,000 yen and I would like to enjoy sightseeing and delicious food. Please suggest the best travel plan."

[1121] Input: User's desired conditions

[1122] Output: The generated prompt statement

[1123] Step 3:

[1124] The server sends a prompt to the generative AI model.

[1125] The server sends the generated prompt to a generative AI model (e.g., OpenAI's GPT-4). Since the generative AI model runs on the cloud, the server sends the request over the Internet.

[1126] Input: Generated prompt text

[1127] Output: The prompt sent to the generative AI model

[1128] Step 4:

[1129] The generative AI model generates a travel plan and returns it to the server.

[1130] The generative AI model generates a travel plan based on the prompt sentence. For example, it generates a plan like the one below.

[1131] An example of a generated itinerary:

[1132] Day 1: Arrival in Tokyo, sightseeing in Asakusa, visiting Sensoji Temple, dinner at a local restaurant

[1133] Day 2: Visit Tokyo Tower, go shopping in Ginza, and have lunch at a sushi restaurant

[1134] Day 3: Visit Ueno Zoo, shopping at Ameyoko, yakiniku dinner

[1135] Day 4: Sightseeing in Odaiba, shopping at VenusFort, dinner at an Italian restaurant

[1136] Day 5: Visit to Tokyo Disneyland, return home

[1137] Input: The prompt sent to the generative AI model

[1138] Output: The generated itinerary

[1139] Step 5:

[1140] The server makes reservations based on the travel plan using the API of each reservation site.

[1141] Based on the generated travel plan, the server makes the necessary reservations using the API of each reservation site (e.g., airline ticket reservation site, accommodation reservation site, restaurant reservation site, etc.). Specifically, it automatically makes airline ticket reservations, accommodation reservations, activity reservations, restaurant reservations, etc.

[1142] Input: Generated itinerary

[1143] Output: Booking requests sent to each booking site

[1144] Step 6:

[1145] The server sends a notification to the user that the reservation is complete.

[1146] The server confirms that all reservations are complete and sends a notification to the user, including details of the reservation (reservation number, date, time, location, etc.). The user can view the notification on their device.

[1147] Input: Reservation completion information from each reservation site

[1148] Output: Booking completion notification sent to user

[1149] (Application example 2)

[1150] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1151] Conventional travel reservation systems have the problem that users have to book flights, hotels, activities, meals, etc. individually, which is time-consuming. In addition, the generation and reservation of meal plans that take into account the user's dietary preferences and allergy information was not automated, so users had to make adjustments themselves. This could make trip planning and execution cumbersome and reduce user satisfaction.

[1152] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1153] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel guide created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for inputting the user's dietary preferences and allergy information and for the AI ​​to generate a meal plan based on the user's preferences, and a means for automatically reserving necessary ingredients and dishes based on the generated meal plan. This allows the user to centrally manage everything from planning to execution of the trip, and the generation and reservation of a meal plan that takes into account dietary preferences and allergy information is automated, significantly reducing the hassle of traveling and improving user satisfaction.

[1154] Key Word Definitions

[1155] "User" means any individual or entity that uses the System to plan and book travel.

[1156] "Dialogue" is the process by which a user and a system exchange information and is the means by which the user communicates their preferences and requests to the system.

[1157] "Trip customization" is the process of creating an individually optimized travel plan based on a user's preferences, budget, destinations, and other information.

[1158] "AI means" refers to a component of the system that uses artificial intelligence technology to analyze information input by users and generate optimal travel and meal plans.

[1159] An "original travel itinerary" is a document created by AI means that details the user's travel plans.

[1160] A "means for making reservations" is a component of a system that automatically makes reservations for flights, hotels, activities, meals, etc.

[1161] A "voice concierge" is a component of a system that provides voice guidance and support to users while traveling.

[1162] "Dietary preferences" refers to information such as the user's preferred ingredients, types of cuisine, and seasonings.

[1163] "Allergy information" refers to information about ingredients or substances to which a user has an allergy.

[1164] "Meal Plan" means a weekly meal plan generated by the AI ​​Means based on the User's dietary preferences and allergy information.

[1165] The "means for automatically reserving ingredients and meals" is a component of the system that automatically reserves the necessary ingredients and meals based on the generated meal plan.

[1166] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[1167] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary created by the AI ​​means, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for inputting the user's dietary preferences and allergy information and having the AI ​​generate a meal plan based on the user's preferences, and means for automatically reserving necessary ingredients and dishes based on the generated meal plan.

[1168] Program processing explanation

[1169] Hardware and software used

[1170] Hardware: Smartphones, servers

[1171] Software: Python, OpenAI API, HTTP request library (requests)

[1172] Data processing and calculation

[1173] 1. Input of user preference information: The user inputs his / her food preferences and allergy information into the application using a smartphone. This information is sent to the server.

[1174] 2. AI meal plan generation: The server uses the OpenAI API to generate a weekly meal plan based on the user's preferences. It sends prompts to the generative AI model to obtain the appropriate meal plan.

[1175] 3. Automated Reservation: Based on the generated meal plan, the necessary ingredients and dishes are automatically reserved using the HTTP request library. The reservation information is sent from the server to the relevant service provider.

[1176] Examples

[1177] When the user enters "I'm a vegetarian, I have no allergies, and I like Japanese food," the server sends the following prompt to the generative AI model:

[1178] User preferences: Vegetarian, no allergies, likes Japanese food

[1179] Generate a meal plan for the week.

[1180] Based on this prompt, the generative AI model generates a meal plan such as "Monday: vegetable sushi, Tuesday: tofu steak, ...". The server receives this meal plan and automatically reserves the necessary ingredients and dishes. For example, the ingredients for vegetable sushi are ordered from an online supermarket, and the tofu steak is reserved at a restaurant.

[1181] In this way, users can centrally manage everything from trip planning to execution, and the generation and booking of meal plans that take into account dietary preferences and allergy information is automated, significantly reducing the hassle of traveling and improving user satisfaction.

[1182] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1183] Program processing steps

[1184] Step 1:

[1185] A user uses a smartphone to input their food preferences and allergy information into the application. The input information is sent from the user's device to the server. The input data includes the user's food preferences (e.g., vegetarian, likes Japanese food) and allergy information (e.g., no allergies).

[1186] Step 2:

[1187] The server creates a prompt for the generative AI model based on the received user preference information. The prompt is written in a format that includes the user's preferences and allergy information. For example, a prompt might be generated that reads, "User preferences: vegetarian, no allergies, likes Japanese food. Please generate a meal plan for one week."

[1188] Step 3:

[1189] The server sends the generated prompt to the OpenAI API, which generates a meal plan based on the AI ​​model. The AI ​​model analyzes the prompt and generates a weekly meal plan that matches the user's preferences. The generated meal plan is returned to the server.

[1190] Step 4:

[1191] The server analyzes the received meal plan and creates a list of ingredients and dishes required, for example, "Monday: veggie sushi, Tuesday: tofu steak."

[1192] Step 5:

[1193] The server uses an HTTP request library to automatically reserve the necessary ingredients and dishes based on the generated meal plan. For example, ingredients for vegetable sushi are ordered from an online supermarket, and a reservation for tofu steak is made with a restaurant. The reservation information is then sent from the server to the relevant service provider.

[1194] Step 6:

[1195] The server sends information about the completed reservation to the user's device. The user can check the information about the reserved ingredients and dishes via their smartphone. For example, a notification such as "The ingredients for Monday's vegetable sushi have been ordered. Tuesday's tofu steak reservation has been completed" is displayed.

[1196] In this way, users can centrally manage everything from planning to execution of their trip, and the generation and booking of meal plans that take into account dietary preferences and allergy information is automated, significantly reducing the hassle of traveling and improving user satisfaction.

[1197] Example 3

[1198] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1199] In conventional travel support systems, it was difficult for users to quickly and accurately obtain the information they needed while traveling. In addition, even in information provision systems that use voice input, the process of generating appropriate information in response to a user's inquiry and providing it by voice was complicated, and there was a problem that it lacked real-time performance. As a result, users had to spend a lot of time and effort to obtain the information they needed while traveling.

[1200] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1201] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for receiving a user's voice input and converting the voice data into text data, a means for inputting a prompt sentence into a generative AI model and generating information, a means for converting the generated text data into voice data, and a means for transmitting the generated voice data to the user's terminal. This allows the user to quickly and accurately obtain necessary information by voice even while on the move.

[1202] "Artificial intelligence means" refers to technologies used to collect information through dialogue with users and customize trips based on the users' preferences and requests.

[1203] The "means for creating an original travel itinerary" refers to a technology for creating a travel itinerary specifically for a user based on information collected by an artificial intelligence means.

[1204] A "reservation facilitation medium" is any technology that allows online reservations of flights, accommodations, activities, meals, etc.

[1205] "Means of providing support as a voice concierge" refers to technology that provides users with the information they need via voice while on the move.

[1206] "Means for receiving voice input and converting the voice data into text data" refers to technology for digitally capturing a user's voice input and converting it into text form.

[1207] "Means of inputting a prompt sentence into a generative AI model and generating information" refers to a technology for inputting text data into a generative AI model and generating appropriate information in response to a user's inquiry.

[1208] The "means for converting the generated text data into voice data" refers to a technique for converting the generated text data into voice format.

[1209] "Means for transmitting the generated voice data to the user's terminal" refers to technology for transmitting the generated voice data to the user's terminal via the Internet.

[1210] This invention is a system in which an AI responds to a user's voice inquiry about the information they need while on the move and provides that information. Specifically, the user makes an inquiry by voice using a device such as a smartphone or tablet, and the server processes the voice data and provides the appropriate information.

[1211] The server uses voice recognition software (e.g., voice recognition API) to convert the user's voice input into text data. It then uses a generative AI model (e.g., generative AI model) to generate appropriate information based on the user's inquiry. This information may include travel routes and local information. The generated text data is converted into voice data using voice synthesis software (e.g., voice synthesis API). The server sends this voice data to the user's device, and the user can receive the information by voice through the device.

[1212] As a concrete example, consider a case where a user makes a voice inquiry such as, "Tell me where the nearest cafe is." In this case, the server performs the following process.

[1213] 1. The user makes a voice inquiry on their smartphone saying, "Tell me where the nearest cafe is."

[1214] 2. The device transmits the voice data to the server, where it is digitally encoded and sent over the Internet to the server.

[1215] 3. The server uses a speech recognition API to convert the voice data into text data. For example, the voice data "Tell me where the nearest cafe is" is converted into text data "Tell me where the nearest cafe is."

[1216] 4. The server inputs the prompt "Tell me where the nearest cafe is" into the generative AI model and generates appropriate information. The generated information is text data such as "The nearest cafe is ____."

[1217] 5. The server uses a speech synthesis API to convert the generated text data into voice data. For example, the text data "The nearest cafe is ____" is converted into voice data.

[1218] 6. The server sends the voice data to the user's device, which then transmits the data over the Internet to the device.

[1219] 7. The user receives audio information through the device. A voice message such as "The nearest cafe is ____" is played from the device's speaker.

[1220] An example of a prompt sentence is, "The user wants to know the nearest cafe. Please provide information about the cafe closest to their current location."

[1221] In this way, the user can easily obtain necessary information even while on the move. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1222] Step 1:

[1223] The user makes a voice inquiry.

[1224] A user uses a device such as a smartphone or tablet to make a voice request for information. For example, say, "Tell me where the nearest cafe is." The input is the user's voice data, and the output is the voice data sent to the device.

[1225] Step 2:

[1226] The terminal transmits the voice data to the server.

[1227] The device captures the user's voice input with a microphone and transmits the voice data to a server, where it is digitally encoded and sent over the Internet to the server. The input is the user's voice data and the output is the digital voice data sent to the server.

[1228] Step 3:

[1229] The server converts the voice data into text data.

[1230] The server uses voice recognition software (e.g., a voice recognition API) to convert the received voice data into text data. For example, voice data such as "Tell me where the nearest cafe is" is converted into text data such as "Tell me where the nearest cafe is." The input is digital voice data, and the output is text data.

[1231] Step 4:

[1232] The server inputs a prompt sentence into the generative AI model and generates information.

[1233] The server inputs the converted text data to a generative AI model (e.g., generative AI model) as a prompt sentence. For example, a prompt sentence such as "Tell me where the nearest cafe is" is input, and the AI ​​model generates appropriate information. The generated information is text data such as "The nearest cafe is ____." The input is text data as the prompt sentence, and the output is the generated text data.

[1234] Step 5:

[1235] The server converts the generated text data into voice data.

[1236] The server converts the generated text data into voice data using speech synthesis software (e.g., speech synthesis API). For example, text data such as "The nearest cafe is ____" is converted into voice data. The input is the generated text data, and the output is voice data.

[1237] Step 6:

[1238] The server transmits the audio data to the terminal.

[1239] The server transmits the converted voice data to the user's terminal. The voice data is sent to the terminal through the Internet. The input is the voice data, and the output is the voice data transmitted to the terminal.

[1240] Step 7:

[1241] A user receives voice information through a terminal.

[1242] The user receives voice information through the terminal. A voice such as "The nearest cafe is ____" is played from the terminal's speaker. The input is the voice data sent to the terminal, and the output is the voice information received by the user.

[1243] (Application example 3)

[1244] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1245] Conventional travel customization systems have the problem that it is difficult for users to obtain the information they need in real time while traveling. In addition, there is a lack of systems that allow users to inquire about information by voice while traveling, which reduces user convenience. Furthermore, there is no voice concierge system in autonomous vehicles, so the provision of information while traveling is insufficient. To solve these problems, a system is needed that allows users to easily obtain the information they need while traveling.

[1246] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1247] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel plan created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, a means including a voice concierge system that operates in an autonomous vehicle, a means for converting a user's voice input into text, analyzing the text to generate an appropriate response, and a means for converting the generated response into voice and providing it to the user. This allows the user to obtain necessary information in real time even while on the move, improving convenience.

[1248] "User" means an individual or organization that uses the System to customize travel and receive information.

[1249] "Interaction" refers to the exchange of information between a user and an artificial intelligence means.

[1250] "Travel customization" refers to individually tailoring travel plans based on a user's preferences and budget.

[1251] "Artificial intelligence means" refers to intelligent algorithms or programs used to customize trips through interaction with users.

[1252] "Custom Journey Plan" means a travel schedule or itinerary created by artificial intelligence means specifically for a User.

[1253] "Air Ticket" refers to the boarding pass for the flight used by the User.

[1254] "Accommodation" refers to facilities such as hotels and inns where users stay during their trip.

[1255] "Activities" refers to sightseeing, leisure, and other events or activities in which a User participates during a Trip.

[1256] "Meals" refers to the meals and drinks consumed by the User during the Trip.

[1257] "Reservation facilitation means" refers to a system or program for making reservations for airfare, accommodations, activities, meals, etc.

[1258] "Means of providing support as a voice concierge while on the move" refers to a system or program that provides appropriate answers when a user inquires about information by voice while on the move.

[1259] A "voice concierge system operating within an autonomous vehicle" refers to a system that provides information to users via voice within an autonomous vehicle.

[1260] "Means for converting voice input to text" refers to a system or program for converting a user's voice into text data.

[1261] "Means for analyzing text and generating appropriate answers" refers to a system or program for analyzing text data and generating appropriate answers to user questions.

[1262] "Means for converting the generated answer into speech and providing it to the user" refers to a system or program for converting the generated text answer into speech data and providing it to the user.

[1263] A system for implementing this invention includes artificial intelligence means for customizing a trip through dialogue with a user, means for creating an original travel plan created by the artificial intelligence means, means for making reservations for airline tickets, accommodations, activities, meals, etc., means for providing support as a voice concierge during travel, a voice concierge system that operates within an autonomous vehicle, means for converting a user's voice input into text, analyzing the text to generate an appropriate response, and means for converting the generated response into voice and providing it to the user.

[1264] The server uses Google Cloud's Dialogflow to convert the user's voice input into text, analyzes the text, and generates an appropriate answer. The generated answer is converted into speech using Google Cloud's Text-to-Speech service and provided to the user. Specifically, when a user asks "Where is the next tourist spot?" inside an autonomous vehicle, the server converts this speech into text and analyzes it using Dialogflow. The answer "The next tourist spot is Tokyo Tower" is generated as the analysis result, and this answer is converted into speech using the Text-to-Speech service and provided to the user.

[1265] The hardware used is a microphone for voice input and a speaker for voice output. The software uses Google Cloud's Dialogflow and Text-to-Speech services.

[1266] As a concrete example, consider the case where a user asks, "What is the nearest restaurant?" When this question is sent to Dialogflow, the AI ​​responds, "The nearest restaurant is ____." This response is converted to audio by the Text-to-Speech service and provided to the user.

[1267] Example of a prompt to be input to a generative AI model:

[1268] When a user asks, "Where is the next tourist spot?", create a system where the AI ​​answers, "The next tourist spot is Tokyo Tower."

[1269] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1270] Step 1:

[1271] The user provides voice input inside the self-driving vehicle.

[1272] Input: User speech (e.g. "What's the next tourist spot?")

[1273] Output: Audio data

[1274] Specific action: The user speaks a question into a microphone in the vehicle.

[1275] Step 2:

[1276] The device converts voice input into text.

[1277] Input: Audio data

[1278] Output: Text data (e.g. "Where is the next tourist spot?")

[1279] Specific operation: The device uses Google Cloud's Dialogflow to convert voice data into text data.

[1280] Step 3:

[1281] The server analyzes the text data and generates an appropriate answer.

[1282] Input: Text data (e.g. "Where is the next tourist spot?")

[1283] Output: Answer text (e.g. "The next tourist spot is Tokyo Tower")

[1284] Specific operation: The server uses Dialogflow to analyze the text data and generate appropriate answers to the user's questions.

[1285] Step 4:

[1286] The server converts the generated answer text into speech.

[1287] Input: Answer text (e.g. "The next tourist spot is Tokyo Tower")

[1288] Output: Audio data

[1289] Specific operation: The server converts the response text into audio data using Google Cloud's Text-to-Speech service.

[1290] Step 5:

[1291] The terminal provides the voice data to the user.

[1292] Input: Audio data

[1293] Output: Audio output to the user

[1294] Specific operation: The terminal plays the voice data through the speaker in the vehicle and provides the user with a response.

[1295] In addition, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1296] "Example 1"

[1297] As one embodiment of the present invention, an AI system including an emotion engine that recognizes the emotion of a user is provided. The emotion engine analyzes the emotion of the user from the user's voice, facial expression, text input, etc., and feeds back the result to the AI ​​system. For example, if the user is feeling stressed about planning a trip, the emotion engine detects the stress, and the AI ​​system responds according to the user's emotion, such as proposing a simpler travel plan to the user.

[1298] "Example 2"

[1299] The emotion engine also customizes trips based on the user's emotions. For example, if the user expresses happiness, the engine recognizes the emotion and customizes the trip plan based on the emotion, such as recommending activities and tourist spots that the user will find enjoyable.

[1300] "Example 3"

[1301] In addition, the emotion engine adjusts the voice concierge's response according to the user's emotions. For example, if the user expresses anxiety, the voice concierge will recognize the emotion and respond in a way that provides the user with a sense of security. This allows the user to feel reassured during their trip, resulting in a more comfortable travel experience.

[1302] The process flow of each embodiment will be described below.

[1303] "Example 1"

[1304] Step 1: The user asks the AI ​​system to plan a trip.

[1305] Step 2: The emotion engine analyzes emotions from the user's voice, facial expressions, text input, etc.

[1306] Step 3: The emotion engine feeds back the analysis results to the AI ​​system.

[1307] Step 4: The AI ​​system suggests travel plans based on the user's emotions.

[1308] "Example 2"

[1309] Step 1: The user asks the AI ​​system to plan a trip.

[1310] Step 2: The emotion engine analyzes the user's emotions.

[1311] Step 3: The emotion engine feeds back the analysis results to the AI ​​system.

[1312] Step 4: The AI ​​system customizes the travel plan based on the user's emotions.

[1313] "Example 3"

[1314] Step 1: The user asks the AI ​​system to plan a trip.

[1315] Step 2: The emotion engine analyzes the user's emotions.

[1316] Step 3: The emotion engine feeds back the analysis results to the AI ​​system.

[1317] Step 4: The AI ​​system adjusts the voice concierge's response based on the user's emotions.

[1318] Example 1

[1319] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1320] Conventional travel plan creation systems had problems in that they did not adequately customize the plan based on the user's desired conditions, and could not adjust the plan to take the user's feelings into account. Furthermore, support during the trip was limited, making it difficult to increase user satisfaction.

[1321] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1322] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, an emotion engine means for analyzing the user's emotions, and a means for adjusting a travel plan based on the analysis results of the emotion engine means. This makes it possible to customize a travel plan based on the user's desired conditions and adjust the plan according to the user's emotions.

[1323] "User" means an individual or organization that uses the System to customize a travel plan and prepare for a trip.

[1324] "Dialogue" refers to the exchange of information between a user and an artificial intelligence means, including in the form of text, voice, facial recognition, etc.

[1325] "Travel customization" is the process of individually tailoring and creating a travel plan based on a user's preferences.

[1326] "Artificial intelligence means" refers to software or hardware for analyzing information input by a user and generating an optimal travel plan.

[1327] "Custom Travel Itinerary" means a document or digital data detailing a travel plan based on the User's desired conditions, created by artificial intelligence means.

[1328] "Means for making reservations for airline tickets, accommodations, activities, meals, etc." refers to software or hardware for making reservations for various services necessary for travel.

[1329] A "voice concierge" is a system that provides users with voice support while traveling, including route guidance and local information.

[1330] The "emotion engine means" is software or hardware for analyzing emotions from a user's voice, facial expression, text input, and the like.

[1331] The "means for adjusting the travel plan based on the analysis results of the emotion engine means" refers to software or hardware for regenerating or adjusting the travel plan depending on the user's emotional state obtained from the emotion engine means.

[1332] The present invention is a system that allows users to input their desired travel conditions and customize a travel plan using artificial intelligence means. The system also has a function of analyzing the user's emotions and adjusting the travel plan based on the results.

[1333] The user uses the device to input the desired conditions for the trip. The input format is diverse, including text, voice, and facial expression recognition. For example, the user might input, "My budget is within 100,000 yen, I would like to stay in Tokyo for three days and visit art museums." This input data is sent from the device to the server.

[1334] The server uses natural language processing (NLP) technology to analyze the received data. Specifically, it uses software such as Google Cloud Natural Language API and IBM Watson Natural Language Understanding. As a result of the analysis, the user's desired conditions are obtained as structured data.

[1335] Next, the server generates a travel plan using a generative AI model (e.g., OpenAI's GPT-4). An example of a prompt sentence to input to the generative AI model is as follows:

[1336] User requirements:

[1337] Budget: Under 100,000 yen

[1338] Destination: Tokyo

[1339] Length of stay: 3 days

[1340] Favorite activity: Visiting museums

[1341] Based on this criteria, generate the best itinerary for you.

[1342] Based on this prompt, the generative AI model will output an optimal itinerary, such as "Day 1: Visit the museums in Ueno, Day 2: Visit the museums in Roppongi, Day 3: Visit the gallery in Ginza and then return home."

[1343] In addition, the server uses an emotion engine to analyze the user's emotions during user input, specifically using Microsoft Azure's Emotion API and Affectiva's emotion recognition software, and the analysis results in the user's emotional state (e.g., stress, joy, excitement, etc.).

[1344] The server regenerates a travel plan based on the user's emotions based on the feedback from the emotion engine. For example, if the user is feeling stressed, it will suggest a simpler travel plan.

[1345] The final itinerary is sent from the server to the terminal. The terminal displays the received itinerary to the user. The user can then proceed with preparing for the trip based on this "original travel guide."

[1346] In this way, the present invention realizes customization of a travel plan based on a user's desired conditions and adjustment of the plan according to the user's emotions.

[1347] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1348] Step 1:

[1349] The user enters the travel requirements.

[1350] The user uses the device to input the desired travel conditions (budget, destination, length of stay, preferred activities, etc.). Input formats include text, voice, and facial expression recognition. For example, the user might input, "My budget is less than 100,000 yen, I would like to stay in Tokyo for three days and visit art museums." The input data is stored in text format on the device.

[1351] Step 2:

[1352] The terminal transmits the input data to the server.

[1353] The terminal converts the data entered by the user into JSON format and sends it to the server using the HTTPS protocol. The input data includes information such as budget, destination, length of stay, and preferred activities.

[1354] Step 3:

[1355] The server parses the input data.

[1356] The server uses natural language processing (NLP) technology to analyze the received JSON data. Specifically, it uses software such as Google Cloud Natural Language API and IBM Watson Natural Language Understanding. As a result of the analysis, the user's desired conditions are obtained as structured data. For example, conditions such as "budget: under 100,000 yen," "destination: Tokyo," "length of stay: 3 days," and "favorite activity: visiting museums" are extracted.

[1357] Step 4:

[1358] The server generates a travel plan using the generative AI model.

[1359] The server generates a travel plan using a generative AI model (e.g., OpenAI's GPT-4) based on the analysis results. Specifically, the server inputs the following prompt sentence into the generative AI model:

[1360] User requirements:

[1361] Budget: Under 100,000 yen

[1362] Destination: Tokyo

[1363] Length of stay: 3 days

[1364] Favorite activity: Visiting museums

[1365] Based on this criteria, generate the best itinerary for you.

[1366] Based on this prompt, the generative AI model will output an optimal itinerary, such as "Day 1: Visit the museums in Ueno, Day 2: Visit the museums in Roppongi, Day 3: Visit the gallery in Ginza and then return home."

[1367] Step 5:

[1368] The server uses an emotion engine to analyze the user's emotions.

[1369] The server uses an emotion engine to analyze the user's emotions while the user is typing. Specifically, it uses Microsoft Azure's Emotion API and Affectiva's emotion recognition software. The analysis results in the user's emotional state (e.g., stress, joy, excitement, etc.). For example, if the user is feeling stressed, that information is fed back to the server.

[1370] Step 6:

[1371] The server adjusts the travel plan according to the emotion.

[1372] The server regenerates a travel plan based on the user's emotions, based on feedback from the emotion engine. For example, if the user is feeling stressed, it will suggest a simpler travel plan. The regenerated plan might be something like "Day 1: Visit a relaxing cafe, Day 2: Visit hot springs, Day 3: Walk in nature."

[1373] Step 7:

[1374] The server sends the final itinerary to the terminal.

[1375] The server converts the final generated itinerary into JSON format and sends it to the terminal using the HTTPS protocol. The transmitted data includes the details of the itinerary.

[1376] Step 8:

[1377] The device displays the travel plan to the user.

[1378] The device will then display the travel plan to the user, who can then use this "original travel guide" to prepare for the trip. The plan includes specific dates and details of the places to be visited.

[1379] (Application example 1)

[1380] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1381] Conventional travel customization systems can generate travel plans based on the user's desired conditions, but they do not adequately handle meal arrangements during the trip or respond to the user's emotions. This can lead to users feeling stressed during the trip, which can reduce the satisfaction of the trip. Another issue is that arranging meals during a trip is complicated, and there is no environment in place for users to easily use food delivery services.

[1382] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1383] In this invention, the server includes an AI means for customizing the trip through dialogue with the user, a means for creating an original travel guide created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for generating an optimal food delivery plan based on the user's desired conditions, and a means for analyzing the user's emotions and responding appropriately based on the results. This makes it easier for the user to arrange meals during the trip, and furthermore, it is possible to respond according to the user's emotions, thereby improving the satisfaction of the trip.

[1384] "User" refers to an individual who uses the System to customize travel or arrange food delivery.

[1385] "Dialogue" refers to the process in which a user and an AI system exchange information through voice or text.

[1386] "Travel customization" refers to individually tailoring travel plans based on a user's preferences.

[1387] "AI means" refers to the function of using artificial intelligence technology to analyze information entered by users and generate optimal travel plans or food delivery plans.

[1388] An "original travel itinerary" refers to a document that contains a unique travel plan generated by an AI tool based on the user's desired conditions.

[1389] "Means of fulfilling reservations" refers to the ability to make online reservations for flights, hotels, activities, meals, etc.

[1390] "Voice concierge" refers to a feature that provides voice support to users while on the move.

[1391] "Food delivery plan" refers to generating the optimal food delivery plan based on the user's desired conditions.

[1392] "Means of emotion analysis" refers to the function of reading emotions from the user's voice or text and feeding the results back to the AI ​​system.

[1393] "Appropriate response" refers to the optimal support and suggestions that the AI ​​system provides based on the user's emotions.

[1394] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for generating an optimal food delivery plan based on the user's desired conditions, and means for analyzing the user's emotions and taking appropriate action based on the results.

[1395] System Configuration

[1396] The server uses the following hardware and software:

[1397] Hardware: A server with powerful processors, memory, and storage devices.

[1398] Software: Python, OpenAI API, Emotion Recognition API

[1399] Data processing and calculation

[1400] 1. User interaction:

[1401] Users use their smartphones to input their desired travel conditions (budget, destination, length of stay, preferred activities, etc.).

[1402] The server receives this information and analyzes it using AI means.

[1403] 2. Generate a travel plan:

[1404] The server uses a generative AI model to generate an optimal travel plan based on the user's desired conditions.

[1405] The generated travel plan is presented to the user as an original travel guide.

[1406] 3. Making a booking:

[1407] The server handles online reservations for flights, hotels, activities, meals, etc.

[1408] 4. Voice Concierge:

[1409] Users can use the voice concierge function on their smartphones while traveling.

[1410] The server provides voice guidance on travel routes and local information.

[1411] 5. Generate food delivery plan:

[1412] Users input their desired dining conditions during their trip (budget, type of cuisine, delivery time, allergy information, etc.).

[1413] Based on this information, the server uses a generative AI model to generate an optimal food delivery plan.

[1414] 6. Sentiment analysis and appropriate response:

[1415] The server analyzes the user's voice and text data using the Emotion Recognition API to identify the user's emotions.

[1416] Based on the results of emotion analysis, the server will respond appropriately to the user. For example, if the user is feeling stressed, it will suggest simpler travel plans or food delivery plans.

[1417] Examples

[1418] If a user requests Italian food to be delivered at 6:00 p.m. within a budget of 2,000 yen and has a nut allergy, and is feeling stressed, the server will suggest an "easy-to-order Italian set menu."

[1419] Examples of prompt statements

[1420] User's desired conditions: Budget: 2000 yen, Cuisine type: Italian, Delivery time: 18:00, Allergy information: Nuts. User's emotion: Stress. Please suggest the best food delivery plan.

[1421] In this way, a system can be realized that provides optimal travel plans and food delivery plans based on the user's desired conditions and emotions.

[1422] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1423] Step 1:

[1424] Users use their smartphones to input their desired travel conditions (budget, destination, length of stay, preferred activities, etc.).

[1425] Input: User's desired conditions (budget, destination, length of stay, preferred activities, etc.)

[1426] Output: The user's preferences are sent to the server.

[1427] Step 2:

[1428] The server uses a generative AI model to generate an optimal travel plan based on the user's desired conditions.

[1429] Input: User's desired conditions

[1430] Data processing: Input prompts into the generative AI model to generate a travel plan

[1431] Output: Generated itinerary

[1432] Step 3:

[1433] The server creates an original travel itinerary based on the generated travel plan.

[1434] Input: Generated itinerary

[1435] Data processing: Convert travel plans into bookmark format

[1436] Output: Original travel guide

[1437] Step 4:

[1438] The server handles online reservations for flights, hotels, activities, meals, etc.

[1439] Input: Original travel guide

[1440] Data processing: Send reservation information to each reservation system

[1441] Output: Reservation confirmation information

[1442] Step 5:

[1443] Users can use the voice concierge function on their smartphones while traveling.

[1444] Input: User's voice command

[1445] Data processing: Analyzes voice instructions and provides necessary information

[1446] Output: Voice guidance and information provided

[1447] Step 6:

[1448] The user inputs their travel meal preferences (budget, type of cuisine, delivery time, allergy information, etc.).

[1449] Input: User's meal preferences

[1450] Output: Meal preferences are sent to the server

[1451] Step 7:

[1452] The server uses a generative AI model to generate an optimal food delivery plan based on the received meal preferences.

[1453] Input: User's meal preferences

[1454] Data processing: Input prompts into the generative AI model to generate a food delivery plan

[1455] Output: Generated food delivery plan

[1456] Step 8:

[1457] The server analyzes the user's voice and text data using the Emotion Recognition API to identify the user's emotions.

[1458] Input: User's voice data, text data

[1459] Data processing: Emotion analysis using Emotion Recognition API

[1460] Output: The user's emotional state.

[1461] Step 9:

[1462] The server responds appropriately to the user based on the results of emotion analysis. For example, if the user is feeling stressed, it will suggest simpler travel plans or food delivery plans.

[1463] Input: User's emotional state, travel plans, food delivery plans

[1464] Data processing: Adjusting plans according to emotional states

[1465] Output: Adjusted travel and food delivery plans

[1466] In this way, a system can be realized that provides optimal travel plans and food delivery plans based on the user's desired conditions and emotions.

[1467] Example 2

[1468] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[1469] Conventional travel reservation systems have the problem that users have to book flights, accommodations, activities, meals, etc. individually, which is time-consuming. In addition, it is difficult to increase user satisfaction because it is not possible to customize travel plans according to the user's emotions. Furthermore, support during the trip is insufficient, and users often have trouble when they are on the ground.

[1470] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1471] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for recognizing the user's emotions and customizing a travel plan based on the emotions, and a means for automatically making reservations based on the generated travel plan. This allows the user to plan and book a trip in a unified manner, enables customization according to emotions, and provides support during the trip, thereby increasing user satisfaction.

[1472] "User" means any individual or entity that uses the System to plan and book travel.

[1473] "Dialogue" is a communication process in which the user and the system exchange information.

[1474] "Travel customization" refers to individually tailoring travel plans based on a user's preferences and requirements.

[1475] "Artificial intelligence means" refers to intelligent algorithms and software used to generate and customize travel plans through interaction with users.

[1476] A "travel guidebook" is a document or digital data that contains detailed travel plans and schedules.

[1477] An "air ticket" is a ticket for travelling on an aircraft.

[1478] "Accommodation" means a hotel or other place of lodging for travelers.

[1479] "Activities" refers to sightseeing, leisure, entertainment and other activities undertaken during a trip.

[1480] "Meals" refers to food and drink consumed during the trip.

[1481] "Reservation facilitation mechanism" refers to the systems and processes used to make online reservations, including but not limited to flights, accommodations, activities, meals, etc.

[1482] "Voice concierge" refers to a service that provides users with support and information while traveling via voice.

[1483] "Means of recognizing emotions" refers to software or algorithms used to analyze user emotions and obtain that data.

[1484] "Emotionally-customized travel plans" refers to systems or processes for adjusting travel plans based on a user's emotional data.

[1485] "Means for automatically making reservations based on the generated travel plan" refers to a system or process for automatically making the necessary reservations in accordance with the generated travel plan.

[1486] This invention is a system that allows a user to plan and book a trip in an integrated manner. The system includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for automatically making a reservation based on a generated travel plan, a means for recognizing a user's emotions and customizing the travel plan based on the emotions, and a means for providing support as a voice concierge during travel.

[1487] Hardware and Software Used

[1488] Hardware

[1489] Server: Use a server with high-performance computing power, which can run generative AI models and manage databases.

[1490] Terminal: A device used by a user, such as a smartphone or PC, that allows the user to access the system and input information.

[1491] software

[1492] Generative AI models: For example, using advanced natural language processing models such as OpenAI's GPT-4, which can generate itineraries based on user input.

[1493] Emotion recognition software: For example, using Microsoft Azure Emotion API, which allows you to analyze and capture user emotions.

[1494] Booking APIs: For example, use the Expedia API or Booking.com API, which allows you to automatically make reservations for flights, accommodation, activities, meals, etc.

[1495] Program Processing

[1496] Generate a travel plan

[1497] The user inputs the desired travel conditions (destination, schedule, budget, desired activities, etc.) into the terminal.

[1498] The terminal transmits the input information to the server.

[1499] The server generates a prompt sentence based on the received information and sends it to the generative AI model.

[1500] The server stores the travel plan received from the generative AI model in a database and notifies the user.

[1501] Automatic booking execution

[1502] The server analyzes the flight, accommodation, activity and meal reservation information based on the generated travel plan.

[1503] The server carries out the reservation process using the API of each reservation site.

[1504] The server notifies the user that the reservation has been completed.

[1505] Customization with Emotion Engine

[1506] The user inputs his / her feelings about the travel plan into the terminal (e.g., "I'm really looking forward to it!").

[1507] The device uses emotion recognition software to analyze the user's emotions and transmits the data to a server.

[1508] The server runs an emotion engine based on the received emotion data to customize the travel plan.

[1509] The server notifies the user of the customized travel plan.

[1510] Examples of concrete examples and prompts

[1511] Examples

[1512] The user inputs the following desired conditions: "I am planning a 3-night, 4-day trip to Tokyo. My budget is under 100,000 yen, and I would like to enjoy sightseeing and gourmet food."

[1513] The server sends the following prompt to the generative AI model: "Please create a plan for a 3-night, 4-day trip to Tokyo. The budget should be within 100,000 yen, and the plan should include sightseeing and gourmet food."

[1514] The server automatically makes reservations for flights, hotels, and restaurants based on the generated plan.

[1515] The user checks the travel plans and enters the emotion, "I'm really looking forward to it!"

[1516] The server uses an emotion engine to analyze the emotion of "fun" and recommends further enjoyable activities (e.g., tickets to Tokyo Disneyland).

[1517] Examples of prompt statements

[1518] "Please create a plan for a 3-night, 4-day trip to Tokyo. The budget should be under 100,000 yen, and the plan should include sightseeing and gourmet food."

[1519] “What activities or tourist destinations would you recommend if a user expressed the emotion of joy?”

[1520] In this way, users can easily plan and book their trips, and customize it according to their mood.

[1521] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1522] Step 1:

[1523] The user inputs the desired travel conditions (destination, schedule, budget, desired activities, etc.) into the terminal.

[1524] Input: destination, dates, budget, desired activities

[1525] Output: Data of the desired conditions entered

[1526] Specific operation: The user inputs information such as "Destination: Tokyo," "Schedule: 3 nights and 4 days," "Budget: 100,000 yen," and "Desired activities: sightseeing and gourmet" on the screen of a smartphone or PC. The device transmits the input information to the server in real time.

[1527] Step 2:

[1528] The server generates a prompt sentence based on the received desired conditions and sends it to the generative AI model.

[1529] Input: Data of desired conditions sent by the user

[1530] Output: The prompt to send to the generative AI model

[1531] Specific operation: The server generates a prompt saying, "Please create a 3-night, 4-day trip to Tokyo. The budget should be within 100,000 yen, and the trip should include sightseeing and gourmet food." The server sends this prompt to the generative AI model, and within a few seconds, the server receives a detailed trip plan.

[1532] Step 3:

[1533] The server stores the travel plan received from the generative AI model in a database and notifies the user.

[1534] Input: A travel plan received from a generative AI model

[1535] Output: Travel plan stored in database, notification to user

[1536] Specific operation: The server saves the travel plan received from the generative AI model in a database. The server then notifies the user of the summary of the saved travel plan via email or app notification.

[1537] Step 4:

[1538] The server analyzes the flight, accommodation, activity and meal reservation information based on the generated travel plan.

[1539] Input: A travel plan stored in the database

[1540] Output: Information required for the reservation process

[1541] Specific operation: The server analyzes the "airline ticket to Tokyo," "hotel for three nights," "admission tickets to tourist attractions," and "restaurant reservations" listed in the travel plan.

[1542] Step 5:

[1543] The server carries out the reservation process using the API of each reservation site.

[1544] Input: Information required for reservation procedure

[1545] Output: Reservation completion information

[1546] Specific operation: The server uses the Expedia API to book an airline ticket and the Booking.com API to book a hotel. The server notifies the user of the completion of the reservation by email or app notification.

[1547] Step 6:

[1548] The user inputs his / her feelings about the travel plan into the terminal (e.g., "I'm really looking forward to it!").

[1549] Input: User sentiment

[1550] Output: Input emotion data

[1551] Specific operation: The user checks the travel plan and inputs the emotion, "I'm really looking forward to it!" The terminal transmits the input emotion data to the server in real time.

[1552] Step 7:

[1553] The device uses emotion recognition software to analyze the user's emotions and transmits the data to a server.

[1554] Input: User emotion data

[1555] Output: Parsed emotion data

[1556] Specific operation: The device uses the Microsoft Azure Emotion API to analyze the emotion of "enjoyment" and sends the data to the server.

[1557] Step 8:

[1558] The server runs an emotion engine based on the received emotion data to customize the travel plan.

[1559] Input: Parsed emotion data

[1560] Output: A customized itinerary

[1561] Specific operation: The server receives the emotion data of "fun" and runs the emotion engine. The server adds an activity that the user can enjoy even more (e.g., a ticket to Tokyo Disneyland).

[1562] Step 9:

[1563] The server notifies the user of the customized travel plan.

[1564] Input: Customized Travel Plan

[1565] Output:Notification to the user

[1566] Specific operation: The server notifies the user of the customized travel plan via email or app notification.

[1567] (Application example 2)

[1568] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1569] Conventional travel reservation systems have the problem that users have to book flights, hotels, activities, meals, etc. individually, which is time-consuming. In addition, it is difficult to increase user satisfaction because it is not possible to customize travel plans according to the user's emotions. Furthermore, there was no system that allowed users to select and customize travel plans in virtual stores, which limited the user experience.

[1570] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1571] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, an emotion engine means for analyzing the user's emotions and customizing a travel plan based on the emotions, and a means for selecting a travel plan in a virtual store and providing a customized travel plan. This allows the user to make a trip reservation in a centralized manner, enables customization of a travel plan according to emotions, and also allows the selection and customization of a travel plan in a virtual store.

[1572] "User" means an individual or organization that uses the System to create and book travel plans.

[1573] "Dialogue" refers to communication between a user and a system in which information is exchanged.

[1574] "Travel customization" refers to individually tailoring travel plans based on a user's preferences and emotions.

[1575] "AI means" refers to technology that uses artificial intelligence to interact with users and create travel plans.

[1576] A "travel guidebook" is a document or digital data that summarizes a travel schedule and detailed information.

[1577] A "means for making reservations" is technology that automatically makes reservations for airline tickets, hotels, activities, meals, etc.

[1578] A "voice concierge" is a service that provides users with route guidance and local information via voice.

[1579] The "emotion engine means" is a technology that analyzes a user's emotions and customizes a travel plan based on those emotions.

[1580] "Virtual Store" means a virtual store space provided on the Internet where users can select and customize their travel plans.

[1581] "Travel Plan" means a plan that includes travel destinations, dates, accommodations, activities, etc.

[1582] A "customized itinerary" is a travel plan that is tailored based on a user's preferences and feelings.

[1583] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary created by the AI ​​means, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, emotion engine means for analyzing a user's emotions and customizing a travel plan based on the emotions, and means for selecting a travel plan in a virtual store and providing a customized travel plan.

[1584] System program processing

[1585] The server first customizes the trip through a dialogue with the user, including information such as the user's preferences, budget, and travel destinations. This information is then analyzed by AI means to create a custom itinerary.

[1586] The server then uses an emotion engine means to analyze the user's emotion. The emotion engine analyzes the text and voice data entered by the user to identify the user's emotional state. For example, if the user enters "I want to relax," the emotion engine recognizes the emotion "relax."

[1587] The server then customizes the travel plan based on the emotion. The AI ​​means selects and suggests to the user travel plans that suit the emotion identified by the emotion engine. For example, for the emotion "relaxation," hot spring trips and beach resorts are suggested.

[1588] When a user selects a suggested travel plan, the server automatically reserves air tickets, hotels, activities, meals, etc., allowing users to complete their travel reservations in a centralized manner.

[1589] In addition, a means to select and customize travel plans within the virtual store will be provided. Users can freely move around the virtual store using their smartphones to check and select travel plans. The selected plan will be automatically booked by AI.

[1590] Hardware and Software Used

[1591] This system mainly uses smartphones and servers. The smartphone is used for interacting with users and operating within the virtual store, while the server executes the AI ​​means, emotion engine means, and reservation means. The software uses Python, with the requests library for API communication and the json library for data processing.

[1592] Examples

[1593] For example, if a user types "I want to relax," the emotion engine will recognize the emotion and provide travel plans suitable for relaxation, such as hot spring trips and beach resorts.

[1594] Example prompt:

[1595] If a user types "I want to relax," the emotion engine will recognize the emotion and provide travel plans suitable for relaxation, such as hot spring trips and beach resorts.

[1596] In this way, users can easily select and book the best travel plan based on their emotions.

[1597] The flow of the identification process in the application example 2 will be described with reference to FIG.

[1598] Step 1:

[1599] The server initiates a dialogue with the user. The user uses a smartphone to input information such as travel destination, preferences, and budget. The server receives this information and stores it in a database. The input data includes travel preferences in text format. The server analyzes this data to determine the user's basic travel needs.

[1600] Step 2:

[1601] The server uses AI tools to analyze the information input by the user and create an original travel plan. Specifically, it generates an appropriate travel plan based on the user's preferences and budget. The input data is the user's travel preferences, and the output data is the generated travel plan. The server presents this plan to the user.

[1602] Step 3:

[1603] The user inputs his / her feelings about the presented travel plan. For example, he / she inputs feelings such as "I want to relax" in text format. The server receives this feeling data and analyzes it using the emotion engine means. The input data is the user's emotion information, and the output data is the analyzed emotion state.

[1604] Step 4:

[1605] The server customizes the travel plan based on the emotional state analyzed using the emotion engine means. For example, for the emotion "relaxation", a plan such as a trip to a hot spring or a beach resort is selected. The input data is the analyzed emotional state, and the output data is the customized travel plan. The server presents the customized plan to the user.

[1606] Step 5:

[1607] When the user selects a customized travel plan, the server automatically makes reservations for airfare, hotels, activities, meals, etc. The input data is the user's selected travel plan, and the output data is reservation confirmation information. The server notifies the user of the reservation confirmation information.

[1608] Step 6:

[1609] The user uses a smartphone to freely move around the virtual store and check and select a travel plan. The server monitors the user's operations in the virtual store and provides an appropriate travel plan. The input data is the user's operation information, and the output data is the provided travel plan.

[1610] Step 7:

[1611] The server acts as a voice concierge to provide support during travel. Specifically, it provides route guidance and local information. The input data is the user's current location and destination information, and the output data is voice guidance information. The server sends the voice guidance information to the user's smartphone.

[1612] Through the above steps, users can make travel reservations in a centralized manner, customize travel plans according to their emotions, and even select and customize travel plans in the virtual store.

[1613] Example 3

[1614] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1615] Conventional travel support systems have difficulty in quickly and appropriately providing users with the information they need while traveling, and they are unable to respond to the user's emotions, meaning that they are unable to provide a sufficient sense of security and comfort during the trip. In particular, there is a demand for a system that can recognize when a user feels anxious or stressed and respond appropriately.

[1616] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1617] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel guide created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for converting voice to text using a voice recognition engine, a means for analyzing text using a natural language processing engine, a means for analyzing the user's emotions using an emotion recognition engine, a means for converting text to voice using a voice synthesis engine, and a means for adjusting the voice concierge's response according to the user's emotions. This allows the user to easily obtain necessary information even while traveling, and further allows the user to enjoy a sense of security and comfort by receiving a response according to their emotions.

[1618] "User" refers to an individual who uses the system to customize their trip and receive information.

[1619] "Artificial intelligence means" refers to intelligent algorithms or programs used to customize trips through interaction with users.

[1620] "Travel itinerary" refers to documents or data that summarize travel plans and schedules created by artificial intelligence means.

[1621] "Accommodation" refers to facilities such as hotels and inns where users can stay during their trip.

[1622] "Activity" refers to the events and experiences that users participate in during their trip.

[1623] "Voice concierge" refers to the system's function of providing information and support to users via voice while on the move.

[1624] A "speech recognition engine" refers to software or algorithms that convert a user's speech into text.

[1625] A "natural language processing engine" refers to software and algorithms that analyze text and understand user intent.

[1626] An "emotion recognition engine" refers to software or algorithms used to analyze emotions from a user's voice or text.

[1627] "Speech synthesis engine" refers to software or algorithms for converting text into speech.

[1628] "Means to tailor responses" refers to the ability to change the content and tone of the voice concierge's responses depending on the user's emotions.

[1629] This invention is a system in which AI responds to and provides information when a user makes a voice inquiry about the information they need while on the move. In addition, it is equipped with an emotion engine, which adjusts the voice concierge's response according to the user's emotions, providing a sense of security and comfort to the user.

[1630] The server uses a server machine equipped with a high-performance processor and large-capacity memory. Specifically, the following hardware and software are used:

[1631] Hardware: A server machine equipped with a powerful processor and large memory capacity (e.g. 64GB RAM).

[1632] software:

[1633] Speech recognition engine: Uses common speech recognition APIs to convert speech to text.

[1634] Natural Language Processing (NLP) engine: Uses common natural language processing models to analyze text and understand user intent.

[1635] Emotion Recognition Engine: Uses common emotion recognition APIs to analyze emotions from the user's voice.

[1636] Speech synthesis engine: Uses common speech synthesis APIs to convert text to speech.

[1637] When a user makes a voice inquiry, the device captures the voice data and sends it to a server via the Internet. The server uses a voice recognition engine to convert the voice into text and analyzes the text with a natural language processing engine. It then analyzes the user's emotions with an emotion recognition engine and generates the required information. The generated information is converted into voice with a voice synthesis engine and sent to the device. The device plays back the voice data and provides the information to the user.

[1638] Examples:

[1639] Suppose a user makes a voice inquiry while traveling, saying, "Tell me where the nearest restaurant is." The device captures this voice and sends it to the server. The server uses a voice recognition engine to convert the voice into text, generating the text, "Tell me where the nearest restaurant is." The natural language processing engine then analyzes this text and understands that the user is looking for the nearest restaurant. The emotion recognition engine is used to analyze the user's emotions and detects feelings of anxiety. The server generates information about the nearest restaurant based on the user's current location information, and generates a message saying, "Don't worry, there's a great restaurant nearby." The server uses a speech synthesis engine to convert this message into speech, and sends the generated voice data to the device. The device plays the voice data and provides the information to the user. The user can listen to the information from the voice concierge and head to the nearest restaurant with peace of mind.

[1640] Example prompt:

[1641] "Explain how a voice concierge can help users when they're on the go looking for the nearest restaurant."

[1642] In this way, the server provides the user with necessary information during the user's movement and responds according to the user's emotions, thereby realizing a system that provides the user with a sense of security and comfort. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1643] Step 1:

[1644] The user makes a voice inquiry.

[1645] Specific operation: The user makes a voice inquiry into a device such as a smartphone or tablet saying, "Tell me where the nearest restaurant is."

[1646] Input: The user's voice data.

[1647] Output: The captured audio data on your device.

[1648] Step 2:

[1649] The terminal transmits the voice data to the server.

[1650] Specific operation: The device transmits the captured audio data to a server via the Internet.

[1651] Input: Audio data captured on the device.

[1652] Output: The audio data sent to the server.

[1653] Step 3:

[1654] The server converts the speech into text using a speech recognition engine.

[1655] Specific operation: The server uses a speech recognition engine to convert the received voice data into text, for example, "What is the nearest restaurant?"

[1656] Input: The audio data sent to the server.

[1657] Output: The text data generated by the speech recognition engine.

[1658] Step 4:

[1659] The server analyzes the text using a natural language processing (NLP) engine.

[1660] Specific operation: The server uses a natural language processing engine to analyze the text data and understand the user's intent. For example, the intent is analyzed as "looking for the nearest restaurant."

[1661] Input: The text data generated by the speech recognition engine.

[1662] Output: The intent data parsed by the natural language processing engine.

[1663] Step 5:

[1664] The server analyzes the user's emotions using an emotion recognition engine.

[1665] Specific operation: The server uses an emotion recognition engine to analyze the user's emotions from the voice data. For example, it is detected that the user is expressing an anxious emotion.

[1666] Input: The audio data sent to the server.

[1667] Output: Emotion data parsed by the emotion recognition engine.

[1668] Step 6:

[1669] The server generates the necessary information and adjusts the response according to the emotion.

[1670] Specific operation: The server generates information about the nearest restaurant based on the user's current location. It also generates a message that provides a sense of security to the user according to the user's emotions. For example, a message such as "Don't worry, there is a nice restaurant nearby" is generated.

[1671] Input: Intent data analyzed by a natural language processing engine, emotion data analyzed by an emotion recognition engine, and the user's current location.

[1672] Output: The informational messages generated.

[1673] Step 7:

[1674] The server converts the text to speech using a speech synthesis engine.

[1675] Specific operation: The server converts the generated text message into speech using a speech synthesis engine, for example generating speech data that says, "Don't worry, there's a great restaurant nearby."

[1676] Input: The generated informational message.

[1677] Output: The speech data generated by the speech synthesis engine.

[1678] Step 8:

[1679] The server transmits the generated voice data to the terminal.

[1680] Specific operations: The server transmits the generated voice data to the terminal.

[1681] Input: The speech data generated by the speech synthesis engine.

[1682] Output: The audio data sent to the device.

[1683] Step 9:

[1684] The terminal reproduces the audio data and provides information to the user.

[1685] Specific operation: The terminal plays the received voice data and provides information to the user. The user can listen to the information from the voice concierge and head to the nearest restaurant.

[1686] Input: The audio data sent to the device.

[1687] Output: The audio information provided to the user.

[1688] (Application example 3)

[1689] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1690] Conventional travel support systems make it difficult for users to easily obtain the information they need while traveling, and they are unable to respond to the user's emotions, resulting in a lack of security and comfort during the trip. In particular, for autonomous vehicles, it is important to provide information while traveling and respond to emotions, but there was no effective way to achieve this.

[1691] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1692] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for analyzing the user's emotions and adjusting the voice concierge's response according to the emotions, a means for calculating an optimal travel route based on the destination, and a means for providing information about the area around the destination. This allows the user to easily obtain necessary information even while traveling, and to feel reassured and comfortable by receiving responses according to their emotions.

[1693] "User interaction" is the process by which a user and a system exchange information through voice or text.

[1694] "Customized travel" means individually tailoring travel plans based on a user's preferences and budget.

[1695] "AI means" refers to means that use artificial intelligence technology to process information and make decisions in response to user requests.

[1696] An "original travel guide" is a unique travel guide created based on the user's travel plans.

[1697] A "means for making reservations" is a system for making online reservations for airline tickets, hotels, activities, meals, etc.

[1698] A "voice concierge" is a virtual assistant that provides information and support to users via voice.

[1699] "Means of emotion analysis" refers to technology that recognizes emotions from a user's voice or text and determines an appropriate response based on those emotions.

[1700] The "means for calculating a travel route" is an algorithm that calculates an optimal travel path based on the user's destination.

[1701] A "means of providing local information" is a system that provides users with information on tourist attractions, restaurants, etc. around the destination.

[1702] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for analyzing the user's emotions and adjusting the voice concierge's response in accordance with the emotions, means for calculating the optimal travel route based on the destination, and means for providing information about the area around the destination.

[1703] System Programming

[1704] Hardware

[1705] Microphone: Used to capture the user's voice input.

[1706] Speaker: Used to provide audio output.

[1707] Server: Used for data processing and information provision.

[1708] software

[1709] speech_recognition: Uses a speech recognition library to convert the user's speech into text.

[1710] pyttsx3: Use the speech synthesis library to convert text to speech.

[1711] emotion_recognition: Analyzes user emotions using an emotion recognition library.

[1712] route_planner: Uses a route planning library to calculate optimal travel routes.

[1713] local_info_provider: Uses the local information provider library to get information about the area around the destination.

[1714] Processing flow

[1715] 1. Speech Recognition: When the user speaks into the microphone, the voice is converted into text through the speech_recognition library.

[1716] 2. Sentiment Analysis: The captured text is analyzed through the emotion_recognition library to identify the user's emotions.

[1717] 3. Information provision: Based on the user request, the route_planner library calculates the optimal travel route and the local_info_provider library obtains information about the area around the destination.

[1718] 4. Speech synthesis: The acquired information is converted into speech through the pyttsx3 library and provided to the user through the speaker.

[1719] Examples

[1720] When a user says, "Tell me the route to Tokyo Station," the system calculates the optimal route and provides voice guidance saying, "The optimal route is XX."

[1721] When a user says, "Tell me about restaurants around Tokyo Station," the system provides information about nearby restaurants.

[1722] If the user says in an anxious voice, "I think I'm lost," the system responds, "Don't worry. You'll reach your destination soon."

[1723] Examples of prompt statements

[1724] "Tell me the route to Tokyo Station."

[1725] "Please tell me about restaurants around Tokyo Station."

[1726] "I think I'm lost."

[1727] In this way, users can easily obtain the information they need even while on the move, and can feel reassured and comfortable by receiving responses that correspond to their emotions.

[1728] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1729] Step 1:

[1730] The user speaks into the microphone.

[1731] Input: User's voice.

[1732] Specific operation: The user says, "Tell me the route to Tokyo Station."

[1733] Output: Audio data.

[1734] Step 2:

[1735] The device uses a speech recognition library (speech_recognition) to convert the voice data into text.

[1736] Input: Audio data.

[1737] Specific operation: The speech recognition library analyzes the voice data and generates text such as "Please tell me the route to Tokyo Station."

[1738] Output: Text data.

[1739] Step 3:

[1740] The server uses an emotion recognition library (emotion_recognition) to analyze the user's emotions from the text data.

[1741] Input: Text data.

[1742] What happens: The emotion recognition library analyzes the text data and identifies the user's emotion as "neutral."

[1743] Output: emotion data.

[1744] Step 4:

[1745] The server uses a route planning library (route_planner) to calculate the optimal travel route based on the destination.

[1746] Input: Text data (destination information).

[1747] Specific operation: The route planning library calculates the optimal route based on the destination information "Tokyo Station."

[1748] Output: Route information.

[1749] Step 5:

[1750] The server uses the local information provider library (local_info_provider) to obtain information about the area around the destination.

[1751] Input: Text data (destination information).

[1752] Specific operation: The local information library obtains restaurant information around "Tokyo Station."

[1753] Output:Local information.

[1754] Step 6:

[1755] The server uses a speech synthesis library (pyttsx3) to convert the acquired information into speech.

[1756] Input: route information, local information.

[1757] Specific operation: The speech synthesis library converts the text "The best route is XX. Restaurant information around Tokyo Station is △△." into speech.

[1758] Output: Audio data.

[1759] Step 7:

[1760] The terminal provides voice data to the user through a speaker.

[1761] Input: Audio data.

[1762] Specific operation: The speaker will provide audio guidance saying, "The best route is XX. Restaurant information around Tokyo Station is △△."

[1763] Output: The user gets the information.

[1764] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1765] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1766] Another example of generative AI is Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1767] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1768] [Third embodiment]

[1769] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1770] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1771] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[1772] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1773] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[1774] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[1775] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[1776] Fig. 6 shows an example of main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1777] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1778] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1779] In the headset type terminal 314, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1780] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1781] "Example 1"

[1782] As an embodiment of the present invention, a system is provided that customizes a trip through dialogue with AI. Specifically, when a user inputs desired travel conditions (e.g. budget, destination, length of stay, preferred activities, etc.) to the AI, the AI ​​generates a travel plan based on this information. The generated travel plan is presented to the user as an "original travel itinerary," and the user can use this as a basis for preparing for the trip.

[1783] "Example 2"

[1784] Furthermore, as an embodiment of the present invention, a system is provided that centralizes reservations for airline tickets, hotels, activities, meals, etc. Specifically, the system automatically makes the necessary reservations based on a travel plan generated by AI. This allows users to save time and effort in the reservation process.

[1785] "Example 3"

[1786] In addition, as an embodiment of the present invention, a system is provided that provides support as a voice concierge while traveling. Specifically, when a user inquires by voice about information required while traveling (e.g., travel route, local information, etc.), the AI ​​responds and provides the information. This allows the user to easily obtain the information they need even while traveling.

[1787] The process flow of each embodiment will be described below.

[1788] "Example 1"

[1789] Step 1: The user inputs their travel preferences (e.g. budget, destination, length of stay, preferred activities, etc.) into the AI.

[1790] Step 2: The AI ​​generates a travel plan based on the information input by the user.

[1791] Step 3: Present the generated travel plan to the user as an "original travel itinerary."

[1792] "Example 2"

[1793] Step 1: Based on the travel plan generated by AI, all necessary reservations (flights, hotels, activities, meals, etc.) are made centrally.

[1794] Step 2: Notify the user of the reservation result.

[1795] "Example 3"

[1796] Step 1: The user makes a voice request for the information they need while traveling (e.g., travel route, local information, etc.).

[1797] Step 2: The AI ​​responds to the user's inquiry and provides information.

[1798] Example 1

[1799] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1800] In conventional travel planning systems, it was difficult for users to customize their travel plans based on their desired conditions, and the process of creating travel plans and making reservations was cumbersome. In addition, there was a lack of support during travel, making it difficult for users to quickly obtain local information. This limited the users' travel experience.

[1801] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1802] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original trip plan created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as voice guidance during travel, a means for transmitting desired conditions input by the user from a terminal to the server, a means for the server to generate a trip plan using a generation AI model, and a means for transmitting the generated trip plan to the terminal and displaying it to the user. This allows the user to easily create and obtain a customized trip plan based on the desired conditions, and allows them to prepare for the trip and receive support on-site.

[1803] "User" means an individual or entity that uses the System to customize a trip.

[1804] "Interaction" is the process in which a user inputs desired requirements to a system and the system responds accordingly.

[1805] "Travel customization" refers to creating individual travel plans based on the user's desired conditions.

[1806] "Artificial intelligence means" means the part of the system that contains algorithms and models for generating travel plans based on user input.

[1807] An "original travel plan" is a unique travel plan created by an artificial intelligence means based on the user's desired conditions.

[1808] "Reservations for airfare, accommodation, activities, meals, etc." refers to the process of securing various services necessary for travel in advance.

[1809] "Voice guidance" is a function that provides users with necessary information via voice while they are traveling.

[1810] A "terminal" is a device (e.g., a PC or smartphone) that allows a user to access the system and input desired conditions.

[1811] The "server" refers to a central processing unit that receives user input data, generates a travel plan using a generative AI model, and transmits it to the terminal.

[1812] A "generative AI model" is an artificial intelligence algorithm that analyzes a user's desired conditions and suggests the optimal travel plan.

[1813] A "prompt" is text containing the user's desired conditions that is input into a generative AI model.

[1814] A "Travel Plan" is a specific travel schedule and activity proposal created based on the User's desired conditions.

[1815] This invention is a system that generates a customized travel plan based on a user's desired travel conditions input. The system includes an artificial intelligence means for customizing the trip through dialogue with the user, a means for creating a generated original travel plan, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as voice guidance during travel, a means for transmitting the desired conditions input by the user from a terminal to a server, a means for the server to generate a travel plan using a generation AI model, and a means for transmitting the generated travel plan to the terminal and displaying it to the user.

[1816] A user accesses the system using a terminal (e.g., a PC or smartphone). The user inputs the desired travel conditions (e.g., budget, destination, length of stay, preferred activities, etc.). Specifically, the user inputs the following information into the system's input form:

[1817] Budget: 100,000 yen

[1818] Destination: Kyoto

[1819] Length of stay: 3 days

[1820] Favorite activities: Visiting temples, experiencing Japanese cuisine

[1821] The device sends the desired conditions entered by the user as data to the server. This data is sent to the server as an HTTP request. Specifically, the device inputs the following prompt sentence into the generative AI model:

[1822] "I would like to stay in Kyoto for three days on a budget of 100,000 yen and enjoy visiting temples and experiencing Japanese cuisine."

[1823] The server generates a travel plan based on the received data using a generative AI model (e.g., OpenAI's GPT-4). The generative AI model analyzes the user's desired conditions and performs data processing and calculations to propose the optimal travel plan. The generated travel plan is returned to the server in the following format:

[1824] Day 1: Arrive at Kyoto Station and visit Kiyomizu-dera Temple and Kinkaku-ji Temple. Enjoy a Japanese dinner in Gion.

[1825] Day 2: Walk through the bamboo forest in Arashiyama and visit Tenryu-ji Temple. Enjoy a Japanese meal in Sagano for lunch.

[1826] Day 3: Visit Fushimi Inari Taisha Shrine and return home from Kyoto Station in the afternoon.

[1827] The server sends the generated travel plan to the terminal. This data is sent to the terminal as an HTTP response. The terminal displays the travel plan received from the server to the user. Specifically, the terminal displays the travel plan on the screen in an easy-to-read format. The user can then proceed with specific travel preparations based on this travel plan.

[1828] The system allows users to easily create and obtain customized travel plans based on their desired conditions, and allows them to receive support during travel preparation and on-site.

[1829] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1830] Step 1:

[1831] The user inputs the desired travel conditions.

[1832] A user accesses the system using a terminal (e.g., a PC or smartphone) and inputs the desired travel conditions (e.g., budget, destination, length of stay, preferred activities, etc.). Specifically, the user enters the following information into the system's input form:

[1833] Budget: 100,000 yen

[1834] Destination: Kyoto

[1835] Length of stay: 3 days

[1836] Favorite activities: Visiting temples, experiencing Japanese cuisine

[1837] Input data: User's desired conditions

[1838] Output data: Desired conditions entered in the input form

[1839] Step 2:

[1840] The terminal transmits the input data to the server.

[1841] The terminal sends the desired conditions entered by the user as data to the server. This data is sent to the server as an HTTP request. Specifically, the terminal sends the following JSON-formatted data to the server:

[1842] json

[1843] {

[1844] "budget": "100,000 yen",

[1845] "destination": "Kyoto",

[1846] "duration": "3 days",

[1847] "activities": ["Temple tour", "Japanese food experience"]

[1848] }

[1849] Input data: User's desired conditions

[1850] Output data: Data of desired conditions sent to the server

[1851] Step 3:

[1852] The server generates a travel plan using the generative AI model.

[1853] The server generates a travel plan using a generative AI model (e.g., OpenAI's GPT-4) based on the received data. The server inputs the user's desired conditions into the generative AI model as a prompt sentence. Specifically, the server inputs the following prompt sentence into the generative AI model:

[1854] "I would like to stay in Kyoto for three days on a budget of 100,000 yen and enjoy visiting temples and experiencing Japanese cuisine."

[1855] The generative AI model generates a travel plan based on this prompt.

[1856] Input data: User's desired conditions, prompt text

[1857] Output data: Generated itinerary

[1858] Step 4:

[1859] The server transmits the generated travel plan to the terminal.

[1860] The server sends the generated itinerary to the terminal. This data is sent to the terminal as an HTTP response. Specifically, the server sends the following JSON format data to the terminal:

[1861] json

[1862] {

[1863] "day1": "After arriving at Kyoto Station, visit Kiyomizu-dera Temple and Kinkaku-ji Temple. In the evening, have a Japanese dinner in Gion.",

[1864] "day2": "Walk through the bamboo forest in Arashiyama and visit Tenryu-ji Temple. For lunch, experience Japanese cuisine in Sagano.",

[1865] "day3": "Visit Fushimi Inari Taisha Shrine and return home from Kyoto Station in the afternoon."

[1866] }

[1867] Input data: Generated itinerary

[1868] Output data: Travel plan sent to the terminal

[1869] Step 5:

[1870] The terminal displays the travel plan to the user.

[1871] The terminal displays the travel plan received from the server to the user. Specifically, the terminal displays the travel plan on the screen in an easy-to-read format. The user can proceed with specific travel preparations based on this travel plan.

[1872] Input data: Travel plan received from the server

[1873] Output data: The itinerary displayed to the user

[1874] (Application example 1)

[1875] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1876] Conventional travel customization systems were able to create travel plans based on users' desired conditions, but they lacked the customization of meals during the trip or the provision of optimal food delivery plans. As a result, users had to spend time and effort finding suitable meals during their trip, which could reduce their satisfaction with the trip.

[1877] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1878] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for generating an optimal food delivery plan based on the user's desired conditions, and a means for presenting the generated food delivery plan to the user. This allows the user to easily find the optimal meal based on their desired conditions even while traveling, improving the satisfaction of the trip.

[1879] "User" means an individual or entity that uses the System to customize travel or generate food delivery plans.

[1880] "Dialogue" is the process in which a user inputs desired conditions or questions to a system and the system responds accordingly.

[1881] "Customized travel" refers to individually tailoring and creating travel plans based on the user's desired conditions.

[1882] "AI means" refers to a part of a system that uses artificial intelligence to analyze users' desired conditions and generate optimal travel plans and food delivery plans.

[1883] An "original travel itinerary" is a document created by AI means that contains a unique travel plan based on the user's desired conditions.

[1884] A "means for fulfilling reservations" is a part of a system that has the functionality to make online reservations for flights, hotels, activities, meals, etc.

[1885] "Voice concierge" is a part of the system that has the ability to provide support to users via voice while on the move.

[1886] A "Food Delivery Plan" is a plan that generates the optimal food delivery plan based on the user's desired conditions.

[1887] A "presentation means" is a part of the system that has the functionality to present the generated plan to the user visually or audibly.

[1888] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary created by the AI ​​means, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for generating an optimal food delivery plan based on the user's desired conditions, and means for presenting the generated food delivery plan to the user.

[1889] System Programming

[1890] The system executes the following programs:

[1891] 1. User interaction:

[1892] Users input their desired travel conditions (budget, destination, length of stay, preferred activities, etc.) through a smartphone app.

[1893] Similarly, enter your dining preferences (budget, type of food, delivery time, allergy information, etc.).

[1894] 2. Analysis by AI means:

[1895] The server generates a prompt sentence based on the input desired conditions.

[1896] Use the OpenAI API to send prompts to a generative AI model (e.g. GPT-3).

[1897] 3. Generate travel and food delivery plans:

[1898] The AI ​​model generates optimal travel plans and food delivery plans and returns them to the server.

[1899] 4. Present the plan:

[1900] The server provides the generated plan to the user visually or audibly.

[1901] Hardware and Software Used

[1902] Hardware:

[1903] Smartphone: A device that allows users to input their desired conditions.

[1904] Server: A device that runs the AI ​​model and generates plans.

[1905] software:

[1906] Python: A programming language used to implement the program.

[1907] OpenAI API: An API for using generative AI models (e.g. GPT-3).

[1908] Data processing and calculation

[1909] Data processing:

[1910] The desired conditions entered by the user are formatted as a prompt.

[1911] example:

[1912] Generate the best food delivery plan based on your user preferences.

[1913] Price: 2000 yen

[1914] Cuisine type: Italian

[1915] Delivery time: 19:00

[1916] Allergy Information: Nuts

[1917] Data Calculation:

[1918] Use the OpenAI API to send prompts to a generative AI model to generate an optimal plan.

[1919] The generated plan is formatted visually or audibly for presentation to the user.

[1920] Examples

[1921] The user enters the following conditions into the app:

[1922] Price: 2000 yen

[1923] Cuisine type: Italian

[1924] Delivery time: 19:00

[1925] Allergy Information: Nuts

[1926] The server generates prompts based on these conditions and uses the OpenAI API to generate an optimal food delivery plan, which is then presented to the user visually or audibly.

[1927] In this way, users can easily find the best meal based on their desired criteria while traveling, thereby improving their satisfaction with the trip.

[1928] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1929] Step 1:

[1930] A user uses a smartphone device to input desired travel conditions (budget, destination, length of stay, favorite activities, etc.) and desired meal conditions (budget, type of food, delivery time, allergy information, etc.). The input data is sent from the device to the server.

[1931] Step 2:

[1932] The server generates a prompt based on the received user's desired conditions. Specifically, it converts the user's input data into text format and creates a prompt suitable for the generative AI model. For example, the following prompt is generated:

[1933] Generate the best food delivery plan based on your user preferences.

[1934] Price: 2000 yen

[1935] Cuisine type: Italian

[1936] Delivery time: 19:00

[1937] Allergy Information: Nuts

[1938] Step 3:

[1939] The server sends the generated prompt to the generative AI model (e.g., GPT-3) using the OpenAI API. The API request includes the prompt along with any required parameters (e.g., max_tokens, temperature, etc.).

[1940] Step 4:

[1941] The generative AI model generates optimal travel and food delivery plans based on the received prompts, which are then returned to the server as an API response.

[1942] Step 5:

[1943] The server parses the plans returned by the generative AI model and formats them for presentation to the user, specifically converting the travel plans and food delivery plans into data for visual or audio display.

[1944] Step 6:

[1945] The server sends the formatted plan to the smartphone terminal. The terminal presents the received plan to the user visually or audibly. The user can check the presented plan and proceed with reservations or orders as necessary.

[1946] In this way, the user can easily find the most suitable meal based on their desired conditions even while traveling, thereby improving the satisfaction of the trip.

[1947] Example 2

[1948] Next, a second embodiment of the second form will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1949] Conventional travel reservation systems require users to make individual reservations for air tickets, accommodations, activities, meals, etc., which is time-consuming and laborious. In addition, when creating a travel plan, users must collect information and make plans themselves, which is inefficient. Furthermore, there is a lack of support during travel, which means that there is insufficient information and guidance on-site.

[1950] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1951] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for making reservations using the application programming interface of each reservation site based on the generated travel plan, and a means for providing support as a voice concierge during travel. This allows the user to plan and book a trip in a unified manner and receive support during travel, making for an efficient and comfortable trip.

[1952] "User" means any individual or entity that uses the System to plan and book travel.

[1953] "Dialogue" is the process by which a user and a system exchange information, and includes the act of conveying the user's wishes and conditions to the system.

[1954] "Trip customization" is the process of creating the optimal travel plan based on the user's preferences, budget, dates, and other criteria.

[1955] "Artificial intelligence means" refers to algorithms or programs used to customize trips through interaction with users.

[1956] A "travel guidebook" is a document or digital data that contains a travel schedule or detailed plans.

[1957] An "air ticket" is a ticket for travelling on an aircraft.

[1958] "Accommodation facilities" refer to facilities such as hotels, inns, and guesthouses where travelers can stay.

[1959] "Activities" refers to activities such as sightseeing, leisure, and experiences that you undertake while traveling.

[1960] "Meals" refers to services such as restaurants and cafes that provide food and drinks to be consumed during travel.

[1961] A "reservation" is the process of reserving services such as airfare, accommodations, activities, and meals in advance.

[1962] An "application programming interface" is an interface that allows different software systems to communicate with each other.

[1963] A "voice concierge" is a service that provides information and guidance to users via voice.

[1964] "Support" refers to providing information and assistance in resolving problems that users require during their travels.

[1965] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[1966] The present invention relates to a system that allows a user to make a trip plan and a reservation in an integrated manner. A specific embodiment of this system will be described below.

[1967] System Configuration

[1968] In this system, users input their desired travel conditions using a terminal (PC, smartphone, tablet, etc.), and the server generates a travel plan based on those conditions and automatically makes the necessary reservations. The system includes the following main components:

[1969] 1. User terminal: This is the device through which the user enters their travel preferences. This includes PCs, smartphones, tablets, etc.

[1970] 2. Server: Receives input from the user, generates a travel plan using the generative AI model, and makes the reservation using the API of each booking site.

[1971] 3. Generative AI models: For example, using a generative AI model such as OpenAI's GPT-4, generate a travel plan based on the user's desired criteria.

[1972] 4. Booking site API: Use the API of each booking site (e.g. airline ticket booking site, hotel booking site, restaurant booking site, etc.) to automatically make the necessary reservations.

[1973] Program Processing

[1974] The server receives the desired travel conditions entered by the user from the terminal and converts them into a prompt. For example, if the user enters the desired conditions, "I am planning a five-day trip to Tokyo in December 2023. My budget is within 200,000 yen, and I would like to enjoy sightseeing and delicious food," the server generates the following prompt.

[1975] Example prompt:

[1976] "I am planning a 5-day trip to Tokyo in December 2023. My budget is within 200,000 yen and I would like to enjoy sightseeing and delicious food. Please suggest the best travel plan."

[1977] The generated prompt sentence is sent to the generative AI model, which generates a travel plan based on the prompt sentence, like this:

[1978] An example of a generated itinerary:

[1979] Day 1: Arrival in Tokyo, sightseeing in Asakusa, visiting Sensoji Temple, dinner at a local restaurant

[1980] Day 2: Visit Tokyo Tower, go shopping in Ginza, and have lunch at a sushi restaurant

[1981] Day 3: Visit Ueno Zoo, shopping at Ameyoko, yakiniku dinner

[1982] Day 4: Sightseeing in Odaiba, shopping at VenusFort, dinner at an Italian restaurant

[1983] Day 5: Visit to Tokyo Disneyland, return home

[1984] The server makes the necessary reservations using the API of each reservation site based on the generated travel plan. For example, to reserve an airline ticket, the API of an airline reservation site is used, to reserve a hotel, the API of a hotel reservation site is used, and to reserve a restaurant, the API of a restaurant reservation site is used.

[1985] After all reservations are completed, the server sends a notification to the user, including details of the reservation (reservation number, date, time, location, etc.). The user can view this notification on their device.

[1986] This system allows users to plan and book their trips all in one place, making travel more efficient and comfortable.

[1987] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1988] Step 1:

[1989] The user inputs the desired travel conditions.

[1990] A user uses a terminal (PC, smartphone, tablet, etc.) to input the desired conditions for the trip (destination, budget, schedule, activities of interest, etc.). For example, a user might input conditions such as "I am planning a five-day trip to Tokyo in December 2023. My budget is within 200,000 yen, and I would like to enjoy sightseeing and delicious meals."

[1991] Input: Your travel preferences (destination, budget, dates, activities you're interested in, etc.)

[1992] Output: The user's preferences are sent to the server.

[1993] Step 2:

[1994] The server converts the entered conditions into a prompt.

[1995] The server receives the desired conditions entered by the user and converts them into a prompt sentence suitable for the generative AI model. For example, it generates a prompt sentence like the following.

[1996] Example prompt:

[1997] "I am planning a 5-day trip to Tokyo in December 2023. My budget is within 200,000 yen and I would like to enjoy sightseeing and delicious food. Please suggest the best travel plan."

[1998] Input: User's desired conditions

[1999] Output: The generated prompt statement

[2000] Step 3:

[2001] The server sends a prompt to the generative AI model.

[2002] The server sends the generated prompt to a generative AI model (e.g., OpenAI's GPT-4). Since the generative AI model runs on the cloud, the server sends the request over the Internet.

[2003] Input: Generated prompt text

[2004] Output: The prompt sent to the generative AI model

[2005] Step 4:

[2006] The generative AI model generates a travel plan and returns it to the server.

[2007] The generative AI model generates a travel plan based on the prompt sentence. For example, it generates a plan like the one below.

[2008] An example of a generated itinerary:

[2009] Day 1: Arrival in Tokyo, sightseeing in Asakusa, visiting Sensoji Temple, dinner at a local restaurant

[2010] Day 2: Visit Tokyo Tower, go shopping in Ginza, and have lunch at a sushi restaurant

[2011] Day 3: Visit Ueno Zoo, shopping at Ameyoko, yakiniku dinner

[2012] Day 4: Sightseeing in Odaiba, shopping at VenusFort, dinner at an Italian restaurant

[2013] Day 5: Visit to Tokyo Disneyland, return home

[2014] Input: The prompt sent to the generative AI model

[2015] Output: The generated itinerary

[2016] Step 5:

[2017] The server makes reservations based on the travel plan using the API of each reservation site.

[2018] Based on the generated travel plan, the server makes the necessary reservations using the API of each reservation site (e.g., airline ticket reservation site, accommodation reservation site, restaurant reservation site, etc.). Specifically, it automatically makes airline ticket reservations, accommodation reservations, activity reservations, restaurant reservations, etc.

[2019] Input: Generated itinerary

[2020] Output: Booking requests sent to each booking site

[2021] Step 6:

[2022] The server sends a notification to the user that the reservation is complete.

[2023] The server confirms that all reservations are complete and sends a notification to the user, including details of the reservation (reservation number, date, time, location, etc.). The user can view the notification on their device.

[2024] Input: Reservation completion information from each reservation site

[2025] Output: Booking completion notification sent to user

[2026] (Application example 2)

[2027] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[2028] Conventional travel reservation systems have the problem that users have to book flights, hotels, activities, meals, etc. individually, which is time-consuming. In addition, the generation and reservation of meal plans that take into account the user's dietary preferences and allergy information was not automated, so users had to make adjustments themselves. This could make trip planning and execution cumbersome and reduce user satisfaction.

[2029] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2030] In this invention, the server includes an AI means for customizing a trip through dialogue with a user, a means for creating an original travel guide created by the AI ​​means, a means for making reservations for air tickets, hotels, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for inputting the user's dietary preferences and allergy information and for the AI ​​to generate a meal plan based on the user's preferences, and a means for automatically reserving necessary ingredients and dishes based on the generated meal plan. This allows the user to centrally manage everything from planning to execution of the trip, and the generation and reservation of a meal plan that takes into account dietary preferences and allergy information is automated, significantly reducing the hassle of traveling and making it possible to improve user satisfaction.

[2031] Key Word Definitions

[2032] "User" means any individual or entity that uses the System to plan and book travel.

[2033] "Dialogue" is the process by which a user and a system exchange information and is the means by which the user communicates their preferences and requests to the system.

[2034] "Trip customization" is the process of creating an individually optimized travel plan based on a user's preferences, budget, destinations, and other information.

[2035] "AI means" refers to a component of the system that uses artificial intelligence technology to analyze information input by users and generate optimal travel and meal plans.

[2036] An "original travel itinerary" is a document created by AI means that details the user's travel plans.

[2037] A "means for making reservations" is a component of a system that automatically makes reservations for flights, hotels, activities, meals, etc.

[2038] A "voice concierge" is a component of a system that provides voice guidance and support to users while traveling.

[2039] "Dietary preferences" refers to information such as the user's preferred ingredients, types of cuisine, and seasonings.

[2040] "Allergy information" refers to information about ingredients or substances to which a user has an allergy.

[2041] "Meal Plan" means a weekly meal plan generated by the AI ​​Means based on the User's dietary preferences and allergy information.

[2042] The "means for automatically reserving ingredients and meals" is a component of the system that automatically reserves the necessary ingredients and meals based on the generated meal plan.

[2043] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[2044] A system for implementing this invention includes AI means for customizing a trip through dialogue with a user, means for creating an original travel itinerary created by the AI ​​means, means for making reservations for airline tickets, hotels, activities, meals, etc., means for providing support as a voice concierge during travel, means for inputting the user's dietary preferences and allergy information and having the AI ​​generate a meal plan based on the user's preferences, and means for automatically reserving necessary ingredients and dishes based on the generated meal plan.

[2045] Program processing explanation

[2046] Hardware and software used

[2047] Hardware: Smartphones, servers

[2048] Software: Python, OpenAI API, HTTP request library (requests)

[2049] Data processing and calculation

[2050] 1. Input of user preference information: The user inputs his / her food preferences and allergy information into the application using a smartphone. This information is sent to the server.

[2051] 2. AI meal plan generation: The server uses the OpenAI API to generate a weekly meal plan based on the user's preferences. It sends prompts to the generative AI model to obtain the appropriate meal plan.

[2052] 3. Automated Reservation: Based on the generated meal plan, the necessary ingredients and dishes are automatically reserved using the HTTP request library. The reservation information is sent from the server to the relevant service provider.

[2053] Examples

[2054] When the user enters "I'm a vegetarian, I have no allergies, and I like Japanese food," the server sends the following prompt to the generative AI model:

[2055] User preferences: Vegetarian, no allergies, likes Japanese food

[2056] Generate a meal plan for the week.

[2057] Based on this prompt, the generative AI model generates a meal plan such as "Monday: vegetable sushi, Tuesday: tofu steak, ...". The server receives this meal plan and automatically reserves the necessary ingredients and dishes. For example, the ingredients for vegetable sushi are ordered from an online supermarket, and the tofu steak is reserved at a restaurant.

[2058] In this way, users can centrally manage everything from trip planning to execution, and the generation and booking of meal plans that take into account dietary preferences and allergy information is automated, significantly reducing the hassle of traveling and improving user satisfaction.

[2059] The flow of the specific process in the application example 2 will be described with reference to FIG.

[2060] Program processing steps

[2061] Step 1:

[2062] A user uses a smartphone to input their food preferences and allergy information into the application. The input information is sent from the user's device to the server. The input data includes the user's food preferences (e.g., vegetarian, likes Japanese food) and allergy information (e.g., no allergies).

[2063] Step 2:

[2064] The server creates a prompt for the generative AI model based on the received user preference information. The prompt is written in a format that includes the user's preferences and allergy information. For example, a prompt might be generated that reads, "User preferences: vegetarian, no allergies, likes Japanese food. Please generate a meal plan for one week."

[2065] Step 3:

[2066] The server sends the generated prompt to the OpenAI API, which generates a meal plan based on the AI ​​model. The AI ​​model analyzes the prompt and generates a weekly meal plan that matches the user's preferences. The generated meal plan is returned to the server.

[2067] Step 4:

[2068] The server analyzes the received meal plan and creates a list of ingredients and dishes required, for example, "Monday: veggie sushi, Tuesday: tofu steak."

[2069] Step 5:

[2070] The server uses an HTTP request library to automatically reserve the necessary ingredients and dishes based on the generated meal plan. For example, ingredients for vegetable sushi are ordered from an online supermarket, and a reservation for tofu steak is made with a restaurant. The reservation information is then sent from the server to the relevant service provider.

[2071] Step 6:

[2072] The server sends information about the completed reservation to the user's device. The user can check the information about the reserved ingredients and dishes via their smartphone. For example, a notification such as "The ingredients for Monday's vegetable sushi have been ordered. Tuesday's tofu steak reservation has been completed" is displayed.

[2073] In this way, users can centrally manage everything from planning to execution of their trip, and the generation and booking of meal plans that take into account dietary preferences and allergy information is automated, significantly reducing the hassle of traveling and improving user satisfaction.

[2074] Example 3

[2075] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[2076] In conventional travel support systems, it was difficult for users to quickly and accurately obtain the information they needed while traveling. In addition, even in information provision systems that use voice input, the process of generating appropriate information in response to a user's inquiry and providing it by voice was complicated, and there was a problem that it lacked real-time performance. As a result, users had to spend a lot of time and effort to obtain the information they needed while traveling.

[2077] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[2078] In this invention, the server includes an artificial intelligence means for customizing a trip through dialogue with a user, a means for creating an original travel itinerary created by the artificial intelligence means, a means for making reservations for air tickets, accommodations, activities, meals, etc., a means for providing support as a voice concierge during travel, a means for receiving a user's voice input and converting the voice data into text data, a means for inputting a prompt sentence into a generative AI model and generating information, a means for converting the generated text data into voice data, and a means for transmitting the generated voice data to the user's terminal. This allows the user to quickly and accurately obtain necessary information by voice even while on the move.

[2079] "Artificial intelligence means" refers to technologies used to collect information through dialogue with users and customize trips based on the users' preferences and requests.

[2080] The "means for creating an original travel itinerary" refers to a technology for creating a travel itinerary specifically for a user based on information collected by an artificial intelligence means.

[2081] A "reservation facilitation medium" is any technology that allows online reservations of flights, accommodations, activities, meals, etc.

[2082] "Means of providing support as a voice concierge" refers to technology that provides users with the information they need via voice while on the move.

[2083] "Means for receiving voice input and converting the voice data into text data" refers to technology for digitally capturing a user's voice input and converting it into text form.

[2084] "Means of inputting a prompt sentence into a generative AI model and generating information" refers to a technology for inputting text data into a generative AI model and generating appropriate information in response to a user's inquiry.

[2085] The "means for converting the generated text data into voice data" refers to a technique for converting the generated text data into voice format.

[2086] "Means for transmitting the generated voice data to the user's terminal" refers to technology for transmitting the generated voice data to the user's terminal via the Internet.

[2087] This invention is a system in which an AI responds to a user's voice inquiry about the information they need while on the move and provides that information. Specifically, the user makes an inquiry by voice using a device such as a smartphone or tablet, and the server processes the voice data and provides the appropriate information.

[2088] The server uses voice recognition software (e.g., voice recognition API) to convert the user's voice input into text data. It then uses a generative AI model (e.g., generative AI model) to generate appropriate information based on the user's inquiry. This information may include travel routes and local information. The generated text data is converted into voice data using voice synthesis software (e.g., voice synthesis API). The server sends this voice data to the user's device, and the user can receive the information by voice through the device.

[2089] As a concrete example, consider a case where a user makes a vo...

Claims

1. An artificial intelligence means for customizing the trip through dialogue with the user; A means for creating an original travel guidebook created by the artificial intelligence means; A means for making travel reservations; A means for providing support as a voice concierge when the user is moving; an emotion engine means for analyzing the emotion of the user; means for adjusting the user's travel plan based on the analysis results of the emotion engine means; A system including:

2. The system according to claim 1 , wherein the AI ​​means customizes the trip based on information such as the user's preferences and budget.

3. The system according to claim 1 , wherein the voice concierge provides route guidance, local information, and the like.

Images