system

Abstract

Provide a system. A means for a user to input desired travel conditions; means for transmitting the input conditions to a server; means for the server to obtain travel information from relevant external sources based on said conditions; A means for an AI model to generate an optimal travel plan using the acquired information; means for presenting the generated plurality of travel plans to a user; A means for completing a reservation procedure based on a travel plan selected by the user; The system includes means for transmitting reservation confirmation information to the user.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern travel planning, package tours are convenient, but individual arrangements often result in lower costs. However, individual arrangements require users to gather a lot of information, and determining the optimal itinerary can be very tedious. There is a need for a method that eliminates this complexity in travel planning and allows users to easily find the optimal itinerary. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems with a system that includes a means for a user to input desired travel conditions, a means for transmitting the input conditions to a server, a means for the server to obtain travel information from relevant external information sources based on the conditions, a means for an AI model to generate an optimal travel plan using the obtained information, a means for presenting the generated multiple travel plans to the user, a means for completing the reservation procedure based on the travel plan selected by the user, and a means for transmitting reservation confirmation information to the user.This allows users to easily obtain the optimal travel plan based on their desired conditions and complete the reservation procedure without any hassle.

[0006] "User" means an individual or entity that uses the System to create travel plans or request reservations.

[0007] "Conditions" are travel requirements and wishes entered by the user (destination, budget, activities, accommodation requirements, etc.).

[0008] A "means" is a method, a device, or a combination thereof, by which a system performs a particular function.

[0009] A "server" is a computing device that processes data within the system, retrieves information from external sources, and generates itineraries using AI models.

[0010] An "information source" is a web service or database that the system accesses to obtain external travel data.

[0011] "Travel Information" means detailed information needed to plan a trip, such as transportation, accommodation, and activities.

[0012] An "AI model" is a machine learning or artificial intelligence algorithm used to optimize travel plans.

[0013] A "travel plan" is a specific itinerary or schedule generated based on the user's requirements.

[0014] "Presenting" refers to displaying the generated travel plan to the user or offering it as an option.

[0015] The "reservation procedure" refers to the process of actually reserving transportation and accommodation based on the travel plan selected by the user.

[0016] "Reservation confirmation information" is confirmation information provided to the user, such as information indicating that the reservation has been successfully completed and a reservation number. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The present invention is an AI service system that automatically performs the entire process from planning to booking a trip. Specific embodiments of the present invention will be described below.

[0039] System Overview

[0040] In this system, users input their desired travel conditions from their terminal, and the server generates the optimal travel plan based on that information and completes the booking process.The main components are the user terminal, the server, and an external information source (API).

[0041] User processing

[0042] 1. User:

[0043] Users input their desired travel conditions into an input form on their device, including the places they want to go, their budget, the activities they want to do, and the accommodations they want.

[0044] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0045] 2. Terminal:

[0046] The conditions entered by the user are temporarily saved and prepared for transmission to the server.

[0047] Convert the conditions into an appropriate format and send the data to the server.

[0048] Server-side processing

[0049] 1. Server:

[0050] The server receives the conditions sent by the user.

[0051] The received data is parsed and key elements are extracted, such as keywords like "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 stars or more."

[0052] 2. Integration with external APIs:

[0053] The server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain the necessary information.

[0054] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," and use Google (registered trademark) Maps' API to obtain information on transportation to Tokyo (such as bullet trains and airplanes).You can also use the hotel search API to obtain information on hotels in Tokyo with three stars or higher.

[0055] 3. AI-powered optimal travel plan generation:

[0056] Based on the acquired information, the AI ​​model generates multiple travel plans, taking into account relevant factors (cost, travel time, convenience, etc.) to create the optimal plan.

[0057] For example, generate Plan A and Plan B as shown below.

[0058] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[0059] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0060] 4. Present to the user:

[0061] The server transmits the generated travel plans to the user terminal.

[0062] The user terminal displays the plans and allows the user to select one.

[0063] Processing reservations

[0064] 1. User:

[0065] The user selects a desired plan from the presented plans and sends a reservation request.

[0066] For example, the user selects "Plan A."

[0067] 2. Terminal:

[0068] The user's selection information is sent to the server.

[0069] 3. Server:

[0070] Check the details of the selected plan and make the reservation by sending a request to the accommodation booking API or transportation booking API.

[0071] If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[0072] 4. User confirmation:

[0073] The server sends the reservation confirmation information received from the external API to the user terminal.

[0074] The user terminal displays confirmation information to the user, such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0075] This system allows users to quickly obtain the optimal travel plan based on their desired conditions, and complete travel reservations hassle-free.

[0076] The processing flow will be explained below.

[0077] Step 1:

[0078] The user enters their desired travel conditions into an input form on the terminal, including the place they want to go, their budget, the activities they want to do, and the conditions for the accommodation they want.

[0079] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0080] Step 2:

[0081] The terminal temporarily stores the conditions entered by the user and prepares to send them to the server, converts the conditions into an appropriate format, and sends the data to the server.

[0082] Step 3:

[0083] The server receives the conditions sent by the user. It parses (analyzes) the received data and extracts key elements. For example, keywords such as "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 stars or more."

[0084] Step 4:

[0085] Based on the extracted conditions, the server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain related travel information.

[0086] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[0087] Step 5:

[0088] The server uses an AI model to generate multiple travel plans based on the acquired information, and creates the optimal plan by taking into account factors for each plan (cost, travel time, convenience, etc.).

[0089] For example, generate Plan A and Plan B as shown below.

[0090] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[0091] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0092] Step 6:

[0093] The server transmits the generated travel plans to the user's terminal.

[0094] The terminal displays the plans to the user and allows the user to select one.

[0095] Step 7:

[0096] The user selects a desired plan from the presented plans and sends a reservation request.

[0097] For example, the user selects "Plan A."

[0098] Step 8:

[0099] The terminal transmits the user's selection information to the server.

[0100] Step 9:

[0101] The server checks the details of the selected plan and makes the reservation by sending a request to the accommodation reservation API or transportation reservation API.

[0102] Step 10:

[0103] The external API successfully completes the reservation process and sends the reservation confirmation information back to the server.

[0104] Step 11:

[0105] The server sends the reservation confirmation information received from the external API to the user's device.

[0106] Step 12:

[0107] The terminal displays a confirmation to the user, notifying them of a successful reservation.

[0108] For example, it will say, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0109] This series of processes allows the user to quickly obtain the optimal travel plan based on their desired conditions, and complete their travel reservation without any hassle.

[0110] Example 1

[0111] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0112] A problem with conventional travel planning and reservation systems is that users have to conduct their own research and find a plan that meets their requirements, which requires a lot of time and effort. It is also difficult to manually assemble an optimal plan by collecting information from multiple sources. Another problem is that errors are likely to occur during the reservation process, resulting in a poor user experience. The purpose of this invention is to automate the entire process from travel planning to booking, reducing users' time and effort, and providing more efficient travel plans and accurate reservation procedures.

[0113] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0114] In this invention, the server includes means for inputting the conditions of a user's desired trip, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions, means for a generative AI model to generate an optimal trip plan using the acquired information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, means for transmitting reservation confirmation information to the user, means for analyzing received data using the input conditions as a key and extracting relevant elements, and a generative AI model that creates multiple trip plans based on the acquired information and evaluates each plan taking into account its details (cost, travel time, convenience).This enables users to efficiently and quickly obtain optimal trip plans and complete the reservation procedure with fewer errors.

[0115] "User" means a person who uses this system to plan and book a trip.

[0116] "Conditions" refers to the desired information that a user enters for travel planning (e.g., travel destination, budget, activities, accommodation requirements, etc.).

[0117] "Server" refers to a central processing unit that retrieves information from relevant external sources based on the input conditions, generates a travel plan using an AI model, and processes the reservation.

[0118] "External information source" refers to an external information system that provides transportation information, accommodation information, activity information, etc.

[0119] An "AI model" is an artificial intelligence algorithm that generates optimal travel plans based on acquired travel information.

[0120] "Travel Plan" refers to multiple travel suggestions generated by an AI model and presented to users.

[0121] The "reservation procedure" is a process for finalizing various reservations based on the travel plan selected by the user.

[0122] "Reservation confirmation information" is confirmation information sent to the user when the reservation procedure is completed, and includes reservation details.

[0123] "Analysis" refers to the process in which the server receives the input conditions and extracts the necessary information.

[0124] "Evaluation" is the process of determining how optimal the generated travel plan is in terms of cost, travel time, and convenience.

[0125] MODE FOR CARRYING OUT THE INVENTION

[0126] The present invention is an AI service system that automatically performs everything from planning to booking a trip. A specific embodiment of this system will be described below.

[0127] System Overview

[0128] In this system, users input their desired travel conditions from their devices, and the server then generates an optimal travel plan based on that information and completes the booking process. The main components are the user device, the server, and an external information source (API). The hardware used includes general computers and communication networks, while the software includes an AI model, an API client, and a data analysis tool.

[0129] User processing

[0130] 1. User:

[0131] The user enters their desired travel conditions into an input form on the terminal, including the desired destination, budget, activities they would like to do, and accommodation requirements.

[0132] For example, enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0133] 2. Terminal:

[0134] The device temporarily saves the conditions entered by the user, converts the input data into JSON format, and prepares to send it to the server.

[0135] Specifically, the conditions are converted into an appropriate format and sent to the server as an HTTP request.

[0136] Server-side processing

[0137] 1. Server:

[0138] The server receives the condition data sent by the user, analyzes it using a JSON parser, and extracts key elements, such as keywords like "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 or more stars."

[0139] 2. Integration with external APIs:

[0140] The server obtains information by sending requests to external traffic information APIs, accommodation APIs, and activity information APIs.

[0141] External information sources include a traffic information API, accommodation API, and activity information API, from which the necessary information is obtained.

[0142] As a concrete example, you can request information on "three-star or higher hotels in Tokyo" from the accommodation API, and request "transportation methods to Tokyo (bullet train, airplane, etc.)" from the transportation information API.

[0143] 3. AI-powered travel plan generation:

[0144] The server generates multiple itineraries using a generative AI model based on information obtained from external APIs. The AI ​​model evaluates the itineraries based on cost, travel time, and convenience, and generates the optimal itinerary.

[0145] For example, the AI ​​model generates Plan A and Plan B as follows:

[0146] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[0147] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0148] 4. Present to the user:

[0149] The server sends the generated travel plans to the user terminal, and the user can select one of the plans presented.

[0150] Processing reservations

[0151] 1. User:

[0152] The user selects the desired plan from the presented plans and submits a reservation request. For example, the user selects "Plan A."

[0153] 2. Terminal:

[0154] The terminal transmits information about the plan selected by the user to the server.

[0155] 3. Server:

[0156] The server checks the details of the selected plan and sends a reservation request to the accommodation booking API and the transport booking API. For example, it reserves "two nights at a three-star hotel A" with the accommodation booking API and reserves "round-trip Shinkansen tickets" with the transport booking API.

[0157] 4. User confirmation:

[0158] The server receives the reservation confirmation information from the external API and sends it to the user's terminal. A confirmation message is displayed saying, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0159] Specific examples

[0160] Travel planning prompts:

[0161] I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a 3-star or higher hotel.

[0162] Booking confirmation prompt:

[0163] I have selected Plan A. Please proceed with your reservation.

[0164] This system allows users to efficiently obtain the best travel plan based on their desired conditions and complete travel reservations hassle-free.

[0165] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0166] Step 1:

[0167] Input: The user enters their travel preferences (destination, budget, activities, accommodation requirements, etc.) into the device.

[0168] Specific operation: The user enters the following into the input form on the device: "I want to go to Tokyo. My budget is within 100,000 yen. I want to go to a hot spring. I want to stay in a hotel with 3 stars or more."

[0169] Output: The user's input data is saved to the terminal.

[0170] Step 2:

[0171] Input: User input data that is saved.

[0172] Specific operation: The terminal converts the data entered by the user into JSON format and prepares to send it to the server. Specific data format conversion processing is performed.

[0173] Output: JSON formatted trip conditions data.

[0174] Step 3:

[0175] Input: Trip conditions data in JSON format.

[0176] Specific operation: The device sends the converted JSON data to the server as an HTTP request.

[0177] Output: The server receives the JSON data.

[0178] Step 4:

[0179] Input: JSON formatted travel conditions data received by the server.

[0180] Specific operation: The server uses a JSON parser to parse the user's search criteria data. Specifically, it extracts keywords such as "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 or more stars."

[0181] Output: Extracted keyword data.

[0182] Step 5:

[0183] Input: Extracted keyword data.

[0184] Specific operation: The server sends requests to the traffic information API, accommodation API, and activity information API to obtain information. For example, it requests information such as "transportation to Tokyo" from the traffic information API, "three-star or higher hotels in Tokyo" from the accommodation API, and "hot springs in Tokyo" from the activity information API.

[0185] Output: Obtained external information data (information on transportation, accommodation, activities).

[0186] Step 6:

[0187] Input: Acquired external information data.

[0188] Specific operation: The server generates a travel plan using a generative AI model based on the acquired information. The AI ​​model evaluates each travel element and creates multiple travel plans. For example, it evaluates based on cost, travel time, and convenience, and generates the following Plan A and Plan B.

[0189] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[0190] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0191] Output: Multiple trip plan data.

[0192] Step 7:

[0193] Input: Multiple itinerary data.

[0194] Specific operations: The server transmits the generated travel plan to the user terminal.

[0195] Output: Travel plan data received by the user device.

[0196] Step 8:

[0197] Input: Travel plan data received by the user device.

[0198] Specific operation: The terminal displays the plans received from the server on the user interface and allows the user to select one.

[0199] Output: Multiple itineraries are displayed for the user to choose from.

[0200] Step 9:

[0201] Input: Multiple proposed travel plans.

[0202] Specific operation: The user selects the desired plan and sends a reservation request such as "Plan A has been selected. Please proceed with the reservation."

[0203] Output: Booking request data.

[0204] Step 10:

[0205] Input: Booking request data.

[0206] Specific operation: The terminal transmits the user's selection information to the server.

[0207] Output: The reservation request data received by the server.

[0208] Step 11:

[0209] Input: The reservation request data received by the server.

[0210] Specific operation: The server checks the details of the selected plan and sends a reservation request to the accommodation booking API and the transportation booking API. For example, it sends "two nights at a three-star hotel A" to the accommodation API and "round-trip Shinkansen ticket" to the transportation API.

[0211] Output: Booking result data.

[0212] Step 12:

[0213] Input: Booking result data.

[0214] Specific operation: The server receives reservation confirmation information from the external API and sends confirmation information such as "Hotel A reservation number XXX" and "Shinkansen reservation number YYY" to the user terminal.

[0215] Output: The confirmation information received by the user device.

[0216] Step 13:

[0217] Input: The confirmation information received by the user device.

[0218] Specific operation: The terminal displays the reservation confirmation information received from the server to the user, and displays a confirmation message such as "Your Shinkansen and hotel reservations have been completed. The reservation number is XXX."

[0219] Output: The booking confirmation message that is displayed to the user.

[0220] (Application example 1)

[0221] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0222] Conventional travel plan generation systems only provide plans based on travel conditions entered by the user, but lack the functionality and support to optimize the shopping experience in physical stores. In particular, they lack a mechanism to efficiently obtain information on the products and budget that users want, as well as the best stores, and to simplify the purchasing process. This means that users end up spending a lot of time and effort visiting multiple stores to find the best products and stores.

[0223] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0224] In this invention, the server includes means for inputting the conditions of a desired trip from a user, means for transmitting the input conditions to the server, means for the server to acquire travel information from related external information sources based on the conditions, means for an AI model to generate an optimal trip plan using the acquired information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, means for transmitting reservation confirmation information to the user, additional means for the user to input desired product information and budget, additional means for acquiring product information from related external information sources based on the input product conditions, additional means for generating an optimal product list and store information using the acquired product information, additional means for presenting the generated multiple product lists and store information to the user and completing a purchase procedure based on the products and store selected by the user, and additional means for transmitting the purchase confirmation information to the user. This allows users to not only plan their trip efficiently in a short amount of time, but also to simultaneously enjoy an optimal shopping experience at physical stores.

[0225] "User" refers to an individual who uses the system to input travel and shopping conditions and select the most suitable plan or product.

[0226] "Travel conditions" refers to elements related to a user's desired trip, such as destination, budget, activities to do, and desired accommodation conditions.

[0227] "Server" refers to a computer system that receives input data from users, obtains necessary information in cooperation with external information sources, generates an optimal plan using an AI model, and presents it to users.

[0228] "External information source" refers to an information source such as an external API or database that the server uses to obtain travel information or product information.

[0229] "Travel Information" refers to data collected about transportation, accommodation, and activities.

[0230] "Product information" refers to data such as the acquired product price, availability, ratings, popularity, etc.

[0231] "AI model" refers to the artificial intelligence algorithm used by the server to generate optimal plans and lists using the acquired travel and product information.

[0232] A "travel plan" refers to the optimal combination of travel schedule, course, and accommodation generated by an AI model and presented to the user.

[0233] "Product list" refers to a list generated by an AI model that includes the most suitable products and stores based on the user's desired conditions, as well as instructions on how to purchase them.

[0234] "Reservation procedure" refers to the series of processes in which a user makes reservations for accommodation, transportation, etc. based on the travel plan selected by the user.

[0235] "Purchase procedure" refers to the process of actually purchasing a product based on the product and store selected by the user.

[0236] "Reservation confirmation information" refers to information sent to a user to confirm that the reservation or purchase process has been successfully completed.

[0237] This invention is a system that automates the entire process from planning to booking a trip, as well as optimizing the shopping experience in brick-and-mortar stores. This system allows users to input their desired travel and product requirements, and then generates and presents optimal plans and product lists based on those inputs.

[0238] System configuration and operation

[0239] 1. User-side processing

[0240] Users use their smartphones or smart glasses to input their desired conditions (travel conditions or product conditions). For example, they might input, "I want to go to Tokyo, my budget is within 100,000 yen, and I want to go to a hot spring," or "I want to buy the latest smartphone within 20,000 yen."

[0241] 2. Terminal processing

[0242] The application installed on the smartphone or smart glasses temporarily stores the conditions entered by the user and prepares to send them to the server. This application is built using a mobile app development platform such as React Native or Flutter (registered trademark). It also validates the user's input and displays error messages.

[0243] 3. Server-side processing

[0244] The server receives and analyzes the conditions sent by the user. It then obtains the necessary information from external sources, such as:

[0245] External sources of travel information: Transportation information API, Accommodation information API, Activity information API (e.g., Travel information API)

[0246] External sources of product conditions: Product information API (e.g., Web Special Offers API), Map information API (e.g., Map Service API)

[0247] The server is implemented using Node.js and Express, and the acquired information is stored in a database such as MongoDB, which centralizes the information and responds quickly to required processing.

[0248] Using the retrieved information, the server generates optimal itineraries and product listings using an AI model built using Tensorflow® and PyTorch, which takes into account factors such as cost, travel time, convenience, ratings, and popularity.

[0249] 4. AI-generated plans

[0250] The AI ​​model will learn and generate a plan based on the following prompt:

[0251] Example prompt for generating a travel plan: "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring."

[0252] Example prompt for generating a product list: "Create a list of reliable stores for the latest smartphones within a budget of ¥20,000."

[0253] The generated travel plan and product list are sent from the server to the user terminal and presented to the user.

[0254] 5. Reservation and purchase procedures

[0255] The user selects from the list of plans and products presented and sends the selection information to the server. The server then executes the reservation or purchase procedure via the API and sends a confirmation to the user if successful.

[0256] This system not only allows users to plan their trips quickly and efficiently, but also allows them to enjoy the best possible shopping experience in physical stores.

[0257] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0258] Step 1:

[0259] Users use an application installed on their smartphone or smart glasses to input travel and product requirements. For example, they might input, "I want to go to Tokyo, my budget is 100,000 yen, and I want to bathe in hot springs," or "I want to buy the latest smartphone within a budget of 20,000 yen."

[0260] Input: Travel terms or product terms

[0261] Output: Data of the entered conditions

[0262] Step 2:

[0263] The terminal temporarily stores the conditions entered by the user, converts them into an appropriate format, and prepares to send them to the server.

[0264] Input: Data for the entered conditions

[0265] Data processing: Data format conversion

[0266] Output: Format converted condition data

[0267] Step 3:

[0268] The server receives the condition data sent by the user and analyzes it. Analysis is the process of extracting necessary key elements from the conditions.

[0269] Input: Format converted condition data

[0270] Data analysis: Extraction of key elements (e.g., "Tokyo," "under 100,000 yen," "hot springs," etc.)

[0271] Output: Data with key elements extracted

[0272] Step 4:

[0273] The server accesses relevant external information sources (APIs) based on the key elements to obtain the necessary travel and product information. External information sources include travel information APIs, product information APIs, map service APIs, etc.

[0274] Input: Data from which key elements have been extracted

[0275] Data Acquisition: Acquiring information from external APIs

[0276] Output: Retrieved travel and product information

[0277] Step 5:

[0278] The server uses the acquired information to generate optimal travel plans and product listings using an AI model that takes into account factors such as cost, travel time, convenience, ratings, and popularity.

[0279] Input: Travel and product information obtained

[0280] Data Computation: Plan Generation Using AI Models

[0281] Output: Generated itinerary and product list

[0282] Step 6:

[0283] The server sends the generated travel plan and product list to the user's terminal, and the user selects the desired plan and product based on the presented information.

[0284] Input: Generated itinerary and product list

[0285] Data transmission: Sending information to the user terminal

[0286] Output: Plans and product list presented to the user

[0287] Step 7:

[0288] The user selects the desired travel plan or product from the presented list, and transmits the selected information from the terminal to the server.

[0289] Input: The plan or product selected by the user

[0290] Data transmission: Sends selected information to the server

[0291] Output: Information about the selected plan and product

[0292] Step 8:

[0293] The server performs reservation and purchase procedures based on the selected plan and product, using APIs such as accommodation reservation API, transportation reservation API, and product purchase API.

[0294] Input: Selected plan and product information

[0295] Data calculation and processing: Execution of reservation and purchase procedures

[0296] Output: Reservation confirmation information or purchase confirmation information

[0297] Step 9:

[0298] The server transmits reservation confirmation information and purchase confirmation information to the user terminal and displays the confirmed details to the user.

[0299] Input: Reservation confirmation information, purchase confirmation information

[0300] Data transmission: Send confirmation information to the user's device

[0301] Output: Confirmation to the user (e.g. "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX.")

[0302] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0303] The present invention aims to provide an optimal travel plan that takes into account the user's emotional state by combining an AI service system that automatically handles everything from travel planning to booking, with an emotion engine. Specific embodiments of the present invention are described below.

[0304] System Overview

[0305] In this system, users input their desired travel conditions from their terminal, and the server generates the optimal travel plan based on that information and completes the booking procedure. Furthermore, the system is configured so that an emotion engine recognizes the user's emotions and reflects them in the generation and proposal of travel plans. The main components are the user terminal, server, external information source (API), and emotion engine.

[0306] User processing

[0307] 1. User:

[0308] Users input their desired travel conditions into an input form on their device, including the places they want to go, their budget, the activities they want to do, and the accommodations they want.

[0309] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0310] 2. Terminal:

[0311] Temporarily saves the conditions entered by the user and prepares them for sending to the server. Converts the conditions into an appropriate format and sends the data to the server.

[0312] Emotion recognition by emotion engine

[0313] 1. Device:

[0314] When a user inputs information, the device uses a camera and microphone to recognize the user's emotions in real time from facial expressions and voice.

[0315] 2. Emotion Engine:

[0316] The emotional information sent from the device is analyzed to determine the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.).

[0317] Server-side processing

[0318] 1. Server:

[0319] The server receives the conditions and emotional information sent by the user. It parses (analyzes) the received data and extracts key elements. For example, "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[0320] 2. Integration with external APIs:

[0321] Based on the extracted conditions and emotion information, the server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain related travel information.

[0322] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[0323] 3. AI-powered optimal travel plan generation:

[0324] Based on the acquired information and the user's emotional state, the AI ​​model generates multiple travel plans, evaluating each plan's elements (cost, travel time, convenience, etc.) to create the optimal plan that best suits the user's emotional state.

[0325] For example, generate Plan A and Plan B as shown below.

[0326] Plan A: If you are currently feeling excited, this plan includes a lot of active activities. It includes a Shinkansen (round trip: 20,000 yen), a 3-star hotel A (2 nights: 40,000 yen), a hot spring tour (10,000 yen), and a sightseeing tour (15,000 yen), for a total of 85,000 yen.

[0327] Plan B: If you are currently feeling emotionally exhausted, this plan includes a lot of relaxing activities. It includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen), for a total of 90,000 yen.

[0328] 4. Present to the user:

[0329] The server transmits the generated travel plans to the user terminal.

[0330] The user terminal displays the plans to the user, allowing the user to select one.

[0331] Processing reservations

[0332] 1. User:

[0333] The user selects a desired plan from the presented plans and sends a reservation request.

[0334] For example, the user selects "Plan A."

[0335] 2. Terminal:

[0336] The user's selection information is sent to the server.

[0337] 3. Server:

[0338] Check the details of the selected plan and make the reservation by sending a request to the accommodation booking API or transportation booking API.

[0339] If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[0340] 4. User confirmation:

[0341] The server sends the reservation confirmation information received from the external API to the user terminal.

[0342] The user terminal displays confirmation information to the user, such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0343] This series of processes allows the user to quickly obtain the optimal travel plan based on their desired conditions, and also allows the user to effortlessly propose and book a plan that takes into account their emotional state.

[0344] The processing flow will be explained below.

[0345] Step 1:

[0346] The user enters their desired travel conditions into an input form on the terminal, including the place they want to go, their budget, the activities they want to do, and the conditions for the accommodation they want.

[0347] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0348] Step 2:

[0349] The terminal temporarily stores the conditions entered by the user and prepares to send them to the server, converts the conditions into an appropriate format, and sends the data to the server.

[0350] Step 3:

[0351] The device uses the device's camera and microphone to capture the user's facial expressions and voice in real time during input.

[0352] Step 4:

[0353] An emotion engine analyzes the captured facial expressions and voice to identify the user's current emotional state.

[0354] For example, if the user is smiling, it is identified as "excited," and if the user is frowning, it is identified as "fatigue."

[0355] Step 5:

[0356] The terminal transmits the user's input travel desires and the emotional state identified by the emotion engine to the server.

[0357] Step 6:

[0358] The server receives the conditions and emotion information sent by the user, parses the received data, and extracts key elements.

[0359] For example, information such as "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excited."

[0360] Step 7:

[0361] The server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs based on the extracted conditions and emotion information to obtain related travel information.

[0362] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[0363] Step 8:

[0364] The server uses an AI model to generate multiple travel plans based on the acquired information, evaluating each plan's elements (cost, travel time, convenience, etc.) and constructing the optimal plan that matches the user's emotional state.

[0365] For example, a plan including many active activities is generated for a user in an "excited" state, and a plan including many relaxing activities is generated for a user in a "fatigued" state.

[0366] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star Hotel A (40,000 yen for 2 nights), hot spring tour (10,000 yen) and sightseeing tour (15,000 yen) for a total of 85,000 yen.

[0367] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0368] Step 9:

[0369] The server transmits the generated travel plans to the user terminal.

[0370] The terminal displays the plans to the user and allows the user to select one.

[0371] Step 10:

[0372] The user selects a desired plan from the presented plans and sends a reservation request.

[0373] For example, the user selects "Plan A."

[0374] Step 11:

[0375] The terminal transmits the user's selection information to the server.

[0376] Step 12:

[0377] The server checks the details of the selected plan and makes the reservation by sending a request to the accommodation reservation API or transportation reservation API.

[0378] Step 13:

[0379] The external API successfully completes the reservation process and sends the reservation confirmation information back to the server.

[0380] Step 14:

[0381] The server sends the reservation confirmation information received from the external API to the user terminal.

[0382] Step 15:

[0383] The terminal displays a confirmation to the user, notifying them of a successful reservation.

[0384] For example, it will say, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0385] Through this series of processes, users can quickly obtain the optimal travel plan based on their desired conditions and emotional state, and can complete their travel reservations without any hassle.

[0386] Example 2

[0387] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0388] Conventional travel plan generation systems create travel plans based solely on the user's desired conditions, without taking the user's emotional state into consideration, making it difficult to provide optimal plans. Furthermore, the technology for efficiently managing and processing data obtained from multiple external information sources was immature, making it difficult to increase user satisfaction. Therefore, there is a need for a system that takes the user's emotional state into consideration and provides optimal travel plans.

[0389] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0390] In this invention, the server includes means for inputting the conditions of a user's desired trip, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions and emotional information from the terminal, means for an AI model to generate an optimal trip plan using the acquired information and the user's emotional information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, and means for transmitting reservation confirmation information to the user. This makes it possible to provide an optimal trip plan that takes into account the user's emotional state.

[0391] "User" refers to an individual or group that uses the system to input desired travel conditions, select a travel plan, and complete the booking process.

[0392] "Travel criteria" refers to parameters such as a traveler's desired destination, budget, activities, and type of accommodation.

[0393] "Terminal" refers to the device (smartphone, tablet, PC, etc.) used by the user to enter desired travel conditions and communicate with the server.

[0394] "Server" refers to the computer system that processes data received from users, communicates with external sources, and generates optimal travel plans.

[0395] "Emotional information" refers to the emotional state (joy, excitement, anxiety, fatigue, etc.) obtained by analyzing the user's facial expressions and voice, which are acquired from the camera and microphone installed on the device.

[0396] "External sources" refers to external databases or APIs that provide information on transportation, accommodation, activities, etc.

[0397] "AI model" refers to algorithms and programs that use artificial intelligence technology to generate optimal travel plans based on users' desired conditions and emotional information.

[0398] A "travel plan" refers to a travel proposal consisting of a combination of transportation, accommodation, and activities, created based on the user's desired conditions and emotional information.

[0399] "Booking Process" refers to the accommodation and transport booking process carried out with an external source based on the selected travel plan.

[0400] "Reservation confirmation information" refers to information such as reservation details and confirmation number provided to a user after completing the reservation process.

[0401] The present invention is a system for generating and providing an optimal travel plan based on a user's desired conditions and taking into consideration the user's emotional information. Specific embodiments for carrying out the present invention will be described below.

[0402] User processing

[0403] 1. User:

[0404] The user enters desired travel conditions into an input form on the terminal. For example, the conditions might be, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a hotel with 3 stars or more."

[0405] 2. Terminal:

[0406] The device temporarily stores the desired conditions entered by the user and prepares to send them to the server. At this time, the data is converted into an appropriate format (for example, JSON format) and sent to the server.

[0407] Emotion recognition by emotion engine

[0408] 1. Device:

[0409] When the user inputs travel conditions, the device uses the device's built-in camera and microphone to collect the user's emotions in real time from facial expressions and voice.

[0410] 2. Emotion Engine:

[0411] The emotional information transmitted from the terminal is analyzed to determine the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.), which is reflected in the generation of a travel plan.

[0412] Server-side processing

[0413] 1. Server:

[0414] The server receives the conditions and emotional information sent by the user, analyzes the data, and extracts key elements, such as "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[0415] 2. Collaboration with external sources:

[0416] Based on the extracted conditions and emotion information, the server sends requests to external transport information APIs, accommodation APIs, and activity information APIs to obtain related travel information. For example, a search for "hot springs in Tokyo" is performed using the TripAdvisor API, and transportation methods to Tokyo are obtained using the Google Maps API. Furthermore, a hotel search API is used to obtain information on hotels with three or more stars in Tokyo.

[0417] 3. Generating optimal travel plans using AI models:

[0418] The server uses the acquired travel information and the user's emotional information to generate multiple travel plans using a generative AI model. It evaluates the elements of each plan (cost, travel time, convenience, etc.) and constructs the optimal plan that matches the user's emotional state. For example, it generates Plan A and Plan B as follows:

[0419] Plan A: If you are currently feeling excited, this plan includes a lot of active activities. It includes a Shinkansen (round trip: 20,000 yen), a 3-star hotel A (2 nights: 40,000 yen), a hot spring tour (10,000 yen), and a sightseeing tour (15,000 yen), for a total of 85,000 yen.

[0420] Plan B: If you are currently feeling emotionally exhausted, this plan includes a lot of relaxing activities. It includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen), for a total of 90,000 yen.

[0421] 4. Server Presentation:

[0422] The server transmits the generated itineraries to the user terminal, which displays them to the user and allows the user to select one.

[0423] Processing reservations

[0424] 1. User:

[0425] The user selects the desired plan from the presented plans and submits a reservation request. For example, the user selects "Plan A."

[0426] 2. Terminal:

[0427] The user's selection information is sent to the server.

[0428] 3. Server:

[0429] The server checks the details of the selected plan and sends a request to the accommodation booking API or transportation booking API to complete the reservation. If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[0430] 4. Provide Verification Information:

[0431] The server sends the reservation confirmation information received from the external API to the user's terminal. The terminal displays the confirmation information to the user, displaying a message such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0432] Examples and prompts

[0433] Specific examples

[0434] If a user inputs "I want to go to Kyoto. My budget is 50,000 yen. I want to visit temples. I want to stay in a two-star or higher accommodation," the system will generate a plan like this:

[0435] Plan A: If you are currently feeling excited, this plan includes active activities. It includes a Shinkansen (round trip 10,000 yen), a two-star accommodation A (20,000 yen for two nights), and a temple tour (5,000 yen), for a total of 35,000 yen.

[0436] Plan B: If you are currently feeling emotionally exhausted, this plan includes relaxing activities. It includes bus travel (5,000 yen round trip), two-star accommodation B (15,000 yen for two nights), and a relaxing temple tour (5,000 yen), for a total of 25,000 yen.

[0437] Prompt statement

[0438] Example of an input prompt for a generative AI model:

[0439] "The user wants to travel to Kyoto, with a budget of 50,000 yen or less, and wants to visit temples. He also wants accommodations that are at least two stars. Based on these conditions and the user's current emotional state, generate the optimal travel plan."

[0440] With the above configuration, the user can quickly obtain the most suitable travel plan and can easily make suggestions and reservations that take into account the user's own emotional state.

[0441] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0442] Step 1:

[0443] User input of desired travel conditions

[0444] The user enters their desired travel conditions (e.g., "I want to go to Tokyo. My budget is within 100,000 yen. I want to bathe in hot springs. I want to stay in a three-star or higher hotel.") into an input form on the device. This input data includes travel destination, budget, desired activities, and accommodation conditions. The device receives the input from the user and temporarily stores it.

[0445] Input: Travel requirements (destination, budget, activities, accommodation requirements)

[0446] Output: Temporarily saved travel preferences

[0447] Step 2:

[0448] Terminal receives data and prepares it for transmission

[0449] The device temporarily stores the desired conditions entered by the user, converts the data into an appropriate format (for example, JSON format), and sends the converted data to the server.

[0450] Input: Temporarily saved travel preferences

[0451] Output: The transformed data to send to the server.

[0452] Step 3:

[0453] Collecting emotional information from devices

[0454] While the user is entering travel information, the device's built-in camera and microphone are used to collect emotional information from the user's facial expressions and voice in real time, which is then analyzed later.

[0455] Input: User's facial and voice data

[0456] Output: Collected emotion information

[0457] Step 4:

[0458] Emotion recognition by emotion engine

[0459] The device sends the collected emotional information to the emotion engine, which analyzes it and determines the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.).

[0460] Input: Collected emotion information

[0461] Output: Parsed emotional state

[0462] Step 5:

[0463] Data reception and analysis by the server

[0464] The server receives the user's desired conditions and emotional information sent from the device. It analyzes the received data and extracts key elements necessary for generating a travel plan. Specifically, these elements include "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[0465] Input: User's desired conditions, analyzed emotional state

[0466] Output: Extracted elements

[0467] Step 6:

[0468] Server-based linkage with external information sources and information acquisition

[0469] Based on the analyzed conditions and sentiment information, the server sends requests to external information sources (APIs) such as transportation information, accommodations, and activities to obtain related travel information. For example, a search for "hot springs in Tokyo" can be performed using TripAdvisor's API, transportation methods to Tokyo can be obtained using Google Maps' API, and hotel search APIs can be used to obtain information on hotels with three or more stars.

[0470] Input: Extracted elements

[0471] Output: Acquired travel information (traffic information, accommodation information, activity information)

[0472] Step 7:

[0473] Generate optimal travel plans using AI models

[0474] The server uses a generative AI model to generate multiple travel plans based on the acquired travel information and the user's emotional information. It evaluates the elements of each plan (cost, travel time, convenience, etc.) and creates the optimal plan that matches the user's emotions. For example, if the user is currently excited, it will generate a plan that includes many active activities, and if the user is tired, it will generate a relaxing plan.

[0475] Input: Acquired travel information, user's emotional information

[0476] Output: Multiple generated itineraries

[0477] Step 8:

[0478] Server sends plan to user device

[0479] The server sends the generated travel plans to the user's terminal, which displays them to the user and allows the user to select one of the plans.

[0480] Input: Multiple generated itineraries

[0481] Output: The travel plan sent to the user's device

[0482] Step 9:

[0483] User selects plan and submits reservation request

[0484] The user selects the desired plan from the presented plans and sends a reservation request from the terminal to the server. For example, the user selects "Plan A."

[0485] Input: User selects plan

[0486] Output: Reservation request data

[0487] Step 10:

[0488] Receiving reservation information by the terminal and sending it to the server

[0489] The terminal receives reservation information for the plan selected by the user and transmits it to the server.

[0490] Input: User selected plan information

[0491] Output: Reservation information sent to the server

[0492] Step 11:

[0493] Server executes reservation procedure

[0494] The server sends a request to the accommodation booking API or transportation booking API based on the selected plan and makes the reservation. If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[0495] Input: Reservation information sent to the server

[0496] Output: Reservation confirmation information

[0497] Step 12:

[0498] The server creates reservation confirmation information and sends it to the user's device

[0499] The server creates confirmation information to provide to the user based on the reservation confirmation information received from the external API, and sends this confirmation information to the user's terminal.

[0500] Input: Reservation confirmation information

[0501] Output: Reservation confirmation information sent to the user's terminal

[0502] Step 13:

[0503] Displaying reservation confirmation information to the user via the terminal

[0504] The terminal displays the reservation confirmation information received from the server to the user. For example, a message such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0505] Input: Reservation confirmation information sent to the user's terminal

[0506] Output: Booking confirmation information displayed to the user

[0507] (Application example 2)

[0508] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0509] Conventional travel plan generation systems do not take into account the user's emotional state, making it difficult to generate travel plans that are suitable for users who are tired or want to relax. Furthermore, plans are not adjusted in real time based on the user's emotions, which can lead to a decrease in user satisfaction. Therefore, there is a need for flexible travel plans that reflect the user's emotional state.

[0510] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0511] In this invention, the server includes means for inputting the user's desired travel conditions, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions, means for an AI model to generate an optimal travel plan using the acquired information, means for presenting the generated multiple travel plans to the user, means for completing a reservation procedure based on the travel plan selected by the user, means for transmitting reservation confirmation information to the user, and means for recognizing the user's emotional state using a camera and microphone mounted on the vehicle and reflecting the recognized emotional state in the travel plan. This makes it possible to generate and present an optimal travel plan that takes the user's emotional state into consideration and adjust the travel plan in real time.

[0512] "User" means an individual who uses the System to plan and book a trip.

[0513] "Conditions" refers to information that indicates the specific elements of a user's desired trip, including destination, budget, activities, accommodation requirements, etc.

[0514] "Server" refers to a central processing unit that retrieves data from external sources based on the conditions sent by the user, generates optimal travel plans using AI models, and makes proposals and reservations for the user.

[0515] "Means" refer to equipment, software, processes, etc. used to achieve a specific function.

[0516] "External sources" refers to external databases or APIs that provide information on transportation, accommodation, activities, etc.

[0517] "Travel Information" means travel-related data obtained from external sources, such as information about transportation, accommodation, activities, etc.

[0518] An "AI model" is an algorithm that learns from large amounts of data and generates optimal travel plans based on specific conditions.

[0519] The "camera" is a photographing device for capturing the user's facial expressions in real time.

[0520] A "microphone" is a recording device that captures the user's voice in real time.

[0521] "Emotional state" is information that indicates the user's psychological state, and refers to emotions recognized from facial expressions and voice (e.g., joy, excitement, anxiety, fatigue, etc.).

[0522] "Itinerary" refers to detailed travel recommendations generated based on the user's criteria and emotional state, such as combinations of destinations, transportation, accommodations, and activities.

[0523] "Reservation process" means the process of officially booking accommodation and transportation based on the travel plan selected by the User.

[0524] "Reservation confirmation information" refers to information sent to the user after the reservation procedure is completed that confirms and certifies the reservation details.

[0525] System configuration

[0526] This invention is an AI service system for autonomous vehicles that automatically handles everything from travel planning to booking, and by combining it with an emotion engine, it provides optimal travel plans that take into account the user's emotional state. The system consists of the following elements:

[0527] 1. User terminal

[0528] This is a device where users input their desired travel conditions. It is installed in the infotainment system of an autonomous vehicle and includes a display that can be operated by voice or touch panel.

[0529] 2. Server

[0530] It is a central processing unit that obtains travel information from external sources based on conditions sent by users and generates optimal travel plans using AI models.

[0531] 3. External information sources (API)

[0532] These are external databases and services that provide information on transportation, accommodation, activities, etc., and work in conjunction with the server to provide travel information.

[0533] 4. Emotion Engine

[0534] The engine uses cameras and microphones installed in the vehicle to recognize the emotional state of the user from their facial expressions and voice. The recognized emotional state is reflected in the generation and adjustment of the travel plan.

[0535] Program processing

[0536] 1. The user enters the conditions

[0537] Passengers input their travel preferences via the autonomous vehicle's infotainment system, including where they want to go, their budget, the activities they want to do, and their preferred accommodations.

[0538] 2. Recognizing emotional states

[0539] Cameras and microphones installed in the vehicle capture the user's facial expressions and voice, which are then analyzed by an emotion engine to recognize the user's emotional state.

[0540] 3. Processing on the Server

[0541] The server receives the user's input conditions and the recognized emotional state, and based on this, retrieves the necessary travel information from external sources, such as transportation information API, accommodation information API, and activity information API.

[0542] Based on the acquired information, the AI ​​model generates an optimal travel plan, taking into account the perceived emotional state and designing a plan that meets the user's psychological needs.

[0543] 4. Presenting your travel plans

[0544] The server then sends the generated itineraries to the vehicle's infotainment system, where the user can view them on the display and select the one they want.

[0545] 5. Completing the reservation process

[0546] Based on the travel plan selected by the user, the server processes the reservation of accommodation and transportation. The reservation confirmation information is sent back to the vehicle's system for the user to check.

[0547] Specific examples

[0548] For example, if a user inputs, "I want to go to Nara. My budget is within 50,000 yen. I want to visit temples. I want accommodations that are two stars or higher," and the server recognizes that the user's emotional state is relaxed, the server will generate multiple travel plans, such as a "relaxing temple tour course" and a "course with a relaxing hot spring."

[0549] Prompt example (text format)

[0550] The following information is required to generate your itinerary:

[0551] Places I want to go: Nara

[0552] Budget: Under 50,000 yen

[0553] Favorite activity: Visiting temples

[0554] Accommodation requirements: 2 stars or more

[0555] Current emotional state: Relaxed

[0556] Generate the best itinerary based on this criteria.

[0557] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0558] Step 1:

[0559] The user enters the conditions

[0560] Users use the infotainment system of the autonomous vehicle to input their travel preferences, including desired destinations, budget, desired activities, accommodation requirements, etc. The input data is temporarily stored on the vehicle terminal and used for subsequent processing.

[0561] Input: User's travel requirements (destination, budget, activities, accommodation requirements, etc.)

[0562] Output: Saved user travel preferences

[0563] Step 2:

[0564] Recognition of emotional states

[0565] The vehicle's onboard camera and microphone capture the user's facial expressions and voice. The emotion engine analyzes this data and recognizes the user's current emotional state, which is then used in the next step.

[0566] Input: facial and voice data captured from the camera and microphone

[0567] Output: Perceived user emotional state (e.g., relaxed, excited, anxious, etc.)

[0568] Step 3:

[0569] Receiving conditions and emotional states on the server

[0570] The terminal transmits the user's input travel preferences and the recognized emotional state to the server, which receives and analyzes the data. The received data is used for subsequent data acquisition and plan generation.

[0571] Input: User's travel preferences and perceived emotional state

[0572] Output: Analyzed condition and emotional state data

[0573] Step 4:

[0574] Obtaining travel information

[0575] The server retrieves travel information from external sources based on the analyzed conditions and emotional state, specifically by sending requests to APIs for transportation information, accommodation information, and activity information to obtain the necessary data.

[0576] Input: Analyzed travel preferences and emotional state

[0577] Output: Travel information obtained from external sources (transportation, accommodation, and activity details)

[0578] Step 5:

[0579] Generate a travel plan

[0580] The server uses an AI model to generate an optimal travel plan based on the acquired travel information and the user's emotional state. The AI ​​model evaluates factors such as cost, travel time, and convenience, and creates multiple plans. The generated plan is adjusted to match the user's emotional state.

[0581] Input: Acquired travel information and emotional state data

[0582] Output: Multiple generated itineraries

[0583] Step 6:

[0584] Presenting your travel plan

[0585] The server sends the generated travel plan to the user's terminal, which receives it and displays it on the vehicle's display. The user can then compare the plans and select one.

[0586] Input: Generated itinerary

[0587] Output: Travel plan displayed on user's device

[0588] Step 7:

[0589] Completing the reservation process

[0590] Based on the travel plan selected by the user, the server processes the reservation of accommodation and transportation, sends a request to an external API, and executes the reservation process. The reservation confirmation information is sent back to the vehicle's system and displayed to the user.

[0591] Input: Travel plan selected by user

[0592] Output: Confirmation of completed booking

[0593] Step 8:

[0594] Real-time adjustment based on emotional state

[0595] As the travel plan progresses, the user's emotional state is monitored in real time. If a change in emotional state is detected, the server adjusts the plan as needed to ensure the user has an optimal experience. This adjustment is made by obtaining additional information from external sources.

[0596] Input: User's real-time emotional state

[0597] Output: Coordinated itinerary and activities

[0598] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0599] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0600] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0601] [Second embodiment]

[0602] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0603] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0604] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0605] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0606] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0607] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0608] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0609] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0610] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0611] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0612] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0613] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0614] The present invention is an AI service system that automatically performs the entire process from planning to booking a trip. Specific embodiments of the present invention will be described below.

[0615] System Overview

[0616] In this system, users input their desired travel conditions from their terminal, and the server generates the optimal travel plan based on that information and completes the booking process.The main components are the user terminal, the server, and an external information source (API).

[0617] User processing

[0618] 1. User:

[0619] Users input their desired travel conditions into an input form on their device, including the places they want to go, their budget, the activities they want to do, and the accommodations they want.

[0620] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0621] 2. Terminal:

[0622] The conditions entered by the user are temporarily saved and prepared for transmission to the server.

[0623] Convert the conditions into an appropriate format and send the data to the server.

[0624] Server-side processing

[0625] 1. Server:

[0626] The server receives the conditions sent by the user.

[0627] The received data is parsed and key elements are extracted, such as keywords like "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 stars or more."

[0628] 2. Integration with external APIs:

[0629] The server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain the necessary information.

[0630] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[0631] 3. AI-powered optimal travel plan generation:

[0632] Based on the acquired information, the AI ​​model generates multiple travel plans, taking into account relevant factors (cost, travel time, convenience, etc.) to create the optimal plan.

[0633] For example, generate Plan A and Plan B as shown below.

[0634] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[0635] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0636] 4. Present to the user:

[0637] The server transmits the generated travel plans to the user terminal.

[0638] The user terminal displays the plans and allows the user to select one.

[0639] Processing reservations

[0640] 1. User:

[0641] The user selects a desired plan from the presented plans and sends a reservation request.

[0642] For example, the user selects "Plan A."

[0643] 2. Terminal:

[0644] The user's selection information is sent to the server.

[0645] 3. Server:

[0646] Check the details of the selected plan and make the reservation by sending a request to the accommodation booking API or transportation booking API.

[0647] If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[0648] 4. User confirmation:

[0649] The server sends the reservation confirmation information received from the external API to the user terminal.

[0650] The user terminal displays confirmation information to the user, such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0651] This system allows users to quickly obtain the optimal travel plan based on their desired conditions, and complete travel reservations hassle-free.

[0652] The processing flow will be explained below.

[0653] Step 1:

[0654] The user enters their desired travel conditions into an input form on the terminal, including the place they want to go, their budget, the activities they want to do, and the conditions for the accommodation they want.

[0655] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0656] Step 2:

[0657] The terminal temporarily stores the conditions entered by the user and prepares to send them to the server, converts the conditions into an appropriate format, and sends the data to the server.

[0658] Step 3:

[0659] The server receives the conditions sent by the user. It parses (analyzes) the received data and extracts key elements. For example, keywords such as "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 stars or more."

[0660] Step 4:

[0661] Based on the extracted conditions, the server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain related travel information.

[0662] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[0663] Step 5:

[0664] The server uses an AI model to generate multiple travel plans based on the acquired information, and creates the optimal plan by taking into account factors for each plan (cost, travel time, convenience, etc.).

[0665] For example, generate Plan A and Plan B as shown below.

[0666] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[0667] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0668] Step 6:

[0669] The server transmits the generated travel plans to the user's terminal.

[0670] The terminal displays the plans to the user and allows the user to select one.

[0671] Step 7:

[0672] The user selects a desired plan from the presented plans and sends a reservation request.

[0673] For example, the user selects "Plan A."

[0674] Step 8:

[0675] The terminal transmits the user's selection information to the server.

[0676] Step 9:

[0677] The server checks the details of the selected plan and makes the reservation by sending a request to the accommodation reservation API or transportation reservation API.

[0678] Step 10:

[0679] The external API successfully completes the reservation process and sends the reservation confirmation information back to the server.

[0680] Step 11:

[0681] The server sends the reservation confirmation information received from the external API to the user's device.

[0682] Step 12:

[0683] The terminal displays a confirmation to the user, notifying them of a successful reservation.

[0684] For example, it will say, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0685] This series of processes allows the user to quickly obtain the optimal travel plan based on their desired conditions, and complete their travel reservation without any hassle.

[0686] Example 1

[0687] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0688] A problem with conventional travel planning and reservation systems is that users have to conduct their own research and find a plan that meets their requirements, which requires a lot of time and effort. It is also difficult to manually assemble an optimal plan by collecting information from multiple sources. Another problem is that errors are likely to occur during the reservation process, resulting in a poor user experience. The purpose of this invention is to automate the entire process from travel planning to booking, reducing users' time and effort, and providing more efficient travel plans and accurate reservation procedures.

[0689] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0690] In this invention, the server includes means for inputting the conditions of a user's desired trip, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions, means for a generative AI model to generate an optimal trip plan using the acquired information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, means for transmitting reservation confirmation information to the user, means for analyzing received data using the input conditions as a key and extracting relevant elements, and a generative AI model that creates multiple trip plans based on the acquired information and evaluates each plan taking into account its details (cost, travel time, convenience).This enables users to efficiently and quickly obtain optimal trip plans and complete the reservation procedure with fewer errors.

[0691] "User" means a person who uses this system to plan and book a trip.

[0692] "Conditions" refers to the desired information that a user enters for travel planning (e.g., travel destination, budget, activities, accommodation requirements, etc.).

[0693] "Server" refers to a central processing unit that retrieves information from relevant external sources based on the input conditions, generates a travel plan using an AI model, and processes the reservation.

[0694] "External information source" refers to an external information system that provides transportation information, accommodation information, activity information, etc.

[0695] An "AI model" is an artificial intelligence algorithm that generates optimal travel plans based on acquired travel information.

[0696] "Travel Plan" refers to multiple travel suggestions generated by an AI model and presented to users.

[0697] The "reservation procedure" is a process for finalizing various reservations based on the travel plan selected by the user.

[0698] "Reservation confirmation information" is confirmation information sent to the user when the reservation procedure is completed, and includes reservation details.

[0699] "Analysis" refers to the process in which the server receives the input conditions and extracts the necessary information.

[0700] "Evaluation" is the process of determining how optimal the generated travel plan is in terms of cost, travel time, and convenience.

[0701] MODE FOR CARRYING OUT THE INVENTION

[0702] The present invention is an AI service system that automatically performs everything from planning to booking a trip. A specific embodiment of this system will be described below.

[0703] System Overview

[0704] In this system, users input their desired travel conditions from their devices, and the server then generates an optimal travel plan based on that information and completes the booking process. The main components are the user device, the server, and an external information source (API). The hardware used includes general computers and communication networks, while the software includes an AI model, an API client, and a data analysis tool.

[0705] User processing

[0706] 1. User:

[0707] The user enters their desired travel conditions into an input form on the terminal, including the desired destination, budget, activities they would like to do, and accommodation requirements.

[0708] For example, enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0709] 2. Terminal:

[0710] The device temporarily saves the conditions entered by the user, converts the input data into JSON format, and prepares to send it to the server.

[0711] Specifically, the conditions are converted into an appropriate format and sent to the server as an HTTP request.

[0712] Server-side processing

[0713] 1. Server:

[0714] The server receives the condition data sent by the user, analyzes it using a JSON parser, and extracts key elements, such as keywords like "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 or more stars."

[0715] 2. Integration with external APIs:

[0716] The server obtains information by sending requests to external traffic information APIs, accommodation APIs, and activity information APIs.

[0717] External information sources include a traffic information API, accommodation API, and activity information API, from which the necessary information is obtained.

[0718] As a concrete example, you can request information on "three-star or higher hotels in Tokyo" from the accommodation API, and request "transportation methods to Tokyo (bullet train, airplane, etc.)" from the transportation information API.

[0719] 3. AI-powered travel plan generation:

[0720] The server generates multiple itineraries using a generative AI model based on information obtained from external APIs. The AI ​​model evaluates the itineraries based on cost, travel time, and convenience, and generates the optimal itinerary.

[0721] For example, the AI ​​model generates Plan A and Plan B as follows:

[0722] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[0723] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0724] 4. Present to the user:

[0725] The server sends the generated travel plans to the user terminal, and the user can select one of the plans presented.

[0726] Processing reservations

[0727] 1. User:

[0728] The user selects the desired plan from the presented plans and submits a reservation request. For example, the user selects "Plan A."

[0729] 2. Terminal:

[0730] The terminal transmits information about the plan selected by the user to the server.

[0731] 3. Server:

[0732] The server checks the details of the selected plan and sends a reservation request to the accommodation booking API and the transport booking API. For example, it reserves "two nights at a three-star hotel A" with the accommodation booking API and reserves "round-trip Shinkansen tickets" with the transport booking API.

[0733] 4. User confirmation:

[0734] The server receives the reservation confirmation information from the external API and sends it to the user's terminal. A confirmation message is displayed saying, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0735] Specific examples

[0736] Travel planning prompts:

[0737] I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a 3-star or higher hotel.

[0738] Booking confirmation prompt:

[0739] I have selected Plan A. Please proceed with your reservation.

[0740] This system allows users to efficiently obtain the best travel plan based on their desired conditions and complete travel reservations hassle-free.

[0741] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0742] Step 1:

[0743] Input: The user enters their travel preferences (destination, budget, activities, accommodation requirements, etc.) into the device.

[0744] Specific operation: The user enters the following into the input form on the device: "I want to go to Tokyo. My budget is within 100,000 yen. I want to go to a hot spring. I want to stay in a hotel with 3 stars or more."

[0745] Output: The user's input data is saved to the terminal.

[0746] Step 2:

[0747] Input: User input data that is saved.

[0748] Specific operation: The terminal converts the data entered by the user into JSON format and prepares to send it to the server. Specific data format conversion processing is performed.

[0749] Output: JSON formatted trip conditions data.

[0750] Step 3:

[0751] Input: Trip conditions data in JSON format.

[0752] Specific operation: The device sends the converted JSON data to the server as an HTTP request.

[0753] Output: The server receives the JSON data.

[0754] Step 4:

[0755] Input: JSON formatted travel conditions data received by the server.

[0756] Specific operation: The server uses a JSON parser to parse the user's search criteria data. Specifically, it extracts keywords such as "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 or more stars."

[0757] Output: Extracted keyword data.

[0758] Step 5:

[0759] Input: Extracted keyword data.

[0760] Specific operation: The server sends requests to the traffic information API, accommodation API, and activity information API to obtain information. For example, it requests information such as "transportation to Tokyo" from the traffic information API, "three-star or higher hotels in Tokyo" from the accommodation API, and "hot springs in Tokyo" from the activity information API.

[0761] Output: Obtained external information data (information on transportation, accommodation, activities).

[0762] Step 6:

[0763] Input: Acquired external information data.

[0764] Specific operation: The server generates a travel plan using a generative AI model based on the acquired information. The AI ​​model evaluates each travel element and creates multiple travel plans. For example, it evaluates based on cost, travel time, and convenience, and generates the following Plan A and Plan B.

[0765] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[0766] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0767] Output: Multiple trip plan data.

[0768] Step 7:

[0769] Input: Multiple itinerary data.

[0770] Specific operations: The server transmits the generated travel plan to the user terminal.

[0771] Output: Travel plan data received by the user device.

[0772] Step 8:

[0773] Input: Travel plan data received by the user device.

[0774] Specific operation: The terminal displays the plans received from the server on the user interface and allows the user to select one.

[0775] Output: Multiple itineraries are displayed for the user to choose from.

[0776] Step 9:

[0777] Input: Multiple proposed travel plans.

[0778] Specific operation: The user selects the desired plan and sends a reservation request such as "Plan A has been selected. Please proceed with the reservation."

[0779] Output: Booking request data.

[0780] Step 10:

[0781] Input: Booking request data.

[0782] Specific operation: The terminal transmits the user's selection information to the server.

[0783] Output: The reservation request data received by the server.

[0784] Step 11:

[0785] Input: The reservation request data received by the server.

[0786] Specific operation: The server checks the details of the selected plan and sends a reservation request to the accommodation booking API and the transportation booking API. For example, it sends "two nights at a three-star hotel A" to the accommodation API and "round-trip Shinkansen ticket" to the transportation API.

[0787] Output: Booking result data.

[0788] Step 12:

[0789] Input: Booking result data.

[0790] Specific operation: The server receives reservation confirmation information from the external API and sends confirmation information such as "Hotel A reservation number XXX" and "Shinkansen reservation number YYY" to the user terminal.

[0791] Output: The confirmation information received by the user device.

[0792] Step 13:

[0793] Input: The confirmation information received by the user device.

[0794] Specific operation: The terminal displays the reservation confirmation information received from the server to the user, and displays a confirmation message such as "Your Shinkansen and hotel reservations have been completed. The reservation number is XXX."

[0795] Output: The booking confirmation message that is displayed to the user.

[0796] (Application example 1)

[0797] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0798] Conventional travel plan generation systems only provide plans based on travel conditions entered by the user, but lack the functionality and support to optimize the shopping experience in physical stores. In particular, they lack a mechanism to efficiently obtain information on the products and budget that users want, as well as the best stores, and to simplify the purchasing process. This means that users end up spending a lot of time and effort visiting multiple stores to find the best products and stores.

[0799] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0800] In this invention, the server includes means for inputting the conditions of a desired trip from a user, means for transmitting the input conditions to the server, means for the server to acquire travel information from related external information sources based on the conditions, means for an AI model to generate an optimal trip plan using the acquired information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, means for transmitting reservation confirmation information to the user, additional means for the user to input desired product information and budget, additional means for acquiring product information from related external information sources based on the input product conditions, additional means for generating an optimal product list and store information using the acquired product information, additional means for presenting the generated multiple product lists and store information to the user and completing a purchase procedure based on the products and store selected by the user, and additional means for transmitting the purchase confirmation information to the user. This allows users to not only plan their trip efficiently in a short amount of time, but also to simultaneously enjoy an optimal shopping experience at physical stores.

[0801] "User" refers to an individual who uses the system to input travel and shopping conditions and select the most suitable plan or product.

[0802] "Travel conditions" refers to elements related to a user's desired trip, such as destination, budget, activities to do, and desired accommodation conditions.

[0803] "Server" refers to a computer system that receives input data from users, obtains necessary information in cooperation with external information sources, generates an optimal plan using an AI model, and presents it to users.

[0804] "External information source" refers to an information source such as an external API or database that the server uses to obtain travel information or product information.

[0805] "Travel Information" refers to data collected about transportation, accommodation, and activities.

[0806] "Product information" refers to data such as the acquired product price, availability, ratings, popularity, etc.

[0807] "AI model" refers to the artificial intelligence algorithm used by the server to generate optimal plans and lists using the acquired travel and product information.

[0808] A "travel plan" refers to the optimal combination of travel schedule, course, and accommodation generated by an AI model and presented to the user.

[0809] "Product list" refers to a list generated by an AI model that includes the most suitable products and stores based on the user's desired conditions, as well as instructions on how to purchase them.

[0810] "Reservation procedure" refers to the series of processes in which a user makes reservations for accommodation, transportation, etc. based on the travel plan selected by the user.

[0811] "Purchase procedure" refers to the process of actually purchasing a product based on the product and store selected by the user.

[0812] "Reservation confirmation information" refers to information sent to a user to confirm that the reservation or purchase process has been successfully completed.

[0813] This invention is a system that automates the entire process from planning to booking a trip, as well as optimizing the shopping experience in brick-and-mortar stores. This system allows users to input their desired travel and product requirements, and then generates and presents optimal plans and product lists based on those inputs.

[0814] System configuration and operation

[0815] 1. User-side processing

[0816] Users use their smartphones or smart glasses to input their desired conditions (travel conditions or product conditions). For example, they might input, "I want to go to Tokyo, my budget is within 100,000 yen, and I want to go to a hot spring," or "I want to buy the latest smartphone within 20,000 yen."

[0817] 2. Terminal processing

[0818] The application installed on the smartphone or smart glasses temporarily stores the conditions entered by the user and prepares them to be sent to the server. This application is built using a mobile app development platform such as React Native or Flutter. It also validates the user input and displays error messages.

[0819] 3. Server-side processing

[0820] The server receives and analyzes the conditions sent by the user. It then obtains the necessary information from external sources, such as:

[0821] External sources of travel information: Transportation information API, Accommodation information API, Activity information API (e.g., Travel information API)

[0822] External sources of product conditions: Product information API (e.g., Web Special Offers API), Map information API (e.g., Map Service API)

[0823] The server is implemented using Node.js and Express, and the acquired information is stored in a database such as MongoDB, which centralizes the information and responds quickly to required processing.

[0824] Using the information obtained, the server generates optimal itineraries and product listings using an AI model built using TensorFlow and PyTorch that takes into account factors such as cost, travel time, convenience, ratings, and popularity.

[0825] 4. AI-generated plans

[0826] The AI ​​model will learn and generate a plan based on the following prompt:

[0827] Example prompt for generating a travel plan: "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring."

[0828] Example prompt for generating a product list: "Create a list of reliable stores for the latest smartphones within a budget of ¥20,000."

[0829] The generated travel plan and product list are sent from the server to the user terminal and presented to the user.

[0830] 5. Reservation and purchase procedures

[0831] The user selects from the list of plans and products presented and sends the selection information to the server. The server then executes the reservation or purchase procedure via the API and sends a confirmation to the user if successful.

[0832] This system not only allows users to plan their trips quickly and efficiently, but also allows them to enjoy the best possible shopping experience in physical stores.

[0833] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0834] Step 1:

[0835] Users use an application installed on their smartphone or smart glasses to input travel and product requirements. For example, they might input, "I want to go to Tokyo, my budget is 100,000 yen, and I want to bathe in hot springs," or "I want to buy the latest smartphone within a budget of 20,000 yen."

[0836] Input: Travel terms or product terms

[0837] Output: Data of the entered conditions

[0838] Step 2:

[0839] The terminal temporarily stores the conditions entered by the user, converts them into an appropriate format, and prepares to send them to the server.

[0840] Input: Data for the entered conditions

[0841] Data processing: Data format conversion

[0842] Output: Format converted condition data

[0843] Step 3:

[0844] The server receives the condition data sent by the user and analyzes it. Analysis is the process of extracting necessary key elements from the conditions.

[0845] Input: Format converted condition data

[0846] Data analysis: Extraction of key elements (e.g., "Tokyo," "under 100,000 yen," "hot springs," etc.)

[0847] Output: Data with key elements extracted

[0848] Step 4:

[0849] The server accesses relevant external information sources (APIs) based on the key elements to obtain the necessary travel and product information. External information sources include travel information APIs, product information APIs, map service APIs, etc.

[0850] Input: Data from which key elements have been extracted

[0851] Data Acquisition: Acquiring information from external APIs

[0852] Output: Retrieved travel and product information

[0853] Step 5:

[0854] The server uses the acquired information to generate optimal travel plans and product listings using an AI model that takes into account factors such as cost, travel time, convenience, ratings, and popularity.

[0855] Input: Travel and product information obtained

[0856] Data Computation: Plan Generation Using AI Models

[0857] Output: Generated itinerary and product list

[0858] Step 6:

[0859] The server sends the generated travel plan and product list to the user's terminal, and the user selects the desired plan and product based on the presented information.

[0860] Input: Generated itinerary and product list

[0861] Data transmission: Sending information to the user terminal

[0862] Output: Plans and product list presented to the user

[0863] Step 7:

[0864] The user selects the desired travel plan or product from the presented list, and transmits the selected information from the terminal to the server.

[0865] Input: The plan or product selected by the user

[0866] Data transmission: Sends selected information to the server

[0867] Output: Information about the selected plan and product

[0868] Step 8:

[0869] The server performs reservation and purchase procedures based on the selected plan and product, using APIs such as accommodation reservation API, transportation reservation API, and product purchase API.

[0870] Input: Selected plan and product information

[0871] Data calculation and processing: Execution of reservation and purchase procedures

[0872] Output: Reservation confirmation information or purchase confirmation information

[0873] Step 9:

[0874] The server transmits reservation confirmation information and purchase confirmation information to the user terminal and displays the confirmed details to the user.

[0875] Input: Reservation confirmation information, purchase confirmation information

[0876] Data transmission: Send confirmation information to the user's device

[0877] Output: Confirmation to the user (e.g. "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX.")

[0878] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0879] The present invention aims to provide an optimal travel plan that takes into account the user's emotional state by combining an AI service system that automatically handles everything from travel planning to booking, with an emotion engine. Specific embodiments of the present invention are described below.

[0880] System Overview

[0881] In this system, users input their desired travel conditions from their terminal, and the server generates the optimal travel plan based on that information and completes the booking procedure. Furthermore, the system is configured so that an emotion engine recognizes the user's emotions and reflects them in the generation and proposal of travel plans. The main components are the user terminal, server, external information source (API), and emotion engine.

[0882] User processing

[0883] 1. User:

[0884] Users input their desired travel conditions into an input form on their device, including the places they want to go, their budget, the activities they want to do, and the accommodations they want.

[0885] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0886] 2. Terminal:

[0887] Temporarily saves the conditions entered by the user and prepares them for sending to the server. Converts the conditions into an appropriate format and sends the data to the server.

[0888] Emotion recognition by emotion engine

[0889] 1. Device:

[0890] When a user inputs information, the device uses a camera and microphone to recognize the user's emotions in real time from facial expressions and voice.

[0891] 2. Emotion Engine:

[0892] The emotional information sent from the device is analyzed to determine the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.).

[0893] Server-side processing

[0894] 1. Server:

[0895] The server receives the conditions and emotional information sent by the user. It parses (analyzes) the received data and extracts key elements. For example, "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[0896] 2. Integration with external APIs:

[0897] Based on the extracted conditions and emotion information, the server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain related travel information.

[0898] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[0899] 3. AI-powered optimal travel plan generation:

[0900] Based on the acquired information and the user's emotional state, the AI ​​model generates multiple travel plans, evaluating each plan's elements (cost, travel time, convenience, etc.) to create the optimal plan that best suits the user's emotional state.

[0901] For example, generate Plan A and Plan B as shown below.

[0902] Plan A: If you are currently feeling excited, this plan includes a lot of active activities. It includes a Shinkansen (round trip: 20,000 yen), a 3-star hotel A (2 nights: 40,000 yen), a hot spring tour (10,000 yen), and a sightseeing tour (15,000 yen), for a total of 85,000 yen.

[0903] Plan B: If you are currently feeling emotionally exhausted, this plan includes a lot of relaxing activities. It includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen), for a total of 90,000 yen.

[0904] 4. Present to the user:

[0905] The server transmits the generated travel plans to the user terminal.

[0906] The user terminal displays the plans to the user, allowing the user to select one.

[0907] Processing reservations

[0908] 1. User:

[0909] The user selects a desired plan from the presented plans and sends a reservation request.

[0910] For example, the user selects "Plan A."

[0911] 2. Terminal:

[0912] The user's selection information is sent to the server.

[0913] 3. Server:

[0914] Check the details of the selected plan and make the reservation by sending a request to the accommodation booking API or transportation booking API.

[0915] If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[0916] 4. User confirmation:

[0917] The server sends the reservation confirmation information received from the external API to the user terminal.

[0918] The user terminal displays confirmation information to the user, such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0919] This series of processes allows the user to quickly obtain the optimal travel plan based on their desired conditions, and also allows the user to effortlessly propose and book a plan that takes into account their emotional state.

[0920] The processing flow will be explained below.

[0921] Step 1:

[0922] The user enters their desired travel conditions into an input form on the terminal, including the place they want to go, their budget, the activities they want to do, and the conditions for the accommodation they want.

[0923] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[0924] Step 2:

[0925] The terminal temporarily stores the conditions entered by the user and prepares to send them to the server, converts the conditions into an appropriate format, and sends the data to the server.

[0926] Step 3:

[0927] The device uses the device's camera and microphone to capture the user's facial expressions and voice in real time during input.

[0928] Step 4:

[0929] An emotion engine analyzes the captured facial expressions and voice to identify the user's current emotional state.

[0930] For example, if the user is smiling, it is identified as "excited," and if the user is frowning, it is identified as "fatigue."

[0931] Step 5:

[0932] The terminal transmits the user's input travel desires and the emotional state identified by the emotion engine to the server.

[0933] Step 6:

[0934] The server receives the conditions and emotion information sent by the user, parses the received data, and extracts key elements.

[0935] For example, information such as "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excited."

[0936] Step 7:

[0937] The server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs based on the extracted conditions and emotion information to obtain related travel information.

[0938] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[0939] Step 8:

[0940] The server uses an AI model to generate multiple travel plans based on the acquired information, evaluating each plan's elements (cost, travel time, convenience, etc.) and constructing the optimal plan that matches the user's emotional state.

[0941] For example, a plan including many active activities is generated for a user in an "excited" state, and a plan including many relaxing activities is generated for a user in a "fatigued" state.

[0942] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star Hotel A (40,000 yen for 2 nights), hot spring tour (10,000 yen) and sightseeing tour (15,000 yen) for a total of 85,000 yen.

[0943] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[0944] Step 9:

[0945] The server transmits the generated travel plans to the user terminal.

[0946] The terminal displays the plans to the user and allows the user to select one.

[0947] Step 10:

[0948] The user selects a desired plan from the presented plans and sends a reservation request.

[0949] For example, the user selects "Plan A."

[0950] Step 11:

[0951] The terminal transmits the user's selection information to the server.

[0952] Step 12:

[0953] The server checks the details of the selected plan and makes the reservation by sending a request to the accommodation reservation API or transportation reservation API.

[0954] Step 13:

[0955] The external API successfully completes the reservation process and sends the reservation confirmation information back to the server.

[0956] Step 14:

[0957] The server sends the reservation confirmation information received from the external API to the user terminal.

[0958] Step 15:

[0959] The terminal displays a confirmation to the user, notifying them of a successful reservation.

[0960] For example, it will say, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[0961] Through this series of processes, users can quickly obtain the optimal travel plan based on their desired conditions and emotional state, and can complete their travel reservations without any hassle.

[0962] Example 2

[0963] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0964] Conventional travel plan generation systems create travel plans based solely on the user's desired conditions, without taking the user's emotional state into consideration, making it difficult to provide optimal plans. Furthermore, the technology for efficiently managing and processing data obtained from multiple external information sources was immature, making it difficult to increase user satisfaction. Therefore, there is a need for a system that takes the user's emotional state into consideration and provides optimal travel plans.

[0965] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0966] In this invention, the server includes means for inputting the conditions of a user's desired trip, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions and emotional information from the terminal, means for an AI model to generate an optimal trip plan using the acquired information and the user's emotional information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, and means for transmitting reservation confirmation information to the user. This makes it possible to provide an optimal trip plan that takes into account the user's emotional state.

[0967] "User" refers to an individual or group that uses the system to input desired travel conditions, select a travel plan, and complete the booking process.

[0968] "Travel criteria" refers to parameters such as a traveler's desired destination, budget, activities, and type of accommodation.

[0969] "Terminal" refers to the device (smartphone, tablet, PC, etc.) used by the user to enter desired travel conditions and communicate with the server.

[0970] "Server" refers to the computer system that processes data received from users, communicates with external sources, and generates optimal travel plans.

[0971] "Emotional information" refers to the emotional state (joy, excitement, anxiety, fatigue, etc.) obtained by analyzing the user's facial expressions and voice, which are acquired from the camera and microphone installed on the device.

[0972] "External sources" refers to external databases or APIs that provide information on transportation, accommodation, activities, etc.

[0973] "AI model" refers to algorithms and programs that use artificial intelligence technology to generate optimal travel plans based on users' desired conditions and emotional information.

[0974] A "travel plan" refers to a travel proposal consisting of a combination of transportation, accommodation, and activities, created based on the user's desired conditions and emotional information.

[0975] "Booking Process" refers to the accommodation and transport booking process carried out with an external source based on the selected travel plan.

[0976] "Reservation confirmation information" refers to information such as reservation details and confirmation number provided to a user after completing the reservation process.

[0977] The present invention is a system for generating and providing an optimal travel plan based on a user's desired conditions and taking into consideration the user's emotional information. Specific embodiments for carrying out the present invention will be described below.

[0978] User processing

[0979] 1. User:

[0980] The user enters desired travel conditions into an input form on the terminal. For example, the conditions might be, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a hotel with 3 stars or more."

[0981] 2. Terminal:

[0982] The device temporarily stores the desired conditions entered by the user and prepares to send them to the server. At this time, the data is converted into an appropriate format (for example, JSON format) and sent to the server.

[0983] Emotion recognition by emotion engine

[0984] 1. Device:

[0985] When the user inputs travel conditions, the device uses the device's built-in camera and microphone to collect the user's emotions in real time from facial expressions and voice.

[0986] 2. Emotion Engine:

[0987] The emotional information transmitted from the terminal is analyzed to determine the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.), which is reflected in the generation of a travel plan.

[0988] Server-side processing

[0989] 1. Server:

[0990] The server receives the conditions and emotional information sent by the user, analyzes the data, and extracts key elements, such as "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[0991] 2. Collaboration with external sources:

[0992] Based on the extracted conditions and emotion information, the server sends requests to external transport information APIs, accommodation APIs, and activity information APIs to obtain related travel information. For example, a search for "hot springs in Tokyo" is performed using the TripAdvisor API, and transportation methods to Tokyo are obtained using the Google Maps API. Furthermore, a hotel search API is used to obtain information on hotels with three or more stars in Tokyo.

[0993] 3. Generating optimal travel plans using AI models:

[0994] The server uses the acquired travel information and the user's emotional information to generate multiple travel plans using a generative AI model. It evaluates the elements of each plan (cost, travel time, convenience, etc.) and constructs the optimal plan that matches the user's emotional state. For example, it generates Plan A and Plan B as follows:

[0995] Plan A: If you are currently feeling excited, this plan includes a lot of active activities. It includes a Shinkansen (round trip: 20,000 yen), a 3-star hotel A (2 nights: 40,000 yen), a hot spring tour (10,000 yen), and a sightseeing tour (15,000 yen), for a total of 85,000 yen.

[0996] Plan B: If you are currently feeling emotionally exhausted, this plan includes a lot of relaxing activities. It includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen), for a total of 90,000 yen.

[0997] 4. Server Presentation:

[0998] The server transmits the generated itineraries to the user terminal, which displays them to the user and allows the user to select one.

[0999] Processing reservations

[1000] 1. User:

[1001] The user selects the desired plan from the presented plans and submits a reservation request. For example, the user selects "Plan A."

[1002] 2. Terminal:

[1003] The user's selection information is sent to the server.

[1004] 3. Server:

[1005] The server checks the details of the selected plan and sends a request to the accommodation booking API or transportation booking API to complete the reservation. If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[1006] 4. Provide Verification Information:

[1007] The server sends the reservation confirmation information received from the external API to the user's terminal. The terminal displays the confirmation information to the user, displaying a message such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1008] Examples and prompts

[1009] Specific examples

[1010] If a user inputs "I want to go to Kyoto. My budget is 50,000 yen. I want to visit temples. I want to stay in a two-star or higher accommodation," the system will generate a plan like this:

[1011] Plan A: If you are currently feeling excited, this plan includes active activities. It includes a Shinkansen (round trip 10,000 yen), a two-star accommodation A (20,000 yen for two nights), and a temple tour (5,000 yen), for a total of 35,000 yen.

[1012] Plan B: If you are currently feeling emotionally exhausted, this plan includes relaxing activities. It includes bus travel (5,000 yen round trip), two-star accommodation B (15,000 yen for two nights), and a relaxing temple tour (5,000 yen), for a total of 25,000 yen.

[1013] Prompt statement

[1014] Example of an input prompt for a generative AI model:

[1015] "The user wants to travel to Kyoto, with a budget of 50,000 yen or less, and wants to visit temples. He also wants accommodations that are at least two stars. Based on these conditions and the user's current emotional state, generate the optimal travel plan."

[1016] With the above configuration, the user can quickly obtain the most suitable travel plan and can easily make suggestions and reservations that take into account the user's own emotional state.

[1017] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1018] Step 1:

[1019] User input of desired travel conditions

[1020] The user enters their desired travel conditions (e.g., "I want to go to Tokyo. My budget is within 100,000 yen. I want to bathe in hot springs. I want to stay in a three-star or higher hotel.") into an input form on the device. This input data includes travel destination, budget, desired activities, and accommodation conditions. The device receives the input from the user and temporarily stores it.

[1021] Input: Travel requirements (destination, budget, activities, accommodation requirements)

[1022] Output: Temporarily saved travel preferences

[1023] Step 2:

[1024] Terminal receives data and prepares it for transmission

[1025] The device temporarily stores the desired conditions entered by the user, converts the data into an appropriate format (for example, JSON format), and sends the converted data to the server.

[1026] Input: Temporarily saved travel preferences

[1027] Output: The transformed data to send to the server.

[1028] Step 3:

[1029] Collecting emotional information from devices

[1030] While the user is entering travel information, the device's built-in camera and microphone are used to collect emotional information from the user's facial expressions and voice in real time, which is then analyzed later.

[1031] Input: User's facial and voice data

[1032] Output: Collected emotion information

[1033] Step 4:

[1034] Emotion recognition by emotion engine

[1035] The device sends the collected emotional information to the emotion engine, which analyzes it and determines the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.).

[1036] Input: Collected emotion information

[1037] Output: Parsed emotional state

[1038] Step 5:

[1039] Data reception and analysis by the server

[1040] The server receives the user's desired conditions and emotional information sent from the device. It analyzes the received data and extracts key elements necessary for generating a travel plan. Specifically, these elements include "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[1041] Input: User's desired conditions, analyzed emotional state

[1042] Output: Extracted elements

[1043] Step 6:

[1044] Server-based linkage with external information sources and information acquisition

[1045] Based on the analyzed conditions and sentiment information, the server sends requests to external information sources (APIs) such as transportation information, accommodations, and activities to obtain related travel information. For example, a search for "hot springs in Tokyo" can be performed using TripAdvisor's API, transportation methods to Tokyo can be obtained using Google Maps' API, and hotel search APIs can be used to obtain information on hotels with three or more stars.

[1046] Input: Extracted elements

[1047] Output: Acquired travel information (traffic information, accommodation information, activity information)

[1048] Step 7:

[1049] Generate optimal travel plans using AI models

[1050] The server uses a generative AI model to generate multiple travel plans based on the acquired travel information and the user's emotional information. It evaluates the elements of each plan (cost, travel time, convenience, etc.) and creates the optimal plan that matches the user's emotions. For example, if the user is currently excited, it will generate a plan that includes many active activities, and if the user is tired, it will generate a relaxing plan.

[1051] Input: Acquired travel information, user's emotional information

[1052] Output: Multiple generated itineraries

[1053] Step 8:

[1054] Server sends plan to user device

[1055] The server sends the generated travel plans to the user's terminal, which displays them to the user and allows the user to select one of the plans.

[1056] Input: Multiple generated itineraries

[1057] Output: The travel plan sent to the user's device

[1058] Step 9:

[1059] User selects plan and submits reservation request

[1060] The user selects the desired plan from the presented plans and sends a reservation request from the terminal to the server. For example, the user selects "Plan A."

[1061] Input: User selects plan

[1062] Output: Reservation request data

[1063] Step 10:

[1064] Receiving reservation information by the terminal and sending it to the server

[1065] The terminal receives reservation information for the plan selected by the user and transmits it to the server.

[1066] Input: User selected plan information

[1067] Output: Reservation information sent to the server

[1068] Step 11:

[1069] Server executes reservation procedure

[1070] The server sends a request to the accommodation booking API or transportation booking API based on the selected plan and makes the reservation. If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[1071] Input: Reservation information sent to the server

[1072] Output: Reservation confirmation information

[1073] Step 12:

[1074] The server creates reservation confirmation information and sends it to the user's device

[1075] The server creates confirmation information to provide to the user based on the reservation confirmation information received from the external API, and sends this confirmation information to the user's terminal.

[1076] Input: Reservation confirmation information

[1077] Output: Reservation confirmation information sent to the user's terminal

[1078] Step 13:

[1079] Displaying reservation confirmation information to the user via the terminal

[1080] The terminal displays the reservation confirmation information received from the server to the user. For example, a message such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1081] Input: Reservation confirmation information sent to the user's terminal

[1082] Output: Booking confirmation information displayed to the user

[1083] (Application example 2)

[1084] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1085] Conventional travel plan generation systems do not take into account the user's emotional state, making it difficult to generate travel plans that are suitable for users who are tired or want to relax. Furthermore, plans are not adjusted in real time based on the user's emotions, which can lead to a decrease in user satisfaction. Therefore, there is a need for flexible travel plans that reflect the user's emotional state.

[1086] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1087] In this invention, the server includes means for inputting the user's desired travel conditions, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions, means for an AI model to generate an optimal travel plan using the acquired information, means for presenting the generated multiple travel plans to the user, means for completing a reservation procedure based on the travel plan selected by the user, means for transmitting reservation confirmation information to the user, and means for recognizing the user's emotional state using a camera and microphone mounted on the vehicle and reflecting the recognized emotional state in the travel plan. This makes it possible to generate and present an optimal travel plan that takes the user's emotional state into consideration and adjust the travel plan in real time.

[1088] "User" means an individual who uses the System to plan and book a trip.

[1089] "Conditions" refers to information that indicates the specific elements of a user's desired trip, including destination, budget, activities, accommodation requirements, etc.

[1090] "Server" refers to a central processing unit that retrieves data from external sources based on the conditions sent by the user, generates optimal travel plans using AI models, and makes proposals and reservations for the user.

[1091] "Means" refer to equipment, software, processes, etc. used to achieve a specific function.

[1092] "External sources" refers to external databases or APIs that provide information on transportation, accommodation, activities, etc.

[1093] "Travel Information" means travel-related data obtained from external sources, such as information about transportation, accommodation, activities, etc.

[1094] An "AI model" is an algorithm that learns from large amounts of data and generates optimal travel plans based on specific conditions.

[1095] The "camera" is a photographing device for capturing the user's facial expressions in real time.

[1096] A "microphone" is a recording device that captures the user's voice in real time.

[1097] "Emotional state" is information that indicates the user's psychological state, and refers to emotions recognized from facial expressions and voice (e.g., joy, excitement, anxiety, fatigue, etc.).

[1098] "Itinerary" refers to detailed travel recommendations generated based on the user's criteria and emotional state, such as combinations of destinations, transportation, accommodations, and activities.

[1099] "Reservation process" means the process of officially booking accommodation and transportation based on the travel plan selected by the User.

[1100] "Reservation confirmation information" refers to information sent to the user after the reservation procedure is completed that confirms and certifies the reservation details.

[1101] System configuration

[1102] This invention is an AI service system for autonomous vehicles that automatically handles everything from travel planning to booking, and by combining it with an emotion engine, it provides optimal travel plans that take into account the user's emotional state. The system consists of the following elements:

[1103] 1. User terminal

[1104] This is a device where users input their desired travel conditions. It is installed in the infotainment system of an autonomous vehicle and includes a display that can be operated by voice or touch panel.

[1105] 2. Server

[1106] It is a central processing unit that obtains travel information from external sources based on conditions sent by users and generates optimal travel plans using AI models.

[1107] 3. External information sources (API)

[1108] These are external databases and services that provide information on transportation, accommodation, activities, etc., and work in conjunction with the server to provide travel information.

[1109] 4. Emotion Engine

[1110] The engine uses cameras and microphones installed in the vehicle to recognize the emotional state of the user from their facial expressions and voice. The recognized emotional state is reflected in the generation and adjustment of the travel plan.

[1111] Program processing

[1112] 1. The user enters the conditions

[1113] Passengers input their travel preferences via the autonomous vehicle's infotainment system, including where they want to go, their budget, the activities they want to do, and their preferred accommodations.

[1114] 2. Recognizing emotional states

[1115] Cameras and microphones installed in the vehicle capture the user's facial expressions and voice, which are then analyzed by an emotion engine to recognize the user's emotional state.

[1116] 3. Processing on the Server

[1117] The server receives the user's input conditions and the recognized emotional state, and based on this, retrieves the necessary travel information from external sources, such as transportation information API, accommodation information API, and activity information API.

[1118] Based on the acquired information, the AI ​​model generates an optimal travel plan, taking into account the perceived emotional state and designing a plan that meets the user's psychological needs.

[1119] 4. Presenting your travel plans

[1120] The server then sends the generated itineraries to the vehicle's infotainment system, where the user can view them on the display and select the one they want.

[1121] 5. Completing the reservation process

[1122] Based on the travel plan selected by the user, the server processes the reservation of accommodation and transportation. The reservation confirmation information is sent back to the vehicle's system for the user to check.

[1123] Specific examples

[1124] For example, if a user inputs, "I want to go to Nara. My budget is within 50,000 yen. I want to visit temples. I want accommodations that are two stars or higher," and the server recognizes that the user's emotional state is relaxed, the server will generate multiple travel plans, such as a "relaxing temple tour course" and a "course with a relaxing hot spring."

[1125] Prompt example (text format)

[1126] The following information is required to generate your itinerary:

[1127] Places I want to go: Nara

[1128] Budget: Under 50,000 yen

[1129] Favorite activity: Visiting temples

[1130] Accommodation requirements: 2 stars or more

[1131] Current emotional state: Relaxed

[1132] Generate the best itinerary based on this criteria.

[1133] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1134] Step 1:

[1135] The user enters the conditions

[1136] Users use the infotainment system of the autonomous vehicle to input their travel preferences, including desired destinations, budget, desired activities, accommodation requirements, etc. The input data is temporarily stored on the vehicle terminal and used for subsequent processing.

[1137] Input: User's travel requirements (destination, budget, activities, accommodation requirements, etc.)

[1138] Output: Saved user travel preferences

[1139] Step 2:

[1140] Recognition of emotional states

[1141] The vehicle's onboard camera and microphone capture the user's facial expressions and voice. The emotion engine analyzes this data and recognizes the user's current emotional state, which is then used in the next step.

[1142] Input: facial and voice data captured from the camera and microphone

[1143] Output: Perceived user emotional state (e.g., relaxed, excited, anxious, etc.)

[1144] Step 3:

[1145] Receiving conditions and emotional states on the server

[1146] The terminal transmits the user's input travel preferences and the recognized emotional state to the server, which receives and analyzes the data. The received data is used for subsequent data acquisition and plan generation.

[1147] Input: User's travel preferences and perceived emotional state

[1148] Output: Analyzed condition and emotional state data

[1149] Step 4:

[1150] Obtaining travel information

[1151] The server retrieves travel information from external sources based on the analyzed conditions and emotional state, specifically by sending requests to APIs for transportation information, accommodation information, and activity information to obtain the necessary data.

[1152] Input: Analyzed travel preferences and emotional state

[1153] Output: Travel information obtained from external sources (transportation, accommodation, and activity details)

[1154] Step 5:

[1155] Generate a travel plan

[1156] The server uses an AI model to generate an optimal travel plan based on the acquired travel information and the user's emotional state. The AI ​​model evaluates factors such as cost, travel time, and convenience, and creates multiple plans. The generated plan is adjusted to match the user's emotional state.

[1157] Input: Acquired travel information and emotional state data

[1158] Output: Multiple generated itineraries

[1159] Step 6:

[1160] Presenting your travel plan

[1161] The server sends the generated travel plan to the user's terminal, which receives it and displays it on the vehicle's display. The user can then compare the plans and select one.

[1162] Input: Generated itinerary

[1163] Output: Travel plan displayed on user's device

[1164] Step 7:

[1165] Completing the reservation process

[1166] Based on the travel plan selected by the user, the server processes the reservation of accommodation and transportation, sends a request to an external API, and executes the reservation process. The reservation confirmation information is sent back to the vehicle's system and displayed to the user.

[1167] Input: Travel plan selected by user

[1168] Output: Confirmation of completed booking

[1169] Step 8:

[1170] Real-time adjustment based on emotional state

[1171] As the travel plan progresses, the user's emotional state is monitored in real time. If a change in emotional state is detected, the server adjusts the plan as needed to ensure the user has an optimal experience. This adjustment is made by obtaining additional information from external sources.

[1172] Input: User's real-time emotional state

[1173] Output: Coordinated itinerary and activities

[1174] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1175] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1176] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1177] [Third embodiment]

[1178] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1179] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1180] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1181] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1182] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1183] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1184] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1185] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1186] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1187] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1188] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1189] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1190] The present invention is an AI service system that automatically performs the entire process from planning to booking a trip. Specific embodiments of the present invention will be described below.

[1191] System Overview

[1192] In this system, users input their desired travel conditions from their terminal, and the server generates the optimal travel plan based on that information and completes the booking process.The main components are the user terminal, the server, and an external information source (API).

[1193] User processing

[1194] 1. User:

[1195] Users input their desired travel conditions into an input form on their device, including the places they want to go, their budget, the activities they want to do, and the accommodations they want.

[1196] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[1197] 2. Terminal:

[1198] The conditions entered by the user are temporarily saved and prepared for transmission to the server.

[1199] Convert the conditions into an appropriate format and send the data to the server.

[1200] Server-side processing

[1201] 1. Server:

[1202] The server receives the conditions sent by the user.

[1203] The received data is parsed and key elements are extracted, such as keywords like "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 stars or more."

[1204] 2. Integration with external APIs:

[1205] The server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain the necessary information.

[1206] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[1207] 3. AI-powered optimal travel plan generation:

[1208] Based on the acquired information, the AI ​​model generates multiple travel plans, taking into account relevant factors (cost, travel time, convenience, etc.) to create the optimal plan.

[1209] For example, generate Plan A and Plan B as shown below.

[1210] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[1211] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[1212] 4. Present to the user:

[1213] The server transmits the generated travel plans to the user terminal.

[1214] The user terminal displays the plans and allows the user to select one.

[1215] Processing reservations

[1216] 1. User:

[1217] The user selects a desired plan from the presented plans and sends a reservation request.

[1218] For example, the user selects "Plan A."

[1219] 2. Terminal:

[1220] The user's selection information is sent to the server.

[1221] 3. Server:

[1222] Check the details of the selected plan and make the reservation by sending a request to the accommodation booking API or transportation booking API.

[1223] If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[1224] 4. User confirmation:

[1225] The server sends the reservation confirmation information received from the external API to the user terminal.

[1226] The user terminal displays confirmation information to the user, such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1227] This system allows users to quickly obtain the optimal travel plan based on their desired conditions, and complete travel reservations hassle-free.

[1228] The processing flow will be explained below.

[1229] Step 1:

[1230] The user enters their desired travel conditions into an input form on the terminal, including the place they want to go, their budget, the activities they want to do, and the conditions for the accommodation they want.

[1231] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[1232] Step 2:

[1233] The terminal temporarily stores the conditions entered by the user and prepares to send them to the server, converts the conditions into an appropriate format, and sends the data to the server.

[1234] Step 3:

[1235] The server receives the conditions sent by the user. It parses (analyzes) the received data and extracts key elements. For example, keywords such as "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 stars or more."

[1236] Step 4:

[1237] Based on the extracted conditions, the server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain related travel information.

[1238] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[1239] Step 5:

[1240] The server uses an AI model to generate multiple travel plans based on the acquired information, and creates the optimal plan by taking into account factors for each plan (cost, travel time, convenience, etc.).

[1241] For example, generate Plan A and Plan B as shown below.

[1242] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[1243] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[1244] Step 6:

[1245] The server transmits the generated travel plans to the user's terminal.

[1246] The terminal displays the plans to the user and allows the user to select one.

[1247] Step 7:

[1248] The user selects a desired plan from the presented plans and sends a reservation request.

[1249] For example, the user selects "Plan A."

[1250] Step 8:

[1251] The terminal transmits the user's selection information to the server.

[1252] Step 9:

[1253] The server checks the details of the selected plan and makes the reservation by sending a request to the accommodation reservation API or transportation reservation API.

[1254] Step 10:

[1255] The external API successfully completes the reservation process and sends the reservation confirmation information back to the server.

[1256] Step 11:

[1257] The server sends the reservation confirmation information received from the external API to the user's device.

[1258] Step 12:

[1259] The terminal displays a confirmation to the user, notifying them of a successful reservation.

[1260] For example, it will say, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1261] This series of processes allows the user to quickly obtain the optimal travel plan based on their desired conditions, and complete their travel reservation without any hassle.

[1262] Example 1

[1263] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1264] A problem with conventional travel planning and reservation systems is that users have to conduct their own research and find a plan that meets their requirements, which requires a lot of time and effort. It is also difficult to manually assemble an optimal plan by collecting information from multiple sources. Another problem is that errors are likely to occur during the reservation process, resulting in a poor user experience. The purpose of this invention is to automate the entire process from travel planning to booking, reducing users' time and effort, and providing more efficient travel plans and accurate reservation procedures.

[1265] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1266] In this invention, the server includes means for inputting the conditions of a user's desired trip, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions, means for a generative AI model to generate an optimal trip plan using the acquired information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, means for transmitting reservation confirmation information to the user, means for analyzing received data using the input conditions as a key and extracting relevant elements, and a generative AI model that creates multiple trip plans based on the acquired information and evaluates each plan taking into account its details (cost, travel time, convenience).This enables users to efficiently and quickly obtain optimal trip plans and complete the reservation procedure with fewer errors.

[1267] "User" means a person who uses this system to plan and book a trip.

[1268] "Conditions" refers to the desired information that a user enters for travel planning (e.g., travel destination, budget, activities, accommodation requirements, etc.).

[1269] "Server" refers to a central processing unit that retrieves information from relevant external sources based on the input conditions, generates a travel plan using an AI model, and processes the reservation.

[1270] "External information source" refers to an external information system that provides transportation information, accommodation information, activity information, etc.

[1271] An "AI model" is an artificial intelligence algorithm that generates optimal travel plans based on acquired travel information.

[1272] "Travel Plan" refers to multiple travel suggestions generated by an AI model and presented to users.

[1273] The "reservation procedure" is a process for finalizing various reservations based on the travel plan selected by the user.

[1274] "Reservation confirmation information" is confirmation information sent to the user when the reservation procedure is completed, and includes reservation details.

[1275] "Analysis" refers to the process in which the server receives the input conditions and extracts the necessary information.

[1276] "Evaluation" is the process of determining how optimal the generated travel plan is in terms of cost, travel time, and convenience.

[1277] MODE FOR CARRYING OUT THE INVENTION

[1278] The present invention is an AI service system that automatically performs everything from planning to booking a trip. A specific embodiment of this system will be described below.

[1279] System Overview

[1280] In this system, users input their desired travel conditions from their devices, and the server then generates an optimal travel plan based on that information and completes the booking process. The main components are the user device, the server, and an external information source (API). The hardware used includes general computers and communication networks, while the software includes an AI model, an API client, and a data analysis tool.

[1281] User processing

[1282] 1. User:

[1283] The user enters their desired travel conditions into an input form on the terminal, including the desired destination, budget, activities they would like to do, and accommodation requirements.

[1284] For example, enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[1285] 2. Terminal:

[1286] The device temporarily saves the conditions entered by the user, converts the input data into JSON format, and prepares to send it to the server.

[1287] Specifically, the conditions are converted into an appropriate format and sent to the server as an HTTP request.

[1288] Server-side processing

[1289] 1. Server:

[1290] The server receives the condition data sent by the user, analyzes it using a JSON parser, and extracts key elements, such as keywords like "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 or more stars."

[1291] 2. Integration with external APIs:

[1292] The server obtains information by sending requests to external traffic information APIs, accommodation APIs, and activity information APIs.

[1293] External information sources include a traffic information API, accommodation API, and activity information API, from which the necessary information is obtained.

[1294] As a concrete example, you can request information on "three-star or higher hotels in Tokyo" from the accommodation API, and request "transportation methods to Tokyo (bullet train, airplane, etc.)" from the transportation information API.

[1295] 3. AI-powered travel plan generation:

[1296] The server generates multiple itineraries using a generative AI model based on information obtained from external APIs. The AI ​​model evaluates the itineraries based on cost, travel time, and convenience, and generates the optimal itinerary.

[1297] For example, the AI ​​model generates Plan A and Plan B as follows:

[1298] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[1299] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[1300] 4. Present to the user:

[1301] The server sends the generated travel plans to the user terminal, and the user can select one of the plans presented.

[1302] Processing reservations

[1303] 1. User:

[1304] The user selects the desired plan from the presented plans and submits a reservation request. For example, the user selects "Plan A."

[1305] 2. Terminal:

[1306] The terminal transmits information about the plan selected by the user to the server.

[1307] 3. Server:

[1308] The server checks the details of the selected plan and sends a reservation request to the accommodation booking API and the transport booking API. For example, it reserves "two nights at a three-star hotel A" with the accommodation booking API and reserves "round-trip Shinkansen tickets" with the transport booking API.

[1309] 4. User confirmation:

[1310] The server receives the reservation confirmation information from the external API and sends it to the user's terminal. A confirmation message is displayed saying, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1311] Specific examples

[1312] Travel planning prompts:

[1313] I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a 3-star or higher hotel.

[1314] Booking confirmation prompt:

[1315] I have selected Plan A. Please proceed with your reservation.

[1316] This system allows users to efficiently obtain the best travel plan based on their desired conditions and complete travel reservations hassle-free.

[1317] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1318] Step 1:

[1319] Input: The user enters their travel preferences (destination, budget, activities, accommodation requirements, etc.) into the device.

[1320] Specific operation: The user enters the following into the input form on the device: "I want to go to Tokyo. My budget is within 100,000 yen. I want to go to a hot spring. I want to stay in a hotel with 3 stars or more."

[1321] Output: The user's input data is saved to the terminal.

[1322] Step 2:

[1323] Input: User input data that is saved.

[1324] Specific operation: The terminal converts the data entered by the user into JSON format and prepares to send it to the server. Specific data format conversion processing is performed.

[1325] Output: JSON formatted trip conditions data.

[1326] Step 3:

[1327] Input: Trip conditions data in JSON format.

[1328] Specific operation: The device sends the converted JSON data to the server as an HTTP request.

[1329] Output: The server receives the JSON data.

[1330] Step 4:

[1331] Input: JSON formatted travel conditions data received by the server.

[1332] Specific operation: The server uses a JSON parser to parse the user's search criteria data. Specifically, it extracts keywords such as "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 or more stars."

[1333] Output: Extracted keyword data.

[1334] Step 5:

[1335] Input: Extracted keyword data.

[1336] Specific operation: The server sends requests to the traffic information API, accommodation API, and activity information API to obtain information. For example, it requests information such as "transportation to Tokyo" from the traffic information API, "three-star or higher hotels in Tokyo" from the accommodation API, and "hot springs in Tokyo" from the activity information API.

[1337] Output: Obtained external information data (information on transportation, accommodation, activities).

[1338] Step 6:

[1339] Input: Acquired external information data.

[1340] Specific operation: The server generates a travel plan using a generative AI model based on the acquired information. The AI ​​model evaluates each travel element and creates multiple travel plans. For example, it evaluates based on cost, travel time, and convenience, and generates the following Plan A and Plan B.

[1341] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[1342] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[1343] Output: Multiple trip plan data.

[1344] Step 7:

[1345] Input: Multiple itinerary data.

[1346] Specific operations: The server transmits the generated travel plan to the user terminal.

[1347] Output: Travel plan data received by the user device.

[1348] Step 8:

[1349] Input: Travel plan data received by the user device.

[1350] Specific operation: The terminal displays the plans received from the server on the user interface and allows the user to select one.

[1351] Output: Multiple itineraries are displayed for the user to choose from.

[1352] Step 9:

[1353] Input: Multiple proposed travel plans.

[1354] Specific operation: The user selects the desired plan and sends a reservation request such as "Plan A has been selected. Please proceed with the reservation."

[1355] Output: Booking request data.

[1356] Step 10:

[1357] Input: Booking request data.

[1358] Specific operation: The terminal transmits the user's selection information to the server.

[1359] Output: The reservation request data received by the server.

[1360] Step 11:

[1361] Input: The reservation request data received by the server.

[1362] Specific operation: The server checks the details of the selected plan and sends a reservation request to the accommodation booking API and the transportation booking API. For example, it sends "two nights at a three-star hotel A" to the accommodation API and "round-trip Shinkansen ticket" to the transportation API.

[1363] Output: Booking result data.

[1364] Step 12:

[1365] Input: Booking result data.

[1366] Specific operation: The server receives reservation confirmation information from the external API and sends confirmation information such as "Hotel A reservation number XXX" and "Shinkansen reservation number YYY" to the user terminal.

[1367] Output: The confirmation information received by the user device.

[1368] Step 13:

[1369] Input: The confirmation information received by the user device.

[1370] Specific operation: The terminal displays the reservation confirmation information received from the server to the user, and displays a confirmation message such as "Your Shinkansen and hotel reservations have been completed. The reservation number is XXX."

[1371] Output: The booking confirmation message that is displayed to the user.

[1372] (Application example 1)

[1373] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1374] Conventional travel plan generation systems only provide plans based on travel conditions entered by the user, but lack the functionality and support to optimize the shopping experience in physical stores. In particular, they lack a mechanism to efficiently obtain information on the products and budget that users want, as well as the best stores, and to simplify the purchasing process. This means that users end up spending a lot of time and effort visiting multiple stores to find the best products and stores.

[1375] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1376] In this invention, the server includes means for inputting the conditions of a desired trip from a user, means for transmitting the input conditions to the server, means for the server to acquire travel information from related external information sources based on the conditions, means for an AI model to generate an optimal trip plan using the acquired information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, means for transmitting reservation confirmation information to the user, additional means for the user to input desired product information and budget, additional means for acquiring product information from related external information sources based on the input product conditions, additional means for generating an optimal product list and store information using the acquired product information, additional means for presenting the generated multiple product lists and store information to the user and completing a purchase procedure based on the products and store selected by the user, and additional means for transmitting the purchase confirmation information to the user. This allows users to not only plan their trip efficiently in a short amount of time, but also to simultaneously enjoy an optimal shopping experience at physical stores.

[1377] "User" refers to an individual who uses the system to input travel and shopping conditions and select the most suitable plan or product.

[1378] "Travel conditions" refers to elements related to a user's desired trip, such as destination, budget, activities to do, and desired accommodation conditions.

[1379] "Server" refers to a computer system that receives input data from users, obtains necessary information in cooperation with external information sources, generates an optimal plan using an AI model, and presents it to users.

[1380] "External information source" refers to an information source such as an external API or database that the server uses to obtain travel information or product information.

[1381] "Travel Information" refers to data collected about transportation, accommodation, and activities.

[1382] "Product information" refers to data such as the acquired product price, availability, ratings, popularity, etc.

[1383] "AI model" refers to the artificial intelligence algorithm used by the server to generate optimal plans and lists using the acquired travel and product information.

[1384] A "travel plan" refers to the optimal combination of travel schedule, course, and accommodation generated by an AI model and presented to the user.

[1385] "Product list" refers to a list generated by an AI model that includes the most suitable products and stores based on the user's desired conditions, as well as instructions on how to purchase them.

[1386] "Reservation procedure" refers to the series of processes in which a user makes reservations for accommodation, transportation, etc. based on the travel plan selected by the user.

[1387] "Purchase procedure" refers to the process of actually purchasing a product based on the product and store selected by the user.

[1388] "Reservation confirmation information" refers to information sent to a user to confirm that the reservation or purchase process has been successfully completed.

[1389] This invention is a system that automates the entire process from planning to booking a trip, as well as optimizing the shopping experience in brick-and-mortar stores. This system allows users to input their desired travel and product requirements, and then generates and presents optimal plans and product lists based on those inputs.

[1390] System configuration and operation

[1391] 1. User-side processing

[1392] Users use their smartphones or smart glasses to input their desired conditions (travel conditions or product conditions). For example, they might input, "I want to go to Tokyo, my budget is within 100,000 yen, and I want to go to a hot spring," or "I want to buy the latest smartphone within 20,000 yen."

[1393] 2. Terminal processing

[1394] The application installed on the smartphone or smart glasses temporarily stores the conditions entered by the user and prepares them to be sent to the server. This application is built using a mobile app development platform such as React Native or Flutter. It also validates the user input and displays error messages.

[1395] 3. Server-side processing

[1396] The server receives and analyzes the conditions sent by the user. It then obtains the necessary information from external sources, such as:

[1397] External sources of travel information: Transportation information API, Accommodation information API, Activity information API (e.g., Travel information API)

[1398] External sources of product conditions: Product information API (e.g., Web Special Offers API), Map information API (e.g., Map Service API)

[1399] The server is implemented using Node.js and Express, and the acquired information is stored in a database such as MongoDB, which centralizes the information and responds quickly to required processing.

[1400] Using the information obtained, the server generates optimal itineraries and product listings using an AI model built using TensorFlow and PyTorch that takes into account factors such as cost, travel time, convenience, ratings, and popularity.

[1401] 4. AI-generated plans

[1402] The AI ​​model will learn and generate a plan based on the following prompt:

[1403] Example prompt for generating a travel plan: "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring."

[1404] Example prompt for generating a product list: "Create a list of reliable stores for the latest smartphones within a budget of ¥20,000."

[1405] The generated travel plan and product list are sent from the server to the user terminal and presented to the user.

[1406] 5. Reservation and purchase procedures

[1407] The user selects from the list of plans and products presented and sends the selection information to the server. The server then executes the reservation or purchase procedure via the API and sends a confirmation to the user if successful.

[1408] This system not only allows users to plan their trips quickly and efficiently, but also allows them to enjoy the best possible shopping experience in physical stores.

[1409] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1410] Step 1:

[1411] Users use an application installed on their smartphone or smart glasses to input travel and product requirements. For example, they might input, "I want to go to Tokyo, my budget is 100,000 yen, and I want to bathe in hot springs," or "I want to buy the latest smartphone within a budget of 20,000 yen."

[1412] Input: Travel terms or product terms

[1413] Output: Data of the entered conditions

[1414] Step 2:

[1415] The terminal temporarily stores the conditions entered by the user, converts them into an appropriate format, and prepares to send them to the server.

[1416] Input: Data for the entered conditions

[1417] Data processing: Data format conversion

[1418] Output: Format converted condition data

[1419] Step 3:

[1420] The server receives the condition data sent by the user and analyzes it. Analysis is the process of extracting necessary key elements from the conditions.

[1421] Input: Format converted condition data

[1422] Data analysis: Extraction of key elements (e.g., "Tokyo," "under 100,000 yen," "hot springs," etc.)

[1423] Output: Data with key elements extracted

[1424] Step 4:

[1425] The server accesses relevant external information sources (APIs) based on the key elements to obtain the necessary travel and product information. External information sources include travel information APIs, product information APIs, map service APIs, etc.

[1426] Input: Data from which key elements have been extracted

[1427] Data Acquisition: Acquiring information from external APIs

[1428] Output: Retrieved travel and product information

[1429] Step 5:

[1430] The server uses the acquired information to generate optimal travel plans and product listings using an AI model that takes into account factors such as cost, travel time, convenience, ratings, and popularity.

[1431] Input: Travel and product information obtained

[1432] Data Computation: Plan Generation Using AI Models

[1433] Output: Generated itinerary and product list

[1434] Step 6:

[1435] The server sends the generated travel plan and product list to the user's terminal, and the user selects the desired plan and product based on the presented information.

[1436] Input: Generated itinerary and product list

[1437] Data transmission: Sending information to the user terminal

[1438] Output: Plans and product list presented to the user

[1439] Step 7:

[1440] The user selects the desired travel plan or product from the presented list, and transmits the selected information from the terminal to the server.

[1441] Input: The plan or product selected by the user

[1442] Data transmission: Sends selected information to the server

[1443] Output: Information about the selected plan and product

[1444] Step 8:

[1445] The server performs reservation and purchase procedures based on the selected plan and product, using APIs such as accommodation reservation API, transportation reservation API, and product purchase API.

[1446] Input: Selected plan and product information

[1447] Data calculation and processing: Execution of reservation and purchase procedures

[1448] Output: Reservation confirmation information or purchase confirmation information

[1449] Step 9:

[1450] The server transmits reservation confirmation information and purchase confirmation information to the user terminal and displays the confirmed details to the user.

[1451] Input: Reservation confirmation information, purchase confirmation information

[1452] Data transmission: Send confirmation information to the user's device

[1453] Output: Confirmation to the user (e.g. "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX.")

[1454] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1455] The present invention aims to provide an optimal travel plan that takes into account the user's emotional state by combining an AI service system that automatically handles everything from travel planning to booking, with an emotion engine. Specific embodiments of the present invention are described below.

[1456] System Overview

[1457] In this system, users input their desired travel conditions from their terminal, and the server generates the optimal travel plan based on that information and completes the booking procedure. Furthermore, the system is configured so that an emotion engine recognizes the user's emotions and reflects them in the generation and proposal of travel plans. The main components are the user terminal, server, external information source (API), and emotion engine.

[1458] User processing

[1459] 1. User:

[1460] Users input their desired travel conditions into an input form on their device, including the places they want to go, their budget, the activities they want to do, and the accommodations they want.

[1461] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[1462] 2. Terminal:

[1463] Temporarily saves the conditions entered by the user and prepares them for sending to the server. Converts the conditions into an appropriate format and sends the data to the server.

[1464] Emotion recognition by emotion engine

[1465] 1. Device:

[1466] When a user inputs information, the device uses a camera and microphone to recognize the user's emotions in real time from facial expressions and voice.

[1467] 2. Emotion Engine:

[1468] The emotional information sent from the device is analyzed to determine the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.).

[1469] Server-side processing

[1470] 1. Server:

[1471] The server receives the conditions and emotional information sent by the user. It parses (analyzes) the received data and extracts key elements. For example, "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[1472] 2. Integration with external APIs:

[1473] Based on the extracted conditions and emotion information, the server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain related travel information.

[1474] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[1475] 3. AI-powered optimal travel plan generation:

[1476] Based on the acquired information and the user's emotional state, the AI ​​model generates multiple travel plans, evaluating each plan's elements (cost, travel time, convenience, etc.) to create the optimal plan that best suits the user's emotional state.

[1477] For example, generate Plan A and Plan B as shown below.

[1478] Plan A: If you are currently feeling excited, this plan includes a lot of active activities. It includes a Shinkansen (round trip: 20,000 yen), a 3-star hotel A (2 nights: 40,000 yen), a hot spring tour (10,000 yen), and a sightseeing tour (15,000 yen), for a total of 85,000 yen.

[1479] Plan B: If you are currently feeling emotionally exhausted, this plan includes a lot of relaxing activities. It includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen), for a total of 90,000 yen.

[1480] 4. Present to the user:

[1481] The server transmits the generated travel plans to the user terminal.

[1482] The user terminal displays the plans to the user, allowing the user to select one.

[1483] Processing reservations

[1484] 1. User:

[1485] The user selects a desired plan from the presented plans and sends a reservation request.

[1486] For example, the user selects "Plan A."

[1487] 2. Terminal:

[1488] The user's selection information is sent to the server.

[1489] 3. Server:

[1490] Check the details of the selected plan and make the reservation by sending a request to the accommodation booking API or transportation booking API.

[1491] If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[1492] 4. User confirmation:

[1493] The server sends the reservation confirmation information received from the external API to the user terminal.

[1494] The user terminal displays confirmation information to the user, such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1495] This series of processes allows the user to quickly obtain the optimal travel plan based on their desired conditions, and also allows the user to effortlessly propose and book a plan that takes into account their emotional state.

[1496] The processing flow will be explained below.

[1497] Step 1:

[1498] The user enters their desired travel conditions into an input form on the terminal, including the place they want to go, their budget, the activities they want to do, and the conditions for the accommodation they want.

[1499] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[1500] Step 2:

[1501] The terminal temporarily stores the conditions entered by the user and prepares to send them to the server, converts the conditions into an appropriate format, and sends the data to the server.

[1502] Step 3:

[1503] The device uses the device's camera and microphone to capture the user's facial expressions and voice in real time during input.

[1504] Step 4:

[1505] An emotion engine analyzes the captured facial expressions and voice to identify the user's current emotional state.

[1506] For example, if the user is smiling, it is identified as "excited," and if the user is frowning, it is identified as "fatigue."

[1507] Step 5:

[1508] The terminal transmits the user's input travel desires and the emotional state identified by the emotion engine to the server.

[1509] Step 6:

[1510] The server receives the conditions and emotion information sent by the user, parses the received data, and extracts key elements.

[1511] For example, information such as "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excited."

[1512] Step 7:

[1513] The server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs based on the extracted conditions and emotion information to obtain related travel information.

[1514] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[1515] Step 8:

[1516] The server uses an AI model to generate multiple travel plans based on the acquired information, evaluating each plan's elements (cost, travel time, convenience, etc.) and constructing the optimal plan that matches the user's emotional state.

[1517] For example, a plan including many active activities is generated for a user in an "excited" state, and a plan including many relaxing activities is generated for a user in a "fatigued" state.

[1518] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star Hotel A (40,000 yen for 2 nights), hot spring tour (10,000 yen) and sightseeing tour (15,000 yen) for a total of 85,000 yen.

[1519] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[1520] Step 9:

[1521] The server transmits the generated travel plans to the user terminal.

[1522] The terminal displays the plans to the user and allows the user to select one.

[1523] Step 10:

[1524] The user selects a desired plan from the presented plans and sends a reservation request.

[1525] For example, the user selects "Plan A."

[1526] Step 11:

[1527] The terminal transmits the user's selection information to the server.

[1528] Step 12:

[1529] The server checks the details of the selected plan and makes the reservation by sending a request to the accommodation reservation API or transportation reservation API.

[1530] Step 13:

[1531] The external API successfully completes the reservation process and sends the reservation confirmation information back to the server.

[1532] Step 14:

[1533] The server sends the reservation confirmation information received from the external API to the user terminal.

[1534] Step 15:

[1535] The terminal displays a confirmation to the user, notifying them of a successful reservation.

[1536] For example, it will say, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1537] Through this series of processes, users can quickly obtain the optimal travel plan based on their desired conditions and emotional state, and can complete their travel reservations without any hassle.

[1538] Example 2

[1539] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1540] Conventional travel plan generation systems create travel plans based solely on the user's desired conditions, without taking the user's emotional state into consideration, making it difficult to provide optimal plans. Furthermore, the technology for efficiently managing and processing data obtained from multiple external information sources was immature, making it difficult to increase user satisfaction. Therefore, there is a need for a system that takes the user's emotional state into consideration and provides optimal travel plans.

[1541] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1542] In this invention, the server includes means for inputting the conditions of a user's desired trip, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions and emotional information from the terminal, means for an AI model to generate an optimal trip plan using the acquired information and the user's emotional information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, and means for transmitting reservation confirmation information to the user. This makes it possible to provide an optimal trip plan that takes into account the user's emotional state.

[1543] "User" refers to an individual or group that uses the system to input desired travel conditions, select a travel plan, and complete the booking process.

[1544] "Travel criteria" refers to parameters such as a traveler's desired destination, budget, activities, and type of accommodation.

[1545] "Terminal" refers to the device (smartphone, tablet, PC, etc.) used by the user to enter desired travel conditions and communicate with the server.

[1546] "Server" refers to the computer system that processes data received from users, communicates with external sources, and generates optimal travel plans.

[1547] "Emotional information" refers to the emotional state (joy, excitement, anxiety, fatigue, etc.) obtained by analyzing the user's facial expressions and voice, which are acquired from the camera and microphone installed on the device.

[1548] "External sources" refers to external databases or APIs that provide information on transportation, accommodation, activities, etc.

[1549] "AI model" refers to algorithms and programs that use artificial intelligence technology to generate optimal travel plans based on users' desired conditions and emotional information.

[1550] A "travel plan" refers to a travel proposal consisting of a combination of transportation, accommodation, and activities, created based on the user's desired conditions and emotional information.

[1551] "Booking Process" refers to the accommodation and transport booking process carried out with an external source based on the selected travel plan.

[1552] "Reservation confirmation information" refers to information such as reservation details and confirmation number provided to a user after completing the reservation process.

[1553] The present invention is a system for generating and providing an optimal travel plan based on a user's desired conditions and taking into consideration the user's emotional information. Specific embodiments for carrying out the present invention will be described below.

[1554] User processing

[1555] 1. User:

[1556] The user enters desired travel conditions into an input form on the terminal. For example, the conditions might be, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a hotel with 3 stars or more."

[1557] 2. Terminal:

[1558] The device temporarily stores the desired conditions entered by the user and prepares to send them to the server. At this time, the data is converted into an appropriate format (for example, JSON format) and sent to the server.

[1559] Emotion recognition by emotion engine

[1560] 1. Device:

[1561] When the user inputs travel conditions, the device uses the device's built-in camera and microphone to collect the user's emotions in real time from facial expressions and voice.

[1562] 2. Emotion Engine:

[1563] The emotional information transmitted from the terminal is analyzed to determine the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.), which is reflected in the generation of a travel plan.

[1564] Server-side processing

[1565] 1. Server:

[1566] The server receives the conditions and emotional information sent by the user, analyzes the data, and extracts key elements, such as "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[1567] 2. Collaboration with external sources:

[1568] Based on the extracted conditions and emotion information, the server sends requests to external transport information APIs, accommodation APIs, and activity information APIs to obtain related travel information. For example, a search for "hot springs in Tokyo" is performed using the TripAdvisor API, and transportation methods to Tokyo are obtained using the Google Maps API. Furthermore, a hotel search API is used to obtain information on hotels with three or more stars in Tokyo.

[1569] 3. Generating optimal travel plans using AI models:

[1570] The server uses the acquired travel information and the user's emotional information to generate multiple travel plans using a generative AI model. It evaluates the elements of each plan (cost, travel time, convenience, etc.) and constructs the optimal plan that matches the user's emotional state. For example, it generates Plan A and Plan B as follows:

[1571] Plan A: If you are currently feeling excited, this plan includes a lot of active activities. It includes a Shinkansen (round trip: 20,000 yen), a 3-star hotel A (2 nights: 40,000 yen), a hot spring tour (10,000 yen), and a sightseeing tour (15,000 yen), for a total of 85,000 yen.

[1572] Plan B: If you are currently feeling emotionally exhausted, this plan includes a lot of relaxing activities. It includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen), for a total of 90,000 yen.

[1573] 4. Server Presentation:

[1574] The server transmits the generated itineraries to the user terminal, which displays them to the user and allows the user to select one.

[1575] Processing reservations

[1576] 1. User:

[1577] The user selects the desired plan from the presented plans and submits a reservation request. For example, the user selects "Plan A."

[1578] 2. Terminal:

[1579] The user's selection information is sent to the server.

[1580] 3. Server:

[1581] The server checks the details of the selected plan and sends a request to the accommodation booking API or transportation booking API to complete the reservation. If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[1582] 4. Provide Verification Information:

[1583] The server sends the reservation confirmation information received from the external API to the user's terminal. The terminal displays the confirmation information to the user, displaying a message such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1584] Examples and prompts

[1585] Specific examples

[1586] If a user inputs "I want to go to Kyoto. My budget is 50,000 yen. I want to visit temples. I want to stay in a two-star or higher accommodation," the system will generate a plan like this:

[1587] Plan A: If you are currently feeling excited, this plan includes active activities. It includes a Shinkansen (round trip 10,000 yen), a two-star accommodation A (20,000 yen for two nights), and a temple tour (5,000 yen), for a total of 35,000 yen.

[1588] Plan B: If you are currently feeling emotionally exhausted, this plan includes relaxing activities. It includes bus travel (5,000 yen round trip), two-star accommodation B (15,000 yen for two nights), and a relaxing temple tour (5,000 yen), for a total of 25,000 yen.

[1589] Prompt statement

[1590] Example of an input prompt for a generative AI model:

[1591] "The user wants to travel to Kyoto, with a budget of 50,000 yen or less, and wants to visit temples. He also wants accommodations that are at least two stars. Based on these conditions and the user's current emotional state, generate the optimal travel plan."

[1592] With the above configuration, the user can quickly obtain the most suitable travel plan and can easily make suggestions and reservations that take into account the user's own emotional state.

[1593] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1594] Step 1:

[1595] User input of desired travel conditions

[1596] The user enters their desired travel conditions (e.g., "I want to go to Tokyo. My budget is within 100,000 yen. I want to bathe in hot springs. I want to stay in a three-star or higher hotel.") into an input form on the device. This input data includes travel destination, budget, desired activities, and accommodation conditions. The device receives the input from the user and temporarily stores it.

[1597] Input: Travel requirements (destination, budget, activities, accommodation requirements)

[1598] Output: Temporarily saved travel preferences

[1599] Step 2:

[1600] Terminal receives data and prepares it for transmission

[1601] The device temporarily stores the desired conditions entered by the user, converts the data into an appropriate format (for example, JSON format), and sends the converted data to the server.

[1602] Input: Temporarily saved travel preferences

[1603] Output: The transformed data to send to the server.

[1604] Step 3:

[1605] Collecting emotional information from devices

[1606] While the user is entering travel information, the device's built-in camera and microphone are used to collect emotional information from the user's facial expressions and voice in real time, which is then analyzed later.

[1607] Input: User's facial and voice data

[1608] Output: Collected emotion information

[1609] Step 4:

[1610] Emotion recognition by emotion engine

[1611] The device sends the collected emotional information to the emotion engine, which analyzes it and determines the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.).

[1612] Input: Collected emotion information

[1613] Output: Parsed emotional state

[1614] Step 5:

[1615] Data reception and analysis by the server

[1616] The server receives the user's desired conditions and emotional information sent from the device. It analyzes the received data and extracts key elements necessary for generating a travel plan. Specifically, these elements include "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[1617] Input: User's desired conditions, analyzed emotional state

[1618] Output: Extracted elements

[1619] Step 6:

[1620] Server-based linkage with external information sources and information acquisition

[1621] Based on the analyzed conditions and sentiment information, the server sends requests to external information sources (APIs) such as transportation information, accommodations, and activities to obtain related travel information. For example, a search for "hot springs in Tokyo" can be performed using TripAdvisor's API, transportation methods to Tokyo can be obtained using Google Maps' API, and hotel search APIs can be used to obtain information on hotels with three or more stars.

[1622] Input: Extracted elements

[1623] Output: Acquired travel information (traffic information, accommodation information, activity information)

[1624] Step 7:

[1625] Generate optimal travel plans using AI models

[1626] The server uses a generative AI model to generate multiple travel plans based on the acquired travel information and the user's emotional information. It evaluates the elements of each plan (cost, travel time, convenience, etc.) and creates the optimal plan that matches the user's emotions. For example, if the user is currently excited, it will generate a plan that includes many active activities, and if the user is tired, it will generate a relaxing plan.

[1627] Input: Acquired travel information, user's emotional information

[1628] Output: Multiple generated itineraries

[1629] Step 8:

[1630] Server sends plan to user device

[1631] The server sends the generated travel plans to the user's terminal, which displays them to the user and allows the user to select one of the plans.

[1632] Input: Multiple generated itineraries

[1633] Output: The travel plan sent to the user's device

[1634] Step 9:

[1635] User selects plan and submits reservation request

[1636] The user selects the desired plan from the presented plans and sends a reservation request from the terminal to the server. For example, the user selects "Plan A."

[1637] Input: User selects plan

[1638] Output: Reservation request data

[1639] Step 10:

[1640] Receiving reservation information by the terminal and sending it to the server

[1641] The terminal receives reservation information for the plan selected by the user and transmits it to the server.

[1642] Input: User selected plan information

[1643] Output: Reservation information sent to the server

[1644] Step 11:

[1645] Server executes reservation procedure

[1646] The server sends a request to the accommodation booking API or transportation booking API based on the selected plan and makes the reservation. If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[1647] Input: Reservation information sent to the server

[1648] Output: Reservation confirmation information

[1649] Step 12:

[1650] The server creates reservation confirmation information and sends it to the user's device

[1651] The server creates confirmation information to provide to the user based on the reservation confirmation information received from the external API, and sends this confirmation information to the user's terminal.

[1652] Input: Reservation confirmation information

[1653] Output: Reservation confirmation information sent to the user's terminal

[1654] Step 13:

[1655] Displaying reservation confirmation information to the user via the terminal

[1656] The terminal displays the reservation confirmation information received from the server to the user. For example, a message such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1657] Input: Reservation confirmation information sent to the user's terminal

[1658] Output: Booking confirmation information displayed to the user

[1659] (Application example 2)

[1660] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1661] Conventional travel plan generation systems do not take into account the user's emotional state, making it difficult to generate travel plans that are suitable for users who are tired or want to relax. Furthermore, plans are not adjusted in real time based on the user's emotions, which can lead to a decrease in user satisfaction. Therefore, there is a need for flexible travel plans that reflect the user's emotional state.

[1662] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1663] In this invention, the server includes means for inputting the user's desired travel conditions, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions, means for an AI model to generate an optimal travel plan using the acquired information, means for presenting the generated multiple travel plans to the user, means for completing a reservation procedure based on the travel plan selected by the user, means for transmitting reservation confirmation information to the user, and means for recognizing the user's emotional state using a camera and microphone mounted on the vehicle and reflecting the recognized emotional state in the travel plan. This makes it possible to generate and present an optimal travel plan that takes the user's emotional state into consideration and adjust the travel plan in real time.

[1664] "User" means an individual who uses the System to plan and book a trip.

[1665] "Conditions" refers to information that indicates the specific elements of a user's desired trip, including destination, budget, activities, accommodation requirements, etc.

[1666] "Server" refers to a central processing unit that retrieves data from external sources based on the conditions sent by the user, generates optimal travel plans using AI models, and makes proposals and reservations for the user.

[1667] "Means" refer to equipment, software, processes, etc. used to achieve a specific function.

[1668] "External sources" refers to external databases or APIs that provide information on transportation, accommodation, activities, etc.

[1669] "Travel Information" means travel-related data obtained from external sources, such as information about transportation, accommodation, activities, etc.

[1670] An "AI model" is an algorithm that learns from large amounts of data and generates optimal travel plans based on specific conditions.

[1671] The "camera" is a photographing device for capturing the user's facial expressions in real time.

[1672] A "microphone" is a recording device that captures the user's voice in real time.

[1673] "Emotional state" is information that indicates the user's psychological state, and refers to emotions recognized from facial expressions and voice (e.g., joy, excitement, anxiety, fatigue, etc.).

[1674] "Itinerary" refers to detailed travel recommendations generated based on the user's criteria and emotional state, such as combinations of destinations, transportation, accommodations, and activities.

[1675] "Reservation process" means the process of officially booking accommodation and transportation based on the travel plan selected by the User.

[1676] "Reservation confirmation information" refers to information sent to the user after the reservation procedure is completed that confirms and certifies the reservation details.

[1677] System configuration

[1678] This invention is an AI service system for autonomous vehicles that automatically handles everything from travel planning to booking, and by combining it with an emotion engine, it provides optimal travel plans that take into account the user's emotional state. The system consists of the following elements:

[1679] 1. User terminal

[1680] This is a device where users input their desired travel conditions. It is installed in the infotainment system of an autonomous vehicle and includes a display that can be operated by voice or touch panel.

[1681] 2. Server

[1682] It is a central processing unit that obtains travel information from external sources based on conditions sent by users and generates optimal travel plans using AI models.

[1683] 3. External information sources (API)

[1684] These are external databases and services that provide information on transportation, accommodation, activities, etc., and work in conjunction with the server to provide travel information.

[1685] 4. Emotion Engine

[1686] The engine uses cameras and microphones installed in the vehicle to recognize the emotional state of the user from their facial expressions and voice. The recognized emotional state is reflected in the generation and adjustment of the travel plan.

[1687] Program processing

[1688] 1. The user enters the conditions

[1689] Passengers input their travel preferences via the autonomous vehicle's infotainment system, including where they want to go, their budget, the activities they want to do, and their preferred accommodations.

[1690] 2. Recognizing emotional states

[1691] Cameras and microphones installed in the vehicle capture the user's facial expressions and voice, which are then analyzed by an emotion engine to recognize the user's emotional state.

[1692] 3. Processing on the Server

[1693] The server receives the user's input conditions and the recognized emotional state, and based on this, retrieves the necessary travel information from external sources, such as transportation information API, accommodation information API, and activity information API.

[1694] Based on the acquired information, the AI ​​model generates an optimal travel plan, taking into account the perceived emotional state and designing a plan that meets the user's psychological needs.

[1695] 4. Presenting your travel plans

[1696] The server then sends the generated itineraries to the vehicle's infotainment system, where the user can view them on the display and select the one they want.

[1697] 5. Completing the reservation process

[1698] Based on the travel plan selected by the user, the server processes the reservation of accommodation and transportation. The reservation confirmation information is sent back to the vehicle's system for the user to check.

[1699] Specific examples

[1700] For example, if a user inputs, "I want to go to Nara. My budget is within 50,000 yen. I want to visit temples. I want accommodations that are two stars or higher," and the server recognizes that the user's emotional state is relaxed, the server will generate multiple travel plans, such as a "relaxing temple tour course" and a "course with a relaxing hot spring."

[1701] Prompt example (text format)

[1702] The following information is required to generate your itinerary:

[1703] Places I want to go: Nara

[1704] Budget: Under 50,000 yen

[1705] Favorite activity: Visiting temples

[1706] Accommodation requirements: 2 stars or more

[1707] Current emotional state: Relaxed

[1708] Generate the best itinerary based on this criteria.

[1709] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1710] Step 1:

[1711] The user enters the conditions

[1712] Users use the infotainment system of the autonomous vehicle to input their travel preferences, including desired destinations, budget, desired activities, accommodation requirements, etc. The input data is temporarily stored on the vehicle terminal and used for subsequent processing.

[1713] Input: User's travel requirements (destination, budget, activities, accommodation requirements, etc.)

[1714] Output: Saved user travel preferences

[1715] Step 2:

[1716] Recognition of emotional states

[1717] The vehicle's onboard camera and microphone capture the user's facial expressions and voice. The emotion engine analyzes this data and recognizes the user's current emotional state, which is then used in the next step.

[1718] Input: facial and voice data captured from the camera and microphone

[1719] Output: Perceived user emotional state (e.g., relaxed, excited, anxious, etc.)

[1720] Step 3:

[1721] Receiving conditions and emotional states on the server

[1722] The terminal transmits the user's input travel preferences and the recognized emotional state to the server, which receives and analyzes the data. The received data is used for subsequent data acquisition and plan generation.

[1723] Input: User's travel preferences and perceived emotional state

[1724] Output: Analyzed condition and emotional state data

[1725] Step 4:

[1726] Obtaining travel information

[1727] The server retrieves travel information from external sources based on the analyzed conditions and emotional state, specifically by sending requests to APIs for transportation information, accommodation information, and activity information to obtain the necessary data.

[1728] Input: Analyzed travel preferences and emotional state

[1729] Output: Travel information obtained from external sources (transportation, accommodation, and activity details)

[1730] Step 5:

[1731] Generate a travel plan

[1732] The server uses an AI model to generate an optimal travel plan based on the acquired travel information and the user's emotional state. The AI ​​model evaluates factors such as cost, travel time, and convenience, and creates multiple plans. The generated plan is adjusted to match the user's emotional state.

[1733] Input: Acquired travel information and emotional state data

[1734] Output: Multiple generated itineraries

[1735] Step 6:

[1736] Presenting your travel plan

[1737] The server sends the generated travel plan to the user's terminal, which receives it and displays it on the vehicle's display. The user can then compare the plans and select one.

[1738] Input: Generated itinerary

[1739] Output: Travel plan displayed on user's device

[1740] Step 7:

[1741] Completing the reservation process

[1742] Based on the travel plan selected by the user, the server processes the reservation of accommodation and transportation, sends a request to an external API, and executes the reservation process. The reservation confirmation information is sent back to the vehicle's system and displayed to the user.

[1743] Input: Travel plan selected by user

[1744] Output: Confirmation of completed booking

[1745] Step 8:

[1746] Real-time adjustment based on emotional state

[1747] As the travel plan progresses, the user's emotional state is monitored in real time. If a change in emotional state is detected, the server adjusts the plan as needed to ensure the user has an optimal experience. This adjustment is made by obtaining additional information from external sources.

[1748] Input: User's real-time emotional state

[1749] Output: Coordinated itinerary and activities

[1750] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1751] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1752] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1753] [Fourth embodiment]

[1754] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1755] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1756] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1757] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1758] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1759] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1760] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1761] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1762] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1763] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1764] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1765] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1766] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1767] The present invention is an AI service system that automatically performs the entire process from planning to booking a trip. Specific embodiments of the present invention will be described below.

[1768] System Overview

[1769] In this system, users input their desired travel conditions from their terminal, and the server generates the optimal travel plan based on that information and completes the booking process.The main components are the user terminal, the server, and an external information source (API).

[1770] User processing

[1771] 1. User:

[1772] Users input their desired travel conditions into an input form on their device, including the places they want to go, their budget, the activities they want to do, and the accommodations they want.

[1773] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[1774] 2. Terminal:

[1775] The conditions entered by the user are temporarily saved and prepared for transmission to the server.

[1776] Convert the conditions into an appropriate format and send the data to the server.

[1777] Server-side processing

[1778] 1. Server:

[1779] The server receives the conditions sent by the user.

[1780] The received data is parsed and key elements are extracted, such as keywords like "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 stars or more."

[1781] 2. Integration with external APIs:

[1782] The server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain the necessary information.

[1783] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[1784] 3. AI-powered optimal travel plan generation:

[1785] Based on the acquired information, the AI ​​model generates multiple travel plans, taking into account relevant factors (cost, travel time, convenience, etc.) to create the optimal plan.

[1786] For example, generate Plan A and Plan B as shown below.

[1787] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[1788] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[1789] 4. Present to the user:

[1790] The server transmits the generated travel plans to the user terminal.

[1791] The user terminal displays the plans and allows the user to select one.

[1792] Processing reservations

[1793] 1. User:

[1794] The user selects a desired plan from the presented plans and sends a reservation request.

[1795] For example, the user selects "Plan A."

[1796] 2. Terminal:

[1797] The user's selection information is sent to the server.

[1798] 3. Server:

[1799] Check the details of the selected plan and make the reservation by sending a request to the accommodation booking API or transportation booking API.

[1800] If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[1801] 4. User confirmation:

[1802] The server sends the reservation confirmation information received from the external API to the user terminal.

[1803] The user terminal displays confirmation information to the user, such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1804] This system allows users to quickly obtain the optimal travel plan based on their desired conditions, and complete travel reservations hassle-free.

[1805] The processing flow will be explained below.

[1806] Step 1:

[1807] The user enters their desired travel conditions into an input form on the terminal, including the place they want to go, their budget, the activities they want to do, and the conditions for the accommodation they want.

[1808] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[1809] Step 2:

[1810] The terminal temporarily stores the conditions entered by the user and prepares to send them to the server, converts the conditions into an appropriate format, and sends the data to the server.

[1811] Step 3:

[1812] The server receives the conditions sent by the user. It parses (analyzes) the received data and extracts key elements. For example, keywords such as "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 stars or more."

[1813] Step 4:

[1814] Based on the extracted conditions, the server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain related travel information.

[1815] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[1816] Step 5:

[1817] The server uses an AI model to generate multiple travel plans based on the acquired information, and creates the optimal plan by taking into account factors for each plan (cost, travel time, convenience, etc.).

[1818] For example, generate Plan A and Plan B as shown below.

[1819] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[1820] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[1821] Step 6:

[1822] The server transmits the generated travel plans to the user's terminal.

[1823] The terminal displays the plans to the user and allows the user to select one.

[1824] Step 7:

[1825] The user selects a desired plan from the presented plans and sends a reservation request.

[1826] For example, the user selects "Plan A."

[1827] Step 8:

[1828] The terminal transmits the user's selection information to the server.

[1829] Step 9:

[1830] The server checks the details of the selected plan and makes the reservation by sending a request to the accommodation reservation API or transportation reservation API.

[1831] Step 10:

[1832] The external API successfully completes the reservation process and sends the reservation confirmation information back to the server.

[1833] Step 11:

[1834] The server sends the reservation confirmation information received from the external API to the user's device.

[1835] Step 12:

[1836] The terminal displays a confirmation to the user, notifying them of a successful reservation.

[1837] For example, it will say, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1838] This series of processes allows the user to quickly obtain the optimal travel plan based on their desired conditions, and complete their travel reservation without any hassle.

[1839] Example 1

[1840] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1841] A problem with conventional travel planning and reservation systems is that users have to conduct their own research and find a plan that meets their requirements, which requires a lot of time and effort. It is also difficult to manually assemble an optimal plan by collecting information from multiple sources. Another problem is that errors are likely to occur during the reservation process, resulting in a poor user experience. The purpose of this invention is to automate the entire process from travel planning to booking, reducing users' time and effort, and providing more efficient travel plans and accurate reservation procedures.

[1842] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1843] In this invention, the server includes means for inputting the conditions of a user's desired trip, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions, means for a generative AI model to generate an optimal trip plan using the acquired information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, means for transmitting reservation confirmation information to the user, means for analyzing received data using the input conditions as a key and extracting relevant elements, and a generative AI model that creates multiple trip plans based on the acquired information and evaluates each plan taking into account its details (cost, travel time, convenience).This enables users to efficiently and quickly obtain optimal trip plans and complete the reservation procedure with fewer errors.

[1844] "User" means a person who uses this system to plan and book a trip.

[1845] "Conditions" refers to the desired information that a user enters for travel planning (e.g., travel destination, budget, activities, accommodation requirements, etc.).

[1846] "Server" refers to a central processing unit that retrieves information from relevant external sources based on the input conditions, generates a travel plan using an AI model, and processes the reservation.

[1847] "External information source" refers to an external information system that provides transportation information, accommodation information, activity information, etc.

[1848] An "AI model" is an artificial intelligence algorithm that generates optimal travel plans based on acquired travel information.

[1849] "Travel Plan" refers to multiple travel suggestions generated by an AI model and presented to users.

[1850] The "reservation procedure" is a process for finalizing various reservations based on the travel plan selected by the user.

[1851] "Reservation confirmation information" is confirmation information sent to the user when the reservation procedure is completed, and includes reservation details.

[1852] "Analysis" refers to the process in which the server receives the input conditions and extracts the necessary information.

[1853] "Evaluation" is the process of determining how optimal the generated travel plan is in terms of cost, travel time, and convenience.

[1854] MODE FOR CARRYING OUT THE INVENTION

[1855] The present invention is an AI service system that automatically performs everything from planning to booking a trip. A specific embodiment of this system will be described below.

[1856] System Overview

[1857] In this system, users input their desired travel conditions from their devices, and the server then generates an optimal travel plan based on that information and completes the booking process. The main components are the user device, the server, and an external information source (API). The hardware used includes general computers and communication networks, while the software includes an AI model, an API client, and a data analysis tool.

[1858] User processing

[1859] 1. User:

[1860] The user enters their desired travel conditions into an input form on the terminal, including the desired destination, budget, activities they would like to do, and accommodation requirements.

[1861] For example, enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[1862] 2. Terminal:

[1863] The device temporarily saves the conditions entered by the user, converts the input data into JSON format, and prepares to send it to the server.

[1864] Specifically, the conditions are converted into an appropriate format and sent to the server as an HTTP request.

[1865] Server-side processing

[1866] 1. Server:

[1867] The server receives the condition data sent by the user, analyzes it using a JSON parser, and extracts key elements, such as keywords like "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 or more stars."

[1868] 2. Integration with external APIs:

[1869] The server obtains information by sending requests to external traffic information APIs, accommodation APIs, and activity information APIs.

[1870] External information sources include a traffic information API, accommodation API, and activity information API, from which the necessary information is obtained.

[1871] As a concrete example, you can request information on "three-star or higher hotels in Tokyo" from the accommodation API, and request "transportation methods to Tokyo (bullet train, airplane, etc.)" from the transportation information API.

[1872] 3. AI-powered travel plan generation:

[1873] The server generates multiple itineraries using a generative AI model based on information obtained from external APIs. The AI ​​model evaluates the itineraries based on cost, travel time, and convenience, and generates the optimal itinerary.

[1874] For example, the AI ​​model generates Plan A and Plan B as follows:

[1875] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[1876] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[1877] 4. Present to the user:

[1878] The server sends the generated travel plans to the user terminal, and the user can select one of the plans presented.

[1879] Processing reservations

[1880] 1. User:

[1881] The user selects the desired plan from the presented plans and submits a reservation request. For example, the user selects "Plan A."

[1882] 2. Terminal:

[1883] The terminal transmits information about the plan selected by the user to the server.

[1884] 3. Server:

[1885] The server checks the details of the selected plan and sends a reservation request to the accommodation booking API and the transport booking API. For example, it reserves "two nights at a three-star hotel A" with the accommodation booking API and reserves "round-trip Shinkansen tickets" with the transport booking API.

[1886] 4. User confirmation:

[1887] The server receives the reservation confirmation information from the external API and sends it to the user's terminal. A confirmation message is displayed saying, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[1888] Specific examples

[1889] Travel planning prompts:

[1890] I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a 3-star or higher hotel.

[1891] Booking confirmation prompt:

[1892] I have selected Plan A. Please proceed with your reservation.

[1893] This system allows users to efficiently obtain the best travel plan based on their desired conditions and complete travel reservations hassle-free.

[1894] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1895] Step 1:

[1896] Input: The user enters their travel preferences (destination, budget, activities, accommodation requirements, etc.) into the device.

[1897] Specific operation: The user enters the following into the input form on the device: "I want to go to Tokyo. My budget is within 100,000 yen. I want to go to a hot spring. I want to stay in a hotel with 3 stars or more."

[1898] Output: The user's input data is saved to the terminal.

[1899] Step 2:

[1900] Input: User input data that is saved.

[1901] Specific operation: The terminal converts the data entered by the user into JSON format and prepares to send it to the server. Specific data format conversion processing is performed.

[1902] Output: JSON formatted trip conditions data.

[1903] Step 3:

[1904] Input: Trip conditions data in JSON format.

[1905] Specific operation: The device sends the converted JSON data to the server as an HTTP request.

[1906] Output: The server receives the JSON data.

[1907] Step 4:

[1908] Input: JSON formatted travel conditions data received by the server.

[1909] Specific operation: The server uses a JSON parser to parse the user's search criteria data. Specifically, it extracts keywords such as "Tokyo," "under 100,000 yen," "hot springs," and "hotels with 3 or more stars."

[1910] Output: Extracted keyword data.

[1911] Step 5:

[1912] Input: Extracted keyword data.

[1913] Specific operation: The server sends requests to the traffic information API, accommodation API, and activity information API to obtain information. For example, it requests information such as "transportation to Tokyo" from the traffic information API, "three-star or higher hotels in Tokyo" from the accommodation API, and "hot springs in Tokyo" from the activity information API.

[1914] Output: Obtained external information data (information on transportation, accommodation, activities).

[1915] Step 6:

[1916] Input: Acquired external information data.

[1917] Specific operation: The server generates a travel plan using a generative AI model based on the acquired information. The AI ​​model evaluates each travel element and creates multiple travel plans. For example, it evaluates based on cost, travel time, and convenience, and generates the following Plan A and Plan B.

[1918] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star hotel A (40,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 70,000 yen.

[1919] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[1920] Output: Multiple trip plan data.

[1921] Step 7:

[1922] Input: Multiple itinerary data.

[1923] Specific operations: The server transmits the generated travel plan to the user terminal.

[1924] Output: Travel plan data received by the user device.

[1925] Step 8:

[1926] Input: Travel plan data received by the user device.

[1927] Specific operation: The terminal displays the plans received from the server on the user interface and allows the user to select one.

[1928] Output: Multiple itineraries are displayed for the user to choose from.

[1929] Step 9:

[1930] Input: Multiple proposed travel plans.

[1931] Specific operation: The user selects the desired plan and sends a reservation request such as "Plan A has been selected. Please proceed with the reservation."

[1932] Output: Booking request data.

[1933] Step 10:

[1934] Input: Booking request data.

[1935] Specific operation: The terminal transmits the user's selection information to the server.

[1936] Output: The reservation request data received by the server.

[1937] Step 11:

[1938] Input: The reservation request data received by the server.

[1939] Specific operation: The server checks the details of the selected plan and sends a reservation request to the accommodation booking API and the transportation booking API. For example, it sends "two nights at a three-star hotel A" to the accommodation API and "round-trip Shinkansen ticket" to the transportation API.

[1940] Output: Booking result data.

[1941] Step 12:

[1942] Input: Booking result data.

[1943] Specific operation: The server receives reservation confirmation information from the external API and sends confirmation information such as "Hotel A reservation number XXX" and "Shinkansen reservation number YYY" to the user terminal.

[1944] Output: The confirmation information received by the user device.

[1945] Step 13:

[1946] Input: The confirmation information received by the user device.

[1947] Specific operation: The terminal displays the reservation confirmation information received from the server to the user, and displays a confirmation message such as "Your Shinkansen and hotel reservations have been completed. The reservation number is XXX."

[1948] Output: The booking confirmation message that is displayed to the user.

[1949] (Application example 1)

[1950] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1951] Conventional travel plan generation systems only provide plans based on travel conditions entered by the user, but lack the functionality and support to optimize the shopping experience in physical stores. In particular, they lack a mechanism to efficiently obtain information on the products and budget that users want, as well as the best stores, and to simplify the purchasing process. This means that users end up spending a lot of time and effort visiting multiple stores to find the best products and stores.

[1952] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1953] In this invention, the server includes means for inputting the conditions of a desired trip from a user, means for transmitting the input conditions to the server, means for the server to acquire travel information from related external information sources based on the conditions, means for an AI model to generate an optimal trip plan using the acquired information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, means for transmitting reservation confirmation information to the user, additional means for the user to input desired product information and budget, additional means for acquiring product information from related external information sources based on the input product conditions, additional means for generating an optimal product list and store information using the acquired product information, additional means for presenting the generated multiple product lists and store information to the user and completing a purchase procedure based on the products and store selected by the user, and additional means for transmitting the purchase confirmation information to the user. This allows users to not only plan their trip efficiently in a short amount of time, but also to simultaneously enjoy an optimal shopping experience at physical stores.

[1954] "User" refers to an individual who uses the system to input travel and shopping conditions and select the most suitable plan or product.

[1955] "Travel conditions" refers to elements related to a user's desired trip, such as destination, budget, activities to do, and desired accommodation conditions.

[1956] "Server" refers to a computer system that receives input data from users, obtains necessary information in cooperation with external information sources, generates an optimal plan using an AI model, and presents it to users.

[1957] "External information source" refers to an information source such as an external API or database that the server uses to obtain travel information or product information.

[1958] "Travel Information" refers to data collected about transportation, accommodation, and activities.

[1959] "Product information" refers to data such as the acquired product price, availability, ratings, popularity, etc.

[1960] "AI model" refers to the artificial intelligence algorithm used by the server to generate optimal plans and lists using the acquired travel and product information.

[1961] A "travel plan" refers to the optimal combination of travel schedule, course, and accommodation generated by an AI model and presented to the user.

[1962] "Product list" refers to a list generated by an AI model that includes the most suitable products and stores based on the user's desired conditions, as well as instructions on how to purchase them.

[1963] "Reservation procedure" refers to the series of processes in which a user makes reservations for accommodation, transportation, etc. based on the travel plan selected by the user.

[1964] "Purchase procedure" refers to the process of actually purchasing a product based on the product and store selected by the user.

[1965] "Reservation confirmation information" refers to information sent to a user to confirm that the reservation or purchase process has been successfully completed.

[1966] This invention is a system that automates the entire process from planning to booking a trip, as well as optimizing the shopping experience in brick-and-mortar stores. This system allows users to input their desired travel and product requirements, and then generates and presents optimal plans and product lists based on those inputs.

[1967] System configuration and operation

[1968] 1. User-side processing

[1969] Users use their smartphones or smart glasses to input their desired conditions (travel conditions or product conditions). For example, they might input, "I want to go to Tokyo, my budget is within 100,000 yen, and I want to go to a hot spring," or "I want to buy the latest smartphone within 20,000 yen."

[1970] 2. Terminal processing

[1971] The application installed on the smartphone or smart glasses temporarily stores the conditions entered by the user and prepares them to be sent to the server. This application is built using a mobile app development platform such as React Native or Flutter. It also validates the user input and displays error messages.

[1972] 3. Server-side processing

[1973] The server receives and analyzes the conditions sent by the user. It then obtains the necessary information from external sources, such as:

[1974] External sources of travel information: Transportation information API, Accommodation information API, Activity information API (e.g., Travel information API)

[1975] External sources of product conditions: Product information API (e.g., Web Special Offers API), Map information API (e.g., Map Service API)

[1976] The server is implemented using Node.js and Express, and the acquired information is stored in a database such as MongoDB, which centralizes the information and responds quickly to required processing.

[1977] Using the information obtained, the server generates optimal itineraries and product listings using an AI model built using TensorFlow and PyTorch that takes into account factors such as cost, travel time, convenience, ratings, and popularity.

[1978] 4. AI-generated plans

[1979] The AI ​​model will learn and generate a plan based on the following prompt:

[1980] Example prompt for generating a travel plan: "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring."

[1981] Example prompt for generating a product list: "Create a list of reliable stores for the latest smartphones within a budget of ¥20,000."

[1982] The generated travel plan and product list are sent from the server to the user terminal and presented to the user.

[1983] 5. Reservation and purchase procedures

[1984] The user selects from the list of plans and products presented and sends the selection information to the server. The server then executes the reservation or purchase procedure via the API and sends a confirmation to the user if successful.

[1985] This system not only allows users to plan their trips quickly and efficiently, but also allows them to enjoy the best possible shopping experience in physical stores.

[1986] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1987] Step 1:

[1988] Users use an application installed on their smartphone or smart glasses to input travel and product requirements. For example, they might input, "I want to go to Tokyo, my budget is 100,000 yen, and I want to bathe in hot springs," or "I want to buy the latest smartphone within a budget of 20,000 yen."

[1989] Input: Travel terms or product terms

[1990] Output: Data of the entered conditions

[1991] Step 2:

[1992] The terminal temporarily stores the conditions entered by the user, converts them into an appropriate format, and prepares to send them to the server.

[1993] Input: Data for the entered conditions

[1994] Data processing: Data format conversion

[1995] Output: Format converted condition data

[1996] Step 3:

[1997] The server receives the condition data sent by the user and analyzes it. Analysis is the process of extracting necessary key elements from the conditions.

[1998] Input: Format converted condition data

[1999] Data analysis: Extraction of key elements (e.g., "Tokyo," "under 100,000 yen," "hot springs," etc.)

[2000] Output: Data with key elements extracted

[2001] Step 4:

[2002] The server accesses relevant external information sources (APIs) based on the key elements to obtain the necessary travel and product information. External information sources include travel information APIs, product information APIs, map service APIs, etc.

[2003] Input: Data from which key elements have been extracted

[2004] Data Acquisition: Acquiring information from external APIs

[2005] Output: Retrieved travel and product information

[2006] Step 5:

[2007] The server uses the acquired information to generate optimal travel plans and product listings using an AI model that takes into account factors such as cost, travel time, convenience, ratings, and popularity.

[2008] Input: Travel and product information obtained

[2009] Data Computation: Plan Generation Using AI Models

[2010] Output: Generated itinerary and product list

[2011] Step 6:

[2012] The server sends the generated travel plan and product list to the user's terminal, and the user selects the desired plan and product based on the presented information.

[2013] Input: Generated itinerary and product list

[2014] Data transmission: Sending information to the user terminal

[2015] Output: Plans and product list presented to the user

[2016] Step 7:

[2017] The user selects the desired travel plan or product from the presented list, and transmits the selected information from the terminal to the server.

[2018] Input: The plan or product selected by the user

[2019] Data transmission: Sends selected information to the server

[2020] Output: Information about the selected plan and product

[2021] Step 8:

[2022] The server performs reservation and purchase procedures based on the selected plan and product, using APIs such as accommodation reservation API, transportation reservation API, and product purchase API.

[2023] Input: Selected plan and product information

[2024] Data calculation and processing: Execution of reservation and purchase procedures

[2025] Output: Reservation confirmation information or purchase confirmation information

[2026] Step 9:

[2027] The server transmits reservation confirmation information and purchase confirmation information to the user terminal and displays the confirmed details to the user.

[2028] Input: Reservation confirmation information, purchase confirmation information

[2029] Data transmission: Send confirmation information to the user's device

[2030] Output: Confirmation to the user (e.g. "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX.")

[2031] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2032] The present invention aims to provide an optimal travel plan that takes into account the user's emotional state by combining an AI service system that automatically handles everything from travel planning to booking, with an emotion engine. Specific embodiments of the present invention are described below.

[2033] System Overview

[2034] In this system, users input their desired travel conditions from their terminal, and the server generates the optimal travel plan based on that information and completes the booking procedure. Furthermore, the system is configured so that an emotion engine recognizes the user's emotions and reflects them in the generation and proposal of travel plans. The main components are the user terminal, server, external information source (API), and emotion engine.

[2035] User processing

[2036] 1. User:

[2037] Users input their desired travel conditions into an input form on their device, including the places they want to go, their budget, the activities they want to do, and the accommodations they want.

[2038] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[2039] 2. Terminal:

[2040] Temporarily saves the conditions entered by the user and prepares them for sending to the server. Converts the conditions into an appropriate format and sends the data to the server.

[2041] Emotion recognition by emotion engine

[2042] 1. Device:

[2043] When a user inputs information, the device uses a camera and microphone to recognize the user's emotions in real time from facial expressions and voice.

[2044] 2. Emotion Engine:

[2045] The emotional information sent from the device is analyzed to determine the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.).

[2046] Server-side processing

[2047] 1. Server:

[2048] The server receives the conditions and emotional information sent by the user. It parses (analyzes) the received data and extracts key elements. For example, "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[2049] 2. Integration with external APIs:

[2050] Based on the extracted conditions and emotion information, the server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs to obtain related travel information.

[2051] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[2052] 3. AI-powered optimal travel plan generation:

[2053] Based on the acquired information and the user's emotional state, the AI ​​model generates multiple travel plans, evaluating each plan's elements (cost, travel time, convenience, etc.) to create the optimal plan that best suits the user's emotional state.

[2054] For example, generate Plan A and Plan B as shown below.

[2055] Plan A: If you are currently feeling excited, this plan includes a lot of active activities. It includes a Shinkansen (round trip: 20,000 yen), a 3-star hotel A (2 nights: 40,000 yen), a hot spring tour (10,000 yen), and a sightseeing tour (15,000 yen), for a total of 85,000 yen.

[2056] Plan B: If you are currently feeling emotionally exhausted, this plan includes a lot of relaxing activities. It includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen), for a total of 90,000 yen.

[2057] 4. Present to the user:

[2058] The server transmits the generated travel plans to the user terminal.

[2059] The user terminal displays the plans to the user, allowing the user to select one.

[2060] Processing reservations

[2061] 1. User:

[2062] The user selects a desired plan from the presented plans and sends a reservation request.

[2063] For example, the user selects "Plan A."

[2064] 2. Terminal:

[2065] The user's selection information is sent to the server.

[2066] 3. Server:

[2067] Check the details of the selected plan and make the reservation by sending a request to the accommodation booking API or transportation booking API.

[2068] If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[2069] 4. User confirmation:

[2070] The server sends the reservation confirmation information received from the external API to the user terminal.

[2071] The user terminal displays confirmation information to the user, such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[2072] This series of processes allows the user to quickly obtain the optimal travel plan based on their desired conditions, and also allows the user to effortlessly propose and book a plan that takes into account their emotional state.

[2073] The processing flow will be explained below.

[2074] Step 1:

[2075] The user enters their desired travel conditions into an input form on the terminal, including the place they want to go, their budget, the activities they want to do, and the conditions for the accommodation they want.

[2076] For example, you might enter, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a three-star or higher hotel."

[2077] Step 2:

[2078] The terminal temporarily stores the conditions entered by the user and prepares to send them to the server, converts the conditions into an appropriate format, and sends the data to the server.

[2079] Step 3:

[2080] The device uses the device's camera and microphone to capture the user's facial expressions and voice in real time during input.

[2081] Step 4:

[2082] An emotion engine analyzes the captured facial expressions and voice to identify the user's current emotional state.

[2083] For example, if the user is smiling, it is identified as "excited," and if the user is frowning, it is identified as "fatigue."

[2084] Step 5:

[2085] The terminal transmits the user's input travel desires and the emotional state identified by the emotion engine to the server.

[2086] Step 6:

[2087] The server receives the conditions and emotion information sent by the user, parses the received data, and extracts key elements.

[2088] For example, information such as "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excited."

[2089] Step 7:

[2090] The server sends requests to external traffic information APIs, accommodation APIs, and activity information APIs based on the extracted conditions and emotion information to obtain related travel information.

[2091] For example, you can use TripAdvisor's API to search for "hot springs in Tokyo," Google Maps' API to get information on transportation to Tokyo (such as bullet trains and airplanes), and Hotel Search API to get information on hotels in Tokyo with 3 stars or more.

[2092] Step 8:

[2093] The server uses an AI model to generate multiple travel plans based on the acquired information, evaluating each plan's elements (cost, travel time, convenience, etc.) and constructing the optimal plan that matches the user's emotional state.

[2094] For example, a plan including many active activities is generated for a user in an "excited" state, and a plan including many relaxing activities is generated for a user in a "fatigued" state.

[2095] Plan A: A plan that includes Shinkansen (20,000 yen round trip), 3-star Hotel A (40,000 yen for 2 nights), hot spring tour (10,000 yen) and sightseeing tour (15,000 yen) for a total of 85,000 yen.

[2096] Plan B: A plan that includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen) for a total of 90,000 yen.

[2097] Step 9:

[2098] The server transmits the generated travel plans to the user terminal.

[2099] The terminal displays the plans to the user and allows the user to select one.

[2100] Step 10:

[2101] The user selects a desired plan from the presented plans and sends a reservation request.

[2102] For example, the user selects "Plan A."

[2103] Step 11:

[2104] The terminal transmits the user's selection information to the server.

[2105] Step 12:

[2106] The server checks the details of the selected plan and makes the reservation by sending a request to the accommodation reservation API or transportation reservation API.

[2107] Step 13:

[2108] The external API successfully completes the reservation process and sends the reservation confirmation information back to the server.

[2109] Step 14:

[2110] The server sends the reservation confirmation information received from the external API to the user terminal.

[2111] Step 15:

[2112] The terminal displays a confirmation to the user, notifying them of a successful reservation.

[2113] For example, it will say, "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[2114] Through this series of processes, users can quickly obtain the optimal travel plan based on their desired conditions and emotional state, and can complete their travel reservations without any hassle.

[2115] Example 2

[2116] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2117] Conventional travel plan generation systems create travel plans based solely on the user's desired conditions, without taking the user's emotional state into consideration, making it difficult to provide optimal plans. Furthermore, the technology for efficiently managing and processing data obtained from multiple external information sources was immature, making it difficult to increase user satisfaction. Therefore, there is a need for a system that takes the user's emotional state into consideration and provides optimal travel plans.

[2118] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2119] In this invention, the server includes means for inputting the conditions of a user's desired trip, means for transmitting the input conditions to the server, means for the server to acquire travel information from relevant external information sources based on the conditions and emotional information from the terminal, means for an AI model to generate an optimal trip plan using the acquired information and the user's emotional information, means for presenting the generated multiple trip plans to the user, means for completing a reservation procedure based on the trip plan selected by the user, and means for transmitting reservation confirmation information to the user. This makes it possible to provide an optimal trip plan that takes into account the user's emotional state.

[2120] "User" refers to an individual or group that uses the system to input desired travel conditions, select a travel plan, and complete the booking process.

[2121] "Travel criteria" refers to parameters such as a traveler's desired destination, budget, activities, and type of accommodation.

[2122] "Terminal" refers to the device (smartphone, tablet, PC, etc.) used by the user to enter desired travel conditions and communicate with the server.

[2123] "Server" refers to the computer system that processes data received from users, communicates with external sources, and generates optimal travel plans.

[2124] "Emotional information" refers to the emotional state (joy, excitement, anxiety, fatigue, etc.) obtained by analyzing the user's facial expressions and voice, which are acquired from the camera and microphone installed on the device.

[2125] "External sources" refers to external databases or APIs that provide information on transportation, accommodation, activities, etc.

[2126] "AI model" refers to algorithms and programs that use artificial intelligence technology to generate optimal travel plans based on users' desired conditions and emotional information.

[2127] A "travel plan" refers to a travel proposal consisting of a combination of transportation, accommodation, and activities, created based on the user's desired conditions and emotional information.

[2128] "Booking Process" refers to the accommodation and transport booking process carried out with an external source based on the selected travel plan.

[2129] "Reservation confirmation information" refers to information such as reservation details and confirmation number provided to a user after completing the reservation process.

[2130] The present invention is a system for generating and providing an optimal travel plan based on a user's desired conditions and taking into consideration the user's emotional information. Specific embodiments for carrying out the present invention will be described below.

[2131] User processing

[2132] 1. User:

[2133] The user enters desired travel conditions into an input form on the terminal. For example, the conditions might be, "I want to go to Tokyo. My budget is under 100,000 yen. I want to go to a hot spring. I want to stay in a hotel with 3 stars or more."

[2134] 2. Terminal:

[2135] The device temporarily stores the desired conditions entered by the user and prepares to send them to the server. At this time, the data is converted into an appropriate format (for example, JSON format) and sent to the server.

[2136] Emotion recognition by emotion engine

[2137] 1. Device:

[2138] When the user inputs travel conditions, the device uses the device's built-in camera and microphone to collect the user's emotions in real time from facial expressions and voice.

[2139] 2. Emotion Engine:

[2140] The emotional information transmitted from the terminal is analyzed to determine the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.), which is reflected in the generation of a travel plan.

[2141] Server-side processing

[2142] 1. Server:

[2143] The server receives the conditions and emotional information sent by the user, analyzes the data, and extracts key elements, such as "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[2144] 2. Collaboration with external sources:

[2145] Based on the extracted conditions and emotion information, the server sends requests to external transport information APIs, accommodation APIs, and activity information APIs to obtain related travel information. For example, a search for "hot springs in Tokyo" is performed using the TripAdvisor API, and transportation methods to Tokyo are obtained using the Google Maps API. Furthermore, a hotel search API is used to obtain information on hotels with three or more stars in Tokyo.

[2146] 3. Generating optimal travel plans using AI models:

[2147] The server uses the acquired travel information and the user's emotional information to generate multiple travel plans using a generative AI model. It evaluates the elements of each plan (cost, travel time, convenience, etc.) and constructs the optimal plan that matches the user's emotional state. For example, it generates Plan A and Plan B as follows:

[2148] Plan A: If you are currently feeling excited, this plan includes a lot of active activities. It includes a Shinkansen (round trip: 20,000 yen), a 3-star hotel A (2 nights: 40,000 yen), a hot spring tour (10,000 yen), and a sightseeing tour (15,000 yen), for a total of 85,000 yen.

[2149] Plan B: If you are currently feeling emotionally exhausted, this plan includes a lot of relaxing activities. It includes a flight (30,000 yen round trip), a 3-star hotel B (50,000 yen for 2 nights), and a hot spring tour (10,000 yen), for a total of 90,000 yen.

[2150] 4. Server Presentation:

[2151] The server transmits the generated itineraries to the user terminal, which displays them to the user and allows the user to select one.

[2152] Processing reservations

[2153] 1. User:

[2154] The user selects the desired plan from the presented plans and submits a reservation request. For example, the user selects "Plan A."

[2155] 2. Terminal:

[2156] The user's selection information is sent to the server.

[2157] 3. Server:

[2158] The server checks the details of the selected plan and sends a request to the accommodation booking API or transportation booking API to complete the reservation. If the external API successfully completes the reservation procedure, reservation confirmation information is sent back to the server.

[2159] 4. Provide Verification Information:

[2160] The server sends the reservation confirmation information received from the external API to the user's terminal. The terminal displays the confirmation information to the user, displaying a message such as "Your Shinkansen and hotel reservations have been completed. Your reservation number is XXX."

[2161] Examples and prompts

[2162] Specific examples

[2163] If a user inputs "I want to go to Kyoto. My budget is 50,000 yen. I want to visit temples. I want to stay in a two-star or higher accommodation," the system will generate a plan like this:

[2164] Plan A: If you are currently feeling excited, this plan includes active activities. It includes a Shinkansen (round trip 10,000 yen), a two-star accommodation A (20,000 yen for two nights), and a temple tour (5,000 yen), for a total of 35,000 yen.

[2165] Plan B: If you are currently feeling emotionally exhausted, this plan includes relaxing activities. It includes bus travel (5,000 yen round trip), two-star accommodation B (15,000 yen for two nights), and a relaxing temple tour (5,000 yen), for a total of 25,000 yen.

[2166] Prompt statement

[2167] Example of an input prompt for a generative AI model:

[2168] "The user wants to travel to Kyoto, with a budget of 50,000 yen or less, and wants to visit temples. He also wants accommodations that are at least two stars. Based on these conditions and the user's current emotional state, generate the optimal travel plan."

[2169] With the above configuration, the user can quickly obtain the most suitable travel plan and can easily make suggestions and reservations that take into account the user's own emotional state.

[2170] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2171] Step 1:

[2172] User input of desired travel conditions

[2173] The user enters their desired travel conditions (e.g., "I want to go to Tokyo. My budget is within 100,000 yen. I want to bathe in hot springs. I want to stay in a three-star or higher hotel.") into an input form on the device. This input data includes travel destination, budget, desired activities, and accommodation conditions. The device receives the input from the user and temporarily stores it.

[2174] Input: Travel requirements (destination, budget, activities, accommodation requirements)

[2175] Output: Temporarily saved travel preferences

[2176] Step 2:

[2177] Terminal receives data and prepares it for transmission

[2178] The device temporarily stores the desired conditions entered by the user, converts the data into an appropriate format (for example, JSON format), and sends the converted data to the server.

[2179] Input: Temporarily saved travel preferences

[2180] Output: The transformed data to send to the server.

[2181] Step 3:

[2182] Collecting emotional information from devices

[2183] While the user is entering travel information, the device's built-in camera and microphone are used to collect emotional information from the user's facial expressions and voice in real time, which is then analyzed later.

[2184] Input: User's facial and voice data

[2185] Output: Collected emotion information

[2186] Step 4:

[2187] Emotion recognition by emotion engine

[2188] The device sends the collected emotional information to the emotion engine, which analyzes it and determines the user's current emotional state (e.g., joy, excitement, anxiety, fatigue, etc.).

[2189] Input: Collected emotion information

[2190] Output: Parsed emotional state

[2191] Step 5:

[2192] Data reception and analysis by the server

[2193] The server receives the user's desired conditions and emotional information sent from the device. It analyzes the received data and extracts key elements necessary for generating a travel plan. Specifically, these elements include "Tokyo," "under 100,000 yen," "hot springs," "hotels of three stars or more," and "current emotional state: excitement."

[2194] Input: User's desired conditions, analyzed emotional state

[2195] Output: Extracted elements

[2196] Step 6:

[2197] Server-based linkage with exte...

Claims

1. A means for a user to input desired travel conditions; means for transmitting the input conditions to a server; means for the server to obtain travel information from relevant external sources based on said conditions; A means for an AI model to generate an optimal travel plan using the acquired information; means for presenting the generated plurality of travel plans to a user; A means for completing a reservation procedure based on a travel plan selected by the user; The system includes means for transmitting reservation confirmation information to the user.

2. The system of claim 1 , wherein the acquired travel information is information related to transportation, accommodations, and activities.

3. The system of claim 1 , wherein the AI ​​model generates a travel plan by evaluating cost, travel time, and convenience.

Images